-- Logs begin at Fri 2022-10-28 08:59:39 UTC, end at Fri 2022-10-28 11:42:21 UTC. -- Oct 28 09:39:34.567446 n-d-zed-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 09:39:34.576255 n-d-zed-1 devstack@n-api.service[112903]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 09:39:34 2022] *** Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: nodename: n-d-zed-1 Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: machine: x86_64 Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: clock source: unix Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: pcre jit disabled Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: detected number of CPU cores: 4 Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: current working directory: / Oct 28 09:39:34.578262 n-d-zed-1 devstack@n-api.service[112903]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:39:34.578979 n-d-zed-1 devstack@n-api.service[112903]: your processes number limit is 47680 Oct 28 09:39:34.578979 n-d-zed-1 devstack@n-api.service[112903]: your memory page size is 4096 bytes Oct 28 09:39:34.578979 n-d-zed-1 devstack@n-api.service[112903]: detected max file descriptor number: 2048 Oct 28 09:39:34.578979 n-d-zed-1 devstack@n-api.service[112903]: lock engine: pthread robust mutexes Oct 28 09:39:34.578979 n-d-zed-1 devstack@n-api.service[112903]: thunder lock: enabled Oct 28 09:39:34.578979 n-d-zed-1 devstack@n-api.service[112903]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 09:39:34.578979 n-d-zed-1 devstack@n-api.service[112903]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 09:39:34.617860 n-d-zed-1 devstack@n-api.service[112903]: Python main interpreter initialized at 0x55a4c73859c0 Oct 28 09:39:34.617860 n-d-zed-1 devstack@n-api.service[112903]: python threads support enabled Oct 28 09:39:34.617860 n-d-zed-1 devstack@n-api.service[112903]: your server socket listen backlog is limited to 100 connections Oct 28 09:39:34.617860 n-d-zed-1 devstack@n-api.service[112903]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:39:34.618836 n-d-zed-1 devstack@n-api.service[112903]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:39:34.618836 n-d-zed-1 devstack@n-api.service[112903]: *** Operational MODE: preforking *** Oct 28 09:39:34.619134 n-d-zed-1 devstack@n-api.service[112903]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:39:34.619134 n-d-zed-1 devstack@n-api.service[112903]: spawned uWSGI master process (pid: 112903) Oct 28 09:39:34.619385 n-d-zed-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 09:39:34.619948 n-d-zed-1 devstack@n-api.service[112903]: spawned uWSGI worker 1 (pid: 112904, cores: 1) Oct 28 09:39:34.620659 n-d-zed-1 devstack@n-api.service[112903]: spawned uWSGI worker 2 (pid: 112905, cores: 1) Oct 28 09:39:34.620659 n-d-zed-1 devstack@n-api.service[112903]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:39:35.284915 n-d-zed-1 devstack@n-api.service[112904]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:39:35.285537 n-d-zed-1 devstack@n-api.service[112905]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:39:36.377540 n-d-zed-1 devstack@n-api.service[112904]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:36.377540 n-d-zed-1 devstack@n-api.service[112904]: from cryptography.utils import int_from_bytes Oct 28 09:39:36.378141 n-d-zed-1 devstack@n-api.service[112904]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:36.378141 n-d-zed-1 devstack@n-api.service[112904]: from cryptography.utils import int_from_bytes Oct 28 09:39:36.379786 n-d-zed-1 devstack@n-api.service[112905]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:36.379786 n-d-zed-1 devstack@n-api.service[112905]: from cryptography.utils import int_from_bytes Oct 28 09:39:36.380206 n-d-zed-1 devstack@n-api.service[112905]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:39:36.380206 n-d-zed-1 devstack@n-api.service[112905]: from cryptography.utils import int_from_bytes Oct 28 09:39:38.862739 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:39:38.863400 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:39:38.863788 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:39:38.863884 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:39:38.863973 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:39:38.864061 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:39:38.864148 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:39:38.864244 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:39:38.864339 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:39:38.864426 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:39:38.864515 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.864608 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.864698 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.864790 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.864999 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.865095 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.865314 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.865411 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.865637 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.865734 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.865941 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.866042 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.866254 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.866357 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.866564 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.866660 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.866885 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.866975 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.867138 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.867239 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.867444 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.867538 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.867775 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-zed-1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.867876 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-zed-1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.868083 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.868186 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.868389 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.868558 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.868718 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.868820 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.869053 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.869155 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.869355 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.869468 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.869671 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.869787 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.869969 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.870062 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.870462 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.870573 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.870891 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.871189 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.871360 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.871512 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.871661 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.871804 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.871933 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.872105 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.872253 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.872389 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.872522 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.872706 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.872849 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.873033 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.873172 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.873337 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.873474 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.873647 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.873792 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.873947 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.874084 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-zed-1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.874336 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-zed-1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.874476 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.874645 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.874774 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.874951 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.875093 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.875259 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.875398 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.875656 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.875800 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.875961 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.876084 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.876264 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.876403 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.876577 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.876721 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.876881 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.877039 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.877227 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.877359 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.877543 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.877680 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.877855 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.877994 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.878168 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.878312 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.878453 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.878671 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.878802 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.878936 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.879064 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.879187 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.879347 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.879485 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.879652 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.879789 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.879948 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.880090 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.880219 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.880351 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.880486 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.880630 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.880758 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.880894 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.881091 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.881245 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.881440 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.881570 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.881709 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.881926 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882059 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882188 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882188 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882437 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882582 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882719 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882854 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.882990 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.883118 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.883260 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.883398 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.883535 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.883673 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.883814 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.883949 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.884093 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.884710 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.884851 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.885011 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.885140 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.885314 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.885460 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.885617 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.885756 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.885930 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.886068 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.886237 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.886378 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.886552 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.886683 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.886851 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.886984 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.887162 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.887305 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.887513 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.887643 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.887776 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.887909 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.888072 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.888204 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.888403 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.888544 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.888720 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.888850 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.889048 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.889142 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.889359 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.889454 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.889666 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.889760 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.889965 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.890052 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.890262 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.890348 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.890560 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.890658 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.890871 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.890965 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.891180 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.891266 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.891430 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.891522 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.891709 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.891811 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.892003 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.892096 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.892299 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.892401 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.892611 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.892715 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.892946 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.893032 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.893228 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.893341 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.893522 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.893614 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.893813 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.893948 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.894112 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.894207 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.894410 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.894507 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.894708 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.894801 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895006 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895102 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895304 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895391 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895604 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895700 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895888 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.895982 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.896191 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.896296 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.896487 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.896573 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.896780 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.896867 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.897118 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.897205 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.897423 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.897528 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.897717 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.897805 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.898014 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.898120 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.898312 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.898407 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.898611 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.898705 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.898919 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.899010 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.899216 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.899302 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.899513 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.899600 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.899876 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.900506 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.900679 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.900771 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901001 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901106 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901309 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901403 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901607 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901692 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901905 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.901999 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.902205 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.902297 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.902495 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.902592 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.902793 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.902884 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.903100 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.903197 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.903400 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.903502 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.903698 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.903799 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.903986 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.904079 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.904282 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.904378 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.904577 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.904664 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.904874 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.904975 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.905194 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.905305 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.905489 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.905575 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.905778 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.905866 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.906086 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.906195 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.906401 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.906507 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.906700 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.906796 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.906999 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.907086 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.907292 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.907384 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.907609 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:39:38.907737 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.907931 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.908033 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.908256 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.908342 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.908580 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.908671 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.908888 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.909068 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.909230 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.909327 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.909551 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.909647 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.909860 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.909952 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.910161 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.910247 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.910467 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.910563 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.910777 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.910862 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.911082 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.911196 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.911385 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.911499 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.911685 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.911821 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.911996 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.912093 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.912305 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.912400 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.912620 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.912706 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.912959 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.913062 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.913258 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.913359 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.913567 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.913659 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.913869 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.913961 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.914180 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.914279 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.914500 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.914596 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.914807 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.914892 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.915108 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.915195 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.915466 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.915559 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.915805 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.915890 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.916113 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.916199 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.916436 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.916539 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.916744 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.916850 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.917076 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.917184 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.917380 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.917473 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.917683 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.917785 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.918017 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.918117 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.918322 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.918422 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.918629 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.918732 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.918938 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.919173 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.919260 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.919330 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.919543 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.919652 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.919849 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.919943 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.920150 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.920244 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.920455 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.920559 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.920759 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.920853 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.921088 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.921193 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.921416 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.921524 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.921723 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.921968 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.922057 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.922126 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.922336 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.922431 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.922647 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.922785 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923163 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923250 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923250 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923410 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923540 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923631 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923841 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.923938 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.924140 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.924307 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.924452 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.924596 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.924738 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.924888 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.925075 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.925220 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.925361 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.925513 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.925655 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.925797 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.925947 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.926090 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.926231 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.926372 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.926513 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.926665 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.926821 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.926965 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.927106 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.927266 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.927416 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.927567 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.927717 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.927860 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.928001 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.928150 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.928292 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.928445 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.928587 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.928728 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.928870 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.929047 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.929295 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.929458 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.929602 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.929743 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.929893 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.930042 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.930204 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.930348 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.930489 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.930630 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.930771 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.930926 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.931149 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.931304 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.931446 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.931595 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.931745 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.931918 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.932145 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.932294 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.932437 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.932578 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.932720 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.932871 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.933061 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.933215 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.933367 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.933510 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.933659 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.933817 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.933972 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.934116 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.934266 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.934416 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.934565 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.934718 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.934860 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.935001 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.935157 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.935306 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.935449 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.935599 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.935742 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.935883 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.936024 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.936166 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.936307 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.936463 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.936620 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.936771 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.936934 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.937106 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.937260 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.937402 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.937543 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.937684 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.937825 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.937966 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.938117 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.938261 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.938414 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.938564 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.938706 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.938854 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.939016 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.939159 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.939319 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.939535 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.939682 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.939824 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.939979 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.940130 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.940279 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.940429 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.940576 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.940576 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.940873 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.941106 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.941257 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.941406 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.941555 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.941712 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.941860 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.942016 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.942251 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.942407 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.942558 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.942716 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.942866 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.943026 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.943174 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.943322 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.943478 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.943637 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.943786 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.943946 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.944102 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.944251 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.944413 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.944564 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.944712 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.944861 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.945042 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.945202 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.945360 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.945509 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.945657 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.945806 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.945953 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.946101 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.946257 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.946413 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.946562 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.947212 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.947361 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.947577 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.947744 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.947894 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.948042 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.948190 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.948339 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.948495 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.948651 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.948801 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.948973 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.949130 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.949279 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.949446 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.949692 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.949849 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.949998 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.950147 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.950304 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.950467 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.950623 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.950772 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.950921 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.951069 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.951217 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.951378 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.951528 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.951687 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.951835 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.951985 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.952133 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.952382 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.952539 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.952695 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.952844 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.953038 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.953201 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.953363 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.953519 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.953668 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.953842 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954005 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954163 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954313 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954486 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954587 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954673 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954768 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954864 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.954948 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955031 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955112 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955193 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955273 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955364 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955447 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955528 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955608 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955689 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955779 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955862 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.955947 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956036 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956119 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956207 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956299 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956467 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956561 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956766 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.956856 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.957090 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.957204 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.957389 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.957489 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.957690 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.957780 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.958000 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.958101 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.958308 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.958405 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.958617 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.958707 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.958936 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.959026 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.959235 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.959326 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.959535 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.959625 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.959840 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.959938 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.960141 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.960229 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.960443 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.960540 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.960745 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.960843 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.961067 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.961158 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.961371 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.961459 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.961694 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.961784 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.961993 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.962083 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.962360 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.963028 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.963148 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.963231 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.963460 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.963629 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.963768 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.963872 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.964070 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.964159 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.964373 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.964511 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.964682 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.964785 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.965013 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.965110 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.965317 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.965408 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.965621 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.965724 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.965924 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.966128 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.966220 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.966302 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.966518 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.966619 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.966824 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.966912 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.967126 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.967215 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.967431 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.967522 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.967736 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.967822 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.968034 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.968124 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.968334 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.968435 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.968642 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.968739 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.968977 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.969254 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.969555 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.969646 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.969884 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.969986 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.970197 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.970294 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.970518 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.970615 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.970837 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.970935 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.971162 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.971265 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.971487 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.971577 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.971799 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.971904 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.972100 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.972199 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.972402 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.972490 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.972699 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.972789 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.973021 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.973167 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.973324 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.973422 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.973622 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.973714 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.973923 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.974014 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.974225 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.974327 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.974543 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.974633 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.974822 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.974920 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.975120 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.975220 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.975419 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.975508 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.975717 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.975806 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.976020 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.976118 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.976316 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.976404 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.976621 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.976721 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.976939 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.977049 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.977251 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.977349 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.977550 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.977638 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.977887 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.977985 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.978172 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.978263 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.978471 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.978572 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.978772 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.978862 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.979103 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.979192 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.979413 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.979508 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.979746 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.979835 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.980072 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.980170 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.980371 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.980476 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.980670 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.980760 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981010 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981103 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981313 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981416 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981611 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981701 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981908 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.981998 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.982208 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.982305 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.982509 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.982604 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.982805 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.982895 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.983103 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.983314 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.983408 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.983490 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.983692 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.983782 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.983993 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.984091 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.984289 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.984392 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.984588 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.984676 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.984882 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.985022 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.985205 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.985295 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.985506 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.985595 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.985801 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.985892 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.986095 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.986185 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.986394 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.986490 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.986693 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.986782 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.987241 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.987335 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.987540 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.987636 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.987834 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.987921 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.988140 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.988228 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.988434 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.988535 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.988730 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.988820 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.989052 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.989142 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.989354 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.989461 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.989657 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.989746 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.989952 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.990041 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.990251 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.990352 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.990558 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.990654 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.990855 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.990944 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.991152 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.991251 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.991450 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.991546 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.991746 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.991835 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.992044 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.992134 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.992343 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.992445 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.992651 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.992740 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.992977 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.993070 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.993277 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.993368 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.993605 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.993708 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.993905 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.994003 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.994204 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.994294 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.994502 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.994600 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.994803 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.994899 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.995095 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.995184 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.995391 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.995490 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.995686 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.995776 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.995982 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.996078 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.996279 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.996376 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.996593 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.996690 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.996894 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.997002 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.997212 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.997315 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.997512 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.997602 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.997809 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.997905 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.998144 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.998235 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.998440 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.998530 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.998788 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.998878 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.999090 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.999181 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.999397 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.999485 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.999708 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:38.999805 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.000012 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.000103 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.000317 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.000407 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.000626 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.000715 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.000941 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.001035 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.001256 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.001347 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.001560 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.001650 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.001864 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.001962 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.002160 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.002250 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.002456 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.002554 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.002755 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.002844 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.003059 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.003147 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.003362 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.003510 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.003671 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.003771 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.003983 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.004073 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.004298 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.004398 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.004595 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.004685 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.004897 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.005053 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.005222 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.005325 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.005524 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.005614 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.005825 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.005914 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.006128 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.006256 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.006432 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.006530 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.006738 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.006827 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.007039 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.007135 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.007343 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.007433 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.007646 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.007736 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.007954 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.008081 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.008264 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.008402 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.008572 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.008734 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.008879 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.009656 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.009754 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.010029 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.010131 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.010336 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.010425 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.010636 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.010724 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.010941 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.011029 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.011240 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.011328 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.011545 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.011633 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.011842 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.011930 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.012275 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.012367 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.012583 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.012678 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.012895 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.013004 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.013224 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.013316 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.013533 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.013622 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.013843 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.013981 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.014158 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.014256 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.014471 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.014569 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.014773 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.014869 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.015185 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.015274 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.015495 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.015585 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.015804 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.015902 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.016113 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.016201 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.016412 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.016510 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.016711 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.016807 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.017040 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.017147 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.017362 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.017450 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.017660 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.017756 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.017975 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.018084 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.018254 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.018350 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.018571 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.018662 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.018868 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.018958 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.019182 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.019272 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.019593 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.019686 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.019901 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.019989 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.020201 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.020288 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.020607 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.020696 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.020925 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.021029 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.021237 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.021358 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.021557 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.021648 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.021873 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.021972 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.022193 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.022282 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.022489 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.022660 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.022797 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.022894 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.023099 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.023190 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.023415 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.023514 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.023732 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.023827 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.024038 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.024133 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.024346 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.024449 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.024647 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.024735 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.025542 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.025645 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.025864 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.025971 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.026173 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.026263 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.026492 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.026589 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.026899 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.026990 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.027217 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.027306 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.027522 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.027612 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.027837 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.027928 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.028157 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.028260 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.028457 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.028546 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.028755 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.028844 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.029084 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.029185 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.029391 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.029481 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.029691 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.029788 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.030011 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.030108 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.030310 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.030414 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.030616 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.030706 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.030920 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.031017 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.031221 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.031320 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.031519 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.031609 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.031817 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.031906 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.032132 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.032230 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.032429 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.032521 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.032745 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.032835 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.033076 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.033180 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.033393 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.033481 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.033709 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.033798 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.034010 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.034100 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.034326 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.034416 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.034630 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.034726 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.034930 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.035019 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.035230 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.035319 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.035531 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.035618 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.035865 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.035966 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.036164 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.036254 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.036476 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.036565 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.036807 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.036945 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.037156 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.037254 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.037459 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.037570 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.037790 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.037885 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.038109 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.038202 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.038427 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.038530 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.038730 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.038831 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.039043 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.039144 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.039365 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.039474 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.039670 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.039778 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.040009 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.040113 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.040268 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.040396 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.041146 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.041288 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.041419 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.041508 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.041723 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.041813 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.042025 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.042127 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.042325 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.042415 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.042623 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.042712 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.042921 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.043011 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.043239 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.043329 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.043538 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.043636 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.043854 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.043944 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.044159 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.044291 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.044458 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.044555 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.044759 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.044850 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.045087 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.045194 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.045429 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.045520 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.045726 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.045814 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.046051 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.046148 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.046354 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.046450 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.046671 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.046808 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.046985 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.047085 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.047299 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.047388 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.047608 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.047697 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.047918 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.048020 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.048232 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.048378 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.048542 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.048621 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.048853 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.048993 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.049183 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.049271 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.049500 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.049596 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.049808 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.049897 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.050119 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.050217 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.050675 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.050765 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.051002 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.051132 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.051315 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.051403 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.051622 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.051717 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.051931 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.052020 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.052239 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.052328 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.052550 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.052720 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.052856 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.052964 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.053262 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.053351 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.053569 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.053670 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.053875 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.053964 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.054196 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.054322 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.054513 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.054620 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.054834 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.054923 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.055163 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.055251 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.055477 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.055568 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.055788 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.055869 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.056152 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.056237 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.056466 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.056557 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.056817 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.056935 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.057154 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.057257 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.057456 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.057545 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.057768 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.057864 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.058077 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.058175 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.058386 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.058523 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.058693 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.058784 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.059001 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.059093 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.059310 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.059400 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.059624 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.059712 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.059932 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.060022 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.060237 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.060327 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.060548 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.060637 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.060859 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.060987 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.061207 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.061299 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.061535 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.061633 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.061850 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.061941 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.062160 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.062252 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.062472 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.062570 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.062783 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.062873 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.063300 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.063391 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.063611 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.063714 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.063938 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.064034 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.064257 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.064352 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.064574 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.064677 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.064886 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.065029 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.065221 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.065312 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.065540 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.065631 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.065840 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.065931 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.066141 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.066231 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.066443 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.066540 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.066745 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.066844 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.067043 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.067135 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.067357 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.067448 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.067660 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.067751 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.067961 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.068056 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.068276 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.068368 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.068578 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.068684 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.069201 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.069322 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.069483 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.069576 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.069808 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.069948 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.070112 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.070212 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.070432 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.070524 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.070745 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.070835 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.071047 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.071150 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.071366 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.071457 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.072192 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.072292 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.072494 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.072585 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.072806 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.072895 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.073135 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.073227 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.073435 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.073536 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.073736 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.073826 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.074041 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.074131 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.074344 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.074435 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.074643 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.074732 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.074946 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.075043 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.075244 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.075324 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.075565 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.075656 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.075866 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.075964 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.076168 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.076263 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.076465 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.076560 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.076771 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.076882 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.077098 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.077190 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.077396 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.077484 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.077699 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.077803 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.077996 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.078085 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.078301 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.078400 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.078600 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.078744 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.078904 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.078994 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.079205 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.079293 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.079514 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.079612 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.079865 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.079963 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.080170 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.080261 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.080469 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.080559 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.080788 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.080885 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.081112 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.081201 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.081412 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.081504 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.081734 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.081833 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.082029 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.082126 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.082346 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.082438 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.082652 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.082743 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.082958 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.083048 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.083298 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.083389 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.083611 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.083700 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.084145 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.084243 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.084490 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.084587 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.084789 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.084889 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.085140 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.085246 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.085466 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.085556 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.085767 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.085868 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.086069 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.086169 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.086370 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.086458 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.086686 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.086775 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.086992 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.087085 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.087324 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.087423 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.087656 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.087746 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.087961 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.088052 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.088264 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.088354 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.088568 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.088658 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.088871 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.088997 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.089198 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.089289 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.089505 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.089612 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.089807 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.089898 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.090111 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.090200 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.090413 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.090512 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.090717 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.090816 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.091019 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.091109 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.091328 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.091426 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.091661 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.091758 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.091977 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.092066 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.092286 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.092376 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.092597 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.092685 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.092924 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.093028 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.093234 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.093326 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.093537 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.093628 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.093839 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.093929 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.094141 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.094232 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.094451 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.094541 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.094772 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.094926 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.095078 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.095169 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.095374 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.095464 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.096078 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.096181 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.096389 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.096479 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.096704 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.096794 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.097044 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.097151 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.097364 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.097457 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.097691 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.097897 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.098015 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.098330 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.098486 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.098652 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.098797 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.098965 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.099123 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.099292 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.099431 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.099630 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.099761 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.099963 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.100096 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.100288 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.100417 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.100593 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.100736 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.100899 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.101068 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.101226 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.101353 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.101535 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.101653 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.101853 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.101945 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.102165 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.102264 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.102469 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.102559 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.102771 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.103388 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.103606 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.103704 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.103912 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.104002 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.104217 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.104308 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.104517 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.104605 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.104818 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.104929 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.105145 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.105238 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.105446 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.105536 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.105741 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.105839 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.106042 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.106130 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.106337 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.106426 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.106634 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.106733 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.106933 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.107022 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.107231 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.107332 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.107532 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.107629 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.107829 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.107967 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.108130 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.108243 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.108434 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.108537 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.108734 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.108831 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.109090 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.109183 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.109426 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.109518 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.109747 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.109837 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.110070 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.110169 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.110381 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.110472 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.110685 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.110773 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.110996 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.111084 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.111300 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.111389 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.111615 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.111705 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.112181 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.112275 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.112491 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.112587 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.112844 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.112959 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.113142 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.113234 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.113446 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.113525 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.113754 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.113834 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.114142 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.114247 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.114367 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.114455 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.114669 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.114747 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.114974 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.115075 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.115295 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.115389 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.115597 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.115696 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.115899 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.115989 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.116217 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.116307 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.116533 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.116684 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.116846 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.116956 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.117178 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.117268 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.117483 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.117586 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.117797 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.117888 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.118099 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.118188 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.118403 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.118527 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.118765 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.118856 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.119072 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.119161 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.119377 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.119475 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.119688 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.119777 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.119993 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.120081 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.120298 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.120402 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.120610 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.120699 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.120957 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.121051 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.121262 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.121353 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.121577 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.121673 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.121884 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.121973 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.122203 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.122294 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.122523 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.122612 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.122847 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.122936 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.123158 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.123248 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.123495 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.123586 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.123807 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.123895 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.124113 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.124203 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.124416 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.124504 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.124660 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:39:39.124764 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:39:39.124956 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112905) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:39:39.277956 n-d-zed-1 devstack@n-api.service[112904]: INFO dbcounter [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Registered counter for database nova_api Oct 28 09:39:39.279738 n-d-zed-1 devstack@n-api.service[112905]: INFO dbcounter [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Registered counter for database nova_api Oct 28 09:39:39.299649 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.301406 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.307053 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.308510 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.364760 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.context [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=112904) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:39:39.366178 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.context [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=112905) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:39:39.368879 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:39:39.369377 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:39:39.370092 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:39:39.370566 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:39:39.370962 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:39:39.371694 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:39:39.372134 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:39:39.372236 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:39:39.372867 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:39:39.373338 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:39:39.374273 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_concurrency.lockutils [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:39:39.375322 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:39:39.376274 n-d-zed-1 devstack@n-api.service[112904]: INFO dbcounter [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Registered counter for database nova_cell0 Oct 28 09:39:39.377361 n-d-zed-1 devstack@n-api.service[112905]: INFO dbcounter [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Registered counter for database nova_cell0 Oct 28 09:39:39.380453 n-d-zed-1 devstack@n-api.service[112904]: INFO dbcounter [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Registered counter for database nova_cell1 Oct 28 09:39:39.381401 n-d-zed-1 devstack@n-api.service[112905]: INFO dbcounter [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Registered counter for database nova_cell1 Oct 28 09:39:39.387772 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.389245 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.392415 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.394208 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.395301 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.396766 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.533407 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.537048 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.542229 n-d-zed-1 devstack@n-api.service[112904]: INFO dbcounter [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Registered counter for database nova_cell0 Oct 28 09:39:39.545902 n-d-zed-1 devstack@n-api.service[112905]: INFO dbcounter [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Registered counter for database nova_cell0 Oct 28 09:39:39.549145 n-d-zed-1 devstack@n-api.service[112904]: DEBUG oslo_db.sqlalchemy.engines [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.553815 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writer thread running {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.554504 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_db.sqlalchemy.engines [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112905) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:39:39.559780 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writer thread running {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:39:39.892406 n-d-zed-1 devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:39.895442 n-d-zed-1 devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:39.899720 n-d-zed-1 devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:39.902883 n-d-zed-1 devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:40.242861 n-d-zed-1 devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:40.249347 n-d-zed-1 devstack@n-api.service[112905]: WARNING keystonemiddleware.auth_token [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:40.252877 n-d-zed-1 devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:39:40.254544 n-d-zed-1 devstack@n-api.service[112905]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4c73859c0 pid: 112905 (default app) Oct 28 09:39:40.256620 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:39:40.257827 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001759 Oct 28 09:39:40.258245 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Fri Oct 28 09:39:40 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:39:40.258884 n-d-zed-1 devstack@n-api.service[112904]: WARNING keystonemiddleware.auth_token [None req-47d17aa3-dbbc-4081-939c-c26753eaba52 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:39:40.264384 n-d-zed-1 devstack@n-api.service[112904]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a4c73859c0 pid: 112904 (default app) Oct 28 09:41:02.912763 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:02.914436 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002096 Oct 28 09:41:02.914998 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:02.927274 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:02.928777 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_cell1:SELECT=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:02.929816 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_cell0:SELECT=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:02.930726 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:03.896795 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-3f52317b-8abc-4cec-9439-212a1d2a670d admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:03.930616 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-3f52317b-8abc-4cec-9439-212a1d2a670d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.008416 Oct 28 09:41:03.932014 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 09:41:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:06.676841 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:06.677890 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-9173bbdc-8ec7-4696-bbb0-a27457b4dc45 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 28 09:41:06.678487 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:07.179725 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-7807639c-29a4-42bb-a8d6-8f21fe1de316 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "name": "cirros256"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:07.231609 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-7807639c-29a4-42bb-a8d6-8f21fe1de316 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.546514 Oct 28 09:41:07.232340 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:07.457017 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-88260243-5866-4f2a-b8f6-c585ce1c1551 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:07.464106 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=3 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:07.465148 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell0:SELECT=3 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:07.465869 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell1:SELECT=3 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:07.466577 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:07.532148 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-88260243-5866-4f2a-b8f6-c585ce1c1551 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287881 Oct 28 09:41:07.532740 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 09:41:07 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:10.200808 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-7807639c-29a4-42bb-a8d6-8f21fe1de316 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:10.202572 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-7807639c-29a4-42bb-a8d6-8f21fe1de316 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002201 Oct 28 09:41:10.203241 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:41:11.027324 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-794d60b5-ab82-4128-b318-bd76f0fdfd0a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:11.093699 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-794d60b5-ab82-4128-b318-bd76f0fdfd0a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.883103 Oct 28 09:41:11.094574 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:11.107791 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-8da5d840-7321-4c7e-a8b3-b31e4038da76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:11.167747 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-8da5d840-7321-4c7e-a8b3-b31e4038da76 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.063765 Oct 28 09:41:11.168363 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 09:41:11 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:41:14.077621 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-794d60b5-ab82-4128-b318-bd76f0fdfd0a admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:14.077621 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-794d60b5-ab82-4128-b318-bd76f0fdfd0a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Oct 28 09:41:14.077621 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:14.772703 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e5d70cca-a751-469c-9c08-58d5657c39de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "ram": 1024}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:14.805016 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e5d70cca-a751-469c-9c08-58d5657c39de admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.717245 Oct 28 09:41:14.805595 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:14.822836 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-c25ad141-dd59-4f43-9a02-10d51248e634 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:14.858428 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-c25ad141-dd59-4f43-9a02-10d51248e634 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044307 Oct 28 09:41:14.859815 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 09:41:14 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:17.694708 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e5d70cca-a751-469c-9c08-58d5657c39de admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:17.695992 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e5d70cca-a751-469c-9c08-58d5657c39de admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002681 Oct 28 09:41:17.696409 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:18.289554 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-52d1d6bb-c2b0-4442-834a-018cb386c888 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "ram": 2048, "disk": 10, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:18.314275 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-52d1d6bb-c2b0-4442-834a-018cb386c888 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.610990 Oct 28 09:41:18.315087 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:18.328198 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-99f06c0b-21e5-4768-86df-4f773e8d1a73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:18.370892 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-99f06c0b-21e5-4768-86df-4f773e8d1a73 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046250 Oct 28 09:41:18.372224 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 09:41:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:41:21.149986 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-52d1d6bb-c2b0-4442-834a-018cb386c888 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:21.151573 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-52d1d6bb-c2b0-4442-834a-018cb386c888 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Oct 28 09:41:21.158078 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:21 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:41:21.725364 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-b4d8d55c-419a-4ffc-a7fc-7e575c6837dc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:21.746714 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-b4d8d55c-419a-4ffc-a7fc-7e575c6837dc admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.587189 Oct 28 09:41:21.747612 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:21 2022] POST /compute/v2.1/flavors => generated 404 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:41:21.760426 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-fa06dad6-8381-429d-a98a-09d84360700b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:21.790725 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-fa06dad6-8381-429d-a98a-09d84360700b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033625 Oct 28 09:41:21.810535 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Fri Oct 28 09:41:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:24.610266 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-b4d8d55c-419a-4ffc-a7fc-7e575c6837dc admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:24.611308 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-b4d8d55c-419a-4ffc-a7fc-7e575c6837dc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 28 09:41:24.611899 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:25.069843 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-dff74509-33dc-46ed-8ade-96b345971573 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:25.095768 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-dff74509-33dc-46ed-8ade-96b345971573 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.477276 Oct 28 09:41:25.096339 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 09:41:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:41:27.869437 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-b4d8d55c-419a-4ffc-a7fc-7e575c6837dc admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:27.870509 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-b4d8d55c-419a-4ffc-a7fc-7e575c6837dc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 Oct 28 09:41:27.870923 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:28.375506 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-81d41ab2-3c46-4ff7-95d4-797c2932de70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "id": "1", "swap": 0, "name": "m1.tiny", "ram": 512}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:28.399776 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-81d41ab2-3c46-4ff7-95d4-797c2932de70 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.520437 Oct 28 09:41:28.405340 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:28.415637 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-5c3d9b85-b58a-4a1c-ac6f-e0454adfdb54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:28.444131 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-5c3d9b85-b58a-4a1c-ac6f-e0454adfdb54 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032233 Oct 28 09:41:28.444717 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 09:41:28 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:41:31.085948 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-81d41ab2-3c46-4ff7-95d4-797c2932de70 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:31.086751 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-81d41ab2-3c46-4ff7-95d4-797c2932de70 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Oct 28 09:41:31.087177 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:31.512230 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-cedc6a37-61ef-4802-a78f-99a473092baa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "name": "m1.small"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:31.531514 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-cedc6a37-61ef-4802-a78f-99a473092baa admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.437008 Oct 28 09:41:31.532074 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:31.544327 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-d151a424-acb0-45a2-baa4-5be4d3906e07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:31.569653 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-d151a424-acb0-45a2-baa4-5be4d3906e07 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029154 Oct 28 09:41:31.570238 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 09:41:31 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:34.199348 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-cedc6a37-61ef-4802-a78f-99a473092baa admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:34.200732 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-cedc6a37-61ef-4802-a78f-99a473092baa admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001805 Oct 28 09:41:34.201520 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:34.649820 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-f5ea44a1-16af-480d-8922-78004ea84f7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "id": "3", "vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:34.687010 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-f5ea44a1-16af-480d-8922-78004ea84f7a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.477265 Oct 28 09:41:34.687580 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:34 2022] POST /compute/v2.1/flavors => generated 406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:34.700367 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-cffa0e2c-f473-42fc-877e-88e68c491c15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:34.705282 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:34.736043 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-cffa0e2c-f473-42fc-877e-88e68c491c15 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039979 Oct 28 09:41:34.736659 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 09:41:34 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:37.408005 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-f5ea44a1-16af-480d-8922-78004ea84f7a admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:37.408005 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-f5ea44a1-16af-480d-8922-78004ea84f7a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002654 Oct 28 09:41:37.408005 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:37.845738 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-4957951a-a745-4de2-bc15-8bf7df8b3697 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "name": "m1.large", "disk": 80}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:37.869925 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-4957951a-a745-4de2-bc15-8bf7df8b3697 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.456344 Oct 28 09:41:37.870884 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:37.883816 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-24916c55-b10c-4a21-8707-0e1dd4acea50 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:37.888961 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:41:37.916452 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-24916c55-b10c-4a21-8707-0e1dd4acea50 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037189 Oct 28 09:41:37.917956 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 09:41:37 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:41:40.538060 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-4957951a-a745-4de2-bc15-8bf7df8b3697 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:41:40.539073 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-4957951a-a745-4de2-bc15-8bf7df8b3697 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002176 Oct 28 09:41:40.539461 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:41:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:41:40.998865 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e9895e16-9fc0-451c-95d0-cd72428cf04d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "id": "5", "swap": 0, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:41.026054 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e9895e16-9fc0-451c-95d0-cd72428cf04d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.480367 Oct 28 09:41:41.026841 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Fri Oct 28 09:41:40 2022] POST /compute/v2.1/flavors => generated 408 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:41:41.039574 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-74dc1a0a-76f0-4bcd-8af7-542066054404 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:41:41.065168 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-74dc1a0a-76f0-4bcd-8af7-542066054404 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030044 Oct 28 09:41:41.066072 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Fri Oct 28 09:41:41 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:42:01.477125 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e9895e16-9fc0-451c-95d0-cd72428cf04d admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:01.478134 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e9895e16-9fc0-451c-95d0-cd72428cf04d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 28 09:42:01.478541 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:01.489439 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:01.877966 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-bb496f7a-4086-4a39-bca2-ce894a71d66a admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:01.895778 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-bb496f7a-4086-4a39-bca2-ce894a71d66a admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.410779 Oct 28 09:42:01.896311 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 09:42:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:03.217056 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e9895e16-9fc0-451c-95d0-cd72428cf04d admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:03.218058 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e9895e16-9fc0-451c-95d0-cd72428cf04d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Oct 28 09:42:03.218509 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:03.756875 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e9cf78e5-2b8d-410a-84d5-0c6643de2fab admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:03.762694 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.wsgi [None req-e9cf78e5-2b8d-410a-84d5-0c6643de2fab admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e9cf78e5-2b8d-410a-84d5-0c6643de2fab admin admin] Request method failure captured: Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: Accept: application/json Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: Accept-Encoding: gzip, deflate Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: Connection: keep-alive Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: Content-Length: 0 Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: Host: 10.222.0.16 Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: Openstack-Api-Version: compute 2.92 Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: Openstack-System-Scope: None Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: User-Agent: python-novaclient Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Auth-Token: gAAAAABjW6PrRZjI3dNfXozqOSPcnE-n70VnENNxbba85TZKynfBdieQorysJlLbhFHlbbhSa09xxO7TuOQJHUZf_mwlWb53bjGVwtTg8ts9bINtF9rN75d2C07hw9UCx4SaZ6WiI-LWGS0Fy3jzanioSlcNXK2O2O2x87atjvYsFlGjMmaUl3E Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Domain-Id: None Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Domain-Name: None Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Identity-Status: Confirmed Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Is-Admin-Project: True Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Domain-Id: default Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Domain-Name: Default Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Name: admin Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Role: admin,member,reader Oct 28 09:42:03.765958 n-d-zed-1 devstack@n-api.service[112904]: X-Roles: admin,member,reader Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04a62e1ae96e4c8e9b9228e06dc65dee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04a62e1ae96e4c8e9b9228e06dc65dee"}]}] Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant: admin Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant-Name: admin Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-User: admin Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-User-Domain-Id: default Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-User-Domain-Name: Default Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-User-Id: b2e4136eee3b43878593830db499a951 Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: X-User-Name: admin Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: method: > Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: exception: Flavor 42 could not be found. Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: action_args: {'id': '42'} Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:42:03.767526 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:03.768448 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.769646 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e9cf78e5-2b8d-410a-84d5-0c6643de2fab admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:42:03.770824 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e9cf78e5-2b8d-410a-84d5-0c6643de2fab admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.399877 Oct 28 09:42:03.770824 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 09:42:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:03.777801 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-8c38315b-ee8f-4870-8683-9071de5fe444 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:03.781936 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:42:03.801309 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-8c38315b-ee8f-4870-8683-9071de5fe444 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027614 Oct 28 09:42:03.801863 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 09:42:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:42:03.813356 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-213f0f2d-a7c9-490c-9ffb-ff6fc120e108 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:03.835393 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-213f0f2d-a7c9-490c-9ffb-ff6fc120e108 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026345 Oct 28 09:42:03.835938 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 09:42:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:03.845959 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-dcf13b7a-1c30-45c4-aef4-dc0d24651c26 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:03.851614 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.wsgi [None req-dcf13b7a-1c30-45c4-aef4-dc0d24651c26 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-dcf13b7a-1c30-45c4-aef4-dc0d24651c26 admin admin] Request method failure captured: Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: Accept: application/json Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: Accept-Encoding: gzip, deflate Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: Connection: keep-alive Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: Content-Length: 0 Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: Host: 10.222.0.16 Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: Openstack-Api-Version: compute 2.92 Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: Openstack-System-Scope: None Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: User-Agent: python-novaclient Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Auth-Token: gAAAAABjW6PrRZjI3dNfXozqOSPcnE-n70VnENNxbba85TZKynfBdieQorysJlLbhFHlbbhSa09xxO7TuOQJHUZf_mwlWb53bjGVwtTg8ts9bINtF9rN75d2C07hw9UCx4SaZ6WiI-LWGS0Fy3jzanioSlcNXK2O2O2x87atjvYsFlGjMmaUl3E Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Domain-Id: None Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Domain-Name: None Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Identity-Status: Confirmed Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Is-Admin-Project: True Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Domain-Id: default Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Domain-Name: Default Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Name: admin Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Role: admin,member,reader Oct 28 09:42:03.855397 n-d-zed-1 devstack@n-api.service[112905]: X-Roles: admin,member,reader Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04a62e1ae96e4c8e9b9228e06dc65dee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04a62e1ae96e4c8e9b9228e06dc65dee"}]}] Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant: admin Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant-Name: admin Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-User: admin Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-User-Domain-Id: default Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-User-Domain-Name: Default Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-User-Id: b2e4136eee3b43878593830db499a951 Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: X-User-Name: admin Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: method: > Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: exception: Flavor 42 could not be found. Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: action_args: {'id': '42'} Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:42:03.857009 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:03.858133 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:03.859597 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-dcf13b7a-1c30-45c4-aef4-dc0d24651c26 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:42:03.861081 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-dcf13b7a-1c30-45c4-aef4-dc0d24651c26 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014956 Oct 28 09:42:03.861081 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 09:42:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:05.086111 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-213f0f2d-a7c9-490c-9ffb-ff6fc120e108 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:05.087656 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-213f0f2d-a7c9-490c-9ffb-ff6fc120e108 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 28 09:42:05.088061 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:05.622231 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3fb2b201-0956-4b85-b7b9-9dda23819e0f admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:05.627379 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.wsgi [None req-3fb2b201-0956-4b85-b7b9-9dda23819e0f admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3fb2b201-0956-4b85-b7b9-9dda23819e0f admin admin] Request method failure captured: Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: Accept: application/json Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: Accept-Encoding: gzip, deflate Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: Connection: keep-alive Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: Content-Length: 0 Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: Host: 10.222.0.16 Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: Openstack-Api-Version: compute 2.92 Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: Openstack-System-Scope: None Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: User-Agent: python-novaclient Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Auth-Token: gAAAAABjW6PsPFa7fYnzG_XaC_YBXZmhcRbjSlgLC41RprLZ-cgxqx47-9wmuRt41smxIxEFXM_J05DyWM9doyUw7nk8AP0FTW50y2gwCU4VmrX2Xz9DfsG5VIJ-AM7tnHsYgBiaBow3cWAgtwOi6ifLaYEBkReC7hGCiNiqF1JJkHVXFKM_IME Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Domain-Id: None Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Domain-Name: None Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Identity-Status: Confirmed Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Is-Admin-Project: True Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Domain-Id: default Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Domain-Name: Default Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Name: admin Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Role: admin,member,reader Oct 28 09:42:05.628951 n-d-zed-1 devstack@n-api.service[112905]: X-Roles: admin,member,reader Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04a62e1ae96e4c8e9b9228e06dc65dee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04a62e1ae96e4c8e9b9228e06dc65dee"}]}] Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant: admin Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant-Name: admin Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-User: admin Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-User-Domain-Id: default Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-User-Domain-Name: Default Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-User-Id: b2e4136eee3b43878593830db499a951 Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: X-User-Name: admin Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: method: > Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: exception: Flavor 84 could not be found. Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: action_args: {'id': '84'} Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:42:05.630544 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:05.631616 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.633064 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3fb2b201-0956-4b85-b7b9-9dda23819e0f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:42:05.634909 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-3fb2b201-0956-4b85-b7b9-9dda23819e0f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.397892 Oct 28 09:42:05.634909 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 09:42:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:05.640703 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-19ee17dd-9965-4ab5-a586-c95b70b7eee2 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:05.655459 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-19ee17dd-9965-4ab5-a586-c95b70b7eee2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018315 Oct 28 09:42:05.655987 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 09:42:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:05.665530 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3b0a5c94-f762-437f-b423-de3f4adeaca3 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:05.683217 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-3b0a5c94-f762-437f-b423-de3f4adeaca3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021332 Oct 28 09:42:05.683760 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 09:42:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:05.693278 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-1d0b15cc-97ee-49ed-94b1-db186b88eac2 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:05.698816 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.wsgi [None req-1d0b15cc-97ee-49ed-94b1-db186b88eac2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-1d0b15cc-97ee-49ed-94b1-db186b88eac2 admin admin] Request method failure captured: Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: Accept: application/json Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: Accept-Encoding: gzip, deflate Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: Connection: keep-alive Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: Content-Length: 0 Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: Host: 10.222.0.16 Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: Openstack-Api-Version: compute 2.92 Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: Openstack-System-Scope: None Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: User-Agent: python-novaclient Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Auth-Token: gAAAAABjW6PsPFa7fYnzG_XaC_YBXZmhcRbjSlgLC41RprLZ-cgxqx47-9wmuRt41smxIxEFXM_J05DyWM9doyUw7nk8AP0FTW50y2gwCU4VmrX2Xz9DfsG5VIJ-AM7tnHsYgBiaBow3cWAgtwOi6ifLaYEBkReC7hGCiNiqF1JJkHVXFKM_IME Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Domain-Id: None Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Domain-Name: None Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Identity-Status: Confirmed Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Is-Admin-Project: True Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Domain-Id: default Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Domain-Name: Default Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Name: admin Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Role: admin,member,reader Oct 28 09:42:05.700368 n-d-zed-1 devstack@n-api.service[112904]: X-Roles: admin,member,reader Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04a62e1ae96e4c8e9b9228e06dc65dee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04a62e1ae96e4c8e9b9228e06dc65dee"}]}] Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant: admin Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant-Name: admin Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-User: admin Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-User-Domain-Id: default Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-User-Domain-Name: Default Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-User-Id: b2e4136eee3b43878593830db499a951 Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: X-User-Name: admin Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: method: > Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: exception: Flavor 84 could not be found. Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: action_args: {'id': '84'} Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:42:05.701948 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:05.703049 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:05.704397 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-1d0b15cc-97ee-49ed-94b1-db186b88eac2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:42:05.705664 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-1d0b15cc-97ee-49ed-94b1-db186b88eac2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012000 Oct 28 09:42:05.705664 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 09:42:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 28 09:42:06.920617 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3b0a5c94-f762-437f-b423-de3f4adeaca3 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:06.921664 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-3b0a5c94-f762-437f-b423-de3f4adeaca3 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 28 09:42:06.922060 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:07.443250 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-f133e4cb-3c42-411d-8667-4a3a3453211c admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:07.449769 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.wsgi [None req-f133e4cb-3c42-411d-8667-4a3a3453211c admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-f133e4cb-3c42-411d-8667-4a3a3453211c admin admin] Request method failure captured: Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: Accept: application/json Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: Accept-Encoding: gzip, deflate Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: Connection: keep-alive Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: Content-Length: 0 Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: Host: 10.222.0.16 Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: Openstack-Api-Version: compute 2.92 Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: Openstack-System-Scope: None Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: User-Agent: python-novaclient Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Auth-Token: gAAAAABjW6PuGdLHVtcIqfS6euGDwABltTsT6TjVRVK4W7CwoTcI4oRIjl45caV1Z9nwrA72s6lI1D3dL2nfK9A2z0vLMO-WoJFDYUG40zseEkseXdMLe_qcFVWZWgkm_uj_qQ-KJIXu2hKjCPkOO1bUsHrM2dR4fzSVMdrMD6I30EOqq7VIy04 Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Domain-Id: None Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Domain-Name: None Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Identity-Status: Confirmed Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Is-Admin-Project: True Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Domain-Id: default Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Domain-Name: Default Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Project-Name: admin Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Role: admin,member,reader Oct 28 09:42:07.451268 n-d-zed-1 devstack@n-api.service[112904]: X-Roles: admin,member,reader Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04a62e1ae96e4c8e9b9228e06dc65dee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04a62e1ae96e4c8e9b9228e06dc65dee"}]}] Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant: admin Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-Tenant-Name: admin Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-User: admin Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-User-Domain-Id: default Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-User-Domain-Name: Default Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-User-Id: b2e4136eee3b43878593830db499a951 Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: X-User-Name: admin Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: method: > Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: exception: Flavor 451 could not be found. Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: action_args: {'id': '451'} Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:42:07.452818 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:07.453752 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.454835 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-f133e4cb-3c42-411d-8667-4a3a3453211c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:42:07.455861 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-f133e4cb-3c42-411d-8667-4a3a3453211c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392668 Oct 28 09:42:07.455861 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 09:42:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:07.462612 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e633b21e-ffc8-4b51-a6b4-19ce8056f437 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:07.478602 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e633b21e-ffc8-4b51-a6b4-19ce8056f437 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019754 Oct 28 09:42:07.479134 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 09:42:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:42:07.488452 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:07.503846 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018862 Oct 28 09:42:07.504384 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Fri Oct 28 09:42:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:42:07.513716 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-750dd602-3e88-4ba8-9942-071b58f9723d admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:07.518723 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.wsgi [None req-750dd602-3e88-4ba8-9942-071b58f9723d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-750dd602-3e88-4ba8-9942-071b58f9723d admin admin] Request method failure captured: Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: Accept: application/json Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: Accept-Encoding: gzip, deflate Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: Connection: keep-alive Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: Content-Length: 0 Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: Host: 10.222.0.16 Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: Openstack-Api-Version: compute 2.92 Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: Openstack-System-Scope: None Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: User-Agent: python-novaclient Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Auth-Token: gAAAAABjW6PuGdLHVtcIqfS6euGDwABltTsT6TjVRVK4W7CwoTcI4oRIjl45caV1Z9nwrA72s6lI1D3dL2nfK9A2z0vLMO-WoJFDYUG40zseEkseXdMLe_qcFVWZWgkm_uj_qQ-KJIXu2hKjCPkOO1bUsHrM2dR4fzSVMdrMD6I30EOqq7VIy04 Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Domain-Id: None Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Domain-Name: None Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Identity-Status: Confirmed Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Is-Admin-Project: True Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Openstack-Nova-Api-Version: 2.92 Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Domain-Id: default Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Domain-Name: Default Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Project-Name: admin Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Role: admin,member,reader Oct 28 09:42:07.520213 n-d-zed-1 devstack@n-api.service[112905]: X-Roles: admin,member,reader Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/04a62e1ae96e4c8e9b9228e06dc65dee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_04a62e1ae96e4c8e9b9228e06dc65dee", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/04a62e1ae96e4c8e9b9228e06dc65dee"}]}] Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant: admin Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant-Id: 04a62e1ae96e4c8e9b9228e06dc65dee Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-Tenant-Name: admin Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-User: admin Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-User-Domain-Id: default Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-User-Domain-Name: Default Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-User-Id: b2e4136eee3b43878593830db499a951 Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: X-User-Name: admin Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: method: > Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: exception: Flavor 451 could not be found. Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: action_args: {'id': '451'} Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:42:07.521676 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:07.522548 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: ERROR nova.api.openstack.wsgi Oct 28 09:42:07.523718 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-750dd602-3e88-4ba8-9942-071b58f9723d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112905) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:42:07.524737 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-750dd602-3e88-4ba8-9942-071b58f9723d admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011445 Oct 28 09:42:07.524737 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 09:42:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:42:08.842170 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:08.843123 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Oct 28 09:42:08.843511 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:09.373365 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-eb004dd7-9905-43c0-bf8e-2743dda8b76b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:09.395010 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-eb004dd7-9905-43c0-bf8e-2743dda8b76b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.415609 Oct 28 09:42:09.395407 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 09:42:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:42:10.630821 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:10.633139 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002939 Oct 28 09:42:10.633881 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:11.152346 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-99a2c1ca-fff0-4a65-bf1b-8bb612cba5b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:11.171256 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-99a2c1ca-fff0-4a65-bf1b-8bb612cba5b2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.400229 Oct 28 09:42:11.171805 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 09:42:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:42:12.503993 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:12.505041 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 28 09:42:12.505472 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:13.090354 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-9173813c-31c8-4a3a-bb34-2b938689820d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:13.109496 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-9173813c-31c8-4a3a-bb34-2b938689820d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.459193 Oct 28 09:42:13.110044 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 09:42:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:42:14.350474 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:14.351506 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Oct 28 09:42:14.352534 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:42:14.908060 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-d9af213f-f2a6-4c34-978b-969b408f5b6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:42:14.926765 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-d9af213f-f2a6-4c34-978b-969b408f5b6a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.430133 Oct 28 09:42:14.927312 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Fri Oct 28 09:42:14 2022] POST /compute/v2.1/flavors => generated 409 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:42:16.188494 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:16.189527 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Oct 28 09:42:16.189921 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:42:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:42:16.709903 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-3cffce87-d945-4ea2-bd6f-698f70f0d1c0 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:42:16.730847 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-3cffce87-d945-4ea2-bd6f-698f70f0d1c0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.406591 Oct 28 09:42:16.731384 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Oct 28 09:42:16 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:43:07.200933 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:07.202326 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-e98151f8-0152-4e2b-b14a-052f0984066e admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Oct 28 09:43:07.202857 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Fri Oct 28 09:43:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:43:07.214878 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:07.605853 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-55be1d20-d0bf-4581-9103-a347b47629a2 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:07.627723 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-55be1d20-d0bf-4581-9103-a347b47629a2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.416922 Oct 28 09:43:07.628287 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 09:43:07 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:43:07.649935 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=14 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:43:07.654539 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-d4155260-2d85-4167-beb1-ef3b1c80a5c3 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:07.662518 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-d4155260-2d85-4167-beb1-ef3b1c80a5c3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014053 Oct 28 09:43:07.663103 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Fri Oct 28 09:43:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:43:07.675932 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-0556174a-91f2-4d45-a734-9064d589bfe3 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:07.683939 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-0556174a-91f2-4d45-a734-9064d589bfe3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012225 Oct 28 09:43:07.684514 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Fri Oct 28 09:43:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:43:07.697456 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-9e1b774f-a8c7-4ff6-b167-1fc32ee5f0c2 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:07.705313 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-9e1b774f-a8c7-4ff6-b167-1fc32ee5f0c2 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011394 Oct 28 09:43:07.705897 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Fri Oct 28 09:43:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:43:07.718263 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-4205be03-4cf5-46b0-9e4c-1a3b8dd49128 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:43:07.726196 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-4205be03-4cf5-46b0-9e4c-1a3b8dd49128 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011601 Oct 28 09:43:07.726770 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Fri Oct 28 09:43:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:48:27.087273 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-9e1b774f-a8c7-4ff6-b167-1fc32ee5f0c2 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:27.088300 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-9e1b774f-a8c7-4ff6-b167-1fc32ee5f0c2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 28 09:48:27.088705 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:48:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:27.233623 n-d-zed-1 devstack@n-api.service[112905]: DEBUG dbcounter [-] [112905] Writing DB stats nova_api:SELECT=6 {{(pid=112905) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:48:27.397358 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:27.403316 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:27.404056 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:27.404554 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:27.405448 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:27.406190 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:27.407482 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:27.468677 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-640aac73-2cbc-4701-a126-5eb5132260d7 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1224 microversion: 2.92 time: 0.237518 Oct 28 09:48:27.469807 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 09:48:27 2022] GET /compute/v2.1/os-services => generated 1224 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:48:28.585558 n-d-zed-1 devstack@n-api.service[112904]: DEBUG nova.api.openstack.wsgi [None req-9e1b774f-a8c7-4ff6-b167-1fc32ee5f0c2 admin admin] Calling method '>' {{(pid=112904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:28.586584 n-d-zed-1 devstack@n-api.service[112904]: INFO nova.api.openstack.requestlog [None req-9e1b774f-a8c7-4ff6-b167-1fc32ee5f0c2 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 28 09:48:28.587182 n-d-zed-1 devstack@n-api.service[112904]: [pid: 112904|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Fri Oct 28 09:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:48:28.785023 n-d-zed-1 devstack@n-api.service[112905]: DEBUG nova.api.openstack.wsgi [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] Calling method '>' {{(pid=112905) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:48:28.788468 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.788973 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.789411 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.790135 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:48:28.790579 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:48:28.791251 n-d-zed-1 devstack@n-api.service[112905]: DEBUG oslo_concurrency.lockutils [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112905) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:48:28.816320 n-d-zed-1 devstack@n-api.service[112905]: INFO nova.api.openstack.requestlog [None req-e215862a-56a4-4fca-beb8-83eab4f484c2 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1224 microversion: 2.92 time: 0.087810 Oct 28 09:48:28.816929 n-d-zed-1 devstack@n-api.service[112905]: [pid: 112905|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 09:48:28 2022] GET /compute/v2.1/os-services => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:49:17.118240 n-d-zed-1 devstack@n-api.service[112903]: Fri Oct 28 09:49:17 2022 - graceful shutdown triggered... Oct 28 09:49:17.118331 n-d-zed-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 28 09:49:17.119533 n-d-zed-1 devstack@n-api.service[112905]: Gracefully killing worker 2 (pid: 112905)... Oct 28 09:49:17.120072 n-d-zed-1 devstack@n-api.service[112904]: Gracefully killing worker 1 (pid: 112904)... Oct 28 09:49:17.252723 n-d-zed-1 devstack@n-api.service[112904]: DEBUG dbcounter [-] [112904] Writing DB stats nova_api:SELECT=4 {{(pid=112904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:49:18.120608 n-d-zed-1 devstack@n-api.service[112903]: worker 1 buried after 1 seconds Oct 28 09:49:18.120608 n-d-zed-1 devstack@n-api.service[112903]: worker 2 buried after 1 seconds Oct 28 09:49:18.120608 n-d-zed-1 devstack@n-api.service[112903]: goodbye to uWSGI. Oct 28 09:49:18.122237 n-d-zed-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 28 09:49:18.122815 n-d-zed-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 28 09:49:18.126375 n-d-zed-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 28 09:49:18.145456 n-d-zed-1 devstack@n-api.service[128738]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 28 09:49:18 2022] *** Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: nodename: n-d-zed-1 Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: machine: x86_64 Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: clock source: unix Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: pcre jit disabled Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: detected number of CPU cores: 4 Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: current working directory: / Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: detected binary path: /usr/bin/uwsgi-core Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: your processes number limit is 47680 Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: your memory page size is 4096 bytes Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: detected max file descriptor number: 2048 Oct 28 09:49:18.160246 n-d-zed-1 devstack@n-api.service[128738]: lock engine: pthread robust mutexes Oct 28 09:49:18.162161 n-d-zed-1 devstack@n-api.service[128738]: thunder lock: enabled Oct 28 09:49:18.162161 n-d-zed-1 devstack@n-api.service[128738]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 28 09:49:18.162161 n-d-zed-1 devstack@n-api.service[128738]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 28 09:49:18.202658 n-d-zed-1 devstack@n-api.service[128738]: Python main interpreter initialized at 0x561d50e719c0 Oct 28 09:49:18.202658 n-d-zed-1 devstack@n-api.service[128738]: python threads support enabled Oct 28 09:49:18.202658 n-d-zed-1 devstack@n-api.service[128738]: your server socket listen backlog is limited to 100 connections Oct 28 09:49:18.202658 n-d-zed-1 devstack@n-api.service[128738]: your mercy for graceful operations on workers is 90 seconds Oct 28 09:49:18.203170 n-d-zed-1 devstack@n-api.service[128738]: mapped 403077 bytes (393 KB) for 2 cores Oct 28 09:49:18.203170 n-d-zed-1 devstack@n-api.service[128738]: *** Operational MODE: preforking *** Oct 28 09:49:18.203413 n-d-zed-1 devstack@n-api.service[128738]: *** uWSGI is running in multiple interpreter mode *** Oct 28 09:49:18.203413 n-d-zed-1 devstack@n-api.service[128738]: spawned uWSGI master process (pid: 128738) Oct 28 09:49:18.203751 n-d-zed-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 28 09:49:18.207033 n-d-zed-1 devstack@n-api.service[128738]: spawned uWSGI worker 1 (pid: 128747, cores: 1) Oct 28 09:49:18.207033 n-d-zed-1 devstack@n-api.service[128738]: spawned uWSGI worker 2 (pid: 128748, cores: 1) Oct 28 09:49:18.207033 n-d-zed-1 devstack@n-api.service[128738]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 28 09:49:18.886649 n-d-zed-1 devstack@n-api.service[128748]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:49:18.892092 n-d-zed-1 devstack@n-api.service[128747]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 28 09:49:20.047049 n-d-zed-1 devstack@n-api.service[128748]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:49:20.047049 n-d-zed-1 devstack@n-api.service[128748]: from cryptography.utils import int_from_bytes Oct 28 09:49:20.048200 n-d-zed-1 devstack@n-api.service[128748]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:49:20.048200 n-d-zed-1 devstack@n-api.service[128748]: from cryptography.utils import int_from_bytes Oct 28 09:49:20.053187 n-d-zed-1 devstack@n-api.service[128747]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:49:20.053187 n-d-zed-1 devstack@n-api.service[128747]: from cryptography.utils import int_from_bytes Oct 28 09:49:20.053905 n-d-zed-1 devstack@n-api.service[128747]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 28 09:49:20.053905 n-d-zed-1 devstack@n-api.service[128747]: from cryptography.utils import int_from_bytes Oct 28 09:49:22.471160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:49:22.471804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:49:22.472136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:49:22.472367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:49:22.472598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:49:22.473023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.473362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.473693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.474021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.474363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.474681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.475015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.475340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.475675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.475942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.476271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.476773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-zed-1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.477140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.477461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.477789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.478103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.478416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.478750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.479056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.479609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.481087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.481087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.481087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.481390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.481633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.481983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.482451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.483018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.483457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.484104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.484753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-zed-1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.485363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.485742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.486087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.486525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.486853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.487189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.487502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.487845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.488166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.488502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.488830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.489191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.489511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.489835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.490156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.490465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.490775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.491100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.491399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.491654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.491966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.492294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.492618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.492971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.493274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.493512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.493811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.494181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.494497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.494814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.495119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.495436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.495748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.496059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.496384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.496698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.497055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.497377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.497705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.498035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.498341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.498757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.499529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.499852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.500200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.500525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.500838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.501193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.501548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.501861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.502179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.502493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.502817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.503157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.503465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.503721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.504028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.504339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.504662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.505001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.505318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.505630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.505942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.506252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.506564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.506881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.507194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.507524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.507817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.508125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.508435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.508743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.509150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.509478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.509817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.510126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.510434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.510746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.510909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 28 09:49:22.511444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.511600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 28 09:49:22.511756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.511903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 28 09:49:22.512064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.512219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 28 09:49:22.512372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.512526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 28 09:49:22.512673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.512828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.513094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.513094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.513400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.513566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.513714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.513861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.514016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.514170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.514323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.514476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.514636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.515394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.515576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.515927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.516191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.516469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.516469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.516944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.516944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.517441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.517626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.517776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.517776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.518079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-zed-1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.518333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.518496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.518767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.518927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.519087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.519257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.519411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.519566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.519721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.519877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.520034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.520182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.520337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.520593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.520756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.520756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.521112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.521300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.521457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.521637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.521786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.521949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.522104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.522259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.522413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.522568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.522715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.522888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.523052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.523207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.523363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.523509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.523669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.523907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.524056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.524251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.524412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.524580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.524737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-zed-1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.524884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.525076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.525238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.525386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.525620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.525620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.525929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.526205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.526464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.526715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.526924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.527167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.527353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.527672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.527825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.527996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.528160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.528327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.528557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.528709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.528865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.529158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.529325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.529473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.529631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.529787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.529934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.530105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.530280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.530466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.530718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.530879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.531053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.531210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.531367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.531522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.531670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.531816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.531986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.532154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.532312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.532483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.532638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.532802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.532992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.533145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.533291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.533572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.533749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.533934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.534096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.534096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.534454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.534624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.534812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.535762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.535929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.536080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.536387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.540336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.541137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.541578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.541747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.541908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.542143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.542143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.542452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.542601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.542758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.542907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.543065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.543065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.543389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.543539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.543696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.543844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.543998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.543998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.544286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.544286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.544615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.544803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.545031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.545031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.545403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.545550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.545758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.545935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.546945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.547805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.547968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.548121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.548269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.548696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.548878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.549068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.549231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.549411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.549565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.549721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.549879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.550034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.550189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.550337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.551072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.551244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.551410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.551678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.551922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.552157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.552425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.552674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.553012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.553269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.553526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.553773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.554049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.555198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.555470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.555829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.556111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.556380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.556691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.557028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.557273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.557530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.559156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.559425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.559674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.559933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.559933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.560822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.561182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.561436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.562218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.562463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.562746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.563844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.564017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.564188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.564352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.564519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.564688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.564844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.565011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.565149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.565311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.565474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.565621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.565834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.566021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.566187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.566187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.566601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.566750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.566900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.567071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.567254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.567420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.567572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.567572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.567889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.568068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.568266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.568424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.568583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.568786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.569024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.569195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.569336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.569488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.569626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.569789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.569965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.570143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.570301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.570449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.570617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.570799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.570964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.571122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.571291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.571459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.571617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.571761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.571934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.572102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.572491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.572646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.572777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.572997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.573179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.573356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.573506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.573654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.573815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.573988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.574155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.575283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.575436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.575589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.575754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.575926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.576093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.576276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.576428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.576587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.576747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.576940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.577165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.577908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.578069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.578243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.578390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.578559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.578708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 28 09:49:22.578874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.579065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.579244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.579400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.579574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.579742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.579910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.580074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.580266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.580419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.580554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.580699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.580847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.580847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.581194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.581194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.581479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.581638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.581789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.581927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.582096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.582260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.582398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.583324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.583461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.583628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.583792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.583792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.584064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.584202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.584349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.584486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.584654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.584830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.585028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.585276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.585499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.585672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.585820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.585964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.585964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.586236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.586379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.586513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.586678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.586817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.586952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.587101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.587326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.587560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.587775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.587984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.588207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.588441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.588651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.588880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.589285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.589515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.589676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.590925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.591193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.591490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.591725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.591971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.592210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.592445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.592731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.592957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.593129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.593294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.593455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.593628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.593784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.593932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.594069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.594214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.594353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.594504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.594700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.594855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.595017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.595154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.595304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.595454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.595589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.595724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.595864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.596009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.596145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.596289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.596438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.596575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.596725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.596725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.597062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.597246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.597394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.597535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.597679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.597829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.598000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.598188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.598322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.598481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.598648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.598820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.599006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.599162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.599332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.599499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.599662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.599823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.599997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.600168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.600325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.600480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.600663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.600816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.601078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.601224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.601359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.602519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.602685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.602869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.603106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.603106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.603550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.603710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.603866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.603866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.604217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.604217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.604510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.604510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.604830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.605048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.605213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.605367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.605529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.605717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.605885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.606044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.606142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.607720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.607837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.607959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.608117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.608295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.609085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.609245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.609501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.609710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.609954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.610116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.610334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.610512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.610680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.610837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.611001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.611001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.611339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.611505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.611672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.611837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.612017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.612223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.612393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.612558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.612723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.612894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.613158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.613323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.613487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.613655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.613831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.613984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.614152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.614312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.614466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.614666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.614815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.614979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.615136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.615290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.615445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.615619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.615772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.615942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.616119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.616273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.616440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.616633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.616928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.617158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.617158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.617158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.617158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.617820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.617977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.618125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.618275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.618455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.618621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.618775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.618941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.619092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.619344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.619569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.619765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.620038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.620217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.620439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.620599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.620769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.620950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.621129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.621129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.621129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.621129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.621129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.621829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.621957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.622058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.622153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.622297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.622466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.622631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.622786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.622942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.623095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.623256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.623495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.623667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.623836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.624055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.624737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.625095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.625255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.625255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.625255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.625255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.625255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.626028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.626180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.626337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.626496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.626645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.626792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.626963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.627113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.627274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.627465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.627633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.627791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.627962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.628119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.628261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.628441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.628606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.628774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.628952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.629145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.629306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.629457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.629457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.629760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.629954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.630108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.630263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.630430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.630621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.630802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.630958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.631122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.631280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.631446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.631613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.631787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.631980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.632148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.632303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.632458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.632685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.632954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.633115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.633269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.633438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.633585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.633734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.633888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.634035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.634210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.634351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.634488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.634640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.634787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.634967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.635978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.636176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.636341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.636506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.636668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.636870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.637194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.637408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.637618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.637807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.638039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.638210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.638378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.638572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.638763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.638926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.639086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.639258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.639475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.639665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.639921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.640095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.640253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.640581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.640843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.641041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.641210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.641368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.641572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.641797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.641960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.642129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.642320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.642485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.642655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.642841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.642986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.643126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.643227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.643323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.643418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.643503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.643623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.643834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.644008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.644174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.644376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.644542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.644696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.644851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.645070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.645226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.645413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.645579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.645745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.645915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.646106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.646264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.646450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.646614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.646783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.646965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.647116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.647287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.647467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.647634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.647786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.647954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.648150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.648430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.648598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.648815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.648999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.649156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.649314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.649496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.649720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.649964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.650126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.650344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.650557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.650757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.650961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.651105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.651275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.651433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.651596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.651768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.652023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.652240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.652402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.652557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.652755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.652963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.653147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.653326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.653488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.653645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.653816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.654031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.654031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.654329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.654484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.654681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.654839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.654839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.655125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.655371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.655530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.655695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.655864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.656022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.656179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.656289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.656392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.656495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.656662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.656819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.657077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.657251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.657417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.657585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.657790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.657946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.658104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.658274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.658453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.658627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.658786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.658925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.659098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.659266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.659465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.659465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.659817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.659978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.660179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.660345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.660513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.660681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.660852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.661092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.661303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.661464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.661633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.661781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.661929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.662092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.662322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.662481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.662637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.662796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.662946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.663109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.663240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.663431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.663601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.663789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.664001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.664257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.664466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.664676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.664839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.665025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.665220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.665401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.665566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.665735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.665905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.666092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.666187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.666542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.666633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.666725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.666878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.667056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.667247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.667410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.667576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.667728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.667913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.668104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.668273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.668429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.668596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.668765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.669100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.669276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.669451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.669606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.669772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.670030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.670247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.670407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.670407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.670789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.671403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.671568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.671670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.671797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.671967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.672134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.672286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.672493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.672675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.672855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.672855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.673198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.673370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.673586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.673586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.673896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.674034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.674184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.674418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.674582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.674751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.674925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.675084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.675259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.675423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.675543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.675651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.675763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.675930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.676079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.676208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.676407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.676585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.676757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.676960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.677195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.677358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.677539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.677716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.677875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.678046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.678308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.678418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.678520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.678688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.678862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.679990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.680325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.680540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.680763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.680964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.681124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.681301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.681470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.681722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.681886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.682057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.682251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.682379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.682457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.682665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.682829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.682985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.683151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.683308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.683505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.683674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.683848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.684860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.685962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.686095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.686228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.686329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.686420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.686568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.687152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.687316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.687479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.687577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.687726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.687832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.687948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.688082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.688199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.688328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.688466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.688637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.688752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.688973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.689112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.689279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.689405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.689504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.689588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.689759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.689892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.690060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.690177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.690384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.690603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.690760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.690931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.691990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.692897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.693944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.694973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.695996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.696995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.697940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.698967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.699854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.700875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.701970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.702964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.703907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.704990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.705952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.706981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.707989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.708993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.709995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.710086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.710168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.710254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.710337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.710418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.731891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.733307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.734141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.734297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.734437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.734700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.734850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.734987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.735123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.735258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.735419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.735577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.735720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.735878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.736023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.736170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.736307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.736442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.736578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.736714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.736849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.737023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.737182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.737514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.737694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.737694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.738040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.738188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.738325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.738461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.738596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.738740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.738878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.739014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.739150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.739287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.739434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.739580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.739718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.739875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.740013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.740150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.740386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.740542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.740682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.740821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.740984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.741133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.744685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.744983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.745251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.747166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.747416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.747623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.747846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.748061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.748230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.748422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.748643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.748789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.749294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.750040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.750294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.750447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.750701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.750981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.751306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.751773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.751943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.752229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.752386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.752538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.753118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.753359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.753506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.753636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.753990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.754290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.754464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.754848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.755063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.755191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.755309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.755426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.755650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.755827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.755949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.756067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.756185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.756301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.756425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.756556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.756717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.756925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.757058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.757311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.757520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.757707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.757836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.758038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.758223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.758351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.758514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.758694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.758878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.759038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.759207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.759342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.759495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.759621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.759764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.759764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.760111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.760310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.760452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.760590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.760707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.760888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.761112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.761258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.761399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.761690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.762062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.762250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.762428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.762581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.762874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.763153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.763475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.764302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.764500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.764749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.765273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.765430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.765591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.765714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.765833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.765966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.766923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.767144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.767269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.767388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.767506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.767624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.767761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.767761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.768926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.769960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.770906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.771886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.772293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.772293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.772525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.772644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.772832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.772969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.773119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.773347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.773577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.773698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.773816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.773934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.774897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.775118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.775349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.775474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.775601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.775721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.775838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.775957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.776658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.777885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.778973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.779995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.780969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128748) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.781767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.782693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.783823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.784684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.785825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.786674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.787684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.788541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.789407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.790428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.791631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.792829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.794265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.794265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.794265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.794265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.794265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.794960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.794960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.795271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.795632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.796726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.797246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.797641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.798061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.798481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.798883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.799281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.799716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.800123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.800604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.801083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.801455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.801860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.802342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.802816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.803185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.803562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.803941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.804321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.804706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.805145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.805533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.805993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.806511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.806681 n-d-zed-1 devstack@n-api.service[128748]: INFO dbcounter [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Registered counter for database nova_api Oct 28 09:49:22.807049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.807505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.807975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.808435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.808894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.809376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.809816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 28 09:49:22.810158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 28 09:49:22.828298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_db.sqlalchemy.engines [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:22.835279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writer thread running {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:22.873267 n-d-zed-1 devstack@n-api.service[128747]: INFO dbcounter [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Registered counter for database nova_api Oct 28 09:49:22.894335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.context [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=128748) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:49:22.894616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_db.sqlalchemy.engines [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:22.898459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:22.898949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:22.900597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:22.901388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:22.901686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writer thread running {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:22.901847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:22.903903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:22.906109 n-d-zed-1 devstack@n-api.service[128748]: INFO dbcounter [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Registered counter for database nova_cell0 Oct 28 09:49:22.910522 n-d-zed-1 devstack@n-api.service[128748]: INFO dbcounter [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Registered counter for database nova_cell1 Oct 28 09:49:22.919116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_db.sqlalchemy.engines [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:22.923400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_db.sqlalchemy.engines [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:22.929471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writer thread running {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:22.932592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writer thread running {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:22.961911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.context [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=128747) load_cells /opt/stack/nova/nova/context.py:464}} Oct 28 09:49:22.965750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:22.966232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:22.968358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:22.969153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:49:22.969602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:49:22.971616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:49:22.973690 n-d-zed-1 devstack@n-api.service[128747]: INFO dbcounter [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Registered counter for database nova_cell0 Oct 28 09:49:22.978061 n-d-zed-1 devstack@n-api.service[128747]: INFO dbcounter [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Registered counter for database nova_cell1 Oct 28 09:49:22.987541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_db.sqlalchemy.engines [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:22.988785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_db.sqlalchemy.engines [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:22.993980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writer thread running {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:23.103491 n-d-zed-1 devstack@n-api.service[128748]: INFO dbcounter [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Registered counter for database nova_cell0 Oct 28 09:49:23.114656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_db.sqlalchemy.engines [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128748) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:23.120158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writer thread running {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:23.140541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writer thread running {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:23.151205 n-d-zed-1 devstack@n-api.service[128747]: INFO dbcounter [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Registered counter for database nova_cell0 Oct 28 09:49:23.158695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_db.sqlalchemy.engines [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 28 09:49:23.163470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writer thread running {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 28 09:49:23.492059 n-d-zed-1 devstack@n-api.service[128747]: WARNING keystonemiddleware.auth_token [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:49:23.499949 n-d-zed-1 devstack@n-api.service[128748]: WARNING keystonemiddleware.auth_token [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:49:23.500484 n-d-zed-1 devstack@n-api.service[128747]: WARNING keystonemiddleware.auth_token [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:49:23.508471 n-d-zed-1 devstack@n-api.service[128748]: WARNING keystonemiddleware.auth_token [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:49:23.845631 n-d-zed-1 devstack@n-api.service[128747]: WARNING keystonemiddleware.auth_token [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:49:23.851649 n-d-zed-1 devstack@n-api.service[128747]: WARNING keystonemiddleware.auth_token [None req-c2484a17-1207-4e58-bcaf-f15d30be851a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:49:23.857062 n-d-zed-1 devstack@n-api.service[128747]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561d50e719c0 pid: 128747 (default app) Oct 28 09:49:23.872029 n-d-zed-1 devstack@n-api.service[128748]: WARNING keystonemiddleware.auth_token [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 28 09:49:23.878614 n-d-zed-1 devstack@n-api.service[128748]: WARNING keystonemiddleware.auth_token [None req-16d1046d-a308-4b96-88cd-4199da355358 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 28 09:49:23.883898 n-d-zed-1 devstack@n-api.service[128748]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561d50e719c0 pid: 128748 (default app) Oct 28 09:50:07.870955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:07.872543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:07.874194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:07.875667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:09.460121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1965729544", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:10.627950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.629301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.635235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:10.641336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:11.366310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:50:11.854185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:50:11.854662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:50:11.855139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:50:11.855545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:50:11.855952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:50:11.906946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:11.907788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:11.908468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:11.909469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:11.910307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:11.910951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:11.919207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:11.924562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:11.925463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:11.926167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:11.927081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:11.927692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:11.928274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:11.970043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:11.983453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for user 9dc12014773b4f9fb34ff214c07d7f61 and project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:11.995139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-821fe637-6668-465a-8fb7-28ec503585c1 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 1.390194 Oct 28 09:50:11.996289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1/1] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 09:50:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:12.010767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:50:12.014629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:50:12.102839 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-de53288b-e710-47af-a09a-990c82f977d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.245219 Oct 28 09:50:12.107892 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1/2] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 4252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:50:12.302652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78d3ba19-2893-4558-98d5-c6f345ed52c8 tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-2050709369", "id": 71846436, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:12.328426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd1596e1-73d6-4f4e-ad86-1a86ad487e4f tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1035617559", "ram": 512, "vcpus": 1, "disk": 10, "id": 227986954, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:12.357744 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78d3ba19-2893-4558-98d5-c6f345ed52c8 tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.86 time: 0.248421 Oct 28 09:50:12.359223 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2/3] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:50:12 2022] POST /compute/v2.1/flavors => generated 465 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:12.440032 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd1596e1-73d6-4f4e-ad86-1a86ad487e4f tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.442220 Oct 28 09:50:12.449919 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2/4] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:11 2022] POST /compute/v2.1/flavors => generated 413 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:12.488385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '.version_select at 0x7fca387db700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:12.497051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=128747) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 09:50:12.499064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:12.499769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:12.500297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:12.535581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:12.536896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:12.537713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:12.557392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Calling method '.version_select at 0x7fca39090f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:12.562875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:12.563758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:12.564351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:12.572637 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-600cb786-4cd6-476a-bdd5-d83edd31a934 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1491 microversion: 2.1 time: 0.212144 Oct 28 09:50:12.573581 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3/5] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 09:50:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1491 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:12.582364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=128748) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 28 09:50:12.582996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:12.585236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:12.585889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:12.656459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:12.657183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:12.657954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:12.678572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:12.679340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:12.680027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:12.690274 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0cc5c240-f5c6-4c21-a805-d58c8df499b2 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1411 microversion: 2.41 time: 0.239476 Oct 28 09:50:12.691484 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3/6] 10.222.0.16 () {60 vars in 1208 bytes} [Fri Oct 28 09:50:12 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1411 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:12.696804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7274907a-5f5d-4af8-8563-8133959248be tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1472013499"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:12.701245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-7274907a-5f5d-4af8-8563-8133959248be tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid 99e02760-97e2-4a53-914e-52154a3e2c68 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:12.735340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1640175626", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:12.803934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:50:12.836617 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7274907a-5f5d-4af8-8563-8133959248be tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.143781 Oct 28 09:50:12.838876 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4/7] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:12.847970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f3cabaf-25c7-410a-8178-fb7879a9ddd1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:12.855618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f3cabaf-25c7-410a-8178-fb7879a9ddd1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:13.304748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f3cabaf-25c7-410a-8178-fb7879a9ddd1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:13.320563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f3cabaf-25c7-410a-8178-fb7879a9ddd1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1213 microversion: 2.1 time: 0.478916 Oct 28 09:50:13.322192 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 5/8] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:12 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1213 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:13.328985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af29e4dd-7c39-4bde-979a-01f07dcfc9f7 tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:13.432046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:50:13.432973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:50:13.433661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:50:13.435057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:50:13.435494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:50:13.458663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:13.459691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:13.461879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:13.462970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:13.469047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:13.469754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:13.505934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Getting quotas for project 340ea03cddd04e83aaabb5e6810892d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:13.519496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Getting quotas for user 791f2111f74a452eaa525d16ce0b6448 and project 340ea03cddd04e83aaabb5e6810892d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:13.544005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:50:13.547198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:50:13.591511 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af29e4dd-7c39-4bde-979a-01f07dcfc9f7 tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/71846436/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.263286 Oct 28 09:50:13.592879 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 6/9] 10.222.0.16 () {62 vars in 1259 bytes} [Fri Oct 28 09:50:13 2022] POST /compute/v2.1/flavors/71846436/os-extra_specs => generated 62 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:13.600255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af1e5737-cbe5-4e0c-a0a2-f3e59be2b28d tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:13.642715 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f50ab2cb-99a5-45b2-8f36-f4bb7848ed59 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067754 Oct 28 09:50:13.644131 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4/10] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:50:13.650521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b07e39c5-1c50-4441-992e-b3d923d1155a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:13.687456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af1e5737-cbe5-4e0c-a0a2-f3e59be2b28d tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/227986954/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.088727 Oct 28 09:50:13.688567 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 7/11] 10.222.0.16 () {60 vars in 1221 bytes} [Fri Oct 28 09:50:13 2022] POST /compute/v2.1/flavors/227986954/os-extra_specs => generated 66 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:13.701037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5c72e25-d531-44f5-8e06-185d1a8654ad tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:13.714983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b07e39c5-1c50-4441-992e-b3d923d1155a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:13.715488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b07e39c5-1c50-4441-992e-b3d923d1155a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:13.715942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b07e39c5-1c50-4441-992e-b3d923d1155a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:13.775556 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a5c72e25-d531-44f5-8e06-185d1a8654ad tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/71846436" status: 202 len: 0 microversion: 2.86 time: 0.084019 Oct 28 09:50:13.776883 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 8/12] 10.222.0.16 () {60 vars in 1196 bytes} [Fri Oct 28 09:50:13 2022] DELETE /compute/v2.1/flavors/71846436 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:50:13.783580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d3ed62d0-ffc3-409b-a64c-2964e9e1bc50 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:13.784551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3ed62d0-ffc3-409b-a64c-2964e9e1bc50 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:13.878479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d3ed62d0-ffc3-409b-a64c-2964e9e1bc50 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:13.896081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d3ed62d0-ffc3-409b-a64c-2964e9e1bc50 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1220 microversion: 2.1 time: 0.117517 Oct 28 09:50:13.897852 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 9/13] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:13 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1220 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:14.144712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-48390d5c-5c32-47dd-b657-05c99f133f71 tempest-FlavorsExtraSpecsTestJSON-260150206 tempest-FlavorsExtraSpecsTestJSON-260150206-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:14.176887 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-48390d5c-5c32-47dd-b657-05c99f133f71 tempest-FlavorsExtraSpecsTestJSON-260150206 tempest-FlavorsExtraSpecsTestJSON-260150206-project] 10.222.0.16 "GET /compute/v2.1/flavors/227986954/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.274564 Oct 28 09:50:14.178349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 10/14] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 09:50:13 2022] GET /compute/v2.1/flavors/227986954/os-extra_specs => generated 66 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:14.189437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6cb72f22-21ae-47f8-b94d-973031d3654d tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:14.251270 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b07e39c5-1c50-4441-992e-b3d923d1155a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 239 microversion: 2.1 time: 0.603855 Oct 28 09:50:14.253797 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 5/15] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:50:13 2022] POST /compute/v2.1/os-aggregates/1/action => generated 239 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:14.285653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62a1f3ca-a6d6-43a2-81e2-7d967cf837ab tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:14.313636 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6cb72f22-21ae-47f8-b94d-973031d3654d tempest-FlavorMetadataValidation-2010120167 tempest-FlavorMetadataValidation-2010120167-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6267 microversion: 2.86 time: 0.133733 Oct 28 09:50:14.332553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 11/16] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 09:50:14 2022] GET /compute/v2.1/flavors/detail => generated 6267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:14.348414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:14.378832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:14.379546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:14.380188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:14.427162 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62a1f3ca-a6d6-43a2-81e2-7d967cf837ab tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/227986954/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.167432 Oct 28 09:50:14.431088 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 6/17] 10.222.0.16 () {60 vars in 1221 bytes} [Fri Oct 28 09:50:14 2022] POST /compute/v2.1/flavors/227986954/os-extra_specs => generated 66 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:14.450517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:14.451956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:14.466785 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-zed-1. Oct 28 09:50:14.501339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:14.501773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:14.502228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:14.502978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:14.505285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:14.510343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 36 Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:14.511396 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: {"add_host": {"host": "n-h1-zed-1"}} Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:14.512711 n-d-zed-1 devstack@n-api.service[128748]: exception: Aggregate 1 already has host n-h1-zed-1. Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-zed-1'}}} Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result.read() Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:50:14.513398 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-zed-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:50:14.514963 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:50:14.515895 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:50:14.516823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result.read() Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-zed-1-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 9, 50, 14, 418498), 'updated_at': None, 'host': 'n-h1-zed-1', 'aggregate_id': 1}] Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:14.518103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-zed-1. Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.518990 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-zed-1. Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:14.520336 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:14.523601 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-zed-1. Oct 28 09:50:14.523601 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:14.523601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-zed-1. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:14.523601 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-177c999e-664c-4bee-b04a-fc5348dee278 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 92 microversion: 2.1 time: 0.179346 Oct 28 09:50:14.523601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 12/18] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:50:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 92 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Oct 28 09:50:14.539585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a17fe9c4-bf74-47f9-a8af-8d1dc988ae23 tempest-FlavorsExtraSpecsTestJSON-260150206 tempest-FlavorsExtraSpecsTestJSON-260150206-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:14.563210 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a17fe9c4-bf74-47f9-a8af-8d1dc988ae23 tempest-FlavorsExtraSpecsTestJSON-260150206 tempest-FlavorsExtraSpecsTestJSON-260150206-project] 10.222.0.16 "GET /compute/v2.1/flavors/227986954/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.047694 Oct 28 09:50:14.563739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 13/19] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 09:50:14 2022] GET /compute/v2.1/flavors/227986954/os-extra_specs/hw:numa_nodes => generated 22 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:14.594038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0677f61-fd17-4339-b160-9d87ca117421 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:14.640786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0677f61-fd17-4339-b160-9d87ca117421 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:14.641378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0677f61-fd17-4339-b160-9d87ca117421 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:14.641825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0677f61-fd17-4339-b160-9d87ca117421 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:14.992893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:15.048596 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-58cf3d06-2ec0-497f-9c40-b75e93a7d031 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1265 microversion: 2.1 time: 0.613588 Oct 28 09:50:15.050819 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 7/20] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:14 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1265 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:15.059962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fefa225a-fa4f-4b46-9099-334626450ecc tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:15.096563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fefa225a-fa4f-4b46-9099-334626450ecc tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/227986954/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042591 Oct 28 09:50:15.097533 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 8/21] 10.222.0.16 () {60 vars in 1221 bytes} [Fri Oct 28 09:50:15 2022] POST /compute/v2.1/flavors/227986954/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:15.104275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cd3c7a5c-e700-4203-9319-56fc2ab4cc5d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.105262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cd3c7a5c-e700-4203-9319-56fc2ab4cc5d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:15.267812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cd3c7a5c-e700-4203-9319-56fc2ab4cc5d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:15.293679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cd3c7a5c-e700-4203-9319-56fc2ab4cc5d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1220 microversion: 2.1 time: 0.194319 Oct 28 09:50:15.294279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 9/22] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:15 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1220 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:15.303826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46ff8c5d-790a-4ab4-b809-c024082dd016 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.321619 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46ff8c5d-790a-4ab4-b809-c024082dd016 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/227986954/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.025054 Oct 28 09:50:15.332937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 10/23] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 09:50:15 2022] GET /compute/v2.1/flavors/227986954/os-extra_specs => generated 66 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:15.345283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-519cb6d9-6fbf-4702-9d7a-e667193be2d3 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:15.434213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-519cb6d9-6fbf-4702-9d7a-e667193be2d3 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/227986954/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.099538 Oct 28 09:50:15.435472 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 11/24] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:50:15 2022] PUT /compute/v2.1/flavors/227986954/os-extra_specs/hw:numa_nodes => generated 22 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:15.445572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddc386e2-d1fb-4a98-a019-8187c2126d69 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.464341 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddc386e2-d1fb-4a98-a019-8187c2126d69 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/227986954/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.022720 Oct 28 09:50:15.464964 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 09:50:15 2022] GET /compute/v2.1/flavors/227986954/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:50:15.483829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2e595d6b-5502-4ed8-98ed-a39469c410b0 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.529092 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0677f61-fd17-4339-b160-9d87ca117421 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 227 microversion: 2.1 time: 0.952338 Oct 28 09:50:15.530625 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 14/26] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:50:14 2022] POST /compute/v2.1/os-aggregates/1/action => generated 227 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:15.540235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:15.547541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-425211ad-befc-431f-ab3e-8dcb8e6dfb7c tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.567929 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2e595d6b-5502-4ed8-98ed-a39469c410b0 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/227986954/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.093390 Oct 28 09:50:15.569895 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 13/27] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 09:50:15 2022] DELETE /compute/v2.1/flavors/227986954/os-extra_specs/hw:numa_nodes => generated 0 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:50:15.589587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d8672af-3423-4ec8-9341-43c1f967cd3b tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.614892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-425211ad-befc-431f-ab3e-8dcb8e6dfb7c tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.073581 Oct 28 09:50:15.616207 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 15/28] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:15 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 09:50:15.629377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ec0096a-6259-4fab-b180-c82527a78b15 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1543621992"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:15.653170 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d8672af-3423-4ec8-9341-43c1f967cd3b tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/227986954/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.072961 Oct 28 09:50:15.654372 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 14/29] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 09:50:15 2022] DELETE /compute/v2.1/flavors/227986954/os-extra_specs/hw:cpu_policy => generated 0 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:50:15.656061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-0ec0096a-6259-4fab-b180-c82527a78b15 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid 7643b770-19d1-417f-832e-5261b8cf757a for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:15.672575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b54f218-718d-4479-8b5c-dfd6db83281c tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.689901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b54f218-718d-4479-8b5c-dfd6db83281c tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/227986954/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030972 Oct 28 09:50:15.694640 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ec0096a-6259-4fab-b180-c82527a78b15 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.069865 Oct 28 09:50:15.695987 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 16/30] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:15.703468 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 15/31] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 09:50:15 2022] GET /compute/v2.1/flavors/227986954/os-extra_specs => generated 19 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:15.707552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3abb6d5-588b-4dd0-a308-4c56a51bf5c1 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1882808033"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:15.711658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-d3abb6d5-588b-4dd0-a308-4c56a51bf5c1 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Generated uuid 4827d39d-d13d-4e7d-a679-38557103037e for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:15.763626 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3abb6d5-588b-4dd0-a308-4c56a51bf5c1 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.063096 Oct 28 09:50:15.764529 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 16/32] 10.222.0.16 () {62 vars in 1205 bytes} [Fri Oct 28 09:50:15 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:15.780445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9720aab6-d89a-430e-a9e9-6026faac5266 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:15.859214 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9720aab6-d89a-430e-a9e9-6026faac5266 tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/227986954" status: 202 len: 0 microversion: 2.1 time: 0.088570 Oct 28 09:50:15.861241 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 17/33] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:50:15 2022] DELETE /compute/v2.1/flavors/227986954 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:15.871681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e22e8f50-f3e1-4468-8b7f-fee6e72a3496 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1849943096"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:16.111902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-172539ff-e051-4fa4-b0b8-2f7645880366 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:16.117010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-172539ff-e051-4fa4-b0b8-2f7645880366 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'ea106b2a3de84ea28bbad06ca62f2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf7a1694754ab495d0630ae8580735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-172539ff-e051-4fa4-b0b8-2f7645880366 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Request method failure captured: Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 36 Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPSs5qhJlsw8eHmcmcTjPxHbGEVmOoUUERozWH4lMEbyqnh77szjDMeH3C45oqpIAjq7wCS_d5TVR5S5WVI0nBeHatpyPaNOk-2Bqk3_C9ckJTyF2Tb831YRqc_OsAJAA5WOcAHILpADM-EnORnFIBEpzKE6qz3tixzirTVe2KjYE Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:50:16.121945 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4bf7a1694754ab495d0630ae8580735", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4bf7a1694754ab495d0630ae8580735"}]}] Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: ea106b2a3de84ea28bbad06ca62f2bda Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: {"add_host": {"host": "n-h1-zed-1"}} Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:16.123206 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-zed-1'}}} Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:16.123857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 28 09:50:16.125190 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:16.126117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-172539ff-e051-4fa4-b0b8-2f7645880366 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:16.126117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-172539ff-e051-4fa4-b0b8-2f7645880366 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.414609 Oct 28 09:50:16.131017 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 17/34] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:50:15 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 423 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:16.143756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9cdbc901-3109-407b-850b-ea3b8463226a tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:16.180596 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e22e8f50-f3e1-4468-8b7f-fee6e72a3496 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.317303 Oct 28 09:50:16.182655 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 18/35] 10.222.0.16 () {62 vars in 1210 bytes} [Fri Oct 28 09:50:15 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:16.204180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:16.206350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:16.209701 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9cdbc901-3109-407b-850b-ea3b8463226a tempest-FlavorsExtraSpecsTestJSON-1171441495 tempest-FlavorsExtraSpecsTestJSON-1171441495-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075666 Oct 28 09:50:16.211698 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 18/36] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:50:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:16.222338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:16.224230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:16.225074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb050cf8-6ac1-45f5-adbf-16f12051da46 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:16.253685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:16.254733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:16.255347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:16.255943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:16.313827 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb050cf8-6ac1-45f5-adbf-16f12051da46 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.099336 Oct 28 09:50:16.323168 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 19/37] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:16 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:50:16.334946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b45c6ef7-2b83-49a1-a502-d3bcffb84e6a tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:16.356526 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b45c6ef7-2b83-49a1-a502-d3bcffb84e6a tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.030547 Oct 28 09:50:16.367594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1190 bytes} [Fri Oct 28 09:50:16 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:16.379801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:16.380789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:16.391340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:16.392112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:16.392846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:16.393801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:16.394442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:16.395035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:16.586441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:16.605470 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec8c7783-b128-434c-b449-dee4775bf1e4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1271 microversion: 2.1 time: 0.410755 Oct 28 09:50:16.610685 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 19/39] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:16 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1271 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:16.621655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afa189c5-1baf-4eb3-8a9e-9bd02ef375de tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1270646816"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:16.629789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-afa189c5-1baf-4eb3-8a9e-9bd02ef375de tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid f9fbe792-8fc9-4ae1-8dcd-84926187f916 for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:16.700319 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-afa189c5-1baf-4eb3-8a9e-9bd02ef375de tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.087846 Oct 28 09:50:16.701711 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 20/40] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:16.723807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30631fe3-9f66-4754-91b8-c1601adabd68 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:16.757218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30631fe3-9f66-4754-91b8-c1601adabd68 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:16.757775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30631fe3-9f66-4754-91b8-c1601adabd68 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:16.758230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30631fe3-9f66-4754-91b8-c1601adabd68 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:16.941182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:16.976898 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-064a1cfe-b553-421e-bc67-5cf7f4d9b60b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1272 microversion: 2.1 time: 0.607655 Oct 28 09:50:16.981349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 21/41] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:16 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1272 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:16.997531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-250094224"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.018695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:17.023986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.025452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.027001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.043721 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30631fe3-9f66-4754-91b8-c1601adabd68 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 311 microversion: 2.41 time: 0.333760 Oct 28 09:50:17.044598 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 21/42] 10.222.0.16 () {62 vars in 1232 bytes} [Fri Oct 28 09:50:16 2022] POST /compute/v2.1/os-aggregates/3/action => generated 311 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:17.064640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dd76acda-1ae2-44f7-be97-ad1014950226 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.087391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.088308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.089703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.121216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd76acda-1ae2-44f7-be97-ad1014950226 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.121653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd76acda-1ae2-44f7-be97-ad1014950226 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.125480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd76acda-1ae2-44f7-be97-ad1014950226 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.133430 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-250094224 could not be found. Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 57 Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:17.143096 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: {"add_host": {"host": "tempest-nonexist_host-250094224"}} Oct 28 09:50:17.144494 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: exception: Compute host tempest-nonexist_host-250094224 could not be found. Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-250094224'}}} Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-250094224' is not mapped to any cell Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.145269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 28 09:50:17.146529 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-250094224 could not be found. Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-250094224 could not be found. Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.147730 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.148970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.148970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.148970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.148970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:17.148970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:17.148970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-250094224 could not be found. Oct 28 09:50:17.148970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.154857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-250094224 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:17.158107 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd702180-1e3f-45b2-893c-6f2b7b791067 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 110 microversion: 2.1 time: 0.171197 Oct 28 09:50:17.159483 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 22/43] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:50:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 110 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:17.186979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef561c68-bb60-4fa2-a18e-0c962b05bfa2 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.247750 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef561c68-bb60-4fa2-a18e-0c962b05bfa2 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.081275 Oct 28 09:50:17.255332 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 23/44] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:17 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:50:17.262417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-274c485d-d77e-42e7-82e2-b656074e0e42 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-274c485d-d77e-42e7-82e2-b656074e0e42 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 283 Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:17.271785 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.272892 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:50:17.273889 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:17.275384 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.280631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.282053 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:50:17.282053 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:50:17.282053 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 09:50:17.282053 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.282053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-274c485d-d77e-42e7-82e2-b656074e0e42 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:17.282415 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-274c485d-d77e-42e7-82e2-b656074e0e42 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.016782 Oct 28 09:50:17.282415 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 24/45] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:50:17.288744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37f05514-59a7-4ca0-899e-1fc93625d47a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37f05514-59a7-4ca0-899e-1fc93625d47a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 27 Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:17.293755 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: {"aggregate": {"name": ""}} Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:17.294899 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '' Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:17.296176 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 09:50:17.297329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.302169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37f05514-59a7-4ca0-899e-1fc93625d47a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:17.303261 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-37f05514-59a7-4ca0-899e-1fc93625d47a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.019906 Oct 28 09:50:17.309615 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 25/46] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:50:17.320409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-839400f5-3cb4-42c3-b534-fea08f7b6fcc tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1648023699"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.325487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-839400f5-3cb4-42c3-b534-fea08f7b6fcc tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'ea106b2a3de84ea28bbad06ca62f2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf7a1694754ab495d0630ae8580735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-839400f5-3cb4-42c3-b534-fea08f7b6fcc tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Request method failure captured: Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 60 Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPSs5qhJlsw8eHmcmcTjPxHbGEVmOoUUERozWH4lMEbyqnh77szjDMeH3C45oqpIAjq7wCS_d5TVR5S5WVI0nBeHatpyPaNOk-2Bqk3_C9ckJTyF2Tb831YRqc_OsAJAA5WOcAHILpADM-EnORnFIBEpzKE6qz3tixzirTVe2KjYE Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:50:17.328986 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4bf7a1694754ab495d0630ae8580735", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4bf7a1694754ab495d0630ae8580735"}]}] Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: ea106b2a3de84ea28bbad06ca62f2bda Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: {"aggregate": {"name": "tempest-test_aggregate-1648023699"}} Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:17.330160 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1648023699'}}} Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:17.330849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:17.331791 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 28 09:50:17.332818 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.334518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-839400f5-3cb4-42c3-b534-fea08f7b6fcc tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:17.335636 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-839400f5-3cb4-42c3-b534-fea08f7b6fcc tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.023277 Oct 28 09:50:17.336500 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 26/47] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:17.360245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb7de48f-ebbd-49dd-ba79-2a4b3a518710 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-564528357"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.370908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-fb7de48f-ebbd-49dd-ba79-2a4b3a518710 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid b31a150a-b117-426f-a3c7-6c48f52ac4d6 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:17.432941 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb7de48f-ebbd-49dd-ba79-2a4b3a518710 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.089985 Oct 28 09:50:17.436107 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 27/48] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:17.454730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de4f9cf3-722c-4548-a91e-c098fddf72e3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-564528357"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.466058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-de4f9cf3-722c-4548-a91e-c098fddf72e3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid 51448dfb-d8bd-4ee8-ac6c-f2d70079f9a2 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:17.494736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-de4f9cf3-722c-4548-a91e-c098fddf72e3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-564528357 already exists. Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de4f9cf3-722c-4548-a91e-c098fddf72e3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 59 Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:17.501374 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: {"aggregate": {"name": "tempest-test_aggregate-564528357"}} Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:17.502514 n-d-zed-1 devstack@n-api.service[128748]: exception: Aggregate tempest-test_aggregate-564528357 already exists. Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-564528357'}}} Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 28 09:50:17.503169 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-564528357 already exists. Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:17.504122 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-564528357 already exists. Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-564528357 already exists. Oct 28 09:50:17.505144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:17.511568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de4f9cf3-722c-4548-a91e-c098fddf72e3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-564528357 already exists. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:17.525593 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de4f9cf3-722c-4548-a91e-c098fddf72e3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.074922 Oct 28 09:50:17.527385 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 28/49] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 84 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:50:17.548608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ebc94eba-f7e1-44d0-a9e3-c973e8aa9d88 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.551582 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dd76acda-1ae2-44f7-be97-ad1014950226 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.496468 Oct 28 09:50:17.555214 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 22/50] 10.222.0.16 () {62 vars in 1232 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:17.573442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-560a2c7c-a9f6-46e4-b6a3-96b761e7e673 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.643374 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-560a2c7c-a9f6-46e4-b6a3-96b761e7e673 tempest-AggregatesAdminTestV241-1363960746 tempest-AggregatesAdminTestV241-1363960746-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.078361 Oct 28 09:50:17.646475 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 23/51] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 09:50:17 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:17.660851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:17.662012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:17.668765 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ebc94eba-f7e1-44d0-a9e3-c973e8aa9d88 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.135718 Oct 28 09:50:17.671943 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 29/52] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:17 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:50:17.681195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.682208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.686141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.687358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:17.689507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:17.690282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:17.693569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-98fec1ad-a692-4888-a932-31d73b280d33 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-703806877", "name": "tempest-test_aggregate-1486051685"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.741788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-98fec1ad-a692-4888-a932-31d73b280d33 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid 0423bcac-783c-4ccc-a124-b0f7176ba410 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:17.833633 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-98fec1ad-a692-4888-a932-31d73b280d33 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.155734 Oct 28 09:50:17.837820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 30/53] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:17.850601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4eaa7ba-e5d9-4074-8463-f31fdbef117f tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1829393711"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:17.858090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-f4eaa7ba-e5d9-4074-8463-f31fdbef117f tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid 6185dc8b-5ad6-4133-b067-80216f2effe5 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:17.957228 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4eaa7ba-e5d9-4074-8463-f31fdbef117f tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.114206 Oct 28 09:50:17.971475 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 31/54] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:17.996241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f3533d8-bfde-4631-997f-d1132ac9501a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.064593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:18.091193 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2f8a461d-6900-484d-95e7-f59afc4a2f24 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1271 microversion: 2.1 time: 0.436796 Oct 28 09:50:18.092469 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 24/55] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:17 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1271 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:18.094770 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f3533d8-bfde-4631-997f-d1132ac9501a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 515 microversion: 2.1 time: 0.121075 Oct 28 09:50:18.095820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 32/56] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:50:17 2022] GET /compute/v2.1/os-aggregates => generated 515 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:18.102149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-477f7362-b043-4c95-a852-fe0618d3e737 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.104247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-477f7362-b043-4c95-a852-fe0618d3e737 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'ea106b2a3de84ea28bbad06ca62f2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf7a1694754ab495d0630ae8580735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-477f7362-b043-4c95-a852-fe0618d3e737 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Request method failure captured: Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPSs5qhJlsw8eHmcmcTjPxHbGEVmOoUUERozWH4lMEbyqnh77szjDMeH3C45oqpIAjq7wCS_d5TVR5S5WVI0nBeHatpyPaNOk-2Bqk3_C9ckJTyF2Tb831YRqc_OsAJAA5WOcAHILpADM-EnORnFIBEpzKE6qz3tixzirTVe2KjYE Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:50:18.127738 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4bf7a1694754ab495d0630ae8580735", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4bf7a1694754ab495d0630ae8580735"}]}] Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: ea106b2a3de84ea28bbad06ca62f2bda Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 09:50:18.128977 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7'} Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:18.129605 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 28 09:50:18.130535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.134100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-477f7362-b043-4c95-a852-fe0618d3e737 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:18.136190 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-477f7362-b043-4c95-a852-fe0618d3e737 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.041402 Oct 28 09:50:18.139195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.140881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:18.146480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 25/57] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 52 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:18.164735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d40d63aa-ea3d-40cb-8974-86a0aba1cc92 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:18.176562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:18.179426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:18.180608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:18.182742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:18.185983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:18.190562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:18.195350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d40d63aa-ea3d-40cb-8974-86a0aba1cc92 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:18.196892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d40d63aa-ea3d-40cb-8974-86a0aba1cc92 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:18.204570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d40d63aa-ea3d-40cb-8974-86a0aba1cc92 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:18.471432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:18.506882 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5bed58f-1773-495f-9362-312fb57b7c3d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1278 microversion: 2.1 time: 0.389307 Oct 28 09:50:18.530477 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 33/58] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:18 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1278 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:18.550905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9dabbc97-761f-4cf1-80bd-3405eb8be3f7 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.671733 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9dabbc97-761f-4cf1-80bd-3405eb8be3f7 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.133152 Oct 28 09:50:18.672491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 34/59] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:50:18.678433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d40d63aa-ea3d-40cb-8974-86a0aba1cc92 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 310 microversion: 2.1 time: 0.527153 Oct 28 09:50:18.685239 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 26/60] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:50:18 2022] POST /compute/v2.1/os-aggregates/6/action => generated 310 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:18.693932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e00ed63-71fb-4dbf-a97f-7bdf85f37fb8 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.735900 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-5e00ed63-71fb-4dbf-a97f-7bdf85f37fb8 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e00ed63-71fb-4dbf-a97f-7bdf85f37fb8 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:18.742672 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: exception: Aggregate -1 could not be found. Oct 28 09:50:18.744594 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '-1'} Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 09:50:18.745922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.747300 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.748599 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.748599 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.748599 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:18.748599 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:18.748599 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 09:50:18.748599 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.748599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e00ed63-71fb-4dbf-a97f-7bdf85f37fb8 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:18.755692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e00ed63-71fb-4dbf-a97f-7bdf85f37fb8 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.068540 Oct 28 09:50:18.755692 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 35/61] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:50:18 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:50:18.759535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2215957-5ac7-44d1-ab13-f764b4f13a90 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-485782507"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:18.764294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-e2215957-5ac7-44d1-ab13-f764b4f13a90 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid 3e175764-11aa-4372-af56-cf9a4d457a5b for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:50:18.825247 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2215957-5ac7-44d1-ab13-f764b4f13a90 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.069631 Oct 28 09:50:18.827959 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 27/62] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:50:18 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:18.839531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-506a6994-f0c0-4b4c-8107-d7389589fa8e tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.843355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-506a6994-f0c0-4b4c-8107-d7389589fa8e tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'ea106b2a3de84ea28bbad06ca62f2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf7a1694754ab495d0630ae8580735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-506a6994-f0c0-4b4c-8107-d7389589fa8e tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Request method failure captured: Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPSs5qhJlsw8eHmcmcTjPxHbGEVmOoUUERozWH4lMEbyqnh77szjDMeH3C45oqpIAjq7wCS_d5TVR5S5WVI0nBeHatpyPaNOk-2Bqk3_C9ckJTyF2Tb831YRqc_OsAJAA5WOcAHILpADM-EnORnFIBEpzKE6qz3tixzirTVe2KjYE Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:50:18.845629 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4bf7a1694754ab495d0630ae8580735", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4bf7a1694754ab495d0630ae8580735"}]}] Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: ea106b2a3de84ea28bbad06ca62f2bda Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 09:50:18.848222 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '8'} Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:18.850132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.853704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-506a6994-f0c0-4b4c-8107-d7389589fa8e tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:18.856820 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-506a6994-f0c0-4b4c-8107-d7389589fa8e tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.011715 Oct 28 09:50:18.856820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 36/63] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 09:50:18 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:18.857846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7a315de-9f4e-417f-9f07-b0cec8d67d6a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.905905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7a315de-9f4e-417f-9f07-b0cec8d67d6a tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.053382 Oct 28 09:50:18.907331 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 28/64] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:18 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:50:18.923086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e9e7656-5af7-43a8-8d64-a40523f2cdf3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:18.965249 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-0e9e7656-5af7-43a8-8d64-a40523f2cdf3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e9e7656-5af7-43a8-8d64-a40523f2cdf3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:18.976097 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: exception: Aggregate -1 could not be found. Oct 28 09:50:18.978408 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '-1'} Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.979243 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 28 09:50:18.980675 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:18.984840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e9e7656-5af7-43a8-8d64-a40523f2cdf3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:18.986445 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e9e7656-5af7-43a8-8d64-a40523f2cdf3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.071753 Oct 28 09:50:19.002609 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 37/65] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:50:18 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:50:19.016487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f4498d4-85ea-49a1-96ec-279cf5c471a0 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:19.018600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8f4498d4-85ea-49a1-96ec-279cf5c471a0 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'ea106b2a3de84ea28bbad06ca62f2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf7a1694754ab495d0630ae8580735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f4498d4-85ea-49a1-96ec-279cf5c471a0 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Request method failure captured: Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPSs5qhJlsw8eHmcmcTjPxHbGEVmOoUUERozWH4lMEbyqnh77szjDMeH3C45oqpIAjq7wCS_d5TVR5S5WVI0nBeHatpyPaNOk-2Bqk3_C9ckJTyF2Tb831YRqc_OsAJAA5WOcAHILpADM-EnORnFIBEpzKE6qz3tixzirTVe2KjYE Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:50:19.021755 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4bf7a1694754ab495d0630ae8580735", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4bf7a1694754ab495d0630ae8580735"}]}] Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: ea106b2a3de84ea28bbad06ca62f2bda Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 09:50:19.022882 n-d-zed-1 devstack@n-api.service[128748]: action_args: {} Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:19.023582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 28 09:50:19.024667 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:19.027199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f4498d4-85ea-49a1-96ec-279cf5c471a0 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:19.028405 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8f4498d4-85ea-49a1-96ec-279cf5c471a0 tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.021878 Oct 28 09:50:19.031643 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 38/66] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:50:19 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:19.123541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:19.124958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:19.136577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.141639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.143069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:19.144149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.146158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.147989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:19.438150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1420730663", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "availability_zone": "tempest-test_az-703806877"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:19.480969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.484395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.486247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:19.489080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.490599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.493415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:19.625661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:19.652515 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47d5e3d1-e1b3-4b49-b840-c43072dfde73 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1271 microversion: 2.1 time: 0.527525 Oct 28 09:50:19.653495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 39/67] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:19 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1271 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:19.659339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:19.663197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:19.664845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:50:19.684549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.689402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.694338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:19.696245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:19.703497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:19.709129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:20.103122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:20.147651 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dcef99c3-8e89-4036-9999-3e7c9855e5a8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1278 microversion: 2.1 time: 0.490364 Oct 28 09:50:20.153033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 40/68] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:19 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1278 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:20.293986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:50:20.294612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:50:20.295001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:50:20.296002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:50:20.296510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:50:20.315255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:20.315845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:20.316294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:20.322246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:20.323098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:20.323618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:20.379266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Getting quotas for project f75fc6889d564010966a8f1806d0d93d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:20.393482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Getting quotas for user c5991ee8e3634d2f9b3a355ba48ffecc and project f75fc6889d564010966a8f1806d0d93d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:20.439200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:50:20.445878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:50:20.596848 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99cfdfed-2af6-4e5c-b0cd-395dd137e49d tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597660 Oct 28 09:50:20.596848 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 29/69] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:50:20.610218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-703a5e0d-7434-4b62-944c-94c0b9bdb2b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:20.611270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-703a5e0d-7434-4b62-944c-94c0b9bdb2b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:20.678352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:20.679269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:20.691030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:20.694470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:20.694944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:20.695701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:20.696166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:20.696609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:21.211819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:21.226077 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0535893c-7215-4197-9cd8-cd8daf8aa7c8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.550151 Oct 28 09:50:21.228617 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 30/70] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:20 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:21.240891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:21.244366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:21.267345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:21.268408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:21.268741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:21.269545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:21.270018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:21.272874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:21.323282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-703a5e0d-7434-4b62-944c-94c0b9bdb2b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:21.369245 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-703a5e0d-7434-4b62-944c-94c0b9bdb2b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1242 microversion: 2.1 time: 0.767846 Oct 28 09:50:21.376679 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 41/71] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:20 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1242 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:22.255073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:22.255073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:22.280924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:22.281536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:22.282100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:22.305631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:22.310044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:22.313332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.103459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:23.129873 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8776c841-c6e9-458d-ab7b-a99b593a5ae9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 1.899954 Oct 28 09:50:23.130497 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 31/72] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:21 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:23.153974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:23.155310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:23.161088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=9,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:23.177691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:23.179596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:23.181775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.184982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:23.188483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:23.192466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:23.499002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:23.518164 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c815733-2005-4983-856c-da8a38dc76a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 1.269469 Oct 28 09:50:23.521472 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 42/73] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:22 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:23.703610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:23.740573 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6868ef9c-3934-4d42-b087-3973a38d01f9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1290 microversion: 2.1 time: 0.605511 Oct 28 09:50:23.744388 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 32/74] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:23 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1290 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:24.164641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:24.181548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:24.225071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:24.226116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:24.226798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:24.238426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:24.243155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:24.244177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:24.574146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:24.575235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:24.600169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:24.609329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:24.610422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:24.611800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:24.612557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:24.613194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:25.979225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.048510 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38afcffb-99d9-4750-8871-3a31723b8928 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 1.892090 Oct 28 09:50:26.065378 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 43/75] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:24 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:26.090957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:26.096461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:26.135804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:26.137754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:26.158667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:26.159873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:26.160644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:26.171841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:26.975954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:26.991872 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62348968-ee0b-4152-be71-994e99c59db9 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1296 microversion: 2.1 time: 0.924253 Oct 28 09:50:26.992777 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 44/76] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:26 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1296 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:27.118019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:27.125614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:27.153720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:27.164802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:27.165835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:27.169322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:27.177118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:27.181868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:27.182607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:27.453758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:27.510597 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24963cfe-4261-49fa-abb9-36fa968430d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 2.944761 Oct 28 09:50:27.563724 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 33/77] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:24 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 2999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:28.026210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:28.027834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:28.057802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:28.060920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:28.062662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:28.068676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:28.071345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:28.073810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:28.341202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:28.351538 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3ec94385-ac19-4411-8b18-94348f4220a5 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1296 microversion: 2.1 time: 0.339256 Oct 28 09:50:28.384238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 34/78] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:28 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1296 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:28.911000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-94c19951-b3b2-49bc-a728-2571f8cb40c0 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1024756957", "ram": 512, "vcpus": 1, "disk": 10, "id": 1654798288, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:28.948482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:28.957212 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-94c19951-b3b2-49bc-a728-2571f8cb40c0 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.397173 Oct 28 09:50:28.966551 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 35/79] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:28 2022] POST /compute/v2.1/flavors => generated 416 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:28.981209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:28.985554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:28.993479 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-413ddd66-de1b-4a62-a292-238f0566eec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 1.880950 Oct 28 09:50:29.001702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:29.005562 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 45/80] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:27 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:29.021676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:29.023043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:29.033055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:29.034669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:29.035905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:29.883858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-195fa4b9-81ea-4945-b5a3-02cc32209fe4 req-17d02cb0-bbb0-485d-8fff-ce1b766ff67b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bd5953d-2698-4320-9718-92a54a912d0e", "tag": "e1d61a80-ac87-4d99-8dc5-95ad0b6cfb45"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:29.938455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-195fa4b9-81ea-4945-b5a3-02cc32209fe4 req-17d02cb0-bbb0-485d-8fff-ce1b766ff67b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:29.952349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-195fa4b9-81ea-4945-b5a3-02cc32209fe4 req-17d02cb0-bbb0-485d-8fff-ce1b766ff67b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:29.953572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-195fa4b9-81ea-4945-b5a3-02cc32209fe4 req-17d02cb0-bbb0-485d-8fff-ce1b766ff67b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:30.069316 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-195fa4b9-81ea-4945-b5a3-02cc32209fe4 req-17d02cb0-bbb0-485d-8fff-ce1b766ff67b service nova] Creating event network-changed:e1d61a80-ac87-4d99-8dc5-95ad0b6cfb45 for instance 5bd5953d-2698-4320-9718-92a54a912d0e on n-h2-zed-1 Oct 28 09:50:30.072205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-195fa4b9-81ea-4945-b5a3-02cc32209fe4 req-17d02cb0-bbb0-485d-8fff-ce1b766ff67b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 09:50:30.072846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-195fa4b9-81ea-4945-b5a3-02cc32209fe4 req-17d02cb0-bbb0-485d-8fff-ce1b766ff67b service nova] Acquired lock "compute-rpcapi-router" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 09:50:30.082011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:30.083008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:30.083789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:30.094110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:30.095006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:30.095892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:30.146984 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.rpcapi [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 09:50:30.151672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] Releasing lock "compute-rpcapi-router" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 09:50:30.210886 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c7fe2c4-b22f-4f08-9cc4-c3729e75d9ab None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.202831 Oct 28 09:50:30.219561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 46/81] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:30.346664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:30.416859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=20 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:30.785725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:30.804168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12310e65-0534-4e4b-9aa5-bfecc8a14a2e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 1.832730 Oct 28 09:50:30.808112 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 36/82] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:28 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 1841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:30.831716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:30.839766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:30.861484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:30.862621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:30.864420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:30.866761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:30.867692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:30.868755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:31.120222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a96d126e-bbe1-4c88-87a0-2206fd0b8f15 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.188709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a96d126e-bbe1-4c88-87a0-2206fd0b8f15 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] HTTP exception thrown: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a96d126e-bbe1-4c88-87a0-2206fd0b8f15 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Request method failure captured: Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/flavors/1654798288/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XhJSFnC-qZzww53C1WdTCXx55dJ9QEx62bETixKE59aNSUMRpX49ILr3Lc6KNOv_rqIm7S3gYsoDUGWDYF4E_DnwG0tcDr_AwJcs9vn9HifGThqjQZbUbOCL1YDfOALoQ0__dryucEQSvMe1E_bCEzneUy2D1JwtNs9aISC4AZIQU Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:50:31.207714 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6953e96131d3458fadd730f1f83307a9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6953e96131d3458fadd730f1f83307a9"}]}] Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: cd8355b7da04450080c2cc59ab5b5857 Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:31.210361 n-d-zed-1 devstack@n-api.service[128748]: exception: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'flavor_id': '1654798288', 'id': 'hw:cpu_thread_policy'} Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:31.211909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.214568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.214568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.214568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.214568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:31.214568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:31.214568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.214568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.221159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a96d126e-bbe1-4c88-87a0-2206fd0b8f15 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Returning 404 to user: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:31.223713 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a96d126e-bbe1-4c88-87a0-2206fd0b8f15 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] 10.222.0.16 "GET /compute/v2.1/flavors/1654798288/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.998924 Oct 28 09:50:31.232848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 47/83] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 09:50:30 2022] GET /compute/v2.1/flavors/1654798288/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 1004 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:31.267372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.268389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:31.280211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:31.281608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:31.282578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:31.283860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:31.284844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:31.285896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:31.312434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.339453 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb6f4f9a-474f-4146-94ec-a02d11c35f79 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1296 microversion: 2.1 time: 0.529432 Oct 28 09:50:31.340294 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 37/84] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:30 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1296 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:31.374275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:31.383502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6490b5c0-1ed9-4a70-be71-59c1a436ed57 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:31.395702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6490b5c0-1ed9-4a70-be71-59c1a436ed57 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'cd8355b7da04450080c2cc59ab5b5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6953e96131d3458fadd730f1f83307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6490b5c0-1ed9-4a70-be71-59c1a436ed57 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Request method failure captured: Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/flavors/1654798288/os-extra_specs HTTP/1.1 Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 66 Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XhJSFnC-qZzww53C1WdTCXx55dJ9QEx62bETixKE59aNSUMRpX49ILr3Lc6KNOv_rqIm7S3gYsoDUGWDYF4E_DnwG0tcDr_AwJcs9vn9HifGThqjQZbUbOCL1YDfOALoQ0__dryucEQSvMe1E_bCEzneUy2D1JwtNs9aISC4AZIQU Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:50:31.423988 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6953e96131d3458fadd730f1f83307a9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6953e96131d3458fadd730f1f83307a9"}]}] Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: cd8355b7da04450080c2cc59ab5b5857 Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 28 09:50:31.426664 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'flavor_id': '1654798288', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:31.427987 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 28 09:50:31.430013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.454993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6490b5c0-1ed9-4a70-be71-59c1a436ed57 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:31.462147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6490b5c0-1ed9-4a70-be71-59c1a436ed57 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] 10.222.0.16 "POST /compute/v2.1/flavors/1654798288/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.096854 Oct 28 09:50:31.469992 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 38/85] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 09:50:31 2022] POST /compute/v2.1/flavors/1654798288/os-extra_specs => generated 124 bytes in 100 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:31.486600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb0bfbd1-22f6-4e1f-a314-aeb3f9553d49 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:31.625961 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb0bfbd1-22f6-4e1f-a314-aeb3f9553d49 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1654798288/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.153975 Oct 28 09:50:31.637784 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 39/86] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 09:50:31 2022] POST /compute/v2.1/flavors/1654798288/os-extra_specs => generated 66 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:31.653254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f17f408f-597e-4166-aeb3-2030ead61627 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.669331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f17f408f-597e-4166-aeb3-2030ead61627 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'cd8355b7da04450080c2cc59ab5b5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6953e96131d3458fadd730f1f83307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f17f408f-597e-4166-aeb3-2030ead61627 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Request method failure captured: Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XhJSFnC-qZzww53C1WdTCXx55dJ9QEx62bETixKE59aNSUMRpX49ILr3Lc6KNOv_rqIm7S3gYsoDUGWDYF4E_DnwG0tcDr_AwJcs9vn9HifGThqjQZbUbOCL1YDfOALoQ0__dryucEQSvMe1E_bCEzneUy2D1JwtNs9aISC4AZIQU Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:50:31.672301 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6953e96131d3458fadd730f1f83307a9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6953e96131d3458fadd730f1f83307a9"}]}] Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: cd8355b7da04450080c2cc59ab5b5857 Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:50:31.673766 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'flavor_id': '1654798288', 'id': 'hw:numa_nodes'} Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:31.674535 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 28 09:50:31.675845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.681381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f17f408f-597e-4166-aeb3-2030ead61627 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:31.682731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f17f408f-597e-4166-aeb3-2030ead61627 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] 10.222.0.16 "DELETE /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.039392 Oct 28 09:50:31.684240 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 40/87] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 09:50:31 2022] DELETE /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes => generated 124 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:31.700441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31799a01-4f6d-4862-ad30-8ac8cf439408 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:31.784372 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31799a01-4f6d-4862-ad30-8ac8cf439408 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1654798288/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.087703 Oct 28 09:50:31.795722 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 41/88] 10.222.0.16 () {60 vars in 1224 bytes} [Fri Oct 28 09:50:31 2022] POST /compute/v2.1/flavors/1654798288/os-extra_specs => generated 66 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:31.802395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e98b4d0-2376-4a32-83ea-56ae7842d985 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:31.820353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0e98b4d0-2376-4a32-83ea-56ae7842d985 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'cd8355b7da04450080c2cc59ab5b5857', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6953e96131d3458fadd730f1f83307a9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e98b4d0-2376-4a32-83ea-56ae7842d985 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Request method failure captured: Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: request: PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 22 Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XhJSFnC-qZzww53C1WdTCXx55dJ9QEx62bETixKE59aNSUMRpX49ILr3Lc6KNOv_rqIm7S3gYsoDUGWDYF4E_DnwG0tcDr_AwJcs9vn9HifGThqjQZbUbOCL1YDfOALoQ0__dryucEQSvMe1E_bCEzneUy2D1JwtNs9aISC4AZIQU Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:50:31.822411 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6953e96131d3458fadd730f1f83307a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6953e96131d3458fadd730f1f83307a9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6953e96131d3458fadd730f1f83307a9"}]}] Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 6953e96131d3458fadd730f1f83307a9 Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: cd8355b7da04450080c2cc59ab5b5857 Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: {"hw:numa_nodes": "1"} Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:50:31.823564 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'flavor_id': '1654798288', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:50:31.824447 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 28 09:50:31.825803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.831196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e98b4d0-2376-4a32-83ea-56ae7842d985 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:31.832418 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e98b4d0-2376-4a32-83ea-56ae7842d985 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604 tempest-FlavorsExtraSpecsNegativeTestJSON-790961604-project] 10.222.0.16 "PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.035317 Oct 28 09:50:31.842896 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 42/89] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 09:50:31 2022] PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes => generated 124 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:31.848316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1612593-65be-4270-b4fc-5a95f52038dc tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.873849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:31.889253 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e1612593-65be-4270-b4fc-5a95f52038dc tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] HTTP exception thrown: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1612593-65be-4270-b4fc-5a95f52038dc tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Request method failure captured: Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/flavors/1654798288/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XjneNorWcuWWVhRvNFwW821LYox86eM5yovjeW_pLwIVdjPQOoMcZki5mAnmuyj5RiZNaUJ1JUQt3QlP_GfLCDvTjl3CJsO5-irKy4TtPHmVTAvq2FR8un-3vaVZKK96Ua3VExKFgCmxww_DJ5FmrRUIuV1-jTjJNNnS68cDa-4j0 Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: c78a88291147438bb1af6d84f4771343 Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:50:31.898238 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c78a88291147438bb1af6d84f4771343"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c78a88291147438bb1af6d84f4771343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c78a88291147438bb1af6d84f4771343", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c78a88291147438bb1af6d84f4771343"}]}] Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: c78a88291147438bb1af6d84f4771343 Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8ffa907aef9a44918a14845e1171c7d3 Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:50:31.899499 n-d-zed-1 devstack@n-api.service[128747]: exception: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'flavor_id': '1654798288', 'id': 'hw:cpu_thread_policy'} Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:31.900083 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.901360 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:31.901360 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:31.901360 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:31.901360 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:31.901360 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:31.901360 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. Oct 28 09:50:31.901360 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:50:31.910100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1612593-65be-4270-b4fc-5a95f52038dc tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Returning 404 to user: Flavor 1654798288 has no extra specs with key hw:cpu_thread_policy. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:31.911482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1612593-65be-4270-b4fc-5a95f52038dc tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1654798288/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.067432 Oct 28 09:50:31.921739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 43/90] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:50:31 2022] DELETE /compute/v2.1/flavors/1654798288/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:50:31.924247 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63321d6f-c499-4459-b927-b0a50877cea8 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.686433 Oct 28 09:50:31.928690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:31.931505 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 48/91] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:31 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:31.936622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:31.959960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:31.963599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:31.969944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:31.973494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:31.979879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:31.980658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:31.989287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9cd9c06-187e-492b-b60a-9db93ab5fb31 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:32.018283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a9cd9c06-187e-492b-b60a-9db93ab5fb31 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9cd9c06-187e-492b-b60a-9db93ab5fb31 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Request method failure captured: Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 27 Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XjneNorWcuWWVhRvNFwW821LYox86eM5yovjeW_pLwIVdjPQOoMcZki5mAnmuyj5RiZNaUJ1JUQt3QlP_GfLCDvTjl3CJsO5-irKy4TtPHmVTAvq2FR8un-3vaVZKK96Ua3VExKFgCmxww_DJ5FmrRUIuV1-jTjJNNnS68cDa-4j0 Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: c78a88291147438bb1af6d84f4771343 Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:32.028152 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c78a88291147438bb1af6d84f4771343"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c78a88291147438bb1af6d84f4771343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c78a88291147438bb1af6d84f4771343", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c78a88291147438bb1af6d84f4771343"}]}] Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: c78a88291147438bb1af6d84f4771343 Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8ffa907aef9a44918a14845e1171c7d3 Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: {"hw:cpu_policy": "shared"} Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:32.030847 n-d-zed-1 devstack@n-api.service[128748]: exception: Request body and URI mismatch Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'flavor_id': '1654798288', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:32.032280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:32.034641 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:50:32.034641 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:50:32.034641 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 28 09:50:32.034641 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.047229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9cd9c06-187e-492b-b60a-9db93ab5fb31 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:32.067909 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a9cd9c06-187e-492b-b60a-9db93ab5fb31 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.094295 Oct 28 09:50:32.070734 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 49/92] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 09:50:31 2022] PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes => generated 73 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:50:32.103953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a15073a3-ae92-463e-83c4-0c7243cc5c04 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a15073a3-ae92-463e-83c4-0c7243cc5c04 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Request method failure captured: Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 49 Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XjneNorWcuWWVhRvNFwW821LYox86eM5yovjeW_pLwIVdjPQOoMcZki5mAnmuyj5RiZNaUJ1JUQt3QlP_GfLCDvTjl3CJsO5-irKy4TtPHmVTAvq2FR8un-3vaVZKK96Ua3VExKFgCmxww_DJ5FmrRUIuV1-jTjJNNnS68cDa-4j0 Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: c78a88291147438bb1af6d84f4771343 Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:50:32.125634 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c78a88291147438bb1af6d84f4771343"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c78a88291147438bb1af6d84f4771343"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c78a88291147438bb1af6d84f4771343", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c78a88291147438bb1af6d84f4771343"}]}] Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: c78a88291147438bb1af6d84f4771343 Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8ffa907aef9a44918a14845e1171c7d3 Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 28 09:50:32.129077 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'flavor_id': '1654798288', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance: Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 28 09:50:32.130497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.133052 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a15073a3-ae92-463e-83c4-0c7243cc5c04 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:50:32.140419 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a15073a3-ae92-463e-83c4-0c7243cc5c04 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.060252 Oct 28 09:50:32.144740 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 50/93] 10.222.0.16 () {60 vars in 1265 bytes} [Fri Oct 28 09:50:32 2022] PUT /compute/v2.1/flavors/1654798288/os-extra_specs/hw:numa_nodes => generated 117 bytes in 68 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:50:32.192994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-029d82f6-1997-4eda-ae8d-36242596cb4b tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:32.325324 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-029d82f6-1997-4eda-ae8d-36242596cb4b tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1654798288" status: 202 len: 0 microversion: 2.1 time: 0.178070 Oct 28 09:50:32.347812 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 51/94] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:50:32 2022] DELETE /compute/v2.1/flavors/1654798288 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:32.378236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef8a0920-9aef-4eb1-bb4f-c9577decf0c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:32.514452 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef8a0920-9aef-4eb1-bb4f-c9577decf0c2 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616 tempest-FlavorsExtraSpecsNegativeTestJSON-1839526616-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.158002 Oct 28 09:50:32.516201 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 52/95] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:50:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:32.558691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:32.560725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:32.610972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:32.612329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:32.622139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:32.623333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:32.624007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:32.633485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:33.134276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:33.192812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9759a02f-62f0-462e-8312-2e9032d1c13a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1296 microversion: 2.1 time: 0.674288 Oct 28 09:50:33.203118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 53/96] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:32 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1296 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:33.236702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:33.244429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:33.286077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:33.287669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:33.292166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:33.296776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:33.300665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:33.309450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:35.540130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.582993 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f9d867b-1a62-4fd2-a1c4-680848fab83d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 3.659095 Oct 28 09:50:35.585036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 44/97] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:31 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 3662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:35.612179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:35.618970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:35.627326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:35.651225 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0af2143-e1ac-484f-8035-11262b3fd28e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 2.438105 Oct 28 09:50:35.658377 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 54/98] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:33 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 2457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:35.671862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:35.695071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:35.709282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:35.717934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:35.718791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:35.719603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:35.810971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:35.869805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:35.879893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:35.880873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:35.886138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:35.890662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:35.897825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:35.903498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:36.039081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-122a041d-bf23-437a-9df9-4ce273c3cc27 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 189 microversion: 2.1 time: 0.367172 Oct 28 09:50:36.052414 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 55/99] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 09:50:35 2022] GET /compute/v2.1/os-availability-zone => generated 189 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:36.287804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6db596d0-5bc9-4b73-8680-938cf0c8e77b req-f3898ef4-fab5-4eec-8c45-f448aecf9f60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b81b164-bda6-4231-a396-be286a5310eb", "tag": "f6376f13-2a79-40aa-bfb5-de1526dc5507"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:36.326845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6db596d0-5bc9-4b73-8680-938cf0c8e77b req-f3898ef4-fab5-4eec-8c45-f448aecf9f60 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:36.328173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6db596d0-5bc9-4b73-8680-938cf0c8e77b req-f3898ef4-fab5-4eec-8c45-f448aecf9f60 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:36.329202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6db596d0-5bc9-4b73-8680-938cf0c8e77b req-f3898ef4-fab5-4eec-8c45-f448aecf9f60 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:36.397451 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6db596d0-5bc9-4b73-8680-938cf0c8e77b req-f3898ef4-fab5-4eec-8c45-f448aecf9f60 service nova] Creating event network-changed:f6376f13-2a79-40aa-bfb5-de1526dc5507 for instance 1b81b164-bda6-4231-a396-be286a5310eb on n-h2-zed-1 Oct 28 09:50:36.426248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6db596d0-5bc9-4b73-8680-938cf0c8e77b req-f3898ef4-fab5-4eec-8c45-f448aecf9f60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.367359 Oct 28 09:50:36.432401 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 56/100] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:36.456833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:36.467085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:36.476970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:36.490122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:36.492015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:36.493721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:36.497361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:36.642072 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b825d1f5-fa42-4baf-bde8-f94e621f03f9 tempest-AZAdminV2TestJSON-2139617915 tempest-AZAdminV2TestJSON-2139617915-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 691 microversion: 2.1 time: 0.206962 Oct 28 09:50:36.665649 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 57/101] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 09:50:36 2022] GET /compute/v2.1/os-availability-zone/detail => generated 691 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:36.698073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:36.698073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:36.738664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:36.740344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:36.744677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:36.746433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:36.752242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:36.755187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:37.456996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:37.509801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b056c3d-fa84-4840-8024-0cd449661964 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.836812 Oct 28 09:50:37.512609 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 58/102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:36 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:37.538989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:37.543458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:37.571723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:37.574156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:37.578777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:37.585149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:37.591969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:37.594762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:37.628736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:38.032724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:38.076183 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c14f25d8-8156-4943-afff-73e284eb7bc2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.559226 Oct 28 09:50:38.089922 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 59/103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:37 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:38.449902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:38.468409 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3286813-4be1-42d6-a9b1-09d16aa9793e tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 2.875121 Oct 28 09:50:38.484953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 45/104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:35 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 2899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:38.541529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:38.542730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:38.556288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:38.557408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:38.559347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:38.561778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:38.563710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:38.564659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:38.956791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:38.983045 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-78cd0a2f-2ee7-4746-883c-0a74bb009664 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.445186 Oct 28 09:50:38.990395 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 60/105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:38 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:39.142704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:39.144286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:39.161091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:39.161648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:39.162145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:39.162922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:39.163390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:39.163815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:39.504695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:39.506716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:39.538942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:39.539747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:39.540446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:39.541431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:39.542200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:39.549182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:39.897596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:39.934368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06d30073-72bb-4bfd-a23f-8b2b57428089 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.443784 Oct 28 09:50:39.957174 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 61/106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:39 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:40.043155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:40.044341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:40.066716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:40.068667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:40.069931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:40.070905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:40.073810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:40.074518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:40.075093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:40.084622 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2411ee2f-3c73-4ee4-b663-eee91e56c070 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.953737 Oct 28 09:50:40.089475 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 46/107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:39 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:40.555844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:40.581421 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e67b1433-e087-4c68-9365-ab0d385a4045 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.561064 Oct 28 09:50:40.583581 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 62/108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:40 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:40.978635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:40.979843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:40.989857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:40.990832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:40.991535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:40.992529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:40.994210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:40.995557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:41.134890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:41.136817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:41.141890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=9,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:41.160479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:41.161247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:41.161779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:41.162611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:41.163157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:41.164164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:41.455513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:41.465071 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9261fb37-f054-4f1d-a23c-7d3d36ffc7a0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.340191 Oct 28 09:50:41.485332 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 63/109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:41 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:41.609194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:41.609973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:41.622307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:41.625551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:41.626185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:41.627538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:41.637391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:41.639248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:41.770336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:41.791625 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f5adbb8-8877-45a3-acc0-d2c2bd84fd84 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.826065 Oct 28 09:50:41.799044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 47/110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:40 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:42.131465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8aab1f37-3ccc-427b-9e47-4453571d45f3 req-1039e2ce-639e-45a3-8b55-e7ed84c31b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33d7b717-7a10-4e29-bc21-e1900a97f1f0", "tag": "120633ec-c1e2-47f7-a7bd-a7eccc51525b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:42.164645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8aab1f37-3ccc-427b-9e47-4453571d45f3 req-1039e2ce-639e-45a3-8b55-e7ed84c31b34 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.168810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8aab1f37-3ccc-427b-9e47-4453571d45f3 req-1039e2ce-639e-45a3-8b55-e7ed84c31b34 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.169918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8aab1f37-3ccc-427b-9e47-4453571d45f3 req-1039e2ce-639e-45a3-8b55-e7ed84c31b34 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.233177 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8aab1f37-3ccc-427b-9e47-4453571d45f3 req-1039e2ce-639e-45a3-8b55-e7ed84c31b34 service nova] Creating event network-changed:120633ec-c1e2-47f7-a7bd-a7eccc51525b for instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 on n-h1-zed-1 Oct 28 09:50:42.239106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8aab1f37-3ccc-427b-9e47-4453571d45f3 req-1039e2ce-639e-45a3-8b55-e7ed84c31b34 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 09:50:42.239826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8aab1f37-3ccc-427b-9e47-4453571d45f3 req-1039e2ce-639e-45a3-8b55-e7ed84c31b34 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 09:50:42.241215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.244740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.255491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.256606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.260370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.261745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.290385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.compute.rpcapi [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 28 09:50:42.291723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] Releasing lock "compute-rpcapi-router" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 09:50:42.320040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:42.322044 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83c679dd-a928-4609-a1f3-3a404d1e6491 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196148 Oct 28 09:50:42.323153 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 48/111] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:42.343880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d348c3ec-f4e0-4b47-9ea7-b08784ee9266 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.738841 Oct 28 09:50:42.348046 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 64/112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:41 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:42.493904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:42.494788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:42.507115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.508234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.513915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.515118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.515851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.516824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.845586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:42.847578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:42.882627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.883906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.884692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:42.885977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:42.886697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:42.887340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:43.879892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:43.888446 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a9cfdb6-7ff4-43b2-878b-a781af26b136 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 1.050142 Oct 28 09:50:43.890757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 65/113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:42 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:43.897563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:43.905492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:43.920879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:43.921897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:43.922513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:43.924209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:43.925097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:43.926325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:43.993118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:44.040427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-173fd868-4cbf-46f6-94a9-5010ef378e18 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 1.550787 Oct 28 09:50:44.054852 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 49/114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:42 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:44.401882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-90a038bb-dc35-4d73-a192-f74dd8a9ec70 tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-699808896", "id": 910166039, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:44.452353 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-90a038bb-dc35-4d73-a192-f74dd8a9ec70 tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 445 microversion: 2.55 time: 0.394621 Oct 28 09:50:44.454903 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 50/115] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:50:44 2022] POST /compute/v2.1/flavors => generated 445 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:44.771896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7ccbb9e-b3fa-49c4-9975-9b7d3fb43c24 tempest-FlavorsV255TestJSON-1385325112 tempest-FlavorsV255TestJSON-1385325112-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:44.789702 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7ccbb9e-b3fa-49c4-9975-9b7d3fb43c24 tempest-FlavorsV255TestJSON-1385325112 tempest-FlavorsV255TestJSON-1385325112-project] 10.222.0.16 "GET /compute/v2.1/flavors/910166039" status: 200 len: 445 microversion: 2.55 time: 0.314692 Oct 28 09:50:44.793451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 51/116] 10.222.0.16 () {60 vars in 1196 bytes} [Fri Oct 28 09:50:44 2022] GET /compute/v2.1/flavors/910166039 => generated 445 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:44.810789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c2e5a9e-8d4c-4855-8d70-480139055acb tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] Action: 'update', calling method: .version_select at 0x7fca395975e0>, body: {"flavor": {"description": "new"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:44.942021 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c2e5a9e-8d4c-4855-8d70-480139055acb tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/910166039" status: 200 len: 446 microversion: 2.55 time: 0.133746 Oct 28 09:50:44.944173 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 52/117] 10.222.0.16 () {62 vars in 1216 bytes} [Fri Oct 28 09:50:44 2022] PUT /compute/v2.1/flavors/910166039 => generated 446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:44.956090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:44.959594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:44.977229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:44.979073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:44.979870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:44.982818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:44.983489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:44.984591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.014098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.033931 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ad1dd46-888b-4641-bcd7-0287ea27be38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 1.139457 Oct 28 09:50:45.036639 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 66/118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:43 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:45.056322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e5bb524-6aeb-46e3-99eb-7b373a4e3346 tempest-FlavorsV255TestJSON-1385325112 tempest-FlavorsV255TestJSON-1385325112-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.149788 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e5bb524-6aeb-46e3-99eb-7b373a4e3346 tempest-FlavorsV255TestJSON-1385325112 tempest-FlavorsV255TestJSON-1385325112-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5721 microversion: 2.55 time: 0.111679 Oct 28 09:50:45.173234 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 67/119] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/flavors/detail => generated 5721 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:45.182751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.186414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:45.201807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.202566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.203197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.204098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.206602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.208976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.366794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.378890 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bb62024-4785-4388-b220-f20a8db7f383 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.432637 Oct 28 09:50:45.393018 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 53/120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:44 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:45.400438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f7194892-cd2e-425c-907c-f28e82fe8160 tempest-FlavorsV255TestJSON-1385325112 tempest-FlavorsV255TestJSON-1385325112-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.440425 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f7194892-cd2e-425c-907c-f28e82fe8160 tempest-FlavorsV255TestJSON-1385325112 tempest-FlavorsV255TestJSON-1385325112-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.55 time: 0.045728 Oct 28 09:50:45.441333 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 54/121] 10.222.0.16 () {60 vars in 1166 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:45.516886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:45.527810 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4ba96573-2511-4e67-97e2-81e858d0f84e tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.353067 Oct 28 09:50:45.541744 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 68/122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:45.551691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7bbcb026-c86f-4287-91a6-a6334d87958b tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.580699 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7bbcb026-c86f-4287-91a6-a6334d87958b tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/910166039" status: 202 len: 0 microversion: 2.55 time: 0.037277 Oct 28 09:50:45.587285 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 69/123] 10.222.0.16 () {60 vars in 1199 bytes} [Fri Oct 28 09:50:45 2022] DELETE /compute/v2.1/flavors/910166039 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:50:45.604814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92a4ace4-2cff-4637-a68e-c3bf24c032ef tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.642920 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92a4ace4-2cff-4637-a68e-c3bf24c032ef tempest-FlavorsV255TestJSON-1462517536 tempest-FlavorsV255TestJSON-1462517536-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.048104 Oct 28 09:50:45.659482 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 70/124] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:50:45.748757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca38496820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.752700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.754688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.756103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.758467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.759145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.759729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.825287 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fdb0cf47-bda5-4f3c-803e-8f9851b6b3d4 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 382 microversion: 2.1 time: 0.370440 Oct 28 09:50:45.827153 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 55/125] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/os-hosts => generated 382 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:45.840751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca382ea3a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.844774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.845312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.849359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.850898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.851445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.852034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.905844 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d298201-a17a-40cb-a2c3-05fdd8f96402 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 382 microversion: 2.1 time: 0.069409 Oct 28 09:50:45.906474 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 71/126] 10.222.0.16 () {58 vars in 1139 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/os-hosts?zone= => generated 382 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:45.927952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca384e8670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:45.936825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.942584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.943821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:45.950470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:45.951166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:45.951768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.016977 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3af83b7-74f6-460d-9eaf-292e484a8719 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.101707 Oct 28 09:50:46.020013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 56/127] 10.222.0.16 () {58 vars in 1145 bytes} [Fri Oct 28 09:50:45 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:46.125233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:46.128888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:46.178854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.179797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.181912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.183272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.187543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.188848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.405346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:46.406646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:46.419151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.420560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.421508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.422868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.424260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.425049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.577414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:46.606169 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ff1bd3bb-ec9f-450d-89d5-6b1b5ed3f367 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.518888 Oct 28 09:50:46.606789 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 72/128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:46 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:46.614187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:46.615120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:46.622216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.622968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.630989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.631844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:46.632577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:46.632783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:46.942634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:46.964117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0f198446-c804-4dda-9a6c-99d2b2adeed9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.354742 Oct 28 09:50:46.966192 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 73/129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:46 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:47.174593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:47.190913 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78d50a32-b66f-45d0-bb9d-b203d2031d5c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.790157 Oct 28 09:50:47.192307 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 57/130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:46 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:50:47.634033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:47.635196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:47.644776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:47.646472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:47.659212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:47.660977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:47.664997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:47.673498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:47.906928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:47.919163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dee02741-dcf0-498a-9042-be410a88296d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.289654 Oct 28 09:50:47.936060 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 74/131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:47 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:47.997382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:47.998899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:48.007704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.009235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.009925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:48.010937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.011826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.012711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:48.223063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:48.225794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:48.281241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.282307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.283103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:48.284423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.296365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.297387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:48.530029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:48.539835 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd469f1b-87be-40fb-a557-4a66a653bf31 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.324797 Oct 28 09:50:48.541269 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 75/132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:48 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:48.736030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:48.745304 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c26bf675-2235-4517-bcdc-92494867da93 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.752026 Oct 28 09:50:48.748628 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 58/133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:47 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:48.944070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:48.953125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:48.977974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.978691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.979457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:48.980412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:48.981048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:48.981341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:49.318600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:49.329480 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a508a456-7d79-4378-893c-d057679fe927 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.389971 Oct 28 09:50:49.330785 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 76/134] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:48 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:49.565680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:49.566299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:49.608533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:49.611961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:49.613451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:49.616534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:49.625065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:49.625915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:50.113164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:50.123836 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99f534ef-0430-4251-93c8-4c075f4e181a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.559126 Oct 28 09:50:50.124496 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 59/135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:49 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:50.137221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:50.139914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:50.151551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:50.152282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:50.152889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:50.153771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:50.157524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:50.158163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:50.178503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ade4b38-ac87-4732-b2ac-f4502f1efaf9 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:50.213380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ade4b38-ac87-4732-b2ac-f4502f1efaf9 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.630361 Oct 28 09:50:50.215872 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 77/136] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:50:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:50.669092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fccab206-6203-4944-ae48-584437e0b852 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1286885613", "id": 544091907, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:50.717451 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fccab206-6203-4944-ae48-584437e0b852 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.490497 Oct 28 09:50:50.719999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 78/137] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:50 2022] POST /compute/v2.1/flavors => generated 422 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:50.734434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:50.736647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:50.758274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:50.759024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:50.759490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:50.761383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:50.764752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:50.767816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:50.769650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:50.787728 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9368224-82d3-4073-bc9e-0dda5816b312 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.658796 Oct 28 09:50:50.811844 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 60/138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:50 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:51.037121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:51.050714 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-61c2cb71-1252-4d57-9eb3-ad03a81f062f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.326950 Oct 28 09:50:51.061014 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 79/139] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:50 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:51.061014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a327a2fb-ed5a-448a-a68f-32f68389586a tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:51.078928 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a327a2fb-ed5a-448a-a68f-32f68389586a tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.025390 Oct 28 09:50:51.080267 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 80/140] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 09:50:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:51.158112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d7ffd469-2ccc-4f3e-8b9d-6b70d7640a79 req-4cb659b2-70b5-4e45-b3da-674232d90627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd5953d-2698-4320-9718-92a54a912d0e", "name": "network-vif-plugged", "status": "completed", "tag": "e1d61a80-ac87-4d99-8dc5-95ad0b6cfb45"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:51.170263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d7ffd469-2ccc-4f3e-8b9d-6b70d7640a79 req-4cb659b2-70b5-4e45-b3da-674232d90627 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:51.171759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d7ffd469-2ccc-4f3e-8b9d-6b70d7640a79 req-4cb659b2-70b5-4e45-b3da-674232d90627 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:51.171759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d7ffd469-2ccc-4f3e-8b9d-6b70d7640a79 req-4cb659b2-70b5-4e45-b3da-674232d90627 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:51.195999 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d7ffd469-2ccc-4f3e-8b9d-6b70d7640a79 req-4cb659b2-70b5-4e45-b3da-674232d90627 service nova] Creating event network-vif-plugged:e1d61a80-ac87-4d99-8dc5-95ad0b6cfb45 for instance 5bd5953d-2698-4320-9718-92a54a912d0e on n-h2-zed-1 Oct 28 09:50:51.212858 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d7ffd469-2ccc-4f3e-8b9d-6b70d7640a79 req-4cb659b2-70b5-4e45-b3da-674232d90627 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.397448 Oct 28 09:50:51.217294 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 61/141] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:51.232717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5fb5e620-a3e0-4efa-8c2f-1f048be38bdc tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1276354521", "id": 2060246220, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:51.234607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f778b2bf-f6d1-49cb-8ac4-666d8e66a843 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Action: 'create', calling method: .version_select at 0x7fca3843a4c0>, body: {"keypair": {"name": "tempest-keypair-297151148", "type": "ssh", "user_id": "0ca384f1279e422ebfbc61b14dc91291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyIimWT5OYoKPKEz6aWelfwFqaWfO/3fGFq1KL6N9j0NynBu5DKGEZ4T8E7CvQuvDHPvrSe07Tb/UaBFyLmN5O0IbpxQ6DQpOaPbHhm6A/nDvpR1CjjnQD2DiWO/JZlqQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:51.259289 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5fb5e620-a3e0-4efa-8c2f-1f048be38bdc tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.036399 Oct 28 09:50:51.260556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 62/142] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:51 2022] POST /compute/v2.1/flavors => generated 425 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:51.294259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f778b2bf-f6d1-49cb-8ac4-666d8e66a843 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Getting quotas for project fa7e244f51f14294b89f3f806b193266. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:51.308379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f778b2bf-f6d1-49cb-8ac4-666d8e66a843 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Getting quotas for user bfa0b841b4e84b04a318be6cee5dfc48 and project fa7e244f51f14294b89f3f806b193266. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:51.361360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c9d75231-5a76-4a6f-a9c2-1161e333cd47 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Action: 'create', calling method: .version_select at 0x7fca385fa4c0>, body: {"pool": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:51.366554 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f778b2bf-f6d1-49cb-8ac4-666d8e66a843 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.284546 Oct 28 09:50:51.369956 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 81/143] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 09:50:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 289 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 09:50:51.385938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:51.386741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:51.406801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:51.407770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:51.408548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:51.411213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:51.412097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:51.412871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:51.681952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:51.692942 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9e8800b3-e7a4-40da-b892-36141e68215b tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.320919 Oct 28 09:50:51.694997 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 82/144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:51 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:51.699895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6ceb6454-690c-4154-bd82-7222cf20ed85 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:51.724386 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6ceb6454-690c-4154-bd82-7222cf20ed85 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028045 Oct 28 09:50:51.727458 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 83/145] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 09:50:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:50:51.733476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0c49209-cc09-4bf7-9577-5b1cc91882c2 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Action: 'create', calling method: .version_select at 0x7fca3815eb80>, body: {"keypair": {"name": "tempest-keypair-1679665446", "type": "ssh", "user_id": "0ca384f1279e422ebfbc61b14dc91291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1MJCkwKgl/PQA6hqHyDY59+Blh3+G9YeKHdv0qDAU3pCm8+e3IgPYTfpPnvqQEf3jP/QvFaiUDkfdHWyQ+NvZZA3pn2lrv9rwfh8pkQzO4R/v6Xe08KHutZQ3oFHUo0w=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:51.756323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b0c49209-cc09-4bf7-9577-5b1cc91882c2 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Getting quotas for project fa7e244f51f14294b89f3f806b193266. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:51.764746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b0c49209-cc09-4bf7-9577-5b1cc91882c2 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Getting quotas for user bfa0b841b4e84b04a318be6cee5dfc48 and project fa7e244f51f14294b89f3f806b193266. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:51.829870 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0c49209-cc09-4bf7-9577-5b1cc91882c2 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.100852 Oct 28 09:50:51.835679 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 84/146] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 09:50:51 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 107 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 09:50:51.841502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21e3f4c7-84e1-4aa5-957d-ae20af18e595 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Action: 'create', calling method: .version_select at 0x7fca3814ddc0>, body: {"keypair": {"name": "tempest-keypair-1318270117", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJpUdCVo/wll70ys54A0ejpyfo/T44CjczmINb//UWEbvb4Yeb9HJPbk9NnrVlkfK63xfEKoVGd/cDHvfnJROl3Qwv6SoIEdkdz7V+0Ep7q/hvLPU0dewQFwB2NIVPdkg=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:51.866390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-21e3f4c7-84e1-4aa5-957d-ae20af18e595 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Getting quotas for project 2f4dca7afa40438cba45411cead48103. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:51.876953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-21e3f4c7-84e1-4aa5-957d-ae20af18e595 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Getting quotas for user a60610c78b5844f78f3ac3a7d421df53 and project 2f4dca7afa40438cba45411cead48103. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:51.931815 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-21e3f4c7-84e1-4aa5-957d-ae20af18e595 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094374 Oct 28 09:50:51.933277 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 85/147] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 09:50:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:51.967147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:51.968795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:51.995920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:51.995920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:51.995920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:51.995920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:51.998613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:52.002486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:52.061957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:52.384411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:52.396162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-120a323c-6c8f-451f-b754-bb79b28e0b41 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.441967 Oct 28 09:50:52.396773 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 86/148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:51 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:52.413207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5b9cc4e-ab4f-4e75-a060-2922ee3942c4 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Calling method '.version_select at 0x7fca381774c0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:52.441407 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5b9cc4e-ab4f-4e75-a060-2922ee3942c4 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-297151148?user_id=0ca384f1279e422ebfbc61b14dc91291" status: 200 len: 511 microversion: 2.10 time: 0.043397 Oct 28 09:50:52.442543 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 87/149] 10.222.0.16 () {60 vars in 1337 bytes} [Fri Oct 28 09:50:52 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-297151148?user_id=0ca384f1279e422ebfbc61b14dc91291 => generated 511 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:52.448460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:52.449583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:52.458783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:52.459713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:52.460518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:52.461845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:52.462734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:52.471408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:52.711089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:52.720043 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81818c24-e51a-40e2-9022-99b834174df9 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.275956 Oct 28 09:50:52.733655 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 88/150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:52 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:52.756589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe90c843-532e-4904-92f3-b63bbda2fc77 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Action: 'create', calling method: .version_select at 0x7fca3843a4c0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1556249764", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIqcX25V40uLb3sPwyi5IqL7TskkwU3KivvDrHcnHgPHlmkJXywG3/J3Z1FGrRLcxil/Nc/4/9fHweEtfj4Yb+jit4ev2V1E1rmBdZNJDJKAeyPJn1Ao/Oa/wixktJomRg=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:52.775471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-fe90c843-532e-4904-92f3-b63bbda2fc77 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Getting quotas for project fa7e244f51f14294b89f3f806b193266. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:52.780436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-fe90c843-532e-4904-92f3-b63bbda2fc77 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Getting quotas for user bfa0b841b4e84b04a318be6cee5dfc48 and project fa7e244f51f14294b89f3f806b193266. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:52.792426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:52.823108 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe90c843-532e-4904-92f3-b63bbda2fc77 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.071463 Oct 28 09:50:52.824097 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 89/151] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 09:50:52 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 90 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 09:50:52.830972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:52.831414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:52.841821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:52.842621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:52.843094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:52.844142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:52.844621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:52.845213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:53.098931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:53.111447 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e341b22-89e3-47cc-aab4-15c637645f19 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.286138 Oct 28 09:50:53.112362 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 90/152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:52 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:53.124334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-58d01f44-c3ae-401c-a191-f0a4bf5f123d tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Calling method '.version_select at 0x7fca38177ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.132054 n-d-zed-1 devstack@n-api.service[128748]: WARNING oslo_db.sqlalchemy.utils [None req-58d01f44-c3ae-401c-a191-f0a4bf5f123d tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 09:50:53.154580 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-58d01f44-c3ae-401c-a191-f0a4bf5f123d tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "GET /compute/v2.1/os-keypairs?user_id=0ca384f1279e422ebfbc61b14dc91291" status: 200 len: 725 microversion: 2.10 time: 0.039534 Oct 28 09:50:53.156787 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 91/153] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 09:50:53 2022] GET /compute/v2.1/os-keypairs?user_id=0ca384f1279e422ebfbc61b14dc91291 => generated 725 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:50:53.179602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-419c52ee-8f0d-4a40-8726-ad278a690777 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Calling method '.version_select at 0x7fca3814d3a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.268432 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-419c52ee-8f0d-4a40-8726-ad278a690777 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1556249764" status: 204 len: 0 microversion: 2.10 time: 0.099683 Oct 28 09:50:53.273355 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 92/154] 10.222.0.16 () {60 vars in 1325 bytes} [Fri Oct 28 09:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1556249764 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:50:53.290317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-407fec79-7e64-4b35-b785-2344e651130d req-86339de1-6b61-4292-91f3-28dd06f3ccd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d7b717-7a10-4e29-bc21-e1900a97f1f0", "name": "network-vif-plugged", "status": "completed", "tag": "120633ec-c1e2-47f7-a7bd-a7eccc51525b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:53.325245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-407fec79-7e64-4b35-b785-2344e651130d req-86339de1-6b61-4292-91f3-28dd06f3ccd2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:53.326877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-407fec79-7e64-4b35-b785-2344e651130d req-86339de1-6b61-4292-91f3-28dd06f3ccd2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:53.327861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-407fec79-7e64-4b35-b785-2344e651130d req-86339de1-6b61-4292-91f3-28dd06f3ccd2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:53.362537 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-407fec79-7e64-4b35-b785-2344e651130d req-86339de1-6b61-4292-91f3-28dd06f3ccd2 service nova] Creating event network-vif-plugged:120633ec-c1e2-47f7-a7bd-a7eccc51525b for instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 on n-h1-zed-1 Oct 28 09:50:53.370775 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-407fec79-7e64-4b35-b785-2344e651130d req-86339de1-6b61-4292-91f3-28dd06f3ccd2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098232 Oct 28 09:50:53.371726 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 93/155] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:53.383059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1142a65-2a91-452a-be70-2f9c606e6e7d tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Calling method '.version_select at 0x7fca382ca160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.419065 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1142a65-2a91-452a-be70-2f9c606e6e7d tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679665446?user_id=0ca384f1279e422ebfbc61b14dc91291" status: 204 len: 0 microversion: 2.10 time: 0.044389 Oct 28 09:50:53.419744 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 94/156] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1679665446?user_id=0ca384f1279e422ebfbc61b14dc91291 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:50:53.474817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.480760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:53.515650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:53.518953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:53.519495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:53.521150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:53.521663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:53.522543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:53.819062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:53.839989 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e53fff1-d5f1-410e-a487-8bf2f0e814c0 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1320 microversion: 2.1 time: 0.414343 Oct 28 09:50:53.840852 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 95/157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:53 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1320 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:53.846356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89f6154b-dd14-4879-99f0-959851249859 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] Calling method '.version_select at 0x7fca3815e040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.884945 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-89f6154b-dd14-4879-99f0-959851249859 tempest-KeyPairsV210TestJSON-858966872 tempest-KeyPairsV210TestJSON-858966872-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-297151148?user_id=0ca384f1279e422ebfbc61b14dc91291" status: 204 len: 0 microversion: 2.10 time: 0.042681 Oct 28 09:50:53.885616 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 96/158] 10.222.0.16 () {60 vars in 1340 bytes} [Fri Oct 28 09:50:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-297151148?user_id=0ca384f1279e422ebfbc61b14dc91291 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:50:53.891278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:53.892592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:53.900563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:53.901685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:53.902594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:53.904445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:53.905944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:53.907041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:54.082345 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c9d75231-5a76-4a6f-a9c2-1161e333cd47 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.816322 Oct 28 09:50:54.083946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 63/159] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 09:50:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:54.099668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8045b9d2-4c13-42bd-a3aa-4c1ce7ad784a tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Calling method '.version_select at 0x7fca384e8ca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:54.351978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:54.372866 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d10ffb07-3ebd-474c-b00d-66e5299550d0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.485414 Oct 28 09:50:54.373811 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 97/160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:53 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:54.381787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:54.383493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:54.397337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:54.398583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:54.399911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:54.401512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:54.402652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:54.403681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:54.455982 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8045b9d2-4c13-42bd-a3aa-4c1ce7ad784a tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/fd58cd40-ff14-4468-88e1-817dd3338fe3" status: 200 len: 142 microversion: 2.1 time: 0.361603 Oct 28 09:50:54.456675 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 64/161] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 09:50:54 2022] GET /compute/v2.1/os-floating-ips/fd58cd40-ff14-4468-88e1-817dd3338fe3 => generated 142 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:54.470788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51f4bbee-9bf3-4ee2-8f5e-0cd6f2cbd5bc tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Calling method '.version_select at 0x7fca38496af0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:54.963435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:54.973334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f02f3bce-6192-4920-9bca-546eb4e0f600 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1338 microversion: 2.1 time: 0.597927 Oct 28 09:50:54.978949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 98/162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:54 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1338 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:54.984877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:54.988640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:54.999008 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-51f4bbee-9bf3-4ee2-8f5e-0cd6f2cbd5bc tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.533462 Oct 28 09:50:55.009000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:55.009827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:55.010432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:55.011724 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 65/163] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 09:50:54 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:55.012792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:55.013515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:55.015563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:55.017821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55266486-641e-492b-9779-fc2b45ea1a38 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Calling method '.version_select at 0x7fca384d0af0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:55.271880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:55.285748 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9be2e11a-b9b7-45b9-83e1-3f3fc530471a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1469 microversion: 2.1 time: 0.305284 Oct 28 09:50:55.286350 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 99/164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:54 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:55.671793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:55.672327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:55.683814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:55.684339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:55.684813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:55.685699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:55.686161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:55.686924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:55.795480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:50:55.883859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:55.973961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:55.992176 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c332eb2-1e02-4c2e-8479-aa4ee93e4a26 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 204 len: 0 microversion: 2.1 time: 0.685340 Oct 28 09:50:55.993333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 100/165] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:50:55 2022] DELETE /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:50:56.002210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-736755988", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "2060246220", "adminPass": "***", "networks": [{"uuid": "76a3c667-1c80-490c-973c-ba68f8115357"}], "security_groups": [{"name": "tempest-securitygroup--64967762"}], "key_name": "tempest-keypair-1318270117", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:56.195638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] validate_networks() for [('76a3c667-1c80-490c-973c-ba68f8115357', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:50:56.434234 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55266486-641e-492b-9779-fc2b45ea1a38 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/fd58cd40-ff14-4468-88e1-817dd3338fe3" status: 202 len: 0 microversion: 2.1 time: 1.420961 Oct 28 09:50:56.436893 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 66/166] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:50:55 2022] DELETE /compute/v2.1/os-floating-ips/fd58cd40-ff14-4468-88e1-817dd3338fe3 => generated 0 bytes in 1425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:50:56.446137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0ba9a71d-ef8f-41ec-a936-5975ce31379e req-041c8a64-e630-41ae-a7e4-04cc2b633eae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b164-bda6-4231-a396-be286a5310eb", "name": "network-vif-plugged", "status": "completed", "tag": "f6376f13-2a79-40aa-bfb5-de1526dc5507"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:56.454981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:56.464384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0ba9a71d-ef8f-41ec-a936-5975ce31379e req-041c8a64-e630-41ae-a7e4-04cc2b633eae service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:56.464637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0ba9a71d-ef8f-41ec-a936-5975ce31379e req-041c8a64-e630-41ae-a7e4-04cc2b633eae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:56.465503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0ba9a71d-ef8f-41ec-a936-5975ce31379e req-041c8a64-e630-41ae-a7e4-04cc2b633eae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:56.480330 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0ba9a71d-ef8f-41ec-a936-5975ce31379e req-041c8a64-e630-41ae-a7e4-04cc2b633eae service nova] Creating event network-vif-plugged:f6376f13-2a79-40aa-bfb5-de1526dc5507 for instance 1b81b164-bda6-4231-a396-be286a5310eb on n-h2-zed-1 Oct 28 09:50:56.488154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0ba9a71d-ef8f-41ec-a936-5975ce31379e req-041c8a64-e630-41ae-a7e4-04cc2b633eae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050016 Oct 28 09:50:56.489251 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 67/167] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:56.495890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:56.496949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:56.505462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:56.506613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:56.507433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:56.508535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:56.509299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:56.509975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:56.724831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:56.759253 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0c327db-4e62-4bd6-9a44-ba8b2f137827 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.263920 Oct 28 09:50:56.759919 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 68/168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:56 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:56.781688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:56.782314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:56.789300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:56.789833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:56.790280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:56.791020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:56.791479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:56.791951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:57.005583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:57.013920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc39c0cc-3c1e-4acf-9267-a82e91e7952a tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1488 microversion: 2.1 time: 0.237178 Oct 28 09:50:57.019982 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 69/169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:56 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1488 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:57.025377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:57.026262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:57.035351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:57.035857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:57.036491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:57.038436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:57.038932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:57.039400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:57.155019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:50:57.158022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:50:57.158722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:50:57.160130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:50:57.160671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:50:57.174960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:57.175722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:57.177036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:57.177993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:57.178615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:57.179212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:57.351012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:57.366305 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a58bf7a-a03c-4e5d-91f8-d040013f2fc7 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1475 microversion: 2.1 time: 0.343435 Oct 28 09:50:57.367301 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 70/170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:57 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1475 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:57.370232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Getting quotas for project 2f4dca7afa40438cba45411cead48103. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:50:57.376055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3200df15-c226-439b-8359-f499a60926a5 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Action: 'create', calling method: .version_select at 0x7fca38681310>, body: {"pool": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:57.383706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Getting quotas for user a60610c78b5844f78f3ac3a7d421df53 and project 2f4dca7afa40438cba45411cead48103. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:50:57.405144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:50:57.408584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:50:57.485644 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19593e7d-4c76-40b7-9ffe-6b672a49c086 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.490044 Oct 28 09:50:57.486987 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 101/171] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:50:55 2022] POST /compute/v2.1/servers => generated 400 bytes in 1493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:50:57.493966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:57.499408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:57.506852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:57.507478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:57.507927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:57.508711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:57.509194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:57.509639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:57.958795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae3bbd50-b778-4749-bda7-e4a52eb0285d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1633 microversion: 2.1 time: 0.470373 Oct 28 09:50:57.959398 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 102/172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:57 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1633 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:57.975266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5804e800-b8db-42ad-9a4b-0de02db840bb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:57.976303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5804e800-b8db-42ad-9a4b-0de02db840bb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.072681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5804e800-b8db-42ad-9a4b-0de02db840bb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.083907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5804e800-b8db-42ad-9a4b-0de02db840bb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1264 microversion: 2.1 time: 0.118746 Oct 28 09:50:58.086405 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 103/173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:57 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1264 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:58.095563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:58.096857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.107358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.107889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.108343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.109205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.109682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.110123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.378378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.392498 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7802872-fa3c-4968-b118-79eb8369603e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1313 microversion: 2.1 time: 0.304777 Oct 28 09:50:58.401069 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 104/174] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:58 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1313 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:58.407792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:58.408297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.421529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.423815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.425023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.426157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.426911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.427581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.476167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:50:58.709803 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-43e70e70-ec73-44ec-86ab-955830e9ea4c tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 204 len: 0 microversion: 2.1 time: 0.303924 Oct 28 09:50:58.715934 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 105/175] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:50:58 2022] DELETE /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:50:58.740816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:58.747015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:58.766087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.766842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.767578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.769446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:58.770195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:58.770807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:58.977383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:58.999359 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1d003d5-b60e-4475-8a50-115a8327ef75 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 200 len: 1433 microversion: 2.1 time: 0.282612 Oct 28 09:50:58.999985 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 106/176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:58 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 1433 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:59.019811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.021543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:59.038486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.041895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.044559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.045631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.052801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.053560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.315952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.338540 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7fbf539d-6637-4a1a-8401-54063077b4d4 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1494 microversion: 2.1 time: 0.332281 Oct 28 09:50:59.342377 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 107/177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:59 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1494 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:59.356041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b537eb2e-c28d-47f8-ae58-b2a0541a86d2 req-8baa5a07-6bc5-4f1f-8d02-3e8c5aee2f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bd5953d-2698-4320-9718-92a54a912d0e", "name": "network-vif-deleted", "tag": "e1d61a80-ac87-4d99-8dc5-95ad0b6cfb45"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:50:59.382753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b537eb2e-c28d-47f8-ae58-b2a0541a86d2 req-8baa5a07-6bc5-4f1f-8d02-3e8c5aee2f24 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.385305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b537eb2e-c28d-47f8-ae58-b2a0541a86d2 req-8baa5a07-6bc5-4f1f-8d02-3e8c5aee2f24 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.390311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b537eb2e-c28d-47f8-ae58-b2a0541a86d2 req-8baa5a07-6bc5-4f1f-8d02-3e8c5aee2f24 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.397451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:50:59.411322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b537eb2e-c28d-47f8-ae58-b2a0541a86d2 req-8baa5a07-6bc5-4f1f-8d02-3e8c5aee2f24 service nova] Creating event network-vif-deleted:e1d61a80-ac87-4d99-8dc5-95ad0b6cfb45 for instance 5bd5953d-2698-4320-9718-92a54a912d0e on n-h2-zed-1 Oct 28 09:50:59.420293 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b537eb2e-c28d-47f8-ae58-b2a0541a86d2 req-8baa5a07-6bc5-4f1f-8d02-3e8c5aee2f24 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075345 Oct 28 09:50:59.422155 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 108/178] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:59.430955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.432846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:59.448758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.449912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.450492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.452947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.453590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.454403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.523708 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3200df15-c226-439b-8359-f499a60926a5 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.154679 Oct 28 09:50:59.525075 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 71/179] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 09:50:57 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:50:59.531064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.531775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:50:59.538420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.538916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.539386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.540102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:50:59.540580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:50:59.541023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:50:59.695438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.707042 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d39d3b28-92c6-4720-b28e-1f7de78beda7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1462 microversion: 2.1 time: 0.179828 Oct 28 09:50:59.708074 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 72/180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:59 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1462 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:50:59.713546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb004e1b-0c4b-4489-9204-e94cc74ed0d1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Calling method '.version_select at 0x7fca385f41f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:50:59.746519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:50:59.757066 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4df19d2b-0a0a-4290-89db-f597e3077f67 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1337 microversion: 2.1 time: 0.332915 Oct 28 09:50:59.757898 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 109/181] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:59 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1337 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:00.093348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:00.094188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:00.103274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.103873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.104656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:00.106097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.106931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.107577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:00.935811 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea627a51-39e9-4291-b275-f9f8c87465eb tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1607 microversion: 2.1 time: 1.176357 Oct 28 09:51:00.938797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 110/182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:50:59 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1607 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:00.951509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:00.952633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:00.970476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.972871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.973424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:00.974376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:00.975010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:00.975444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.002292 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] HTTP exception thrown: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Request method failure captured: Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e HTTP/1.1 Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPdLm-jdDYPbYcuDZSAgfEPTuqziw9aLw7Yt6-3aamVpuFmNCcrYCAIxVHOZFOUb-N07m2EnC9wW9878OkzNOWKTDPX0EDTUCHbM9S9Bggjnn451TVMBt7GQVyCEmLYNFLRMmyXzfKzK2q0cydxq5uAedWOSMx-IFYCRu03rua2-s Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:01.009467 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_340ea03cddd04e83aaabb5e6810892d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/340ea03cddd04e83aaabb5e6810892d2"}]}] Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 791f2111f74a452eaa525d16ce0b6448 Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:01.010792 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5bd5953d-2698-4320-9718-92a54a912d0e'} Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:01.011501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:01.012729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:01.015564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Returning 404 to user: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:01.016942 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50de1e6b-30d2-4634-afd5-2fa82c517c51 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 404 len: 111 microversion: 2.1 time: 0.076580 Oct 28 09:51:01.017546 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 111/183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:00 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:01.026231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:01.026891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:01.036883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.036883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.037399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.038320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.039093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.039749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.496786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5991ee8e3634d2f9b3a355ba48ffecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f75fc6889d564010966a8f1806d0d93d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:01.522777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e14080e8-961b-4f71-b14c-8d80bcef79b2 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 200 len: 1494 microversion: 2.1 time: 0.500156 Oct 28 09:51:01.524937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 112/184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:01 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 1494 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:01.539422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:01.543538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:01.563399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.565313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.566010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.568669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.569783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.570701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.626454 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb004e1b-0c4b-4489-9204-e94cc74ed0d1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed" status: 202 len: 0 microversion: 2.1 time: 1.916773 Oct 28 09:51:01.627388 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 73/185] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:50:59 2022] DELETE /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed => generated 0 bytes in 1919 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:01.632267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:01.632849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:01.646552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.652074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.652728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.653821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:01.654963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:01.655551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:01.808285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:01.817432 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06390940-e925-40ab-b579-6cf2b9878de2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1343 microversion: 2.1 time: 0.289986 Oct 28 09:51:01.837786 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 113/186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:01 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1343 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:01.844217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-317045797", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:01.956639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:51:02.007951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8f6e3fb8d6584717b71970da75f27541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0844f17c02294217954ad90f41b9e2fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:02.008833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] flavor_id is None. Assuming migration. {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 09:51:02.009301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 09:51:02.227429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:02.264891 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b824c304-04d6-42c8-b599-66f970aa1dcc tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb/action" status: 202 len: 0 microversion: 2.1 time: 0.636276 Oct 28 09:51:02.266325 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 74/187] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:51:01 2022] POST /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb/action => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:02.273245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf8e46be-2a5e-4cb1-a626-99105f8492e1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Calling method '.version_select at 0x7fca384d0ca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:02.326791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-bf8e46be-2a5e-4cb1-a626-99105f8492e1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cafd7eb8-c718-418c-86d1-64bc4681d1ed could not be found", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:51:02.327946 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-bf8e46be-2a5e-4cb1-a626-99105f8492e1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] HTTP exception thrown: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf8e46be-2a5e-4cb1-a626-99105f8492e1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Request method failure captured: Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed HTTP/1.1 Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6X6LcwxeIQm8OiDUESOUXDBvkqIzHL1hvS6UNiMUOmq3Ns8Lz4UOYOQ-hTqCxYaUo2ST6vLMFX2lQ6yhJ0DAEMmMdd_h42bltivzcRlw--Fruodfddn_oOS1OsNl63gUx9GmdA6pbGmnchf_78gsll2xW_M_kMa0A6Hr2t4x5rvaV4 Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 52ff249ad8e3441885b7a01001a36628 Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FloatingIPsTestJSON-1698684774 Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:02.346161 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52ff249ad8e3441885b7a01001a36628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52ff249ad8e3441885b7a01001a36628"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_52ff249ad8e3441885b7a01001a36628", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/52ff249ad8e3441885b7a01001a36628"}]}] Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FloatingIPsTestJSON-1698684774 Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 52ff249ad8e3441885b7a01001a36628 Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1698684774 Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FloatingIPsTestJSON-1698684774-project Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 3fab2b378c624925ba5eaf18d8d7a4e5 Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FloatingIPsTestJSON-1698684774-project Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: exception: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'cafd7eb8-c718-418c-86d1-64bc4681d1ed'} Oct 28 09:51:02.347514 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:51:02.348267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cafd7eb8-c718-418c-86d1-64bc4681d1ed could not be found Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38d6c660-9b69-4ca1-9575-14d0f6660124'] Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed. Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:02.349389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:02.350490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:02.354580 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.354580 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.356494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf8e46be-2a5e-4cb1-a626-99105f8492e1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Returning 404 to user: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:02.358263 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf8e46be-2a5e-4cb1-a626-99105f8492e1 tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed" status: 404 len: 111 microversion: 2.1 time: 0.090477 Oct 28 09:51:02.359079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 75/188] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 09:51:02 2022] GET /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:02.368230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f092ff42-6497-4734-a702-ba4773e5abb7 req-babb4405-c503-4d14-bae3-483c6681acc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33d7b717-7a10-4e29-bc21-e1900a97f1f0", "name": "network-vif-deleted", "tag": "120633ec-c1e2-47f7-a7bd-a7eccc51525b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:02.404399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f092ff42-6497-4734-a702-ba4773e5abb7 req-babb4405-c503-4d14-bae3-483c6681acc6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:02.406211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f092ff42-6497-4734-a702-ba4773e5abb7 req-babb4405-c503-4d14-bae3-483c6681acc6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:02.406976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f092ff42-6497-4734-a702-ba4773e5abb7 req-babb4405-c503-4d14-bae3-483c6681acc6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:02.437995 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f092ff42-6497-4734-a702-ba4773e5abb7 req-babb4405-c503-4d14-bae3-483c6681acc6 service nova] Creating event network-vif-deleted:120633ec-c1e2-47f7-a7bd-a7eccc51525b for instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 on n-h1-zed-1 Oct 28 09:51:02.447241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f092ff42-6497-4734-a702-ba4773e5abb7 req-babb4405-c503-4d14-bae3-483c6681acc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085700 Oct 28 09:51:02.449151 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 76/189] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:02.459258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:02.460559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:02.469061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:02.469715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:02.470361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:02.471227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:02.471829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:02.473549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:02.721403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:02.736414 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19ade8ee-de9f-4286-af0f-c4bc196b21cc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1471 microversion: 2.1 time: 0.285284 Oct 28 09:51:02.738172 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 77/190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:02 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1471 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:02.751078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3dc848a-aedc-4566-9934-884fa8eea89f tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Calling method '.version_select at 0x7fca385fa940>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:02.839637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-f3dc848a-aedc-4566-9934-884fa8eea89f tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cafd7eb8-c718-418c-86d1-64bc4681d1ed could not be found", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:51:02.840617 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f3dc848a-aedc-4566-9934-884fa8eea89f tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] HTTP exception thrown: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3dc848a-aedc-4566-9934-884fa8eea89f tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Request method failure captured: Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed HTTP/1.1 Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6X6LcwxeIQm8OiDUESOUXDBvkqIzHL1hvS6UNiMUOmq3Ns8Lz4UOYOQ-hTqCxYaUo2ST6vLMFX2lQ6yhJ0DAEMmMdd_h42bltivzcRlw--Fruodfddn_oOS1OsNl63gUx9GmdA6pbGmnchf_78gsll2xW_M_kMa0A6Hr2t4x5rvaV4 Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 52ff249ad8e3441885b7a01001a36628 Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FloatingIPsTestJSON-1698684774 Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:02.843716 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52ff249ad8e3441885b7a01001a36628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/52ff249ad8e3441885b7a01001a36628"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_52ff249ad8e3441885b7a01001a36628", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/52ff249ad8e3441885b7a01001a36628"}]}] Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FloatingIPsTestJSON-1698684774 Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 52ff249ad8e3441885b7a01001a36628 Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1698684774 Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FloatingIPsTestJSON-1698684774-project Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 3fab2b378c624925ba5eaf18d8d7a4e5 Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FloatingIPsTestJSON-1698684774-project Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: exception: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'cafd7eb8-c718-418c-86d1-64bc4681d1ed'} Oct 28 09:51:02.844895 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:51:02.845647 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cafd7eb8-c718-418c-86d1-64bc4681d1ed could not be found Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33e6b408-b5f6-4cbb-914f-c1fd9d351d27'] Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed. Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:02.846670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:02.847787 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:02.848837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed Oct 28 09:51:02.848837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:02.851561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3dc848a-aedc-4566-9934-884fa8eea89f tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] Returning 404 to user: Floating IP not found for ID cafd7eb8-c718-418c-86d1-64bc4681d1ed {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:02.852684 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3dc848a-aedc-4566-9934-884fa8eea89f tempest-FloatingIPsTestJSON-1698684774 tempest-FloatingIPsTestJSON-1698684774-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed" status: 404 len: 111 microversion: 2.1 time: 0.113328 Oct 28 09:51:02.859377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 78/191] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:51:02 2022] DELETE /compute/v2.1/os-floating-ips/cafd7eb8-c718-418c-86d1-64bc4681d1ed => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:02.864617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:02.873526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:02.899287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:02.902901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:02.904882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:02.905782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:02.907741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:02.908402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.047597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:03.048878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:03.049684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:03.050348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:03.050952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:03.070919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.072255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.074786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.076487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.078539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.079425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.104255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Getting quotas for project 340ea03cddd04e83aaabb5e6810892d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:03.113061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Getting quotas for user 791f2111f74a452eaa525d16ce0b6448 and project 340ea03cddd04e83aaabb5e6810892d2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:03.129633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:51:03.132560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:51:03.146969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:03.172400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] HTTP exception thrown: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Request method failure captured: Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 HTTP/1.1 Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPRbB7n4-e04MQNhkeuC_j4rdd7M6qOhiZ363382qCb5zXNKSNeLYT0R6qyFdgbfpWAnKWMemvfY8267qYgX7fIAxzC3jHKRwV8aa8cvCIRlCMJHH3g6ncWNzZ66ti-I_esHHwYz6XnXmeHw3xxZlUP2LPRlIF9yXExkwqND7zrmw Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: f75fc6889d564010966a8f1806d0d93d Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:03.179266 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f75fc6889d564010966a8f1806d0d93d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f75fc6889d564010966a8f1806d0d93d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f75fc6889d564010966a8f1806d0d93d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f75fc6889d564010966a8f1806d0d93d"}]}] Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: f75fc6889d564010966a8f1806d0d93d Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AggregatesAdminTestJSON-1958503239-project Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: c5991ee8e3634d2f9b3a355ba48ffecc Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AggregatesAdminTestJSON-1958503239-project Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:03.181168 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '33d7b717-7a10-4e29-bc21-e1900a97f1f0'} Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:03.182350 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:03.184762 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:03.202330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Returning 404 to user: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:03.204977 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c757568-4fb6-4f87-b925-6be9ad2e4c53 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 404 len: 111 microversion: 2.1 time: 0.344081 Oct 28 09:51:03.212099 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 79/192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:02 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 111 bytes in 352 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:03.218193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.218919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:03.227095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.227594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.228031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.228734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.229486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.230540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.249051 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bacea849-7dfd-4537-af4a-fa5e47ecbaec tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.409508 Oct 28 09:51:03.256064 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 114/193] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:51:03.261904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6538a962-714c-45d4-a1df-ee8d8a485e71 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:03.308886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6538a962-714c-45d4-a1df-ee8d8a485e71 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:03.309432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6538a962-714c-45d4-a1df-ee8d8a485e71 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:03.309924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6538a962-714c-45d4-a1df-ee8d8a485e71 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:03.714391 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6538a962-714c-45d4-a1df-ee8d8a485e71 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 298 microversion: 2.1 time: 0.455198 Oct 28 09:51:03.723088 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 115/194] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:51:03 2022] POST /compute/v2.1/os-aggregates/6/action => generated 298 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:03.731234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3eaeb448-5b09-463f-91a3-2e675f013c58 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:03.731841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3eaeb448-5b09-463f-91a3-2e675f013c58 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:03.982823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3eaeb448-5b09-463f-91a3-2e675f013c58 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:03.994226 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3eaeb448-5b09-463f-91a3-2e675f013c58 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1219 microversion: 2.1 time: 0.275432 Oct 28 09:51:03.994667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:04.007736 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2bdb778b-f857-4166-973a-6563bb8bb4a7 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1409 microversion: 2.1 time: 0.793376 Oct 28 09:51:04.009115 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 80/195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:03 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1409 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:04.014164 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 116/196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:03 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1219 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:04.017067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b8f571f-9ca7-4675-b504-3effa3779add tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:04.024065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:04.024945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:04.033160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:04.033658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:04.040566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:04.041699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:04.042190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:04.042628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:04.060469 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b8f571f-9ca7-4675-b504-3effa3779add tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048807 Oct 28 09:51:04.067547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 81/197] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:04 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:04.085176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-950b2dec-8bf2-41c2-a6a8-6a0c294967bf tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-851148261"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:04.099862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-950b2dec-8bf2-41c2-a6a8-6a0c294967bf tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid 0ec4eb48-51cf-490b-97af-a11e78655b46 for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:04.156231 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-950b2dec-8bf2-41c2-a6a8-6a0c294967bf tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.080071 Oct 28 09:51:04.160090 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 82/198] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:04 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:04.171724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-89d90fc4-b041-413f-8dad-e10e63b2b38a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:04.199719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d90fc4-b041-413f-8dad-e10e63b2b38a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:04.200228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d90fc4-b041-413f-8dad-e10e63b2b38a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:04.207308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d90fc4-b041-413f-8dad-e10e63b2b38a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:04.631309 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-89d90fc4-b041-413f-8dad-e10e63b2b38a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 238 microversion: 2.1 time: 0.464113 Oct 28 09:51:04.632081 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 83/199] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:51:04 2022] POST /compute/v2.1/os-aggregates/9/action => generated 238 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:04.643409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d81975f9-827f-4c9c-9242-b2dd385e5536 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:04.651763 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d81975f9-827f-4c9c-9242-b2dd385e5536 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 238 microversion: 2.1 time: 0.011875 Oct 28 09:51:04.659705 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 84/200] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 09:51:04 2022] GET /compute/v2.1/os-aggregates/9 => generated 238 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:04.672287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99d2c0e4-8b0b-4bce-a538-275c57c3a508 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:04.697112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d2c0e4-8b0b-4bce-a538-275c57c3a508 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:04.697985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d2c0e4-8b0b-4bce-a538-275c57c3a508 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:04.700457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d2c0e4-8b0b-4bce-a538-275c57c3a508 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:04.811033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:04.849423 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee0c67b8-f0c4-4348-bbea-f3ae8086e397 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1471 microversion: 2.1 time: 0.833778 Oct 28 09:51:04.851528 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 117/201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:04 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1471 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:04.897435 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99d2c0e4-8b0b-4bce-a538-275c57c3a508 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.229698 Oct 28 09:51:04.899503 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 85/202] 10.222.0.16 () {60 vars in 1191 bytes} [Fri Oct 28 09:51:04 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:04.920890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2bb4acb-a983-400f-ad16-f9c9a0aae5bb tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:04.983064 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2bb4acb-a983-400f-ad16-f9c9a0aae5bb tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.066891 Oct 28 09:51:05.007388 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 118/203] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:04 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:05.023707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:05.030350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-589bfb52-31bc-4abb-a8bc-c8cc2aab2723 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-774142817"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:05.037780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:05.045465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-589bfb52-31bc-4abb-a8bc-c8cc2aab2723 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid e302394b-e063-497f-887d-2f8885dc30d3 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:05.066215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:05.066741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:05.075052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:05.075981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:05.076469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:05.078361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:05.093731 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-589bfb52-31bc-4abb-a8bc-c8cc2aab2723 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.067802 Oct 28 09:51:05.100342 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 119/204] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:05 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:05.115686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:05.116711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:05.138349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:05.139326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:05.140328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:05.141440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:05.142254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:05.142971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:05.207236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:05.225444 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96fba5d2-10ce-4f06-8fac-afc3b209088f tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1271 microversion: 2.1 time: 0.205333 Oct 28 09:51:05.227252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 86/205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:05 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1271 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:05.238353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe9277f1-306a-400e-86a7-d3f9afe2a9cb tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:05.268253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9277f1-306a-400e-86a7-d3f9afe2a9cb tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:05.269598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9277f1-306a-400e-86a7-d3f9afe2a9cb tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:05.273225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9277f1-306a-400e-86a7-d3f9afe2a9cb tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:05.538330 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe9277f1-306a-400e-86a7-d3f9afe2a9cb tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 239 microversion: 2.1 time: 0.309736 Oct 28 09:51:05.539171 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 87/206] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:05 2022] POST /compute/v2.1/os-aggregates/10/action => generated 239 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:05.551618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a37b85b1-fb7f-472e-b0ff-c71c2bbdc11d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:05.577880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a37b85b1-fb7f-472e-b0ff-c71c2bbdc11d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 242 microversion: 2.1 time: 0.030182 Oct 28 09:51:05.578604 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 88/207] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:51:05 2022] GET /compute/v2.1/os-aggregates => generated 242 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:05.607365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2cc0c26-edf6-4795-ab96-58ae7398632c tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:05.641046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cc0c26-edf6-4795-ab96-58ae7398632c tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:05.643522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cc0c26-edf6-4795-ab96-58ae7398632c tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:05.646607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cc0c26-edf6-4795-ab96-58ae7398632c tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.025188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2cc0c26-edf6-4795-ab96-58ae7398632c tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 227 microversion: 2.1 time: 0.426898 Oct 28 09:51:06.026573 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 89/208] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:05 2022] POST /compute/v2.1/os-aggregates/10/action => generated 227 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:06.037985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:06.038728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:06.058248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.061034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.061627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.062481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.065267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.066115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.393338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:06.408453 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e524034e-c86f-4dab-bde6-eab7837c59c5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1471 microversion: 2.1 time: 0.380013 Oct 28 09:51:06.410585 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 90/209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:06 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1471 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:06.423337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a89b75af-5074-44ec-88fd-dda21632fa0a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:06.439145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:06.470380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39cb4fb3-3e35-45c4-8031-e8eb1958ee62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1388 microversion: 2.1 time: 1.367408 Oct 28 09:51:06.471544 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 120/210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:05 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1388 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:06.479800 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a89b75af-5074-44ec-88fd-dda21632fa0a tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.063164 Oct 28 09:51:06.479800 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 91/211] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:06 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:06.480084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:06.487026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:06.489868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.490699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.491269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.492370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78bb64c9-2a24-4cff-b8f8-e028fa1a230e tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2092677225"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:06.492704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.493397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.494078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.496098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-78bb64c9-2a24-4cff-b8f8-e028fa1a230e tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid 3f535f20-e1e4-45eb-afaa-f71fe0669857 for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:06.572654 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78bb64c9-2a24-4cff-b8f8-e028fa1a230e tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.085177 Oct 28 09:51:06.573940 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 92/212] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:06 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:06.598626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-69a05e6e-adca-4f79-92d5-c68215d167c3 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:06.615667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69a05e6e-adca-4f79-92d5-c68215d167c3 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.616723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69a05e6e-adca-4f79-92d5-c68215d167c3 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.618420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69a05e6e-adca-4f79-92d5-c68215d167c3 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:06.726095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:06.738669 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2be9d570-abb6-4e69-9647-6295fcc5671b tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1277 microversion: 2.1 time: 0.265763 Oct 28 09:51:06.744972 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 121/213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:06 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1277 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:06.874335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-69a05e6e-adca-4f79-92d5-c68215d167c3 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 240 microversion: 2.1 time: 0.290846 Oct 28 09:51:06.877986 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 93/214] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 240 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:06.899653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f33f3c99-2805-4935-9025-1a24cd0395d5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:06.958721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f33f3c99-2805-4935-9025-1a24cd0395d5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:06.961142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f33f3c99-2805-4935-9025-1a24cd0395d5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:06.964636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f33f3c99-2805-4935-9025-1a24cd0395d5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.165669 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f33f3c99-2805-4935-9025-1a24cd0395d5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 228 microversion: 2.1 time: 0.278823 Oct 28 09:51:07.169969 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 122/215] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:06 2022] POST /compute/v2.1/os-aggregates/11/action => generated 228 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:07.182682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5562d643-a763-4dfb-9610-0e8b19b1f522 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:07.226935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f102a566-954a-4190-b036-3844c90409ea req-9f8ec97a-e5a1-4208-9a2a-4820c4f6ec74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfe35a-7658-4371-947c-581fc4879381", "tag": "629553c4-0314-42b4-93f6-22adcfb47516"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:07.259214 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5562d643-a763-4dfb-9610-0e8b19b1f522 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.083590 Oct 28 09:51:07.265156 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 94/216] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:07 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:07.273484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f102a566-954a-4190-b036-3844c90409ea req-9f8ec97a-e5a1-4208-9a2a-4820c4f6ec74 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.274335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f102a566-954a-4190-b036-3844c90409ea req-9f8ec97a-e5a1-4208-9a2a-4820c4f6ec74 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.275099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f102a566-954a-4190-b036-3844c90409ea req-9f8ec97a-e5a1-4208-9a2a-4820c4f6ec74 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.301514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ea341b4-6cc7-409f-861f-6402d23f70f6 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1591572299"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:07.308723 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f102a566-954a-4190-b036-3844c90409ea req-9f8ec97a-e5a1-4208-9a2a-4820c4f6ec74 service nova] Creating event network-changed:629553c4-0314-42b4-93f6-22adcfb47516 for instance 5ecfe35a-7658-4371-947c-581fc4879381 on n-h1-zed-1 Oct 28 09:51:07.313409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-6ea341b4-6cc7-409f-861f-6402d23f70f6 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid 94e4384c-405a-4a0e-b6cc-80fea2529aae for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:07.323802 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f102a566-954a-4190-b036-3844c90409ea req-9f8ec97a-e5a1-4208-9a2a-4820c4f6ec74 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110398 Oct 28 09:51:07.325657 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 123/217] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:07.342048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c3de9d8a-0476-4b73-b8a5-e4fd875ed506 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1388391039"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:07.350144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-c3de9d8a-0476-4b73-b8a5-e4fd875ed506 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid da712d24-bc3e-4948-86db-702fcb3cc5a6 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:07.403540 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c3de9d8a-0476-4b73-b8a5-e4fd875ed506 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.073458 Oct 28 09:51:07.408438 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 124/218] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:07.437462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-08ed4f8e-a45e-4b21-94c4-1b86d4b75656 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:07.477593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ea341b4-6cc7-409f-861f-6402d23f70f6 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.204572 Oct 28 09:51:07.479094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08ed4f8e-a45e-4b21-94c4-1b86d4b75656 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.479802 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 95/219] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:07.481900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08ed4f8e-a45e-4b21-94c4-1b86d4b75656 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.484026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08ed4f8e-a45e-4b21-94c4-1b86d4b75656 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.491886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:07.494373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:07.511371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.512468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.513854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.515084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.515972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.516796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.853594 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-08ed4f8e-a45e-4b21-94c4-1b86d4b75656 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 240 microversion: 2.1 time: 0.438262 Oct 28 09:51:07.854707 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 125/220] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:07 2022] POST /compute/v2.1/os-aggregates/12/action => generated 240 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:07.872866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbd4f337-cfca-40d3-8da0-eb4660998833 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:07.936588 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fbd4f337-cfca-40d3-8da0-eb4660998833 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.079913 Oct 28 09:51:07.937645 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 126/221] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:07 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:07.972162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:07.973551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:07.989436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.990354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.991138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:07.992448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:07.993351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:07.994154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:08.249266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:08.269002 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e29e335-801d-4f0e-879e-23e24d9d9719 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1471 microversion: 2.1 time: 0.786334 Oct 28 09:51:08.270102 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 96/222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:07 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1471 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:08.279691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.280353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:08.299859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:08.300370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:08.300815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:08.313097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:08.313749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:08.314378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:08.427401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:08.449689 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8dffaa5-dfca-4f6f-aa95-ded918f592f4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1277 microversion: 2.1 time: 0.177990 Oct 28 09:51:08.451888 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 97/223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:08 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:08.463451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3797137a-9dab-447a-a63a-279aa3ac4a8d tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:08.475687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3797137a-9dab-447a-a63a-279aa3ac4a8d tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'ea106b2a3de84ea28bbad06ca62f2bda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bf7a1694754ab495d0630ae8580735', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3797137a-9dab-447a-a63a-279aa3ac4a8d tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Request method failure captured: Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 39 Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPSs5qhJlsw8eHmcmcTjPxHbGEVmOoUUERozWH4lMEbyqnh77szjDMeH3C45oqpIAjq7wCS_d5TVR5S5WVI0nBeHatpyPaNOk-2Bqk3_C9ckJTyF2Tb831YRqc_OsAJAA5WOcAHILpADM-EnORnFIBEpzKE6qz3tixzirTVe2KjYE Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:08.479626 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e4bf7a1694754ab495d0630ae8580735"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e4bf7a1694754ab495d0630ae8580735", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e4bf7a1694754ab495d0630ae8580735"}]}] Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: e4bf7a1694754ab495d0630ae8580735 Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-662340398 Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: ea106b2a3de84ea28bbad06ca62f2bda Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-662340398-project Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: {"remove_host": {"host": "n-h1-zed-1"}} Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:08.482653 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '12', 'body': {'remove_host': {'host': 'n-h1-zed-1'}}} Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:08.484123 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 28 09:51:08.487496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.491601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3797137a-9dab-447a-a63a-279aa3ac4a8d tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:08.493856 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3797137a-9dab-447a-a63a-279aa3ac4a8d tempest-AggregatesAdminNegativeTestJSON-662340398 tempest-AggregatesAdminNegativeTestJSON-662340398-project] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.039744 Oct 28 09:51:08.495664 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 98/224] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:08 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:08.505183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-268d1c87-49cf-4fcb-8e21-140a16c692c5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.517687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=8,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:08.526450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-268d1c87-49cf-4fcb-8e21-140a16c692c5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-268d1c87-49cf-4fcb-8e21-140a16c692c5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Request method failure captured: Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XTUHTdBe7iv4Rs50J8IL6GKnqbaei8HKRM_X7-ySE6eH1J_UB9G6uRGa_G3PrIO32Ft80dGMFwj7nmLS9PNBIcJSzmw8IlzNn4TeyHG6Y6o6zXY9dHS9rjcWIuz7qiJPe-icnthCd_Ck8GP2HC59lJ2M0sAQciRwKO5fHr14MS3C8 Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:51:08.533944 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0796e3f43b1f4b2192c5dc4a92af949c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0796e3f43b1f4b2192c5dc4a92af949c"}]}] Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 0558ebc9efa1407b8e7ec523317ec4c4 Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: exception: Aggregate 13 could not be found. Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '13'} Oct 28 09:51:08.536666 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.538430 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 28 09:51:08.540892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.543417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-268d1c87-49cf-4fcb-8e21-140a16c692c5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:08.548025 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-268d1c87-49cf-4fcb-8e21-140a16c692c5 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.045836 Oct 28 09:51:08.552682 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 99/225] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:08 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:51:08.609395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7fca0096-0aee-492a-9031-feb5d46dc5d4 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:08.632109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fca0096-0aee-492a-9031-feb5d46dc5d4 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:08.643940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fca0096-0aee-492a-9031-feb5d46dc5d4 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:08.651521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:08.660850 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-510d2e65-bc0e-4639-b770-fef2449cca50 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1388 microversion: 2.1 time: 0.717161 Oct 28 09:51:08.665888 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 127/226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:07 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1388 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:08.674133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a63003e0-07c8-499e-8c22-0b047b485978 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.705719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a63003e0-07c8-499e-8c22-0b047b485978 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a63003e0-07c8-499e-8c22-0b047b485978 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Request method failure captured: Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-aggregates/13 HTTP/1.1 Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XTUHTdBe7iv4Rs50J8IL6GKnqbaei8HKRM_X7-ySE6eH1J_UB9G6uRGa_G3PrIO32Ft80dGMFwj7nmLS9PNBIcJSzmw8IlzNn4TeyHG6Y6o6zXY9dHS9rjcWIuz7qiJPe-icnthCd_Ck8GP2HC59lJ2M0sAQciRwKO5fHr14MS3C8 Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:51:08.708396 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0796e3f43b1f4b2192c5dc4a92af949c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0796e3f43b1f4b2192c5dc4a92af949c"}]}] Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0558ebc9efa1407b8e7ec523317ec4c4 Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: exception: Aggregate 13 could not be found. Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '13'} Oct 28 09:51:08.711006 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:51:08.712656 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 13 could not be found. Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 13 could not be found. Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.719322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.723062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.723062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:08.723062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:08.723062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 13 could not be found. Oct 28 09:51:08.723062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.723062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a63003e0-07c8-499e-8c22-0b047b485978 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:08.723894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fca0096-0aee-492a-9031-feb5d46dc5d4 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:08.724076 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a63003e0-07c8-499e-8c22-0b047b485978 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.044694 Oct 28 09:51:08.724076 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 128/227] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:08 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:51:08.728297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7cc3cd45-1c68-4cea-b5aa-ce0ea60b8b18 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-880492118", "name": "tempest-test_aggregate-1655080031"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:08.742600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-7cc3cd45-1c68-4cea-b5aa-ce0ea60b8b18 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid d2c87794-55d2-40b8-a14b-c9e5dd8dedeb for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:08.812868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7cc3cd45-1c68-4cea-b5aa-ce0ea60b8b18 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.092469 Oct 28 09:51:08.813946 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 129/228] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 09:51:08 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:08.826286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5a18a6e-9c07-4b9c-a3af-14c71782d9a1 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.880417 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5a18a6e-9c07-4b9c-a3af-14c71782d9a1 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.058584 Oct 28 09:51:08.884211 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 130/229] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 28 09:51:08.895933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80caa2a9-dad6-4b76-8244-d3f3151eab7b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.924204 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-80caa2a9-dad6-4b76-8244-d3f3151eab7b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80caa2a9-dad6-4b76-8244-d3f3151eab7b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Request method failure captured: Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XTUHTdBe7iv4Rs50J8IL6GKnqbaei8HKRM_X7-ySE6eH1J_UB9G6uRGa_G3PrIO32Ft80dGMFwj7nmLS9PNBIcJSzmw8IlzNn4TeyHG6Y6o6zXY9dHS9rjcWIuz7qiJPe-icnthCd_Ck8GP2HC59lJ2M0sAQciRwKO5fHr14MS3C8 Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:51:08.925885 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0796e3f43b1f4b2192c5dc4a92af949c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0796e3f43b1f4b2192c5dc4a92af949c"}]}] Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0558ebc9efa1407b8e7ec523317ec4c4 Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: exception: Aggregate 14 could not be found. Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '14'} Oct 28 09:51:08.927354 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.928235 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 28 09:51:08.929487 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:08.932984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80caa2a9-dad6-4b76-8244-d3f3151eab7b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:08.934127 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-80caa2a9-dad6-4b76-8244-d3f3151eab7b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.045022 Oct 28 09:51:08.937981 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 131/230] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:08 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:51:08.953105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8df2cfde-4321-4ac4-952f-0aff04adfb2b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:08.996703 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8df2cfde-4321-4ac4-952f-0aff04adfb2b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8df2cfde-4321-4ac4-952f-0aff04adfb2b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Request method failure captured: Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XTUHTdBe7iv4Rs50J8IL6GKnqbaei8HKRM_X7-ySE6eH1J_UB9G6uRGa_G3PrIO32Ft80dGMFwj7nmLS9PNBIcJSzmw8IlzNn4TeyHG6Y6o6zXY9dHS9rjcWIuz7qiJPe-icnthCd_Ck8GP2HC59lJ2M0sAQciRwKO5fHr14MS3C8 Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:51:09.000031 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0796e3f43b1f4b2192c5dc4a92af949c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0796e3f43b1f4b2192c5dc4a92af949c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0796e3f43b1f4b2192c5dc4a92af949c"}]}] Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 0796e3f43b1f4b2192c5dc4a92af949c Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-144330572 Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0558ebc9efa1407b8e7ec523317ec4c4 Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminTestJSON-144330572-project-admin Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: exception: Aggregate 14 could not be found. Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '14'} Oct 28 09:51:09.001501 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:51:09.002273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:09.003548 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:09.004794 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:09.004794 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:09.004794 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:09.004794 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Oct 28 09:51:09.004794 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:09.006196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8df2cfde-4321-4ac4-952f-0aff04adfb2b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:09.007250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8df2cfde-4321-4ac4-952f-0aff04adfb2b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.064786 Oct 28 09:51:09.008009 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 132/231] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:08 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 09:51:09.018470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4db1c55-09df-44e7-b597-6e9fa0c02764 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-200975080"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:09.033976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-d4db1c55-09df-44e7-b597-6e9fa0c02764 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid 14e300fb-befa-4420-b05c-9c472c55dcb6 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:09.098834 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d4db1c55-09df-44e7-b597-6e9fa0c02764 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.084140 Oct 28 09:51:09.102695 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 133/232] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:09.114471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fff9f7aa-1c96-4e7e-b816-bee2f57741f0 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.137192 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fff9f7aa-1c96-4e7e-b816-bee2f57741f0 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 227 microversion: 2.1 time: 0.027344 Oct 28 09:51:09.149622 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 134/233] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:09 2022] GET /compute/v2.1/os-aggregates/15 => generated 227 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:09.168272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-036f2a42-f813-40ca-aa22-8f3186f9360b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:09.236098 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-036f2a42-f813-40ca-aa22-8f3186f9360b tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/15/action" status: 200 len: 265 microversion: 2.1 time: 0.081890 Oct 28 09:51:09.237091 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 135/234] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:09 2022] POST /compute/v2.1/os-aggregates/15/action => generated 265 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:09.256627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7fca0096-0aee-492a-9031-feb5d46dc5d4 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.702440 Oct 28 09:51:09.261204 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 100/235] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:08 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:09.267884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-951ad865-0460-40c8-a272-fe737a5b3b6d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.285752 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-951ad865-0460-40c8-a272-fe737a5b3b6d tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/15" status: 200 len: 241 microversion: 2.1 time: 0.034136 Oct 28 09:51:09.286904 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 136/236] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:09 2022] GET /compute/v2.1/os-aggregates/15 => generated 241 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:09.303050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75b3564c-70ef-4db2-a838-b4273b1806bc tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.324310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.327530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:09.343429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:09.344858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:09.355347 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75b3564c-70ef-4db2-a838-b4273b1806bc tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.074945 Oct 28 09:51:09.367842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:09.368030 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 101/237] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:09 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:09.368129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:09.368129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:09.369191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:09.398307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-73d19aa5-f11f-4d11-b09e-eb64bc5351ba tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.449205 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-73d19aa5-f11f-4d11-b09e-eb64bc5351ba tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.075305 Oct 28 09:51:09.451508 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 102/238] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:09 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:09.466889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6195f623-61c2-4b62-bce3-18afc1a5ef40 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-676354493"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:09.474138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-6195f623-61c2-4b62-bce3-18afc1a5ef40 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Generated uuid a5162ca4-eb2c-4e20-8abe-3811323b30d9 for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:09.506244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6195f623-61c2-4b62-bce3-18afc1a5ef40 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.053008 Oct 28 09:51:09.514471 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 103/239] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:09.519415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca381d85e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.523071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:09.523670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:09.524147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:09.524945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:09.529973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:09.531473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:09.616407 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-103a9378-173f-4a35-94be-e96632fc0ed1 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 361 microversion: 2.1 time: 0.100556 Oct 28 09:51:09.618575 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 104/240] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 09:51:09 2022] GET /compute/v2.1/os-hosts => generated 361 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:09.624498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b81fde25-6a18-4126-a751-95e1dfe3cbd2 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1471731229", "availability_zone": "tempest-test_az-914951771"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:09.650172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-b81fde25-6a18-4126-a751-95e1dfe3cbd2 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid 6c282d6b-0dd8-40f1-9068-b4e86c898cf6 for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:09.702141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b81fde25-6a18-4126-a751-95e1dfe3cbd2 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.078994 Oct 28 09:51:09.703228 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 105/241] 10.222.0.16 () {60 vars in 1165 bytes} [Fri Oct 28 09:51:09 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:09.709465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:09.712034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:09.725034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:09.725545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:09.725994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:09.728223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:09.729112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:09.729676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.212017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:10.228522 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17052f25-f7a5-4be9-9bab-8fe5e9c2f99c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.937357 Oct 28 09:51:10.229954 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 137/242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:09 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:10.237166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:10.261123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=83,nova_api:DELETE=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:10.265637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.271072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.271934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.278258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:10.283242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.283994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.285378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.295612 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cba41f1f-345a-4f85-ad07-24c9ba8f78c1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.590737 Oct 28 09:51:10.297366 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 106/243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:09 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:10.324596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca381d8e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.329479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.compute.aggregates [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Failed to remove host nonexist_host from aggregate 16. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 09:51:10.329479 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 16 Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Request method failure captured: Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-aggregates/16/action HTTP/1.1 Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 42 Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XSVqOFMFoPMXIrGUfde0he5z7Pl-FoCfZdv2Rs4wit8N5AyjRLCo8EFkPFQAhTxNHc73VWRJDCfOudaBwKJeoMjaQWyA9f-EATVsFW5P7DIeQgH-wjC2Val5s8PJxinDBgFu6JSugNA8wiAAezGuKRvnb1SPvVkdjCHHO8IefnObA Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:51:10.334363 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b3878f8ee0f4a06abb8f252be0af556"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b3878f8ee0f4a06abb8f252be0af556", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b3878f8ee0f4a06abb8f252be0af556"}]}] Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b3878f8ee0f4a06abb8f252be0af556 Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107 Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 654f1e57690f450c8269bf545ac8a214 Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: {"remove_host": {"host": "nonexist_host"}} Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:10.336769 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot remove host nonexist_host in aggregate 16 Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '16', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 28 09:51:10.338230 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 28 09:51:10.340361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 16 Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.348887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:10.354579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:10.354579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:10.354579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:10.354579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:10.354579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 16 Oct 28 09:51:10.354579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:10.356157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.356157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.356157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.358406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 16 {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:10.358406 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d915e73f-5239-4573-b54e-42a182d04dbe tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/16/action" status: 404 len: 94 microversion: 2.1 time: 0.105541 Oct 28 09:51:10.359530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.359530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.359530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.360372 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 138/244] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 09:51:10 2022] POST /compute/v2.1/os-aggregates/16/action => generated 94 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:51:10.360372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.360372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:10.384644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.388678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.388678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.388678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.389306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.390319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.407076 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c4e7a83d-722b-4c58-9758-1770bf28bc23 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 227 microversion: 2.1 time: 0.105217 Oct 28 09:51:10.408995 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 107/245] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:10 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 227 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:10.415265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-35748ec1-e89d-493d-a99c-934c09ada1e9 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1471731229_new", "availability_zone": "tempest-test_az-914951771_new"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:10.462793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35748ec1-e89d-493d-a99c-934c09ada1e9 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.464368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35748ec1-e89d-493d-a99c-934c09ada1e9 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.465046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35748ec1-e89d-493d-a99c-934c09ada1e9 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.564422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-35748ec1-e89d-493d-a99c-934c09ada1e9 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 335 microversion: 2.1 time: 0.149860 Oct 28 09:51:10.564724 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 108/246] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 09:51:10 2022] PUT /compute/v2.1/os-aggregates/17 => generated 335 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:10.576729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba486139-25a4-4a16-90d2-78f93ffecbf3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.609559 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba486139-25a4-4a16-90d2-78f93ffecbf3 tempest-AggregatesAdminNegativeTestJSON-1474291107 tempest-AggregatesAdminNegativeTestJSON-1474291107-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.037392 Oct 28 09:51:10.610486 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 109/247] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:10 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:10.615266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca381efd30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.621470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.621994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.622485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.623360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.623769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.624202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.668492 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3150b128-cb8b-4434-9b0a-92d5bd40ea45 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 361 microversion: 2.1 time: 0.056511 Oct 28 09:51:10.672617 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 110/248] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 09:51:10 2022] GET /compute/v2.1/os-hosts => generated 361 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:10.677816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4da0078e-03c7-4499-a911-62d3ee0a8c76 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.686631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4da0078e-03c7-4499-a911-62d3ee0a8c76 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 338 microversion: 2.1 time: 0.013046 Oct 28 09:51:10.694060 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 111/249] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:51:10 2022] GET /compute/v2.1/os-aggregates => generated 338 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:10.698379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca381d88b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.707706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.708133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.709287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.729266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.729810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.730212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.766182 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9717c046-837f-400d-baa4-6369a6385af0 tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h1-zed-1" status: 200 len: 455 microversion: 2.1 time: 0.076311 Oct 28 09:51:10.767482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 112/250] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:51:10 2022] GET /compute/v2.1/os-hosts/n-h1-zed-1 => generated 455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:10.774518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9cd6a240-ee2a-4658-90d7-c7568fe08d57 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.819121 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9cd6a240-ee2a-4658-90d7-c7568fe08d57 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.050086 Oct 28 09:51:10.833885 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 113/251] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:10 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:10.845178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Calling method '.version_select at 0x7fca381f3790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:10.872859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.874578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.875268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.896121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:10.896837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:10.897449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:10.921376 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-05c82db8-c711-4c98-ad5a-1a50eac46a6d tempest-HostsAdminTestJSON-1772893296 tempest-HostsAdminTestJSON-1772893296-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-h2-zed-1" status: 200 len: 583 microversion: 2.1 time: 0.085544 Oct 28 09:51:10.922874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 114/252] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:51:10 2022] GET /compute/v2.1/os-hosts/n-h2-zed-1 => generated 583 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:10.933806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0139011-f089-4933-a2b2-573ac2981776 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-330322839"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:10.940044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.aggregate [None req-a0139011-f089-4933-a2b2-573ac2981776 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Generated uuid 42d4cdbb-db1f-4773-a00b-2592109abb79 for aggregate {{(pid=128747) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 09:51:11.007147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0139011-f089-4933-a2b2-573ac2981776 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.082871 Oct 28 09:51:11.019776 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 115/253] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 09:51:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:11.025244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46f03530-fa71-4f12-91c0-72c8dbe10645 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.036533 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46f03530-fa71-4f12-91c0-72c8dbe10645 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.014061 Oct 28 09:51:11.056422 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 116/254] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:51:11 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:11.084247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf40524a-9769-4618-a721-31b0f8199f91 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.145082 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf40524a-9769-4618-a721-31b0f8199f91 tempest-AggregatesAdminTestJSON-144330572 tempest-AggregatesAdminTestJSON-144330572-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.086212 Oct 28 09:51:11.156718 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 117/255] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 09:51:11 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 09:51:11.176862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.181344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:11.198254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.199330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.202718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:11.203629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.206869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.208205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:11.257905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] HTTP exception thrown: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Request method failure captured: Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 HTTP/1.1 Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPRbB7n4-e04MQNhkeuC_j4rdd7M6qOhiZ363382qCb5zXNKSNeLYT0R6qyFdgbfpWAnKWMemvfY8267qYgX7fIAxzC3jHKRwV8aa8cvCIRlCMJHH3g6ncWNzZ66ti-I_esHHwYz6XnXmeHw3xxZlUP2LPRlIF9yXExkwqND7zrmw Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: f75fc6889d564010966a8f1806d0d93d Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:11.282509 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f75fc6889d564010966a8f1806d0d93d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f75fc6889d564010966a8f1806d0d93d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f75fc6889d564010966a8f1806d0d93d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f75fc6889d564010966a8f1806d0d93d"}]}] Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: f75fc6889d564010966a8f1806d0d93d Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AggregatesAdminTestJSON-1958503239-project Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: c5991ee8e3634d2f9b3a355ba48ffecc Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AggregatesAdminTestJSON-1958503239-project Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.286461 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '33d7b717-7a10-4e29-bc21-e1900a97f1f0'} Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:11.287772 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.291172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.297689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Returning 404 to user: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:11.297689 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eac5deee-6f53-44f5-8dab-adc3b91ed9fa tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "DELETE /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 404 len: 111 microversion: 2.1 time: 0.125038 Oct 28 09:51:11.297689 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 118/256] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:51:11 2022] DELETE /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:11.308309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:11.316707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.319265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:11.327042 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0eb3f06b-6149-4daf-b0d1-9efd81c0c343 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1388 microversion: 2.1 time: 0.976284 Oct 28 09:51:11.327708 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 139/257] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:10 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1388 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:11.357569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.358713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.359441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:11.360551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.361235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.361822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:11.370746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.371400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] [instance: 33d7b717-7a10-4e29-bc21-e1900a97f1f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:11.410758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.411364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.413726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:11.419876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.420618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.421104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:11.493026 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] HTTP exception thrown: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Request method failure captured: Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 HTTP/1.1 Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPRbB7n4-e04MQNhkeuC_j4rdd7M6qOhiZ363382qCb5zXNKSNeLYT0R6qyFdgbfpWAnKWMemvfY8267qYgX7fIAxzC3jHKRwV8aa8cvCIRlCMJHH3g6ncWNzZ66ti-I_esHHwYz6XnXmeHw3xxZlUP2LPRlIF9yXExkwqND7zrmw Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: f75fc6889d564010966a8f1806d0d93d Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:11.496030 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f75fc6889d564010966a8f1806d0d93d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f75fc6889d564010966a8f1806d0d93d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f75fc6889d564010966a8f1806d0d93d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f75fc6889d564010966a8f1806d0d93d"}]}] Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: f75fc6889d564010966a8f1806d0d93d Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1958503239 Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AggregatesAdminTestJSON-1958503239-project Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c5991ee8e3634d2f9b3a355ba48ffecc Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AggregatesAdminTestJSON-1958503239-project Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.497526 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '33d7b717-7a10-4e29-bc21-e1900a97f1f0'} Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:11.498468 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. Oct 28 09:51:11.499649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:11.502730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] Returning 404 to user: Instance 33d7b717-7a10-4e29-bc21-e1900a97f1f0 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:11.503842 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74bcd005-cc4c-4b03-8fd3-224e86b19164 tempest-AggregatesAdminTestJSON-1958503239 tempest-AggregatesAdminTestJSON-1958503239-project] 10.222.0.16 "GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0" status: 404 len: 111 microversion: 2.1 time: 0.175159 Oct 28 09:51:11.504599 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 140/258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:11 2022] GET /compute/v2.1/servers/33d7b717-7a10-4e29-bc21-e1900a97f1f0 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:11.532879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:11.536016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:11.549069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.549579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.550030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:11.550770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:11.551230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:11.551933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:12.261396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:12.283623 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6913ba99-1a71-478b-a43a-54c9513d3339 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.770529 Oct 28 09:51:12.284993 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 141/259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:11 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:12.354875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:12.356223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:12.370389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:12.372657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:12.373070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:12.376089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:12.376678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:12.380547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:12.780795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:12.784638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:12.798141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe245c52-c5bc-4c5e-8127-b0afbf41dc7b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 1.496974 Oct 28 09:51:12.800024 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 119/260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:11 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 1515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:12.810322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-bee17df4-a175-4944-9f6c-9a265b48315d req-6b5a5b7a-5490-4a12-ba5d-36f6a0546a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e447ef-6e3d-4845-849a-01c49f8cc9c0", "tag": "2e057f62-84e5-4c4b-b2f2-e890a65b252f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:12.843349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bee17df4-a175-4944-9f6c-9a265b48315d req-6b5a5b7a-5490-4a12-ba5d-36f6a0546a06 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:12.844892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bee17df4-a175-4944-9f6c-9a265b48315d req-6b5a5b7a-5490-4a12-ba5d-36f6a0546a06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:12.848126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bee17df4-a175-4944-9f6c-9a265b48315d req-6b5a5b7a-5490-4a12-ba5d-36f6a0546a06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:12.876037 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-bee17df4-a175-4944-9f6c-9a265b48315d req-6b5a5b7a-5490-4a12-ba5d-36f6a0546a06 service nova] Creating event network-changed:2e057f62-84e5-4c4b-b2f2-e890a65b252f for instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 on n-h2-zed-1 Oct 28 09:51:12.890821 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-bee17df4-a175-4944-9f6c-9a265b48315d req-6b5a5b7a-5490-4a12-ba5d-36f6a0546a06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086446 Oct 28 09:51:12.899801 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 120/261] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:12.916266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:12.926670 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfac26fe-15e3-4abf-81cb-be90eb28f609 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1388 microversion: 2.1 time: 0.575884 Oct 28 09:51:12.932710 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 142/262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:12 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1388 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:13.308789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:13.310398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:13.324198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:13.324724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:13.325466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:13.328257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:13.329486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:13.333658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:13.846627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:13.847535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:13.878922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:13.884287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:13.885115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:13.886040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:13.887768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:13.890329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:14.027454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=32 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:14.033950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.054838 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c9dcd0e-2a1e-4f36-8649-fd13d711e30a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.748724 Oct 28 09:51:14.062739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 121/263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:13 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:14.084172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:14.085295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:14.107670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:14.109316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:14.110375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:14.111368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:14.112066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:14.113409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:14.660894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.672312 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd346921-7f60-488c-8abc-2a0c1a7e6a69 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1388 microversion: 2.1 time: 0.599704 Oct 28 09:51:14.678767 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 122/264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:14 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1388 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:14.895423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5d0afb0f-a5c2-4edb-9a21-787c4c6ddf14 req-535b7955-e2a9-4df1-b5ff-d0662004b9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfe35a-7658-4371-947c-581fc4879381", "name": "network-vif-plugged", "status": "completed", "tag": "629553c4-0314-42b4-93f6-22adcfb47516"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:14.911167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=11,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:14.937887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:14.943297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:14.952047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d0afb0f-a5c2-4edb-9a21-787c4c6ddf14 req-535b7955-e2a9-4df1-b5ff-d0662004b9ac service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:14.954938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d0afb0f-a5c2-4edb-9a21-787c4c6ddf14 req-535b7955-e2a9-4df1-b5ff-d0662004b9ac service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:14.957262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d0afb0f-a5c2-4edb-9a21-787c4c6ddf14 req-535b7955-e2a9-4df1-b5ff-d0662004b9ac service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:14.966029 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c24d359b-f1f4-466f-9264-483f86a99463 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 1.122521 Oct 28 09:51:14.967396 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 143/265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:13 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:15.008252 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5d0afb0f-a5c2-4edb-9a21-787c4c6ddf14 req-535b7955-e2a9-4df1-b5ff-d0662004b9ac service nova] Creating event network-vif-plugged:629553c4-0314-42b4-93f6-22adcfb47516 for instance 5ecfe35a-7658-4371-947c-581fc4879381 on n-h1-zed-1 Oct 28 09:51:15.040149 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5d0afb0f-a5c2-4edb-9a21-787c4c6ddf14 req-535b7955-e2a9-4df1-b5ff-d0662004b9ac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155971 Oct 28 09:51:15.043970 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 123/266] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:15.087524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:15.088140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:15.098398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:15.099199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:15.100429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:15.101527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:15.102232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:15.103434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:15.530155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:15.541327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47676c63-47aa-49c4-a70e-6ea5a5efe612 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.459151 Oct 28 09:51:15.542680 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 144/267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:15 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:15.708358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:15.712957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:15.729845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:15.730719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:15.731452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:15.742019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:15.749621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:15.751257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:15.996895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:16.000771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:16.015473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:16.016338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:16.016945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:16.027713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:16.030245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:16.031271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:16.438953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.456565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fce913a-5722-4bbc-83c2-8c6ed754d807 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1388 microversion: 2.1 time: 0.755228 Oct 28 09:51:16.457257 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 124/268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:15 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1388 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:16.590362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:16.591585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:16.612579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:16.617544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:16.623521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:16.625157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:16.625928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:16.626675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:16.627306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:16.643733 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22cd39af-d3aa-48e9-8d35-351578be3cc7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.651761 Oct 28 09:51:16.644665 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 145/269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:15 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:17.090464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:17.104031 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e27497f8-2dc4-4480-9da2-12be99706e0a tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.520638 Oct 28 09:51:17.107686 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 125/270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:16 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:17.486189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:17.486816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:17.503101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:17.503609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:17.504045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:17.504764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:17.505245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:17.505668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:17.671756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:17.673615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:17.691035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:17.691550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:17.694694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:17.695482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:17.699338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:17.701269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:17.867729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:17.881851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d60d1cf7-88fe-4712-b85e-8406a3f63bc8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1587 microversion: 2.1 time: 0.399230 Oct 28 09:51:17.896943 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 146/271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:17 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1587 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:18.045898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:18.056297 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f646033-0923-4079-b001-f3aa470c612b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.392198 Oct 28 09:51:18.056888 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 126/272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:17 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:18.065315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:18.066166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:18.087348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:18.088807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:18.089393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:18.090826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:18.091646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:18.092100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:18.326624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-262320a2-5e64-428a-bc42-4dfb51874ad9 tempest-ListImageFiltersNegativeTestJSON-930630 tempest-ListImageFiltersNegativeTestJSON-930630-project] Calling method '.version_select at 0x7fca33f48310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:18.345686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f4ade0f-1642-40d9-8eeb-16d27f4e8010 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.287441 Oct 28 09:51:18.346513 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 127/273] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 09:51:18 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381/os-interface => generated 285 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:18.370572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:18.371612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:18.377199 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-262320a2-5e64-428a-bc42-4dfb51874ad9 tempest-ListImageFiltersNegativeTestJSON-930630 tempest-ListImageFiltersNegativeTestJSON-930630-project] HTTP exception thrown: Image not found. Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-262320a2-5e64-428a-bc42-4dfb51874ad9 tempest-ListImageFiltersNegativeTestJSON-930630 tempest-ListImageFiltersNegativeTestJSON-930630-project] Request method failure captured: Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/images/fc55d03c-979c-475d-91ff-4a54f8b5d55e HTTP/1.1 Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6YVDwa3QQGwswp0_newhPCGNFM1gMmgbAPIlQkOjlsiDu0lqnXwZPXnawRArcOf5hpa2gXGqgsK0rLAIaZQanvznjkGSY_a7T-rYY7T8HERKlgl1eN-HlAbfAeNS2QRtECTp0gI9kKgOCnyyNeJVSGYhCeI8QTd8cACr3PR2YLFgsQ Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 8c6e6170a41f42a6ae8bf5d0a2191534 Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-930630 Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:18.389077 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c6e6170a41f42a6ae8bf5d0a2191534"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8c6e6170a41f42a6ae8bf5d0a2191534"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8c6e6170a41f42a6ae8bf5d0a2191534", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8c6e6170a41f42a6ae8bf5d0a2191534"}]}] Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-930630 Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 8c6e6170a41f42a6ae8bf5d0a2191534 Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-930630 Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ListImageFiltersNegativeTestJSON-930630-project Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 9d8f213a26a245d89343f0a99f281a21 Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-930630-project Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'fc55d03c-979c-475d-91ff-4a54f8b5d55e'} Oct 28 09:51:18.391666 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:51:18.393283 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fc55d03c-979c-475d-91ff-4a54f8b5d55e Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:51:18.397893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fc55d03c-979c-475d-91ff-4a54f8b5d55e could not be found. Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:18.403207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:18.407330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-262320a2-5e64-428a-bc42-4dfb51874ad9 tempest-ListImageFiltersNegativeTestJSON-930630 tempest-ListImageFiltersNegativeTestJSON-930630-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:18.416359 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-262320a2-5e64-428a-bc42-4dfb51874ad9 tempest-ListImageFiltersNegativeTestJSON-930630 tempest-ListImageFiltersNegativeTestJSON-930630-project] 10.222.0.16 "GET /compute/v2.1/images/fc55d03c-979c-475d-91ff-4a54f8b5d55e" status: 404 len: 62 microversion: 2.1 time: 0.509055 Oct 28 09:51:18.416359 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 147/274] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:51:17 2022] GET /compute/v2.1/images/fc55d03c-979c-475d-91ff-4a54f8b5d55e => generated 62 bytes in 512 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:51:18.417433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:18.417433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:18.417433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:18.417433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:18.418639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:18.418639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:19.009238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:19.021818 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-82238728-7d6c-4993-a769-17cad01bf9ed tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.673690 Oct 28 09:51:19.026567 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 128/275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:18 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:19.081741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:19.082577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:19.094457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:19.094949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:19.095375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:19.102144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:19.107294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:19.107986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:20.051978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:20.055888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:20.085819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:20.093430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:20.094342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:20.095657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:20.096545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:20.100184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:20.282308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:20.469931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.515869 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-108289c1-5b99-497a-bcba-ee6a524632a7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 1.437732 Oct 28 09:51:20.522932 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 148/276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:19 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:20.638421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:20.772590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:20.783919 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d6129f9-ebd4-4132-bede-dcb377655846 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.738994 Oct 28 09:51:20.789430 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 129/277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:20 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:21.354511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:21.355143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:21.362302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c34a7e14-c45d-4910-83d6-1b67abcc3067 req-8b8b1b44-7f6b-47bd-8b5c-12fa3f75c66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ecfe35a-7658-4371-947c-581fc4879381", "tag": "629553c4-0314-42b4-93f6-22adcfb47516"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:21.362881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:21.363146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:21.365901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:21.366766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:21.369178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:21.370674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:21.378912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c34a7e14-c45d-4910-83d6-1b67abcc3067 req-8b8b1b44-7f6b-47bd-8b5c-12fa3f75c66f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:21.386842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c34a7e14-c45d-4910-83d6-1b67abcc3067 req-8b8b1b44-7f6b-47bd-8b5c-12fa3f75c66f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:21.387593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c34a7e14-c45d-4910-83d6-1b67abcc3067 req-8b8b1b44-7f6b-47bd-8b5c-12fa3f75c66f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:21.412410 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c34a7e14-c45d-4910-83d6-1b67abcc3067 req-8b8b1b44-7f6b-47bd-8b5c-12fa3f75c66f service nova] Creating event network-changed:629553c4-0314-42b4-93f6-22adcfb47516 for instance 5ecfe35a-7658-4371-947c-581fc4879381 on n-h1-zed-1 Oct 28 09:51:21.433449 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c34a7e14-c45d-4910-83d6-1b67abcc3067 req-8b8b1b44-7f6b-47bd-8b5c-12fa3f75c66f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073988 Oct 28 09:51:21.435465 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 130/278] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:21.929065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:21.942331 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3e71894-f71f-493b-b989-5ffb02f38c78 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 200 len: 1587 microversion: 2.1 time: 0.588528 Oct 28 09:51:21.977521 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 149/279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:21 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 1587 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:21.997269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.000262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:22.015864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.018315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.019310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.021436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.025315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.026059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.248791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca381f3310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.251038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.251769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.252348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.289139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.289983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.290576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.332578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.333106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.333563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.349892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8acd931b-aba6-43e3-a34f-820f07ffd61f tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.908978 Oct 28 09:51:22.350486 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 131/280] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:21 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:22.358355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.359111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:22.372841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.373343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.373343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.374964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.374964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.374964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.727650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.743678 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92f2bb15-ae33-402b-875c-90f98f3c7171 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.759746 Oct 28 09:51:22.746771 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 150/281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:21 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:22.795735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:22.805350 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f272a4ea-e5bf-4aab-885a-58d04d3d7bb2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.453691 Oct 28 09:51:22.809642 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 132/282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:22 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:22.821385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca381d8c10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.823993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.829952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.830922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.885410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.886747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.891063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.926551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.927621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.928627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:22.948756 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee0978f9-45f8-4d5c-a198-445ad5b34942 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1493 microversion: 2.1 time: 0.136627 Oct 28 09:51:22.949717 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 133/283] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 09:51:22 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1493 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:22.969456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca381d8ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:22.972428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:22.972967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:22.973407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.029706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.030401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.030760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.062736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.066659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.067117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.097051 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bc396c1-b259-489e-8039-b278361a92d6 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.123096 Oct 28 09:51:23.115047 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 134/284] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:22 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:23.126777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca382bcb80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.130449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.130941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.131837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.176292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.177147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.178938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.212837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3cd94f0c-e0a3-4acb-a7a6-2fd9195312ad tempest-AZAdminNegativeTestJSON-1163251861 tempest-AZAdminNegativeTestJSON-1163251861-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.214468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3cd94f0c-e0a3-4acb-a7a6-2fd9195312ad tempest-AZAdminNegativeTestJSON-1163251861 tempest-AZAdminNegativeTestJSON-1163251861-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '60be8c6d70464fe494cfedfea9fd094a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d3de060186a47989b163426fd5dc396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3cd94f0c-e0a3-4acb-a7a6-2fd9195312ad tempest-AZAdminNegativeTestJSON-1163251861 tempest-AZAdminNegativeTestJSON-1163251861-project] Request method failure captured: Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6YXDkpg6UoRLAZwqVNWcT-SzcgCEKBwQCZDxdsPVyasJmO5akucOPE0oHC0oWyMv3OfxBdOQ1JXnzcNSoDQHBho7xpgXnZzWY364ype8k7zwmNdy7cEF2dj1EfRD9m7sgFb3bVIqwIwxkZeN0znRGWMjyYmpveLQtpFJdzcVPkBNxE Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1d3de060186a47989b163426fd5dc396 Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1163251861 Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:23.218507 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d3de060186a47989b163426fd5dc396"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1d3de060186a47989b163426fd5dc396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1d3de060186a47989b163426fd5dc396", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1d3de060186a47989b163426fd5dc396"}]}] Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AZAdminNegativeTestJSON-1163251861 Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1d3de060186a47989b163426fd5dc396 Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1163251861 Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AZAdminNegativeTestJSON-1163251861-project Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 60be8c6d70464fe494cfedfea9fd094a Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AZAdminNegativeTestJSON-1163251861-project Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 09:51:23.220743 n-d-zed-1 devstack@n-api.service[128748]: action_args: {} Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:23.221602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:23.222833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3cd94f0c-e0a3-4acb-a7a6-2fd9195312ad tempest-AZAdminNegativeTestJSON-1163251861 tempest-AZAdminNegativeTestJSON-1163251861-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:23.224018 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3cd94f0c-e0a3-4acb-a7a6-2fd9195312ad tempest-AZAdminNegativeTestJSON-1163251861 tempest-AZAdminNegativeTestJSON-1163251861-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.473192 Oct 28 09:51:23.226296 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 151/285] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 09:51:22 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 478 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:23.227205 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-87c7f03a-140c-4c2b-b39a-a0803174e1cf tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 752 microversion: 2.1 time: 0.107381 Oct 28 09:51:23.229875 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 135/286] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 752 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:23.269491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c347c86d-55a2-405a-b32e-c32a9e48e09a tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca33f480d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.285580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c347c86d-55a2-405a-b32e-c32a9e48e09a tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.286308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c347c86d-55a2-405a-b32e-c32a9e48e09a tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.305942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c347c86d-55a2-405a-b32e-c32a9e48e09a tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.411230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c347c86d-55a2-405a-b32e-c32a9e48e09a tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.161826 Oct 28 09:51:23.422038 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 152/287] 10.222.0.16 () {58 vars in 1179 bytes} [Fri Oct 28 09:51:23 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:23.428735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca381f7ca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.436760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.437346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.437807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.500808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.502504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.505345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.544970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.549076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.549076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.582707 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62afea9e-2b41-4bf2-8aef-497f02fe2fda tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.155298 Oct 28 09:51:23.583837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 136/288] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:23 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:23.603783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca381d8e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.608661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.609476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.612982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.662156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.664542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.666453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.700154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-97dc01bd-e889-4961-aaf5-c5cad6e5cb60 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 752 microversion: 2.1 time: 0.103355 Oct 28 09:51:23.714695 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 137/289] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:23 2022] GET /compute/v2.1/os-hypervisors/1 => generated 752 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:23.736446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca382bcf70>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.738394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.738890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.739333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.790965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.791478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.791927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.809749 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c67cbceb-da58-4c0a-b031-4c3b14e4f7c5 tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 752 microversion: 2.1 time: 0.093804 Oct 28 09:51:23.828362 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 138/290] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:23 2022] GET /compute/v2.1/os-hypervisors/2 => generated 752 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:23.836181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.837734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:23.855657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.859433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.860179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.862314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.864233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.864957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.884253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] Calling method '.version_select at 0x7fca383eb1f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:23.908737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.917782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.918482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.922643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:23.930359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:23.932811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:23.998047 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07a0dd6d-9719-4d89-945f-1637735775db tempest-AbsoluteLimitsTestJSON-592372377 tempest-AbsoluteLimitsTestJSON-592372377-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.529413 Oct 28 09:51:24.002144 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 153/291] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:51:23 2022] GET /compute/v2.1/limits => generated 511 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:24.007513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Calling method '.version_select at 0x7fca38082ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:24.012400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:24.014705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:24.016387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:24.055901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:24.057835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:24.059392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:24.083474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:24.090545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:24.091875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:24.140471 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ad60576-93b2-4251-8d96-3ef589b0890c tempest-HypervisorAdminTestJSON-527797383 tempest-HypervisorAdminTestJSON-527797383-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 172 microversion: 2.1 time: 0.136263 Oct 28 09:51:24.141362 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 154/292] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 09:51:24 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 172 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:24.158794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:24.159895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:24.179748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:24.182281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:24.182963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:24.188471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:24.189299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:24.189982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:24.461707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.472805 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d03bce2-4883-4476-b7c3-550c38ed4fd1 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.328406 Oct 28 09:51:24.478052 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 155/293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:24 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:24.491135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:24.501213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:24.553264 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c9f1e944-c1e9-4828-835f-27629fd51312 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.721698 Oct 28 09:51:24.558622 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 139/294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:23 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:24.578797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ae67b141-0845-47df-b53e-7b59b4d266ba req-d26236db-7a19-4d65-9997-d7b408a6d5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e447ef-6e3d-4845-849a-01c49f8cc9c0", "name": "network-vif-plugged", "status": "completed", "tag": "2e057f62-84e5-4c4b-b2f2-e890a65b252f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:24.632865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae67b141-0845-47df-b53e-7b59b4d266ba req-d26236db-7a19-4d65-9997-d7b408a6d5f2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:24.633802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae67b141-0845-47df-b53e-7b59b4d266ba req-d26236db-7a19-4d65-9997-d7b408a6d5f2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:24.639105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae67b141-0845-47df-b53e-7b59b4d266ba req-d26236db-7a19-4d65-9997-d7b408a6d5f2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:24.675045 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ae67b141-0845-47df-b53e-7b59b4d266ba req-d26236db-7a19-4d65-9997-d7b408a6d5f2 service nova] Creating event network-vif-plugged:2e057f62-84e5-4c4b-b2f2-e890a65b252f for instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 on n-h2-zed-1 Oct 28 09:51:24.696348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ae67b141-0845-47df-b53e-7b59b4d266ba req-d26236db-7a19-4d65-9997-d7b408a6d5f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130850 Oct 28 09:51:24.701706 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 156/295] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:25.519787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:25.520840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:25.549504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:25.550344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:25.551054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:25.552229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:25.573121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:25.574078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:25.642161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:25.653279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:25.702989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:25.704509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:25.707711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:25.710440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:25.713882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:25.714916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:26.065756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:26.076831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96ed7dbb-12c6-4635-908c-73d65b2d1ebd tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1319 microversion: 2.1 time: 0.564526 Oct 28 09:51:26.077982 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 140/296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:25 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1319 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:26.242108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:26.260804 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6ef517f6-c4bf-4b74-9a00-929a85e5c238 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.652106 Oct 28 09:51:26.278282 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 157/297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:25 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:27.109018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:27.110383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:27.131655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.136190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.139713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.142158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.144266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.144806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.291871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:27.292528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:27.303862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.304362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.304797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.312520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.313423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.313872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.458266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:27.466840 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98ebf6a7-c9ae-4e0e-84a5-908422dff104 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1469 microversion: 2.1 time: 0.365943 Oct 28 09:51:27.471700 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 141/298] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:27 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:27.495038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:27.503153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:27.521125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.523610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.524450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.525420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.526644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.528640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.763481 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25d24405-6b43-4b2b-84f7-d37fdb49df97 tempest-DeleteServersAdminTestJSON-805679538 tempest-DeleteServersAdminTestJSON-805679538-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0/action" status: 202 len: 0 microversion: 2.1 time: 0.273300 Oct 28 09:51:27.766041 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 142/299] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:51:27 2022] POST /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:51:27.779393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:27.782462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:27.798916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.799425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.799865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.800594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.801263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.801569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.870678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:27.871510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:27.872556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:27.873302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lazy-loading 'fault' on Instance uuid f9e447ef-6e3d-4845-849a-01c49f8cc9c0 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:51:28.090743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.118523 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4583984f-c199-4a46-bff3-d96860f8b0b2 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1452 microversion: 2.1 time: 0.346769 Oct 28 09:51:28.124437 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 143/300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:27 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1452 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:28.160568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:28.162374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:28.175896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:28.177031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:28.177674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:28.178871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:28.180482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:28.181199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:28.220483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:51:28.236036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.260111 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4f6c3dec-bebe-4439-9cc7-52fe36da05cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.970540 Oct 28 09:51:28.269985 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 158/301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:27 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:28.372712 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9841d8dd-877e-4e6b-bf8f-4342f8231fb6 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 204 len: 0 microversion: 2.1 time: 0.227203 Oct 28 09:51:28.373371 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 144/302] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:51:28 2022] DELETE /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:51:28.385559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:28.386307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:28.393171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:28.393674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:28.394113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:28.395076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:28.396066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:28.396889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:28.441334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:28.442167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:28.442798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:28.443438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lazy-loading 'fault' on Instance uuid f9e447ef-6e3d-4845-849a-01c49f8cc9c0 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:51:28.620103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:28.632118 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12970f80-2ec2-4608-a2d7-6d0ca48c0d71 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1458 microversion: 2.1 time: 0.249560 Oct 28 09:51:28.634040 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 145/303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:28 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1458 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:28.931129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e2addc3-8529-4f34-b2cd-aa7b67e39598 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1856658698", "id": 268219714, "os-flavor-access:is_public": "False"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:28.963728 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e2addc3-8529-4f34-b2cd-aa7b67e39598 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.692506 Oct 28 09:51:28.966818 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 159/304] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:28 2022] POST /compute/v2.1/flavors => generated 428 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:28.979874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-58c34bf0-6840-40d5-a9d7-6aa99af8c126 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cd91623aae3942a6bcca7f7c0cd83cef"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:29.285436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:29.286057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:29.294173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:29.294672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:29.295118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:29.295833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:29.296296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:29.296733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:29.486664 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-58c34bf0-6840-40d5-a9d7-6aa99af8c126 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/268219714/action" status: 200 len: 96 microversion: 2.1 time: 0.505997 Oct 28 09:51:29.487807 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 146/305] 10.222.0.16 () {60 vars in 1197 bytes} [Fri Oct 28 09:51:28 2022] POST /compute/v2.1/flavors/268219714/action => generated 96 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:29.757081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:29.777823 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7fb4dc2e-4e0e-4e63-8837-2f17abc2f49e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 0.495243 Oct 28 09:51:29.799990 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 160/306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:29 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:29.810426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:29.811126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d8fed5c1-39f0-498b-95a7-5bc523f5ab8b tempest-FlavorsAccessTestJSON-730934634 tempest-FlavorsAccessTestJSON-730934634-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:29.811430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:29.833881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:29.837570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:29.838368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:29.848350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:29.862552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:29.864006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:29.866881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d8fed5c1-39f0-498b-95a7-5bc523f5ab8b tempest-FlavorsAccessTestJSON-730934634 tempest-FlavorsAccessTestJSON-730934634-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6236 microversion: 2.1 time: 0.372048 Oct 28 09:51:29.867340 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 147/307] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:29 2022] GET /compute/v2.1/flavors/detail => generated 6236 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:29.891482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-35dccd34-3911-43f5-859b-d92b9b99fe42 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cd91623aae3942a6bcca7f7c0cd83cef"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:29.980555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:29.982819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:29.986471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:29.987095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lazy-loading 'fault' on Instance uuid f9e447ef-6e3d-4845-849a-01c49f8cc9c0 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:51:30.495860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:30.510926 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d47f23b1-6e7c-41a0-896f-da317b39fec9 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1458 microversion: 2.1 time: 0.705921 Oct 28 09:51:30.513747 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 161/308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:29 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1458 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:30.808393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:30.809142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:30.831756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:30.836988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:30.837577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:30.838308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:30.838824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:30.839263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:30.896071 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-35dccd34-3911-43f5-859b-d92b9b99fe42 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/268219714/action" status: 200 len: 21 microversion: 2.1 time: 1.007955 Oct 28 09:51:30.900609 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 148/309] 10.222.0.16 () {60 vars in 1197 bytes} [Fri Oct 28 09:51:29 2022] POST /compute/v2.1/flavors/268219714/action => generated 21 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:30.933103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81424178-c32c-4d37-8b2c-59359d8bdd3b tempest-FlavorsAccessTestJSON-730934634 tempest-FlavorsAccessTestJSON-730934634-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.096750 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81424178-c32c-4d37-8b2c-59359d8bdd3b tempest-FlavorsAccessTestJSON-730934634 tempest-FlavorsAccessTestJSON-730934634-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.184827 Oct 28 09:51:31.120080 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 149/310] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:30 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:31.156433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4480118f-2837-4514-bfa5-c5b6520be14f tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.263829 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4480118f-2837-4514-bfa5-c5b6520be14f tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/268219714" status: 202 len: 0 microversion: 2.1 time: 0.100504 Oct 28 09:51:31.267469 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 150/311] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:51:31 2022] DELETE /compute/v2.1/flavors/268219714 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:31.304549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62ce4e37-19db-44d8-a4eb-b47437ec354b tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.399582 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62ce4e37-19db-44d8-a4eb-b47437ec354b tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.114731 Oct 28 09:51:31.400707 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 151/312] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:31 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:31.429316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6febdf75-0b34-4ea7-8c11-5f3ddda5ddc0 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1621855650", "id": 1330116555, "os-flavor-access:is_public": "False"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:31.464571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6febdf75-0b34-4ea7-8c11-5f3ddda5ddc0 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.040342 Oct 28 09:51:31.466588 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 152/313] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:31 2022] POST /compute/v2.1/flavors => generated 431 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:31.480849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70b64ccb-2161-49df-b148-2e31031b63a5 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.532581 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70b64ccb-2161-49df-b148-2e31031b63a5 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1330116555/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.050040 Oct 28 09:51:31.534629 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 153/314] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 09:51:31 2022] GET /compute/v2.1/flavors/1330116555/os-flavor-access => generated 21 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:31.549865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:31.551264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:31.568469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=2,nova_api:DELETE=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:31.571172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:31.572045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:31.572767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:31.601565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:31.602641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:31.609445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:31.687024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:31.689758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:31.690615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:31.696628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lazy-loading 'fault' on Instance uuid f9e447ef-6e3d-4845-849a-01c49f8cc9c0 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:51:33.184286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:33.233402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:33.250546 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d2b130a7-dbec-4407-a2fa-cf2abab1ee32 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1458 microversion: 2.1 time: 1.708911 Oct 28 09:51:33.251283 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 154/315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:31 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1458 bytes in 1711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:33.257128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-79028bac-9351-4471-b47b-f5081a9ae04a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1476 microversion: 2.1 time: 2.450293 Oct 28 09:51:33.277271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b0c8f82-8a59-4c18-b8ec-eb86e2dbf9dc tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:33.290407 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 162/316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:30 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1476 bytes in 2490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:33.328947 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b0c8f82-8a59-4c18-b8ec-eb86e2dbf9dc tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1330116555" status: 202 len: 0 microversion: 2.1 time: 0.062466 Oct 28 09:51:33.330194 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 155/317] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:51:33 2022] DELETE /compute/v2.1/flavors/1330116555 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:33.345050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7ded481b-20cf-49ef-9cd6-2dfcb5a6e1d2 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:33.415569 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7ded481b-20cf-49ef-9cd6-2dfcb5a6e1d2 tempest-FlavorsAccessTestJSON-1935797747 tempest-FlavorsAccessTestJSON-1935797747-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.077402 Oct 28 09:51:33.417126 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 163/318] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:33 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:33.773549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Calling method '.version_select at 0x7fca3802f3a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:33.775559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:33.776099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:33.776579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:33.830169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:33.830668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:33.831923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:33.861992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:33.862660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:33.863121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:33.908126 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b16d72c2-e010-4d14-ae5c-db454ef009e0 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.28 time: 0.511200 Oct 28 09:51:33.909145 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 156/319] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 09:51:33 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:51:33.925475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Calling method '.version_select at 0x7fca33ea0d30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:33.939917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:33.948077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:33.954513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:33.976207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:33.984322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:34.034326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:34.035767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:34.036852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:34.050578 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad86e832-11d1-472b-8ad5-4aca57b281c1 tempest-HypervisorAdminV228Test-394993394 tempest-HypervisorAdminV228Test-394993394-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 712 microversion: 2.28 time: 0.133515 Oct 28 09:51:34.052651 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 164/320] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 09:51:33 2022] GET /compute/v2.1/os-hypervisors/1 => generated 712 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:51:34.278502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:34.279386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:34.295784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:34.296351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:34.296805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:34.299828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:34.300459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:34.304415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:34.400067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:34.402853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:34.404807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:34.407697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lazy-loading 'fault' on Instance uuid f9e447ef-6e3d-4845-849a-01c49f8cc9c0 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:51:35.064159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c436eb1-1698-4e10-956c-e0bab3638110 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Calling method '.version_select at 0x7fca3802f0d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.078483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4c436eb1-1698-4e10-956c-e0bab3638110 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '236491013a7b459e83eb3dd3280c145b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720fdb249ed1424197c88e597e153de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c436eb1-1698-4e10-956c-e0bab3638110 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Request method failure captured: Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6YikKKq4px0ZrwsZ5FllJuMDoVvAhkjIE7mSoQQpx2M3pNM6njDAi52s3wOyq17g9K-NszbMjoQxB-5SQ7w2qzgon-v78PHa4BoxbnJaNp08PutOTSREREfQgbWsKS6LePZSKln9tbqzf_Ed8gAbYxgfiDbopqp7gURSNXhCXSL8nM Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:35.085345 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_720fdb249ed1424197c88e597e153de5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/720fdb249ed1424197c88e597e153de5"}]}] Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 236491013a7b459e83eb3dd3280c145b Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: action_args: {} Oct 28 09:51:35.086901 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:35.087755 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 28 09:51:35.091233 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.092338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c436eb1-1698-4e10-956c-e0bab3638110 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:35.092338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c436eb1-1698-4e10-956c-e0bab3638110 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.843543 Oct 28 09:51:35.095891 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 157/321] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 09:51:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 851 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:35.104751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.109889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:35.134395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.135277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.136470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.137906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.138588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.151255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.365922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.396487 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a6bd942b-94b1-4e76-8717-1094b602e3e4 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1458 microversion: 2.1 time: 1.121848 Oct 28 09:51:35.411000 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 165/322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:34 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1458 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:35.444468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d319c5ab-8ea8-463a-8909-540ad57ed543 req-37920ac2-e799-480f-92d7-ab9df65e1fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b164-bda6-4231-a396-be286a5310eb", "name": "network-vif-unplugged", "status": "completed", "tag": "f6376f13-2a79-40aa-bfb5-de1526dc5507"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:35.463381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d319c5ab-8ea8-463a-8909-540ad57ed543 req-37920ac2-e799-480f-92d7-ab9df65e1fb1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.464188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d319c5ab-8ea8-463a-8909-540ad57ed543 req-37920ac2-e799-480f-92d7-ab9df65e1fb1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.465657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d319c5ab-8ea8-463a-8909-540ad57ed543 req-37920ac2-e799-480f-92d7-ab9df65e1fb1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:35.472704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:35.493517 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d319c5ab-8ea8-463a-8909-540ad57ed543 req-37920ac2-e799-480f-92d7-ab9df65e1fb1 service nova] Creating event network-vif-unplugged:f6376f13-2a79-40aa-bfb5-de1526dc5507 for instance 1b81b164-bda6-4231-a396-be286a5310eb on n-h1-zed-1 Oct 28 09:51:35.536206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-d319c5ab-8ea8-463a-8909-540ad57ed543 req-37920ac2-e799-480f-92d7-ab9df65e1fb1 service nova] Instance 1b81b164-bda6-4231-a396-be286a5310eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:51:35.578120 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d319c5ab-8ea8-463a-8909-540ad57ed543 req-37920ac2-e799-480f-92d7-ab9df65e1fb1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.164958 Oct 28 09:51:35.578815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 166/323] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:35.593389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ca84abd-f7fe-4602-b0cc-1000bbf41415 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Calling method '.version_select at 0x7fca33ef9310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.595350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8ca84abd-f7fe-4602-b0cc-1000bbf41415 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '236491013a7b459e83eb3dd3280c145b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720fdb249ed1424197c88e597e153de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ca84abd-f7fe-4602-b0cc-1000bbf41415 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Request method failure captured: Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6YikKKq4px0ZrwsZ5FllJuMDoVvAhkjIE7mSoQQpx2M3pNM6njDAi52s3wOyq17g9K-NszbMjoQxB-5SQ7w2qzgon-v78PHa4BoxbnJaNp08PutOTSREREfQgbWsKS6LePZSKln9tbqzf_Ed8gAbYxgfiDbopqp7gURSNXhCXSL8nM Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:35.616302 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_720fdb249ed1424197c88e597e153de5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/720fdb249ed1424197c88e597e153de5"}]}] Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 236491013a7b459e83eb3dd3280c145b Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: action_args: {} Oct 28 09:51:35.617733 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:35.618729 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 28 09:51:35.619886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.621045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ca84abd-f7fe-4602-b0cc-1000bbf41415 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:35.621769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ca84abd-f7fe-4602-b0cc-1000bbf41415 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.035987 Oct 28 09:51:35.622497 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 167/324] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:35 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:35.640777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db3458f3-6956-4782-99b7-b54c098c8b8d tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Calling method '.version_select at 0x7fca33ef9430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.643050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db3458f3-6956-4782-99b7-b54c098c8b8d tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '236491013a7b459e83eb3dd3280c145b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720fdb249ed1424197c88e597e153de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db3458f3-6956-4782-99b7-b54c098c8b8d tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Request method failure captured: Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6YikKKq4px0ZrwsZ5FllJuMDoVvAhkjIE7mSoQQpx2M3pNM6njDAi52s3wOyq17g9K-NszbMjoQxB-5SQ7w2qzgon-v78PHa4BoxbnJaNp08PutOTSREREfQgbWsKS6LePZSKln9tbqzf_Ed8gAbYxgfiDbopqp7gURSNXhCXSL8nM Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:35.651172 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_720fdb249ed1424197c88e597e153de5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/720fdb249ed1424197c88e597e153de5"}]}] Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 236491013a7b459e83eb3dd3280c145b Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: action_args: {} Oct 28 09:51:35.652442 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:35.653287 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 28 09:51:35.654316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:35.655803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db3458f3-6956-4782-99b7-b54c098c8b8d tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:35.655803 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-db3458f3-6956-4782-99b7-b54c098c8b8d tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.023111 Oct 28 09:51:35.657519 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 168/325] 10.222.0.16 () {58 vars in 1179 bytes} [Fri Oct 28 09:51:35 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:51:35.908928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:35.925000 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37b0bf95-519d-41d9-9bb1-3b14c45e6e00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1475 microversion: 2.1 time: 0.827501 Oct 28 09:51:35.935801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Calling method '.version_select at 0x7fca33ef9940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:35.943133 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 158/326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:35 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1475 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:35.946642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:35.947711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:35.948476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.018953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.019819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.020612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.043141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.046098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.050060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.101525 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eae9d315-31ee-4485-90e9-ca9931d2e5bc tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.433565 Oct 28 09:51:36.103156 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 169/327] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:35 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:36.114356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7e5f6d8-9f5d-4de8-843c-6df7fdb99e01 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Calling method '.version_select at 0x7fca3816c670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.117961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7e5f6d8-9f5d-4de8-843c-6df7fdb99e01 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '236491013a7b459e83eb3dd3280c145b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720fdb249ed1424197c88e597e153de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7e5f6d8-9f5d-4de8-843c-6df7fdb99e01 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Request method failure captured: Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6YikKKq4px0ZrwsZ5FllJuMDoVvAhkjIE7mSoQQpx2M3pNM6njDAi52s3wOyq17g9K-NszbMjoQxB-5SQ7w2qzgon-v78PHa4BoxbnJaNp08PutOTSREREfQgbWsKS6LePZSKln9tbqzf_Ed8gAbYxgfiDbopqp7gURSNXhCXSL8nM Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:36.120956 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_720fdb249ed1424197c88e597e153de5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/720fdb249ed1424197c88e597e153de5"}]}] Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 236491013a7b459e83eb3dd3280c145b Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '1'} Oct 28 09:51:36.122946 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:36.123670 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 28 09:51:36.124740 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.134537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7e5f6d8-9f5d-4de8-843c-6df7fdb99e01 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:36.138138 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7e5f6d8-9f5d-4de8-843c-6df7fdb99e01 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.027387 Oct 28 09:51:36.139737 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 159/328] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:36.153029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95621ee2-2343-41fd-b4d7-4117039edb53 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Calling method '.version_select at 0x7fca33ef9040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.156413 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-95621ee2-2343-41fd-b4d7-4117039edb53 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] HTTP exception thrown: Hypervisor with ID '472a4942-a150-478d-bc2e-983391019dd7' could not be found. Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95621ee2-2343-41fd-b4d7-4117039edb53 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Request method failure captured: Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hypervisors/472a4942-a150-478d-bc2e-983391019dd7/uptime HTTP/1.1 Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6YlhXN9tYSLixy5_XZWg7a6M7gZLOtt5RPr8g91tIaHocCCYO5X2BAGY83B9bVz9sdnZTevA_k1xHbwVHtoievMxoSQZmYnR6vekZ9UKZQhsux4MUEF6R8C4w6Xy3Uo8dqnIkQzJj1OoMCl-QCpWXwtPC9i4V2wvUK7R7c8D3LHY_0 Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: a250c58117674f73a7b2f1e348d56ea7 Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1475344376 Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:51:36.167921 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a250c58117674f73a7b2f1e348d56ea7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a250c58117674f73a7b2f1e348d56ea7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a250c58117674f73a7b2f1e348d56ea7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a250c58117674f73a7b2f1e348d56ea7"}]}] Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1475344376 Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: a250c58117674f73a7b2f1e348d56ea7 Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1475344376 Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 9d8811dc18b5479495104e14c3e11c86 Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: exception: Hypervisor with ID '472a4942-a150-478d-bc2e-983391019dd7' could not be found. Oct 28 09:51:36.170083 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '472a4942-a150-478d-bc2e-983391019dd7'} Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '472a4942-a150-478d-bc2e-983391019dd7' Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 09:51:36.170810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '472a4942-a150-478d-bc2e-983391019dd7' could not be found. Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.172073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '472a4942-a150-478d-bc2e-983391019dd7' could not be found. Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95621ee2-2343-41fd-b4d7-4117039edb53 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Returning 404 to user: Hypervisor with ID '472a4942-a150-478d-bc2e-983391019dd7' could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:36.173259 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-95621ee2-2343-41fd-b4d7-4117039edb53 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/472a4942-a150-478d-bc2e-983391019dd7/uptime" status: 404 len: 123 microversion: 2.1 time: 0.026496 Oct 28 09:51:36.178484 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 170/329] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/os-hypervisors/472a4942-a150-478d-bc2e-983391019dd7/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:36.183652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Calling method '.version_select at 0x7fca3802f5e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.186698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.188111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.188829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.209022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.209905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.210825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.243905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.244480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.245010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.259673 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c1c9d95-70b2-4901-9e5f-aa42bb0b29bd tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.079651 Oct 28 09:51:36.266523 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 160/330] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:36.271701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-840a5fa8-556c-4518-a121-f0c0cd59ff54 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Calling method '.version_select at 0x7fca33e8c040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.274750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-840a5fa8-556c-4518-a121-f0c0cd59ff54 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '236491013a7b459e83eb3dd3280c145b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '720fdb249ed1424197c88e597e153de5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-840a5fa8-556c-4518-a121-f0c0cd59ff54 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Request method failure captured: Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6YikKKq4px0ZrwsZ5FllJuMDoVvAhkjIE7mSoQQpx2M3pNM6njDAi52s3wOyq17g9K-NszbMjoQxB-5SQ7w2qzgon-v78PHa4BoxbnJaNp08PutOTSREREfQgbWsKS6LePZSKln9tbqzf_Ed8gAbYxgfiDbopqp7gURSNXhCXSL8nM Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:36.276623 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/720fdb249ed1424197c88e597e153de5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_720fdb249ed1424197c88e597e153de5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/720fdb249ed1424197c88e597e153de5"}]}] Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 720fdb249ed1424197c88e597e153de5 Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-746673945 Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 236491013a7b459e83eb3dd3280c145b Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-746673945-project Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1'} Oct 28 09:51:36.278209 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:36.279083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 28 09:51:36.280266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.286966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-840a5fa8-556c-4518-a121-f0c0cd59ff54 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:36.288337 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-840a5fa8-556c-4518-a121-f0c0cd59ff54 tempest-HypervisorAdminNegativeTestJSON-746673945 tempest-HypervisorAdminNegativeTestJSON-746673945-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.020723 Oct 28 09:51:36.289318 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 171/331] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:36.301048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6bfceb05-dd72-4a48-86b6-d40bf32955e5 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Calling method '.version_select at 0x7fca380f1820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.303012 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6bfceb05-dd72-4a48-86b6-d40bf32955e5 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] HTTP exception thrown: Hypervisor with ID '8baf5160-de67-4194-a5ce-225871e402b2' could not be found. Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6bfceb05-dd72-4a48-86b6-d40bf32955e5 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Request method failure captured: Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hypervisors/8baf5160-de67-4194-a5ce-225871e402b2 HTTP/1.1 Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6YlhXN9tYSLixy5_XZWg7a6M7gZLOtt5RPr8g91tIaHocCCYO5X2BAGY83B9bVz9sdnZTevA_k1xHbwVHtoievMxoSQZmYnR6vekZ9UKZQhsux4MUEF6R8C4w6Xy3Uo8dqnIkQzJj1OoMCl-QCpWXwtPC9i4V2wvUK7R7c8D3LHY_0 Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: a250c58117674f73a7b2f1e348d56ea7 Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1475344376 Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:51:36.305965 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a250c58117674f73a7b2f1e348d56ea7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a250c58117674f73a7b2f1e348d56ea7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a250c58117674f73a7b2f1e348d56ea7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a250c58117674f73a7b2f1e348d56ea7"}]}] Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1475344376 Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: a250c58117674f73a7b2f1e348d56ea7 Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1475344376 Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 9d8811dc18b5479495104e14c3e11c86 Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: exception: Hypervisor with ID '8baf5160-de67-4194-a5ce-225871e402b2' could not be found. Oct 28 09:51:36.307701 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '8baf5160-de67-4194-a5ce-225871e402b2'} Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8baf5160-de67-4194-a5ce-225871e402b2' Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 28 09:51:36.308533 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:51:36.310593 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8baf5160-de67-4194-a5ce-225871e402b2' could not be found. Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8baf5160-de67-4194-a5ce-225871e402b2' could not be found. Oct 28 09:51:36.311904 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:36.313190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6bfceb05-dd72-4a48-86b6-d40bf32955e5 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] Returning 404 to user: Hypervisor with ID '8baf5160-de67-4194-a5ce-225871e402b2' could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:36.314068 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6bfceb05-dd72-4a48-86b6-d40bf32955e5 tempest-HypervisorAdminNegativeTestJSON-1475344376 tempest-HypervisorAdminNegativeTestJSON-1475344376-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/8baf5160-de67-4194-a5ce-225871e402b2" status: 404 len: 123 microversion: 2.1 time: 0.018011 Oct 28 09:51:36.316869 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 161/332] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/os-hypervisors/8baf5160-de67-4194-a5ce-225871e402b2 => generated 123 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:36.464669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.467286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:36.490647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.491665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.492540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.494411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.495342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.508501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.620203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.620745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.624419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.624999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lazy-loading 'fault' on Instance uuid f9e447ef-6e3d-4845-849a-01c49f8cc9c0 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:51:36.755640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '791f2111f74a452eaa525d16ce0b6448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea03cddd04e83aaabb5e6810892d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:36.773481 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a82ef5d-f8af-48a2-b605-08550f4a2827 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 200 len: 1416 microversion: 2.1 time: 0.333751 Oct 28 09:51:36.774530 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 172/333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 1416 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:36.954777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:36.955404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:36.972514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.973115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.973639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:36.976995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:36.983604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:36.984388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.577495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:37.605927 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0772329-477c-42db-9376-f969094fe58c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1475 microversion: 2.1 time: 0.652875 Oct 28 09:51:37.636675 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 162/334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:36 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1475 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:37.694590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e447ef-6e3d-4845-849a-01c49f8cc9c0", "name": "network-vif-deleted", "tag": "2e057f62-84e5-4c4b-b2f2-e890a65b252f"}, {"name": "network-changed", "server_uuid": "1b81b164-bda6-4231-a396-be286a5310eb", "tag": "f6376f13-2a79-40aa-bfb5-de1526dc5507"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:37.731902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.732440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.736218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.801556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:37.802180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:37.806886 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] Creating event network-vif-deleted:2e057f62-84e5-4c4b-b2f2-e890a65b252f for instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 on n-h2-zed-1 Oct 28 09:51:37.807412 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] Creating event network-changed:f6376f13-2a79-40aa-bfb5-de1526dc5507 for instance 1b81b164-bda6-4231-a396-be286a5310eb on n-h1-zed-1 Oct 28 09:51:37.815836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.820018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.821381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.824717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.825479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.827350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.828146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] Instance 1b81b164-bda6-4231-a396-be286a5310eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:51:37.881255 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1ae515a0-4fe9-43d8-bf62-6c7fbac56ffe req-cf593c3e-c548-4bec-8da8-ee02d8af50d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.191760 Oct 28 09:51:37.883602 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] HTTP exception thrown: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Request method failure captured: Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 HTTP/1.1 Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPdLm-jdDYPbYcuDZSAgfEPTuqziw9aLw7Yt6-3aamVpuFmNCcrYCAIxVHOZFOUb-N07m2EnC9wW9878OkzNOWKTDPX0EDTUCHbM9S9Bggjnn451TVMBt7GQVyCEmLYNFLRMmyXzfKzK2q0cydxq5uAedWOSMx-IFYCRu03rua2-s Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:37.887664 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_340ea03cddd04e83aaabb5e6810892d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/340ea03cddd04e83aaabb5e6810892d2"}]}] Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 791f2111f74a452eaa525d16ce0b6448 Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.889521 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f9e447ef-6e3d-4845-849a-01c49f8cc9c0'} Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:37.890369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.891848 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.893533 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 173/335] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:51:37.894053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Returning 404 to user: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:37.895855 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-afa30507-8cdc-4ba3-92dd-bf5be705062d tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 404 len: 111 microversion: 2.1 time: 0.099326 Oct 28 09:51:37.897209 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 163/336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:37 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:51:37.916379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:37.917162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:37.931941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.932626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.933439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.934600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:37.936418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:37.937187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:37.969550 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] HTTP exception thrown: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Request method failure captured: Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 HTTP/1.1 Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPdLm-jdDYPbYcuDZSAgfEPTuqziw9aLw7Yt6-3aamVpuFmNCcrYCAIxVHOZFOUb-N07m2EnC9wW9878OkzNOWKTDPX0EDTUCHbM9S9Bggjnn451TVMBt7GQVyCEmLYNFLRMmyXzfKzK2q0cydxq5uAedWOSMx-IFYCRu03rua2-s Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:37.974061 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_340ea03cddd04e83aaabb5e6810892d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/340ea03cddd04e83aaabb5e6810892d2"}]}] Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 791f2111f74a452eaa525d16ce0b6448 Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.975615 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f9e447ef-6e3d-4845-849a-01c49f8cc9c0'} Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:37.976485 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:37.977789 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:37.981033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Returning 404 to user: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:37.981033 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9e35a532-b267-4021-ada7-1b3ab5425dcb tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 404 len: 111 microversion: 2.1 time: 0.068563 Oct 28 09:51:37.981033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 174/337] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:51:37 2022] DELETE /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:37.986247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:37.989055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: f9e447ef-6e3d-4845-849a-01c49f8cc9c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:38.004732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.005750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.009151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.010767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.016003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.016717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.052061 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] HTTP exception thrown: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Request method failure captured: Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 HTTP/1.1 Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPdLm-jdDYPbYcuDZSAgfEPTuqziw9aLw7Yt6-3aamVpuFmNCcrYCAIxVHOZFOUb-N07m2EnC9wW9878OkzNOWKTDPX0EDTUCHbM9S9Bggjnn451TVMBt7GQVyCEmLYNFLRMmyXzfKzK2q0cydxq5uAedWOSMx-IFYCRu03rua2-s Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:38.056517 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_340ea03cddd04e83aaabb5e6810892d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/340ea03cddd04e83aaabb5e6810892d2"}]}] Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 791f2111f74a452eaa525d16ce0b6448 Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:38.058054 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f9e447ef-6e3d-4845-849a-01c49f8cc9c0'} Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:38.058777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. Oct 28 09:51:38.060009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.063931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Returning 404 to user: Instance f9e447ef-6e3d-4845-849a-01c49f8cc9c0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:38.065087 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f2124269-bb52-4eee-a8e9-9999705d4602 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0" status: 404 len: 111 microversion: 2.1 time: 0.082823 Oct 28 09:51:38.067338 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 164/338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:37 2022] GET /compute/v2.1/servers/f9e447ef-6e3d-4845-849a-01c49f8cc9c0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:51:38.080499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:38.081789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:38.115497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.120364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.121418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.125729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.130367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.132882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.187113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] HTTP exception thrown: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Request method failure captured: Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e HTTP/1.1 Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XPdLm-jdDYPbYcuDZSAgfEPTuqziw9aLw7Yt6-3aamVpuFmNCcrYCAIxVHOZFOUb-N07m2EnC9wW9878OkzNOWKTDPX0EDTUCHbM9S9Bggjnn451TVMBt7GQVyCEmLYNFLRMmyXzfKzK2q0cydxq5uAedWOSMx-IFYCRu03rua2-s Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:51:38.197921 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_340ea03cddd04e83aaabb5e6810892d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/340ea03cddd04e83aaabb5e6810892d2"}]}] Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 791f2111f74a452eaa525d16ce0b6448 Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.199471 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5bd5953d-2698-4320-9718-92a54a912d0e'} Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:38.200741 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.202152 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.203440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Returning 404 to user: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:38.205050 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-572e789e-b261-4841-ac5a-d4ef91e0daae tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 404 len: 111 microversion: 2.1 time: 0.130941 Oct 28 09:51:38.213760 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 175/339] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:51:38 2022] DELETE /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:38.220644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:38.221337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] [instance: 5bd5953d-2698-4320-9718-92a54a912d0e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:38.244600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.250736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.252795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.256454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.260240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.261535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.320384 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] HTTP exception thrown: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Request method failure captured: Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e HTTP/1.1 Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPdLm-jdDYPbYcuDZSAgfEPTuqziw9aLw7Yt6-3aamVpuFmNCcrYCAIxVHOZFOUb-N07m2EnC9wW9878OkzNOWKTDPX0EDTUCHbM9S9Bggjnn451TVMBt7GQVyCEmLYNFLRMmyXzfKzK2q0cydxq5uAedWOSMx-IFYCRu03rua2-s Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:38.327736 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/340ea03cddd04e83aaabb5e6810892d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_340ea03cddd04e83aaabb5e6810892d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/340ea03cddd04e83aaabb5e6810892d2"}]}] Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 340ea03cddd04e83aaabb5e6810892d2 Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1081097909 Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 791f2111f74a452eaa525d16ce0b6448 Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersAdminTestJSON-1081097909-project Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.329681 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '5bd5953d-2698-4320-9718-92a54a912d0e'} Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:38.330519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. Oct 28 09:51:38.332428 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:38.335551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] Returning 404 to user: Instance 5bd5953d-2698-4320-9718-92a54a912d0e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:38.335551 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d9cee47-8a61-4d9f-a691-59b353ed52e5 tempest-DeleteServersAdminTestJSON-1081097909 tempest-DeleteServersAdminTestJSON-1081097909-project] 10.222.0.16 "GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e" status: 404 len: 111 microversion: 2.1 time: 0.118150 Oct 28 09:51:38.338438 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 165/340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:38 2022] GET /compute/v2.1/servers/5bd5953d-2698-4320-9718-92a54a912d0e => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:38.648973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:38.650038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:38.689539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.690430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.691408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:38.696617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:38.705485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:38.706434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:39.906267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:39.915647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81da7ec3-66aa-4bc7-9188-c9718795fa91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1475 microversion: 2.1 time: 1.274028 Oct 28 09:51:39.931376 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 176/341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:38 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1475 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:40.947954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:40.949429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:40.966178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:40.967121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:40.970407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:40.971630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:40.972123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:40.972565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:41.037932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:41.465491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:41.485821 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eec9c15c-ca45-49fd-b61a-e5084cf6c58d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1473 microversion: 2.1 time: 0.540238 Oct 28 09:51:41.486948 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 166/342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:40 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1473 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:42.516172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:42.523324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:42.535048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:42.539550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:42.540999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:42.543033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:42.545674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:42.546892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:42.548011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:43.291034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:43.308025 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cacb22ee-e04b-4448-8c63-17a5b3ab5693 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1470 microversion: 2.1 time: 0.799734 Oct 28 09:51:43.311702 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 177/343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:42 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1470 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:43.343244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:43.343865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:43.353879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:43.354390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:43.354837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:43.355551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:43.359198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:43.360765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:43.500132 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb2f1a6f-f65f-44e0-8c7d-26eb9fbdc935 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb/action" status: 204 len: 0 microversion: 2.1 time: 0.168687 Oct 28 09:51:43.505280 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 167/344] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:51:43 2022] POST /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb/action => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:51:43.513422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:43.514050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:43.532436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:43.533088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:43.533088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:43.536948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:43.554112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:43.557989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:44.289280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:44.307822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-13e07d14-c904-4670-bd2b-f9035c872ab0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1470 microversion: 2.1 time: 0.801151 Oct 28 09:51:44.308645 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 178/345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:43 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1470 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:45.353974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:45.354701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:45.374280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:45.374801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:45.378578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:45.379416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:45.379951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:45.380346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:45.676615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:45.685292 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb6caa93-682d-473f-b5da-10eaa2758097 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1470 microversion: 2.1 time: 0.335990 Oct 28 09:51:45.691190 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 168/346] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:45 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:46.153691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9bf92648-0d25-4c73-8906-f55869ff6681 req-5d36b805-e543-496f-8be6-528a7c1d8747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b164-bda6-4231-a396-be286a5310eb", "name": "network-vif-plugged", "status": "completed", "tag": "f6376f13-2a79-40aa-bfb5-de1526dc5507"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:46.184082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9bf92648-0d25-4c73-8906-f55869ff6681 req-5d36b805-e543-496f-8be6-528a7c1d8747 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:46.185357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9bf92648-0d25-4c73-8906-f55869ff6681 req-5d36b805-e543-496f-8be6-528a7c1d8747 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:46.185832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9bf92648-0d25-4c73-8906-f55869ff6681 req-5d36b805-e543-496f-8be6-528a7c1d8747 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:46.225302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9bf92648-0d25-4c73-8906-f55869ff6681 req-5d36b805-e543-496f-8be6-528a7c1d8747 service nova] Creating event network-vif-plugged:f6376f13-2a79-40aa-bfb5-de1526dc5507 for instance 1b81b164-bda6-4231-a396-be286a5310eb on n-h1-zed-1 Oct 28 09:51:46.239473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-9bf92648-0d25-4c73-8906-f55869ff6681 req-5d36b805-e543-496f-8be6-528a7c1d8747 service nova] Instance 1b81b164-bda6-4231-a396-be286a5310eb is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:51:46.265812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9bf92648-0d25-4c73-8906-f55869ff6681 req-5d36b805-e543-496f-8be6-528a7c1d8747 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115968 Oct 28 09:51:46.269725 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 179/347] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:46.976173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b31bf859-43fa-49ce-8214-6ec3900529a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:46.980026 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b31bf859-43fa-49ce-8214-6ec3900529a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b31bf859-43fa-49ce-8214-6ec3900529a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066-project-admin] Request method failure captured: Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yymrt42-TAtoa6jqy_5UjIk5IWIaUuNedtPpIeE9i_kD_za77VYkpjXEw3VPkbfPQ8RqYTRE-nsbTULLutXl-ca8koLUOC6mYhUYe3033bZYuKqM29e0ABnKFfnGZB1ZzwVu07Fxft9HWAWBHVnLrXKCT5UwTh-eBtTn7LkspYHok Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 5be064b42d144d9cac4cb5932e6961ae Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:51:46.989920 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5be064b42d144d9cac4cb5932e6961ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5be064b42d144d9cac4cb5932e6961ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5be064b42d144d9cac4cb5932e6961ae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5be064b42d144d9cac4cb5932e6961ae"}]}] Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 5be064b42d144d9cac4cb5932e6961ae Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066-project-admin Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: c613bf289b5f421f84e4dd485d926ef7 Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066-project-admin Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:46.991397 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid timestamp for date invalid_time Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'invalid_time'} Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:46.992273 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:46.994074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b31bf859-43fa-49ce-8214-6ec3900529a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:46.995496 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b31bf859-43fa-49ce-8214-6ec3900529a4 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066 tempest-InstanceUsageAuditLogNegativeTestJSON-1636169066-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.634801 Oct 28 09:51:46.996390 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 169/348] 10.222.0.16 () {58 vars in 1224 bytes} [Fri Oct 28 09:51:46 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 638 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:51:47.014151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.015131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:47.033586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:47.036846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:47.037818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:47.040899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:47.049673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:47.051764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:47.221288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-204eebc2-f2ed-4245-becf-4d7d6c3c6261 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33e8a8b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-844364538", "description": "tempest-description-873443848"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:47.553985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:47.573166 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1470 microversion: 2.1 time: 0.570653 Oct 28 09:51:47.574122 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 170/349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:46 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1470 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:47.576302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:47.578363 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8970bb3-f3c0-4fbb-8bb2-89c395ada57e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003207 Oct 28 09:51:47.579828 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 171/350] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 09:51:47 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 09:51:47.610679 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-204eebc2-f2ed-4245-becf-4d7d6c3c6261 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.992093 Oct 28 09:51:47.613640 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 180/351] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:51:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:48.201007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d91bc710-9391-4ca8-99f5-7b937c34eaac tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:48.203654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d91bc710-9391-4ca8-99f5-7b937c34eaac tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'b864666d062b4fcb88102e20b18c8d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518f128bf91f4e43b906128b568d6b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d91bc710-9391-4ca8-99f5-7b937c34eaac tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Request method failure captured: Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Ywx5vIDf8l2TXP4OWXo0Xzk7P0YwkoS5umKQSt7SpgiEmfb9PP5d6DKiNrtAdb9drZEgsbRMwAAVpaX7441iNU6mToRBHr10aED0dskt-Zio0Oyzm48yuDQLTX5bAwnkulPfdqKithAQ95tf7XEjuNjHLxv0Yx8k5uSpqkgyniwg8 Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 518f128bf91f4e43b906128b568d6b0e Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:48.207204 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/518f128bf91f4e43b906128b568d6b0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/518f128bf91f4e43b906128b568d6b0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_518f128bf91f4e43b906128b568d6b0e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/518f128bf91f4e43b906128b568d6b0e"}]}] Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 518f128bf91f4e43b906128b568d6b0e Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b864666d062b4fcb88102e20b18c8d3c Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project Oct 28 09:51:48.208739 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: action_args: {} Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:48.209650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 28 09:51:48.211124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:48.212679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d91bc710-9391-4ca8-99f5-7b937c34eaac tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:48.212679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d91bc710-9391-4ca8-99f5-7b937c34eaac tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.629873 Oct 28 09:51:48.212849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 172/352] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 09:51:47 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 632 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:48.219936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d75c027-777f-412b-9117-cd5b07610b00 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33f5d820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1715017693", "description": "tempest-description-826840719"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:48.592018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-634fede4-08d9-4ef7-b641-d8e8fce274c9 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1325859482", "id": 866179263, "os-flavor-access:is_public": "False"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:48.615853 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d75c027-777f-412b-9117-cd5b07610b00 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.401889 Oct 28 09:51:48.619700 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 173/353] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:51:48 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:48.627856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05d8af86-d4e7-4be3-8b69-9d7c7165f9a7 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:48.631805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-05d8af86-d4e7-4be3-8b69-9d7c7165f9a7 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'b864666d062b4fcb88102e20b18c8d3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '518f128bf91f4e43b906128b568d6b0e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05d8af86-d4e7-4be3-8b69-9d7c7165f9a7 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Request method failure captured: Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2009:51:48 HTTP/1.1 Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Ywx5vIDf8l2TXP4OWXo0Xzk7P0YwkoS5umKQSt7SpgiEmfb9PP5d6DKiNrtAdb9drZEgsbRMwAAVpaX7441iNU6mToRBHr10aED0dskt-Zio0Oyzm48yuDQLTX5bAwnkulPfdqKithAQ95tf7XEjuNjHLxv0Yx8k5uSpqkgyniwg8 Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 518f128bf91f4e43b906128b568d6b0e Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:48.633879 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/518f128bf91f4e43b906128b568d6b0e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/518f128bf91f4e43b906128b568d6b0e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_518f128bf91f4e43b906128b568d6b0e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/518f128bf91f4e43b906128b568d6b0e"}]}] Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 518f128bf91f4e43b906128b568d6b0e Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b864666d062b4fcb88102e20b18c8d3c Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project Oct 28 09:51:48.635247 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '2022-10-28 09:51:48'} Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:48.636062 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 28 09:51:48.637194 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:48.638420 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-634fede4-08d9-4ef7-b641-d8e8fce274c9 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 1.017078 Oct 28 09:51:48.638420 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 181/354] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:47 2022] POST /compute/v2.1/flavors => generated 436 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:48.639741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05d8af86-d4e7-4be3-8b69-9d7c7165f9a7 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:48.641160 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-05d8af86-d4e7-4be3-8b69-9d7c7165f9a7 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583 tempest-InstanceUsageAuditLogNegativeTestJSON-102885583-project] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 09:51:48" status: 403 len: 128 microversion: 2.1 time: 0.019770 Oct 28 09:51:48.642912 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 174/355] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 09:51:48 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2009%3A51%3A48 => generated 128 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:48.647548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:48.648591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:48.694939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3deeeb48-e251-453e-a854-4ec89ebe1c58 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:48.697798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:48.698331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:48.699210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:48.703875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:48.704382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:48.704846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:49.072498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:49.084764 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82aa8ec7-4938-4ae0-9dc9-195b6ea62301 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1462 microversion: 2.1 time: 0.446894 Oct 28 09:51:49.085887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 182/356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:48 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1462 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:49.108235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1301068875", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b6147248-3c85-49a3-b087-eb8439f76f93"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:49.218319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] validate_networks() for [('b6147248-3c85-49a3-b087-eb8439f76f93', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:51:49.550274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3deeeb48-e251-453e-a854-4ec89ebe1c58 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/866179263/action" status: 200 len: 96 microversion: 2.1 time: 0.871693 Oct 28 09:51:49.552540 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 175/357] 10.222.0.16 () {60 vars in 1197 bytes} [Fri Oct 28 09:51:48 2022] POST /compute/v2.1/flavors/866179263/action => generated 96 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:49.557823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:49.560048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:49.569882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:49.571065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:49.573435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:49.574565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:49.577053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:49.578114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:49.934997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:49.935801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:49.935982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:49.936292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:49.936708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:49.960647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:49.961177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:49.961620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:49.962369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:49.962831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:49.963263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:49.986119 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c1f55c9-e320-4d0b-8fbb-8ddeeab81474 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1607 microversion: 2.1 time: 0.430759 Oct 28 09:51:49.988864 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 176/358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:49 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1607 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:50.000127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0cedb92f-1138-468c-8bfc-d902f6e006d3 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:50.024943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Getting quotas for project 28e5a1214de9496d87b690d38ba80ea4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:50.057822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Getting quotas for user a7e06c8681bd48ce9422147f306cd27c and project 28e5a1214de9496d87b690d38ba80ea4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:50.096818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:51:50.101474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:51:50.198045 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5541c4f-b836-4efb-82d1-27d35915556f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108866 Oct 28 09:51:50.211965 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 183/359] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:51:50.233771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-57aa1f12-f42d-4a13-a06a-b3e185251443 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '.version_select at 0x7fca33eb0310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:50.238416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57aa1f12-f42d-4a13-a06a-b3e185251443 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:50.239829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57aa1f12-f42d-4a13-a06a-b3e185251443 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:50.241163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57aa1f12-f42d-4a13-a06a-b3e185251443 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:50.278980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-57aa1f12-f42d-4a13-a06a-b3e185251443 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 397 microversion: 2.1 time: 0.059083 Oct 28 09:51:50.285144 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 184/360] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:51:50 2022] GET /compute/v2.1/os-migrations => generated 397 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:50.312513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a2a5e47-0abb-41f4-88de-b731031976a7 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:50.313419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a2a5e47-0abb-41f4-88de-b731031976a7 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:50.399431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a2a5e47-0abb-41f4-88de-b731031976a7 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:50.410425 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a2a5e47-0abb-41f4-88de-b731031976a7 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1216 microversion: 2.1 time: 0.122564 Oct 28 09:51:50.412022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 185/361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:50 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1216 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:50.590495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:50.591706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:50.602667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:50.613821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:50.614710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:50.616558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:50.618192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:50.618824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:50.709567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:51:50.847813 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6661f141-edbb-4507-b3ec-d9473eb5745f tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 204 len: 0 microversion: 2.1 time: 0.261583 Oct 28 09:51:50.849821 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 186/362] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:51:50 2022] DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:51:50.863811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1753897966", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:50.965374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:51:51.174496 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-0cedb92f-1138-468c-8bfc-d902f6e006d3 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] HTTP exception thrown: Flavor access already exists for flavor 23 and project 2556286fc5e54589bf8c8b0c2536a6a6 combination. Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0cedb92f-1138-468c-8bfc-d902f6e006d3 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Request method failure captured: Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/flavors/866179263/action HTTP/1.1 Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 67 Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yw9X-U2x7EE-cr4fvUpW0dp3oTIKTsn4Vn-MWFxr5TCfy6tiHV4r8aGW9tGoU7b08vSHVfBjpv_KlHYs3sedBWwF8VSMEUspl9aKwkBd4EoGuldDhu-XXL-TWGVdXdAsc5lX_vHGm02Id55OACEtQoCzdJist91W9GQod1EbZMZNg Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 0290b58495f5461bb76b62694e8a5806 Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:51:51.201389 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0290b58495f5461bb76b62694e8a5806"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0290b58495f5461bb76b62694e8a5806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0290b58495f5461bb76b62694e8a5806", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0290b58495f5461bb76b62694e8a5806"}]}] Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 0290b58495f5461bb76b62694e8a5806 Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f18ec10891064e63b13a15b4375e4e1a Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: {"addTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} Oct 28 09:51:51.202711 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: exception: Flavor access already exists for flavor 23 and project 2556286fc5e54589bf8c8b0c2536a6a6 combination. Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '866179263', 'body': {'addTenantAccess': {'tenant': '2556286fc5e54589bf8c8b0c2536a6a6'}}} Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result.read() Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:51:51.203494 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '23-2556286fc5e54589bf8c8b0c2536a6a6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 09:51:51.204583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 09:51:51.205859 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 09:51:51.206842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result.read() Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '23-2556286fc5e54589bf8c8b0c2536a6a6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 9, 51, 51, 163350), 'updated_at': None, 'flavor_id': 23, 'project_id': '2556286fc5e54589bf8c8b0c2536a6a6'}] Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:51.207975 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 23 and project 2556286fc5e54589bf8c8b0c2536a6a6 combination. Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:51.210431 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 23 and project 2556286fc5e54589bf8c8b0c2536a6a6 combination. Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:51.215433 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:51.217240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 23 and project 2556286fc5e54589bf8c8b0c2536a6a6 combination. Oct 28 09:51:51.217240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:51.217240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0cedb92f-1138-468c-8bfc-d902f6e006d3 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Returning 409 to user: Flavor access already exists for flavor 23 and project 2556286fc5e54589bf8c8b0c2536a6a6 combination. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:51.217240 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0cedb92f-1138-468c-8bfc-d902f6e006d3 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/866179263/action" status: 409 len: 152 microversion: 2.1 time: 1.222394 Oct 28 09:51:51.218100 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 177/363] 10.222.0.16 () {60 vars in 1197 bytes} [Fri Oct 28 09:51:49 2022] POST /compute/v2.1/flavors/866179263/action => generated 152 bytes in 1228 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:51:51.246220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8510fa0d-6d39-48c5-99c0-bb03717cad2c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:51.411833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:51.412248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:51.412930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:51.413493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:51.414062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:51.431773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:51.432262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:51.432749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:51.433493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:51.433950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:51.434449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:51.480323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:51.485782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for user 9dc12014773b4f9fb34ff214c07d7f61 and project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:51.499656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:51:51.512571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:51:51.620207 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-914cf5ea-cc10-462b-bbb9-46557f4b32af tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767630 Oct 28 09:51:51.622031 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 187/364] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:51:51.629665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:51.632844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:51.647196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:51.647700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:51.648155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:51.649013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:51.649696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:51.650139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:51.792540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:51.803895 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7cbd03b3-ff98-488d-bff5-b773985ee560 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1268 microversion: 2.1 time: 0.180151 Oct 28 09:51:51.807693 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 188/365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:51 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:51.819305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-843312256", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "544091907", "adminPass": "***", "networks": [{"uuid": "76a3c667-1c80-490c-973c-ba68f8115357"}], "security_groups": [{"name": "tempest-securitygroup--64967762"}], "key_name": "tempest-keypair-1318270117", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:51.992823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] validate_networks() for [('76a3c667-1c80-490c-973c-ba68f8115357', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:51:52.315599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8510fa0d-6d39-48c5-99c0-bb03717cad2c tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/866179263/action" status: 200 len: 21 microversion: 2.1 time: 1.095704 Oct 28 09:51:52.317561 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 178/366] 10.222.0.16 () {60 vars in 1197 bytes} [Fri Oct 28 09:51:51 2022] POST /compute/v2.1/flavors/866179263/action => generated 21 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:52.323597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:52.324407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:52.333625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:52.334356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:52.335040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:52.335899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:52.336538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:52.336935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:52.490692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:52.510950 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0539092a-f855-4983-b694-2e3e875ee486 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1217 microversion: 2.1 time: 0.191952 Oct 28 09:51:52.513144 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 179/367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:52 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1217 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:52.520890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-297faf05-3292-451d-bbfe-b9c25f10ddd3 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:52.585417 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-297faf05-3292-451d-bbfe-b9c25f10ddd3 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/866179263" status: 202 len: 0 microversion: 2.1 time: 0.068908 Oct 28 09:51:52.586915 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 180/368] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:51:52 2022] DELETE /compute/v2.1/flavors/866179263 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:52.612607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc788c99-2ca3-4033-9aff-9baae1724f3a tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:52.668360 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc788c99-2ca3-4033-9aff-9baae1724f3a tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.074808 Oct 28 09:51:52.683742 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 181/369] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:52 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:52.693058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-172a0ffe-fd66-42d9-bff9-89bb00b86e7d tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1404549049", "id": 1904542496, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:52.729444 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-172a0ffe-fd66-42d9-bff9-89bb00b86e7d tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.039728 Oct 28 09:51:52.735393 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 182/370] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:52 2022] POST /compute/v2.1/flavors => generated 438 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:52.748401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3124231e-8660-464c-aba2-cc3cb32f0cb8 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:52.761606 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-3124231e-8660-464c-aba2-cc3cb32f0cb8 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3124231e-8660-464c-aba2-cc3cb32f0cb8 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Request method failure captured: Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/flavors/1904542496/os-flavor-access HTTP/1.1 Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yw9X-U2x7EE-cr4fvUpW0dp3oTIKTsn4Vn-MWFxr5TCfy6tiHV4r8aGW9tGoU7b08vSHVfBjpv_KlHYs3sedBWwF8VSMEUspl9aKwkBd4EoGuldDhu-XXL-TWGVdXdAsc5lX_vHGm02Id55OACEtQoCzdJist91W9GQod1EbZMZNg Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 0290b58495f5461bb76b62694e8a5806 Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:51:52.764667 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0290b58495f5461bb76b62694e8a5806"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0290b58495f5461bb76b62694e8a5806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0290b58495f5461bb76b62694e8a5806", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0290b58495f5461bb76b62694e8a5806"}]}] Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 0290b58495f5461bb76b62694e8a5806 Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f18ec10891064e63b13a15b4375e4e1a Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: exception: Access list not available for public flavors. Oct 28 09:51:52.766130 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'flavor_id': '1904542496'} Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 28 09:51:52.766958 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:52.769822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3124231e-8660-464c-aba2-cc3cb32f0cb8 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:52.770907 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3124231e-8660-464c-aba2-cc3cb32f0cb8 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1904542496/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.030585 Oct 28 09:51:52.771997 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 183/371] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 09:51:52 2022] GET /compute/v2.1/flavors/1904542496/os-flavor-access => generated 91 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 09:51:52.784686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-257550d0-3bee-4de1-9571-3264e7e04f0e tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:52.816554 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-257550d0-3bee-4de1-9571-3264e7e04f0e tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1904542496" status: 202 len: 0 microversion: 2.1 time: 0.039597 Oct 28 09:51:52.817387 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 184/372] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:51:52 2022] DELETE /compute/v2.1/flavors/1904542496 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:52.836172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea09f318-5c56-490e-8b8b-4b324d1d3b21 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:52.886353 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea09f318-5c56-490e-8b8b-4b324d1d3b21 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.063372 Oct 28 09:51:52.886353 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 185/373] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:52 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:52.922317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:52.924780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:52.936256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:52.936762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:52.937228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:52.938738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:52.939382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:52.940533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:53.055841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:53.063874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-643363ff-a16d-4ae7-8273-3cc7fcb4aac6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1274 microversion: 2.1 time: 0.176463 Oct 28 09:51:53.064708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 186/374] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:52 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1274 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:53.069996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f2a01a5-01e2-4dab-b8a6-1e26605194dc tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-650953063", "id": 392270930, "os-flavor-access:is_public": "False"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:53.099580 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f2a01a5-01e2-4dab-b8a6-1e26605194dc tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.033553 Oct 28 09:51:53.100418 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 187/375] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:53 2022] POST /compute/v2.1/flavors => generated 435 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:53.675549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:53.676102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:53.676433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:53.676848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:53.677281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:53.696863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:53.697387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:53.697832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:53.698570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:53.699078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:53.699444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:53.735178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Getting quotas for project 2f4dca7afa40438cba45411cead48103. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:53.739429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Getting quotas for user a60610c78b5844f78f3ac3a7d421df53 and project 2f4dca7afa40438cba45411cead48103. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:53.753889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:51:53.757531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:51:53.765457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06583158-afe3-4e45-93dd-a1dbd6edf3a0 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:53.769399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-06583158-afe3-4e45-93dd-a1dbd6edf3a0 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b6fdf4cd494c44b18e831ebd3a53df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2556286fc5e54589bf8c8b0c2536a6a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06583158-afe3-4e45-93dd-a1dbd6edf3a0 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Request method failure captured: Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/flavors/392270930/action HTTP/1.1 Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 67 Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yuz3EaL3UPEIZbev8KpdoXr683X7s9-0ZVe1h5pfHVZGbvGQvklLGIac9AMG6ZW8dSgCmAXfl3UrP2rZFn5la0Jw-gyqfz04JcqrAD4GsskAcBG3dAaqMlw9hv6gEbFDw_vwuGUz-BsAuKB23qhmCApMjKOLamrO_Gnv3fGZyz2XM Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2556286fc5e54589bf8c8b0c2536a6a6 Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-88957746 Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:53.775046 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2556286fc5e54589bf8c8b0c2536a6a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2556286fc5e54589bf8c8b0c2536a6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2556286fc5e54589bf8c8b0c2536a6a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2556286fc5e54589bf8c8b0c2536a6a6"}]}] Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-88957746 Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2556286fc5e54589bf8c8b0c2536a6a6 Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-88957746 Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsAccessNegativeTestJSON-88957746-project Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b6fdf4cd494c44b18e831ebd3a53df7f Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-88957746-project Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: {"addTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} Oct 28 09:51:53.776424 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '392270930', 'body': {'addTenantAccess': {'tenant': '2556286fc5e54589bf8c8b0c2536a6a6'}}} Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:53.777156 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 28 09:51:53.778771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:53.779872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06583158-afe3-4e45-93dd-a1dbd6edf3a0 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:53.781591 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-06583158-afe3-4e45-93dd-a1dbd6edf3a0 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] 10.222.0.16 "POST /compute/v2.1/flavors/392270930/action" status: 403 len: 130 microversion: 2.1 time: 0.671355 Oct 28 09:51:53.785493 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 188/376] 10.222.0.16 () {60 vars in 1197 bytes} [Fri Oct 28 09:51:53 2022] POST /compute/v2.1/flavors/392270930/action => generated 130 bytes in 676 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:53.798219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:53.801029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:53.820593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:53.824382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:53.825068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:53.825833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:53.826299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:53.826731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:53.832299 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d2a1a40b-3d15-4a0c-a9c6-4becfdb1fc52 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.021406 Oct 28 09:51:53.842187 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 189/377] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:51 2022] POST /compute/v2.1/servers => generated 400 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:51:53.848003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56695ee0-70cc-491e-aef4-fbaf706a6958 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:53.874338 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56695ee0-70cc-491e-aef4-fbaf706a6958 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/392270930" status: 202 len: 0 microversion: 2.1 time: 0.030584 Oct 28 09:51:53.875703 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 190/378] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:51:53 2022] DELETE /compute/v2.1/flavors/392270930 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:53.892010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c1608d4b-effb-4126-96a0-e2ec4487a48c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:53.892807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c1608d4b-effb-4126-96a0-e2ec4487a48c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:53.959301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:53.968660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb64cb30-13ff-4f34-9b98-fcaac18aece7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1271 microversion: 2.1 time: 0.181895 Oct 28 09:51:53.969604 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 189/379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:53 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:53.975028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0fe80cd5-6a52-422b-8b54-2c5af7e795da tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:54.019973 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0fe80cd5-6a52-422b-8b54-2c5af7e795da tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.049187 Oct 28 09:51:54.053482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 190/380] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:53 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:54.058485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4815d0be-c46e-4114-9494-0afaa04d66c9 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-11891172", "id": 1640754958, "os-flavor-access:is_public": "False"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:54.097323 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4815d0be-c46e-4114-9494-0afaa04d66c9 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.040919 Oct 28 09:51:54.108924 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 191/381] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:54 2022] POST /compute/v2.1/flavors => generated 437 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:54.131640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:54.136705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:54.149370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:54.152147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:54.152763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:54.156375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:54.157173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:54.157846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:54.295994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:54.316847 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c9267d2-71e9-4622-9606-d1f0673d936a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1274 microversion: 2.1 time: 0.203644 Oct 28 09:51:54.351606 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 192/382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:54 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:54.371027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-54312ea4-19dc-414d-b03c-0a5a570cd34a tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:54.421593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c1608d4b-effb-4126-96a0-e2ec4487a48c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:54.449739 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c1608d4b-effb-4126-96a0-e2ec4487a48c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1262 microversion: 2.1 time: 0.572190 Oct 28 09:51:54.461182 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 191/383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:53 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1262 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:54.997003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:55.007445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:55.029190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:55.031008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:55.031470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:55.035698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:55.037675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:55.038837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:55.285703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=10,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:55.313280 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-54312ea4-19dc-414d-b03c-0a5a570cd34a tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1640754958/action" status: 200 len: 97 microversion: 2.1 time: 0.950209 Oct 28 09:51:55.324572 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 193/384] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 09:51:54 2022] POST /compute/v2.1/flavors/1640754958/action => generated 97 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:55.341940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38140fbe-8dd3-4940-8670-6c877a597d16 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:55.354091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-38140fbe-8dd3-4940-8670-6c877a597d16 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'b6fdf4cd494c44b18e831ebd3a53df7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2556286fc5e54589bf8c8b0c2536a6a6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38140fbe-8dd3-4940-8670-6c877a597d16 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Request method failure captured: Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/flavors/1640754958/action HTTP/1.1 Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 70 Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yuz3EaL3UPEIZbev8KpdoXr683X7s9-0ZVe1h5pfHVZGbvGQvklLGIac9AMG6ZW8dSgCmAXfl3UrP2rZFn5la0Jw-gyqfz04JcqrAD4GsskAcBG3dAaqMlw9hv6gEbFDw_vwuGUz-BsAuKB23qhmCApMjKOLamrO_Gnv3fGZyz2XM Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2556286fc5e54589bf8c8b0c2536a6a6 Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-88957746 Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:51:55.357641 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2556286fc5e54589bf8c8b0c2536a6a6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2556286fc5e54589bf8c8b0c2536a6a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2556286fc5e54589bf8c8b0c2536a6a6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2556286fc5e54589bf8c8b0c2536a6a6"}]}] Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-88957746 Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2556286fc5e54589bf8c8b0c2536a6a6 Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-88957746 Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsAccessNegativeTestJSON-88957746-project Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b6fdf4cd494c44b18e831ebd3a53df7f Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-88957746-project Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: {"removeTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} Oct 28 09:51:55.359002 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '1640754958', 'body': {'removeTenantAccess': {'tenant': '2556286fc5e54589bf8c8b0c2536a6a6'}}} Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can( Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:51:55.359712 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 28 09:51:55.362799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:51:55.370869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38140fbe-8dd3-4940-8670-6c877a597d16 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:51:55.373119 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-38140fbe-8dd3-4940-8670-6c877a597d16 tempest-FlavorsAccessNegativeTestJSON-88957746 tempest-FlavorsAccessNegativeTestJSON-88957746-project] 10.222.0.16 "POST /compute/v2.1/flavors/1640754958/action" status: 403 len: 133 microversion: 2.1 time: 0.043713 Oct 28 09:51:55.375707 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 194/385] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 09:51:55 2022] POST /compute/v2.1/flavors/1640754958/action => generated 133 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:51:55.391223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:55.396283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:55.422926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:55.423885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:55.426195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:55.428639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:55.430771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:55.433143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:55.700029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:55.719372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9a3edaf9-d64b-492e-8856-75ea027b71d8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 0.728207 Oct 28 09:51:55.720581 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 192/386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:54 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:51:55.726609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f79b7126-5488-49c3-a812-f8c8e92513bc tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2556286fc5e54589bf8c8b0c2536a6a6"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:56.402559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:56.426949 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ac49067-fdbc-4c9a-8cc7-6c79f2414429 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 1.036499 Oct 28 09:51:56.450993 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 195/387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:55 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:56.517795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:56.519000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:56.533507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:56.534747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:56.535421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:56.536454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:56.537150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:56.537732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:56.948077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:56.992180 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f07e82b9-3c56-491c-b920-53e1db93fb62 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1320 microversion: 2.1 time: 0.557418 Oct 28 09:51:57.019329 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 196/388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:56 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1320 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:57.129668 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f79b7126-5488-49c3-a812-f8c8e92513bc tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/1640754958/action" status: 200 len: 21 microversion: 2.1 time: 1.400300 Oct 28 09:51:57.133303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 193/389] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 09:51:55 2022] POST /compute/v2.1/flavors/1640754958/action => generated 21 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:51:57.145978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-31347ac5-befb-4501-8742-6803edeb60ba req-9830b0b0-6ad8-4b6b-967a-16cb2af07271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ecfe35a-7658-4371-947c-581fc4879381", "name": "network-vif-deleted", "tag": "629553c4-0314-42b4-93f6-22adcfb47516"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:57.181799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-31347ac5-befb-4501-8742-6803edeb60ba req-9830b0b0-6ad8-4b6b-967a-16cb2af07271 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:57.188308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-31347ac5-befb-4501-8742-6803edeb60ba req-9830b0b0-6ad8-4b6b-967a-16cb2af07271 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:57.189220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-31347ac5-befb-4501-8742-6803edeb60ba req-9830b0b0-6ad8-4b6b-967a-16cb2af07271 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:57.234721 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-31347ac5-befb-4501-8742-6803edeb60ba req-9830b0b0-6ad8-4b6b-967a-16cb2af07271 service nova] Creating event network-vif-deleted:629553c4-0314-42b4-93f6-22adcfb47516 for instance 5ecfe35a-7658-4371-947c-581fc4879381 on n-h1-zed-1 Oct 28 09:51:57.258158 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-31347ac5-befb-4501-8742-6803edeb60ba req-9830b0b0-6ad8-4b6b-967a-16cb2af07271 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115383 Oct 28 09:51:57.260198 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 194/390] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:57.290702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:57.292403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:57.322127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:57.325821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:57.328502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:57.334401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:57.339006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:57.339958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:57.909600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:57.963594 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56d707a9-930e-4179-8248-3e2b40aee0a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 0.666798 Oct 28 09:51:57.965204 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 195/391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:57 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:57.973762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dee68f67-21c3-4ce7-aad9-d03b92684282 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:57.998357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-641344737", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:58.017244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:58.076205 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dee68f67-21c3-4ce7-aad9-d03b92684282 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1640754958" status: 202 len: 0 microversion: 2.1 time: 0.104525 Oct 28 09:51:58.078228 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 196/392] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:51:57 2022] DELETE /compute/v2.1/flavors/1640754958 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:51:58.092944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:58.096355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:58.114808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:58.118842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:58.121566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:58.128805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:58.129605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:58.130471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:58.132412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:51:58.220335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:51:58.593702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:58.607888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3aa9abe-b549-4920-82c8-b4bca2f45e3f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 0.528300 Oct 28 09:51:58.608491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 197/393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:58 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:58.625502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:58.625502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:58.636786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:58.638062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:58.638526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:58.639298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:58.639774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:58.643630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:58.763205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:51:58.780372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-509022e2-3380-4e9a-b211-85e1c53a2009 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1320 microversion: 2.1 time: 0.169707 Oct 28 09:51:58.781785 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 198/394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:58 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:58.804529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd30df15-8174-4aa5-86e8-641fcb2d1c87 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:58.833936 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd30df15-8174-4aa5-86e8-641fcb2d1c87 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.034014 Oct 28 09:51:58.845065 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 199/395] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:51:58 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:51:59.285083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:51:59.286018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:51:59.286253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:51:59.286930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:51:59.287721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:51:59.319013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.327410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.327930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.335646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.338783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.343054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.458697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:51:59.477733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:51:59.484005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Calling method '.version_select at 0x7fca33e8c160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:59.488055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.490199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.491526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.502970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:51:59.509757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:51:59.541398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.542014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.542522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.678664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.679237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.679684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.735094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.735640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.736308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.767759 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6a84a78-ead7-4e2b-b973-e9185dcdd21c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.740857 Oct 28 09:51:59.788506 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 197/396] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:51:59.813972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4bfa19af-d24f-4aee-962f-b0c20b52b53a tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1567797973", "id": 2041341835, "os-flavor-access:is_public": "False"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:51:59.826918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.827420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.827861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.868625 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5bd18768-4108-46b1-a1ce-a2c3d1481b3f tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1903 microversion: 2.53 time: 1.031752 Oct 28 09:51:59.868951 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 200/397] 10.222.0.16 () {60 vars in 1243 bytes} [Fri Oct 28 09:51:58 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1903 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:51:59.901523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:51:59.902201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:51:59.921018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4bfa19af-d24f-4aee-962f-b0c20b52b53a tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.127731 Oct 28 09:51:59.933213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.933213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.933213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.933213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:51:59.933771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:51:59.933771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:51:59.937948 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 198/398] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:51:59 2022] POST /compute/v2.1/flavors => generated 439 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:51:59.967526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-bed9992f-cd7d-4a73-b856-5fab9e818cd7 req-8a17ff39-f5ef-4aeb-b2ae-0a73033c2193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e315df11-58a5-4ed8-98b2-0077c5ab20ee", "tag": "c3c34cfd-4412-4272-92b8-e0b27f33eb05"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:00.028807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bed9992f-cd7d-4a73-b856-5fab9e818cd7 req-8a17ff39-f5ef-4aeb-b2ae-0a73033c2193 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.030630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bed9992f-cd7d-4a73-b856-5fab9e818cd7 req-8a17ff39-f5ef-4aeb-b2ae-0a73033c2193 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.031521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bed9992f-cd7d-4a73-b856-5fab9e818cd7 req-8a17ff39-f5ef-4aeb-b2ae-0a73033c2193 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.114728 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-bed9992f-cd7d-4a73-b856-5fab9e818cd7 req-8a17ff39-f5ef-4aeb-b2ae-0a73033c2193 service nova] Creating event network-changed:c3c34cfd-4412-4272-92b8-e0b27f33eb05 for instance e315df11-58a5-4ed8-98b2-0077c5ab20ee on n-h2-zed-1 Oct 28 09:52:00.133290 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-bed9992f-cd7d-4a73-b856-5fab9e818cd7 req-8a17ff39-f5ef-4aeb-b2ae-0a73033c2193 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192134 Oct 28 09:52:00.134969 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 199/399] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:00.141516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:00.142850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:00.153572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.155483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.156181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.158299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.159098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.160437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.559079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.570798 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-573c48c9-481c-40e4-af79-455325fc1d45 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 0.434293 Oct 28 09:52:00.598134 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 200/400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:00 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:00.610084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1937234d-f0c2-408c-a4c1-ff4c487b85a2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:00.611117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1937234d-f0c2-408c-a4c1-ff4c487b85a2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:00.757727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1937234d-f0c2-408c-a4c1-ff4c487b85a2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.773929 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1937234d-f0c2-408c-a4c1-ff4c487b85a2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1216 microversion: 2.1 time: 0.173018 Oct 28 09:52:00.795475 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 201/401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:00 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1216 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:00.808860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:00.810099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:00.819224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.820181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.820875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.821870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.822602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.823258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.871464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:00.893778 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e704ef3f-eb1e-4b9e-969d-1e01009df40b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 1.023339 Oct 28 09:52:00.906458 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 201/402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:51:59 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:00.919596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Calling method '.version_select at 0x7fca33e79310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:00.934685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.936331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.937104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.957811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.959507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.961507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:00.995327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:00.996170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:00.996977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.017603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:01.018467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:01.019490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.051782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:01.053077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:01.053924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.067372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4ae11fad-36b7-4172-86ab-04c3f5bc73a7 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 601 microversion: 2.53 time: 0.158725 Oct 28 09:52:01.077922 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 202/403] 10.222.0.16 () {60 vars in 1222 bytes} [Fri Oct 28 09:52:00 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 601 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:52:01.193237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:01.203880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78440f41-9d34-4008-bb8f-87effb59951c tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1320 microversion: 2.1 time: 0.405454 Oct 28 09:52:01.227051 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 202/404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:00 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1320 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:01.235024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-964e2ce2-b033-4b5e-99d3-4401c69f0f24 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8147473bf7ed4b89bbdc689dbea7f248"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:01.368405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0683d451-f564-47d0-8df8-feddeea676c6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Calling method '.version_select at 0x7fca33e8c9d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.758272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-964e2ce2-b033-4b5e-99d3-4401c69f0f24 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] HTTP exception thrown: Flavor access not found for 27 / 8147473bf7ed4b89bbdc689dbea7f248 combination. Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-964e2ce2-b033-4b5e-99d3-4401c69f0f24 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Request method failure captured: Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/flavors/2041341835/action HTTP/1.1 Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 70 Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yw9X-U2x7EE-cr4fvUpW0dp3oTIKTsn4Vn-MWFxr5TCfy6tiHV4r8aGW9tGoU7b08vSHVfBjpv_KlHYs3sedBWwF8VSMEUspl9aKwkBd4EoGuldDhu-XXL-TWGVdXdAsc5lX_vHGm02Id55OACEtQoCzdJist91W9GQod1EbZMZNg Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 0290b58495f5461bb76b62694e8a5806 Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:52:01.760071 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0290b58495f5461bb76b62694e8a5806"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0290b58495f5461bb76b62694e8a5806"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0290b58495f5461bb76b62694e8a5806", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0290b58495f5461bb76b62694e8a5806"}]}] Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 0290b58495f5461bb76b62694e8a5806 Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-620765177 Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f18ec10891064e63b13a15b4375e4e1a Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: {"removeTenantAccess": {"tenant": "8147473bf7ed4b89bbdc689dbea7f248"}} Oct 28 09:52:01.762637 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: exception: Flavor access not found for 27 / 8147473bf7ed4b89bbdc689dbea7f248 combination. Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '2041341835', 'body': {'removeTenantAccess': {'tenant': '8147473bf7ed4b89bbdc689dbea7f248'}}} Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 28 09:52:01.765687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 27 / 8147473bf7ed4b89bbdc689dbea7f248 combination. Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 27 / 8147473bf7ed4b89bbdc689dbea7f248 combination. Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:01.770942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 27 / 8147473bf7ed4b89bbdc689dbea7f248 combination. Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-964e2ce2-b033-4b5e-99d3-4401c69f0f24 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Returning 404 to user: Flavor access not found for 27 / 8147473bf7ed4b89bbdc689dbea7f248 combination. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:01.776964 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-964e2ce2-b033-4b5e-99d3-4401c69f0f24 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors/2041341835/action" status: 404 len: 124 microversion: 2.1 time: 0.533187 Oct 28 09:52:01.778739 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0683d451-f564-47d0-8df8-feddeea676c6 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2" status: 200 len: 371 microversion: 2.1 time: 0.683277 Oct 28 09:52:01.778739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 203/405] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 09:52:01 2022] GET /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2 => generated 371 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:01.779214 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 203/406] 10.222.0.16 () {60 vars in 1200 bytes} [Fri Oct 28 09:52:01 2022] POST /compute/v2.1/flavors/2041341835/action => generated 124 bytes in 539 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:01.779458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4000c7de-e0ea-451b-93ae-d27e305d1e6d req-a663d386-32f2-4493-94bc-1b483ff11624 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43bf398-e1f4-4d70-a0f3-95206e038e24", "tag": "83e59ddf-79e4-4360-a974-08584405f59f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:01.780984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Calling method '.version_select at 0x7fca33d3b550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.791665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:01.792158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:01.792834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.816792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:01.817615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:01.818399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.826429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b746474-6fba-4e3d-9dd8-5d2daee649f8 tempest-HypervisorAdminV253TestBase-1546676453 tempest-HypervisorAdminV253TestBase-1546676453-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/30352c22-ea01-42a5-8d2e-bfd13219a879" status: 200 len: 786 microversion: 2.53 time: 0.058319 Oct 28 09:52:01.827344 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 204/407] 10.222.0.16 () {60 vars in 1298 bytes} [Fri Oct 28 09:52:01 2022] GET /compute/v2.1/os-hypervisors/30352c22-ea01-42a5-8d2e-bfd13219a879 => generated 786 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:52:01.828164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4000c7de-e0ea-451b-93ae-d27e305d1e6d req-a663d386-32f2-4493-94bc-1b483ff11624 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:01.828542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4000c7de-e0ea-451b-93ae-d27e305d1e6d req-a663d386-32f2-4493-94bc-1b483ff11624 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:01.829011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4000c7de-e0ea-451b-93ae-d27e305d1e6d req-a663d386-32f2-4493-94bc-1b483ff11624 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.833850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.834727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:01.841647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:01.843829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:01.844580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.845525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:01.846152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:01.847165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:01.875131 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4000c7de-e0ea-451b-93ae-d27e305d1e6d req-a663d386-32f2-4493-94bc-1b483ff11624 service nova] Creating event network-changed:83e59ddf-79e4-4360-a974-08584405f59f for instance b43bf398-e1f4-4d70-a0f3-95206e038e24 on n-h1-zed-1 Oct 28 09:52:01.895849 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4000c7de-e0ea-451b-93ae-d27e305d1e6d req-a663d386-32f2-4493-94bc-1b483ff11624 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127175 Oct 28 09:52:01.899235 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 204/408] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:01.922902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7970c65e-4c7b-47a9-a5dc-370a901d2908 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:01.977517 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7970c65e-4c7b-47a9-a5dc-370a901d2908 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2041341835" status: 202 len: 0 microversion: 2.1 time: 0.076924 Oct 28 09:52:01.978478 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 205/409] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:52:01 2022] DELETE /compute/v2.1/flavors/2041341835 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:01.991322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Action: 'update', calling method: .version_select at 0x7fca33ef9af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:02.250017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:02.250585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:02.254278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:02.255549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:02.256250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:02.258371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:02.463935 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e07464c-1e25-4557-bcee-93e78294b4a5 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2" status: 200 len: 328 microversion: 2.1 time: 0.479028 Oct 28 09:52:02.473321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 206/410] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:01 2022] PUT /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2 => generated 328 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:02.499922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:02.506104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:02.526255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:02.534322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:02.534807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:02.539016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:02.539526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:02.542367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:02.590055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:02.604950 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f136a718-db55-492f-84fd-0dc45f55b32d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 0.775853 Oct 28 09:52:02.609067 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 205/411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:01 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:02.624502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:02.627142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:02.655559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:02.663862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:02.665135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:02.666050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:02.666649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:02.667201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:02.720330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:03.028518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:03.040934 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74b6ddc6-fe99-4f83-ad49-acb515a5221f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 0.427959 Oct 28 09:52:03.044189 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 206/412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:02 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:03.053522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-271dddf3-8e1f-4781-a9f8-8c63a5ccef85 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.094283 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-271dddf3-8e1f-4781-a9f8-8c63a5ccef85 tempest-FlavorsAccessNegativeTestJSON-620765177 tempest-FlavorsAccessNegativeTestJSON-620765177-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.046195 Oct 28 09:52:03.095744 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 207/413] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:52:03 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:03.101391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.102454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:03.110600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:03.111878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:03.112710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:03.114087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:03.114893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:03.115616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:03.266306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:03.279916 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93d6048a-175b-4281-9c78-5c34b55a9538 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1276 microversion: 2.1 time: 0.809699 Oct 28 09:52:03.280997 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 207/414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:02 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1276 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:03.299741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f347dbd7-f99b-45c2-b1a9-2f967b68e603 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.329419 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f347dbd7-f99b-45c2-b1a9-2f967b68e603 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2" status: 202 len: 0 microversion: 2.1 time: 0.046427 Oct 28 09:52:03.331628 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 208/415] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 09:52:03 2022] DELETE /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:03.358582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ffc0e2f-534d-47b9-86cd-f78bf5caea4c tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Calling method '.version_select at 0x7fca33e3ad30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:03.983868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4ffc0e2f-534d-47b9-86cd-f78bf5caea4c tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2" status: 200 len: 371 microversion: 2.1 time: 0.648573 Oct 28 09:52:03.985367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 209/416] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 09:52:03 2022] GET /compute/v2.1/os-quota-sets/5e603ff1e3b94b8eba4e350a974326e2 => generated 371 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:03.991816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:04.007837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:04.029241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:04.030929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:04.031473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:04.034861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:04.035388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:04.035850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:04.177687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.209903 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4865a45b-4fec-4c26-adc1-9a88106fed74 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 1.112363 Oct 28 09:52:04.222376 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 208/417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:03 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:04.261971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:04.263715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:04.276547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:04.278142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:04.278884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:04.280280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:04.281468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:04.282730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:04.766639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.788319 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2459b95a-5e6a-4ea4-8ea9-4c179bc02b44 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 0.800618 Oct 28 09:52:04.789405 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 210/418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:03 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:04.811482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1abcf819-8df0-4a63-9e79-b7a4ee62dca0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Calling method '.version_select at 0x7fca33dfce50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:04.914304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:04.942655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95c3fdb7-f9d1-4552-aad5-3c596b8bf9a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 0.691484 Oct 28 09:52:04.947066 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 209/419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:04 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:04.990216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:04.991738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:05.003315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:05.004875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:05.005958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:05.007543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:05.008627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:05.009655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:05.165571 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1abcf819-8df0-4a63-9e79-b7a4ee62dca0 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63/defaults" status: 200 len: 371 microversion: 2.1 time: 0.373936 Oct 28 09:52:05.167925 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 211/420] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:52:04 2022] GET /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63/defaults => generated 371 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:05.270934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:05.274506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:05.299756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:05.311636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:05.317836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:05.324016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:05.328443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:05.329622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:05.333642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:05.344619 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a91d7e3-f768-4ef9-bd63-179c9420bf64 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1274 microversion: 2.1 time: 0.380006 Oct 28 09:52:05.348711 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 210/421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:04 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1274 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:05.498037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Action: 'update', calling method: .version_select at 0x7fca33cef3a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:05.876725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:05.877301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:05.877755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:05.878531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:05.879639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:05.880135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:06.205465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:06.274736 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ffa71c50-54d4-4e16-90ff-e378190dea29 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674" status: 200 len: 328 microversion: 2.1 time: 0.775438 Oct 28 09:52:06.277837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 211/422] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:05 2022] PUT /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674 => generated 328 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:52:06.286332 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8cb1d734-80af-48bd-adc6-596c717da49e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 1.024590 Oct 28 09:52:06.289005 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 212/423] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:05 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:06.317940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:06.319780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:06.333981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:06.335081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:06.335753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:06.336759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:06.337269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:06.338523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:06.339117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:06.339915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:06.354162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:06.355442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:06.356662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:06.358869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:06.361122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:06.362420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:06.922172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:06.959439 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-79a56b8b-edba-402e-8c3a-8eb2fc32234f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 0.676996 Oct 28 09:52:06.963787 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 212/424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:06 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:06.986043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e550501c-d686-466d-8b97-d39f20a5a3a0 req-26b832a8-46d3-455c-b3be-95ec479efe7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18fa029b-3f20-4349-818b-d177d0e8b0d0", "tag": "c056cd56-d958-460c-9dfa-be289a2b2478"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:07.022905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e550501c-d686-466d-8b97-d39f20a5a3a0 req-26b832a8-46d3-455c-b3be-95ec479efe7c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:07.023546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e550501c-d686-466d-8b97-d39f20a5a3a0 req-26b832a8-46d3-455c-b3be-95ec479efe7c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:07.024162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e550501c-d686-466d-8b97-d39f20a5a3a0 req-26b832a8-46d3-455c-b3be-95ec479efe7c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:07.074606 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e550501c-d686-466d-8b97-d39f20a5a3a0 req-26b832a8-46d3-455c-b3be-95ec479efe7c service nova] Creating event network-changed:c056cd56-d958-460c-9dfa-be289a2b2478 for instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 on n-h2-zed-1 Oct 28 09:52:07.093046 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e550501c-d686-466d-8b97-d39f20a5a3a0 req-26b832a8-46d3-455c-b3be-95ec479efe7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127174 Oct 28 09:52:07.097165 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 213/425] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:07.111535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Calling method '.version_select at 0x7fca33cc48b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:07.254583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:07.300425 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92116e60-46bc-45f5-be64-a7449d081fa7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 1.006185 Oct 28 09:52:07.302142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 213/426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:06 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:07.320768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:07.325614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:07.349796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:07.351008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:07.353146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:07.369532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:07.374777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:07.375548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:07.678003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:07.691031 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a52d3493-5abc-486c-95ee-0ad5e43214c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1274 microversion: 2.1 time: 0.386448 Oct 28 09:52:07.691527 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 214/427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:07 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1274 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:07.716506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:07.719162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:07.726878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:07.727652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:07.728278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:07.729225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:07.729866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:07.730473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:07.955340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:07.961077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:07.962198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:07.964671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:07.967424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:07.969620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:08.064434 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3ada421-7d87-48da-9e74-0ecf2298a446 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674/detail" status: 200 len: 916 microversion: 2.1 time: 0.963076 Oct 28 09:52:08.082729 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 214/428] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:52:07 2022] GET /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674/detail => generated 916 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:08.101206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:08.102849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:08.115078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:08.115918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:08.116893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:08.118592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:08.119944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:08.120986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:08.146880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:08.173662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-543ec2aa-b05c-4825-8850-1fbda9e9fe27 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 0.466402 Oct 28 09:52:08.174511 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 215/429] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:07 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:08.336948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:08.336948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:08.350213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:08.351104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:08.351963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:08.362070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:08.362467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:08.365676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:08.721621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:08.745547 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74d406f2-689d-4090-8905-7c24a04ba0a8 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 0.660659 Oct 28 09:52:08.750371 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 215/430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:08 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:08.785146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Action: 'update', calling method: .version_select at 0x7fca33d30b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:09.051095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.052145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.052741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.054234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.055032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.056158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.125060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.126295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.131267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.134813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.137017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.138328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.246009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:09.273750 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cbb142f-8212-42bd-bf63-d79190de1596 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674?user_id=60accc0c23bc44f9a03f37c081f479eb" status: 200 len: 328 microversion: 2.1 time: 0.520761 Oct 28 09:52:09.288421 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 216/431] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:52:08 2022] PUT /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674?user_id=60accc0c23bc44f9a03f37c081f479eb => generated 328 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:09.295683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.296591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:09.311668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.312700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.314167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.315561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.316377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.317151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.544072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.555366 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-324a79a8-2ecc-4d4b-bde2-41be6f0d245d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 1.225976 Oct 28 09:52:09.557227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 216/432] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:08 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:09.576883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ba431efa-93e4-485b-b61e-f40380415b3a req-3fc7412e-baa6-4052-afe1-17aaf42a9391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e315df11-58a5-4ed8-98b2-0077c5ab20ee", "name": "network-vif-plugged", "status": "completed", "tag": "c3c34cfd-4412-4272-92b8-e0b27f33eb05"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:09.595560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ba431efa-93e4-485b-b61e-f40380415b3a req-3fc7412e-baa6-4052-afe1-17aaf42a9391 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.596604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ba431efa-93e4-485b-b61e-f40380415b3a req-3fc7412e-baa6-4052-afe1-17aaf42a9391 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.597589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ba431efa-93e4-485b-b61e-f40380415b3a req-3fc7412e-baa6-4052-afe1-17aaf42a9391 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.623026 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ba431efa-93e4-485b-b61e-f40380415b3a req-3fc7412e-baa6-4052-afe1-17aaf42a9391 service nova] Creating event network-vif-plugged:c3c34cfd-4412-4272-92b8-e0b27f33eb05 for instance e315df11-58a5-4ed8-98b2-0077c5ab20ee on n-h2-zed-1 Oct 28 09:52:09.632590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ba431efa-93e4-485b-b61e-f40380415b3a req-3fc7412e-baa6-4052-afe1-17aaf42a9391 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072739 Oct 28 09:52:09.633987 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 217/433] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:09.645480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:09.647530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:09.661659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.663494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.664557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.667221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:09.669538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:09.670498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:09.821183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:09.837519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0fd8de56-30c4-43e7-b0a7-14e6695f153f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1316 microversion: 2.1 time: 0.551250 Oct 28 09:52:09.838896 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 217/434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:09 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1316 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:09.848034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6764b188-87b7-4201-994d-eb7f584a7c01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Calling method '.version_select at 0x7fca33d3b4c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.120361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:10.136623 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-04a5a94b-a9a8-4f32-aa3e-7dab3e618250 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 0.500548 Oct 28 09:52:10.139698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6764b188-87b7-4201-994d-eb7f584a7c01 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674?user_id=60accc0c23bc44f9a03f37c081f479eb" status: 200 len: 370 microversion: 2.1 time: 0.292621 Oct 28 09:52:10.140797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 218/435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:09 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:10.142096 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 218/436] 10.222.0.16 () {58 vars in 1323 bytes} [Fri Oct 28 09:52:09 2022] GET /compute/v2.1/os-quota-sets/d9d62f2c0fbd4773994c94cfbcac0674?user_id=60accc0c23bc44f9a03f37c081f479eb => generated 370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:10.156969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.165534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:10.179001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.179923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.180678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.182114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.183124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.184617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.229711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:10.591175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:10.592375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:10.614887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.619359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.620450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:10.623401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:10.623401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:10.623831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.095026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.119008 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ab826311-b0e7-4e12-8666-42cbf86843e0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 0.532834 Oct 28 09:52:11.119605 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 219/437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:10 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:11.144868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:11.146719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:11.154992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.175627 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c4fdab7-d620-4afc-85f7-ff7a8ec1eeee tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 1.032761 Oct 28 09:52:11.177524 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 219/438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:10 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:11.182225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:11.183852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:11.184558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.192781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:11.194280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:11.195332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.209798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:11.211378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:11.252640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:11.253909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:11.257109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.261845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:11.268756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:11.270104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.780786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:11.831435 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c4e4216a-12c1-41ce-a892-4946ee6199fa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1316 microversion: 2.1 time: 0.702413 Oct 28 09:52:11.839016 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 220/439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:11 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:11.852505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7d016d9a-f062-4bb0-b84d-de198e9536ab req-0b11e1a0-f105-4d44-976b-800d879f7259 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43bf398-e1f4-4d70-a0f3-95206e038e24", "name": "network-vif-plugged", "status": "completed", "tag": "83e59ddf-79e4-4360-a974-08584405f59f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:11.891367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7d016d9a-f062-4bb0-b84d-de198e9536ab req-0b11e1a0-f105-4d44-976b-800d879f7259 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:11.894980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7d016d9a-f062-4bb0-b84d-de198e9536ab req-0b11e1a0-f105-4d44-976b-800d879f7259 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:11.896050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7d016d9a-f062-4bb0-b84d-de198e9536ab req-0b11e1a0-f105-4d44-976b-800d879f7259 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:11.931345 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7d016d9a-f062-4bb0-b84d-de198e9536ab req-0b11e1a0-f105-4d44-976b-800d879f7259 service nova] Creating event network-vif-plugged:83e59ddf-79e4-4360-a974-08584405f59f for instance b43bf398-e1f4-4d70-a0f3-95206e038e24 on n-h1-zed-1 Oct 28 09:52:11.965200 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7d016d9a-f062-4bb0-b84d-de198e9536ab req-0b11e1a0-f105-4d44-976b-800d879f7259 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115768 Oct 28 09:52:11.966199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 221/440] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:11.977505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1b46c7f-1a89-4943-ad61-1dd89966f6d7 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Calling method '.version_select at 0x7fca33d3b670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:12.300162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:12.812287 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1b46c7f-1a89-4943-ad61-1dd89966f6d7 tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63/defaults" status: 200 len: 371 microversion: 2.1 time: 0.844273 Oct 28 09:52:12.814019 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 222/441] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:52:11 2022] GET /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63/defaults => generated 371 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:12.820848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:12.821628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:12.831063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:12.832321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:12.834192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:12.836401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:12.838264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:12.840152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:12.917273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:12.932747 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b70b7b6-e73b-4726-8066-e066b0032d95 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 1.753299 Oct 28 09:52:12.934254 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 220/442] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:11 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:12.946974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:12.948388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:12.965262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:12.966690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:12.967373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:12.968539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:12.973560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:12.974394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:13.518040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:13.528529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:13.624367 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-086e0c91-9073-44cb-bb89-48fe05e095bc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1313 microversion: 2.1 time: 0.807375 Oct 28 09:52:13.638796 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 223/443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:12 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1313 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:13.653574 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56607211-c1ed-48ef-b956-95805c606fe6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1316 microversion: 2.1 time: 0.698064 Oct 28 09:52:13.670882 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 221/444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:12 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1316 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:13.674657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Action: 'update', calling method: .version_select at 0x7fca33d3ba60>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:13.701700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:13.705745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:13.743404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:13.746105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:13.747579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:13.748936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:13.757578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:13.761216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:13.978972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=34 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:14.369494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:14.372793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.373715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.377817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.378978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.379600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.380710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.405958 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-be59c02d-ca9e-4c86-b0ba-18696dbac413 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1316 microversion: 2.1 time: 0.731099 Oct 28 09:52:14.410311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 222/445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:13 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1316 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:14.436551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7c0c76c6-c7a1-468b-b8d0-356be4a71dfe req-828c5bf8-fb7a-4713-9d72-78c61aa60e5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05112b40-6767-428e-8884-474dd5e18ae9", "tag": "194f7ac8-0af3-4fcc-b9e5-c4d135f440be"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:14.491784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c0c76c6-c7a1-468b-b8d0-356be4a71dfe req-828c5bf8-fb7a-4713-9d72-78c61aa60e5b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.494394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c0c76c6-c7a1-468b-b8d0-356be4a71dfe req-828c5bf8-fb7a-4713-9d72-78c61aa60e5b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.495588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c0c76c6-c7a1-468b-b8d0-356be4a71dfe req-828c5bf8-fb7a-4713-9d72-78c61aa60e5b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.524014 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7c0c76c6-c7a1-468b-b8d0-356be4a71dfe req-828c5bf8-fb7a-4713-9d72-78c61aa60e5b service nova] Creating event network-changed:194f7ac8-0af3-4fcc-b9e5-c4d135f440be for instance 05112b40-6767-428e-8884-474dd5e18ae9 on n-h1-zed-1 Oct 28 09:52:14.535384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7c0c76c6-c7a1-468b-b8d0-356be4a71dfe req-828c5bf8-fb7a-4713-9d72-78c61aa60e5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119488 Oct 28 09:52:14.537155 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 223/446] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:14.562836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:14.564688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:14.595339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.596778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.599351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.600119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.600601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.601194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.869289 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d933bc55-5433-463d-ac38-2df28869000d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63" status: 200 len: 329 microversion: 2.1 time: 1.221937 Oct 28 09:52:14.870071 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 224/447] 10.222.0.16 () {60 vars in 1263 bytes} [Fri Oct 28 09:52:13 2022] PUT /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63 => generated 329 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:14.877567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:14.878723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:14.888812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.889723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.890375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:14.891310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:14.891949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:14.892619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.132860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.142343 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c71f785b-57e1-4fcd-be2f-7e1eddef61c0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1463 microversion: 2.1 time: 0.270967 Oct 28 09:52:15.142946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 225/448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:14 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1463 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:15.156980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:15.157627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:15.164488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:15.165050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:15.165496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.166231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:15.166883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:15.167483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.241312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.254738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d8a2e33-8320-4221-a982-047ec22bcbbb tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 0.715545 Oct 28 09:52:15.257820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 224/449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:14 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:15.264451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Action: 'update', calling method: .version_select at 0x7fca33e3ad30>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:15.414416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:15.431066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f944d4ea-8dc8-4fb6-9531-065083a6f633 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1505 microversion: 2.1 time: 0.283742 Oct 28 09:52:15.448951 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 226/450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:15 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:15.846942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:15.847721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:15.847883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.850187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:15.850720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:15.851231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:15.902411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1615500129", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:15.902789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:DELETE=8,nova_api:SELECT=91,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:16.022486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:16.515255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:16.516461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:16.517149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:16.517728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:16.518305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:16.530149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.530985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.531870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:16.532843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.533556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.534149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:16.557708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Getting quotas for project cdc8b6c3e715487293067ca378466ca4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:16.563143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Getting quotas for user 66a05c50f8b744f0b5c22c7a33e88530 and project cdc8b6c3e715487293067ca378466ca4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:16.573784 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1dc229a-e9ce-4ffb-b7a9-a91fad6f011d tempest-QuotasAdminTestJSON-1754212578 tempest-QuotasAdminTestJSON-1754212578-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63" status: 200 len: 329 microversion: 2.1 time: 1.310105 Oct 28 09:52:16.576669 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 225/451] 10.222.0.16 () {60 vars in 1263 bytes} [Fri Oct 28 09:52:15 2022] PUT /compute/v2.1/os-quota-sets/591c284c04044d2e91aa94035ab6eb63 => generated 329 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:16.584727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:52:16.598169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:16.620679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:16.626890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:16.640813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.641788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.642696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:16.644060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.645156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.646578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:16.759482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d796f47-f750-47a0-a1fd-9720dc350271 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315567 Oct 28 09:52:16.766129 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 227/452] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:52:16.789816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:16.795283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:16.819879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.823526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.825956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:16.827226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:16.827996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:16.833564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:17.055171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:17.065865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Old instance type m1.heat2, new instance type m1.heat {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 09:52:17.103370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:17.104129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:17.110987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:17.115121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:17.119458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:17.205041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:17.241121 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d997c586-9f3e-4e26-b88a-5f3b3dd38b7b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1316 microversion: 2.1 time: 0.472961 Oct 28 09:52:17.242351 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 228/453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:16 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1316 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:17.269532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-844364538"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:17.271625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:17.288978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:17.294924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:17.297090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:17.300187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:17.303399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:17.312024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:17.564408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ba8d7e6-ecdf-480c-ab85-eaac53a0bb21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24/action" status: 202 len: 0 microversion: 2.1 time: 0.982259 Oct 28 09:52:17.565465 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 226/454] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:52:16 2022] POST /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24/action => generated 0 bytes in 988 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:17.603389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e780e5bf-b070-4ec5-892b-3aa6bed71461 req-87cb0848-83fb-41a9-90bf-28fb8cd3b1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fa029b-3f20-4349-818b-d177d0e8b0d0", "name": "network-vif-plugged", "status": "completed", "tag": "c056cd56-d958-460c-9dfa-be289a2b2478"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:17.609380 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.network.security_group_api [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Adding security group 244ec2e3-a160-4bf7-93b5-119c9f04decf to port c3c34cfd-4412-4272-92b8-e0b27f33eb05 Oct 28 09:52:17.671851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e780e5bf-b070-4ec5-892b-3aa6bed71461 req-87cb0848-83fb-41a9-90bf-28fb8cd3b1f6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:17.673437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e780e5bf-b070-4ec5-892b-3aa6bed71461 req-87cb0848-83fb-41a9-90bf-28fb8cd3b1f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:17.691301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e780e5bf-b070-4ec5-892b-3aa6bed71461 req-87cb0848-83fb-41a9-90bf-28fb8cd3b1f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:17.797272 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e780e5bf-b070-4ec5-892b-3aa6bed71461 req-87cb0848-83fb-41a9-90bf-28fb8cd3b1f6 service nova] Creating event network-vif-plugged:c056cd56-d958-460c-9dfa-be289a2b2478 for instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 on n-h2-zed-1 Oct 28 09:52:17.811654 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e780e5bf-b070-4ec5-892b-3aa6bed71461 req-87cb0848-83fb-41a9-90bf-28fb8cd3b1f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244147 Oct 28 09:52:17.813511 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 227/455] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:17.835236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:17.837425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:17.854850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:17.857591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:17.859034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:17.861168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:17.862353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:17.864209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.097364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:19.128040 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c899d41-6900-49b9-b0ec-77079ce16504 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 1.308180 Oct 28 09:52:19.129900 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 228/456] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:17 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:19.146147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:19.158737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:19.180197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.181474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.182371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.185252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.186138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.189223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.333346 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7baa10d5-2403-477a-b4b0-964f19e6996c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee/action" status: 202 len: 0 microversion: 2.1 time: 2.084400 Oct 28 09:52:19.334744 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 229/457] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:52:17 2022] POST /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee/action => generated 0 bytes in 2092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:19.374272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:19.382094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:19.397938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:19.414886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.415794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.423767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.426214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:19.430256 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-726d6dec-46b1-4484-a683-715f804250d1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1271 microversion: 2.1 time: 0.298226 Oct 28 09:52:19.430719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:19.444938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:19.445378 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 229/458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:19 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:20.117389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.119828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:20.133925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b991de36-7378-497e-947a-ceb1b85bbcc6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1472 microversion: 2.1 time: 0.789939 Oct 28 09:52:20.134991 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 230/459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:19 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1472 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:20.160430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:20.161493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:20.170285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.171155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.172042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.173882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.174664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.175322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.275521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Calling method '.version_select at 0x7fca33d45af0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:20.279933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.280742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.281521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.282524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.283159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.283779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.355145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c4d611d8-01da-4393-8688-4e1743d74a08 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 200 len: 361 microversion: 2.1 time: 0.917322 Oct 28 09:52:20.355814 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 230/460] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 09:52:19 2022] GET /compute/v2.1/os-hosts => generated 361 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:20.386529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1715017693"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:20.387617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:20.414275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.418138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.418668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.419700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.420159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.424437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.551867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:20.564223 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7cd7ca48-47ca-4fe4-938d-527701114557 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1316 microversion: 2.1 time: 0.411878 Oct 28 09:52:20.564891 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 231/461] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:20 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1316 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:20.578523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3753fb69-7f83-41eb-8c24-603794351a1f req-b7e3923e-79c5-4310-9be8-e2c56df5fdae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e315df11-58a5-4ed8-98b2-0077c5ab20ee", "tag": "c3c34cfd-4412-4272-92b8-e0b27f33eb05"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:20.633158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3753fb69-7f83-41eb-8c24-603794351a1f req-b7e3923e-79c5-4310-9be8-e2c56df5fdae service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.633672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3753fb69-7f83-41eb-8c24-603794351a1f req-b7e3923e-79c5-4310-9be8-e2c56df5fdae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.634117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3753fb69-7f83-41eb-8c24-603794351a1f req-b7e3923e-79c5-4310-9be8-e2c56df5fdae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.675206 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3753fb69-7f83-41eb-8c24-603794351a1f req-b7e3923e-79c5-4310-9be8-e2c56df5fdae service nova] Creating event network-changed:c3c34cfd-4412-4272-92b8-e0b27f33eb05 for instance e315df11-58a5-4ed8-98b2-0077c5ab20ee on n-h2-zed-1 Oct 28 09:52:20.693517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3753fb69-7f83-41eb-8c24-603794351a1f req-b7e3923e-79c5-4310-9be8-e2c56df5fdae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117970 Oct 28 09:52:20.698934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 232/462] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:20.720920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:20.721962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:20.729034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.729829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.730468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:20.731778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:20.732576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:20.733061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:21.249106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:21.264510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d0369ac2-8cff-497a-827d-3106e6573f05 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1386 microversion: 2.1 time: 0.561243 Oct 28 09:52:21.267787 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 233/463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:20 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1386 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:21.289877 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.network.security_group_api [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Adding security group 189664d2-bb4a-40d1-8995-db87735d1d8f to port c3c34cfd-4412-4272-92b8-e0b27f33eb05 Oct 28 09:52:21.949257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48315132-f9f5-4dcd-b7a6-be3b8ddf66c7 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Calling method '.version_select at 0x7fca33c805e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:21.959908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48315132-f9f5-4dcd-b7a6-be3b8ddf66c7 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'a85c88bc4e1a4e7989c1761102ee215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104fb3926d1943d29ac30dabd56ab2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48315132-f9f5-4dcd-b7a6-be3b8ddf66c7 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Request method failure captured: Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZPXpQ9HE3Cjyln9yzQIYBbuHXJrF_Yof2GJ8D09agj_zk8gvVJnQs2zYIaGa-7BJaHOPq30wjLOW1Y1CcHl2znARb-cJbDEx078iEKbh2wkQVeJXAGxTz-D5zUdhnNWN4xPtpikQ1TFYsHJAIdfOWEQNJELepax-8RlcvaLo74QUc Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:21.962664 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_104fb3926d1943d29ac30dabd56ab2d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/104fb3926d1943d29ac30dabd56ab2d2"}]}] Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a85c88bc4e1a4e7989c1761102ee215c Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: action_args: {} Oct 28 09:52:21.965888 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:21.971103 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 28 09:52:21.974113 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:21.978739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48315132-f9f5-4dcd-b7a6-be3b8ddf66c7 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:21.978739 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48315132-f9f5-4dcd-b7a6-be3b8ddf66c7 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] 10.222.0.16 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.694989 Oct 28 09:52:21.978739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 234/464] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 09:52:21 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 696 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:21.978739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:21.980248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:21.994173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:21.994674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:21.995385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:21.996140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:21.997207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:21.997961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:22.205870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:22.226133 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-360a8a75-ffc1-4364-9687-be9386fbe235 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1277 microversion: 2.1 time: 0.260141 Oct 28 09:52:22.227872 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 235/465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:21 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:22.235053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:22.236178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:22.248331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:22.249146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:22.249751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:22.250682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:22.251411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:22.252069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:22.889185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:22.904083 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-34681a82-b1f5-4da0-aaab-bdd298f5e17e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1472 microversion: 2.1 time: 0.673765 Oct 28 09:52:22.919613 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 236/466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:22 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1472 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:22.936551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-627b329d-4af6-4cb2-a924-258e55a92802 req-8fbb0d3e-2a9b-4dde-aeba-a224e81c025b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05112b40-6767-428e-8884-474dd5e18ae9", "name": "network-vif-plugged", "status": "completed", "tag": "194f7ac8-0af3-4fcc-b9e5-c4d135f440be"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:22.954979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-627b329d-4af6-4cb2-a924-258e55a92802 req-8fbb0d3e-2a9b-4dde-aeba-a224e81c025b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:22.956967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-627b329d-4af6-4cb2-a924-258e55a92802 req-8fbb0d3e-2a9b-4dde-aeba-a224e81c025b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:22.957790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-627b329d-4af6-4cb2-a924-258e55a92802 req-8fbb0d3e-2a9b-4dde-aeba-a224e81c025b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:22.978591 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-627b329d-4af6-4cb2-a924-258e55a92802 req-8fbb0d3e-2a9b-4dde-aeba-a224e81c025b service nova] Creating event network-vif-plugged:194f7ac8-0af3-4fcc-b9e5-c4d135f440be for instance 05112b40-6767-428e-8884-474dd5e18ae9 on n-h1-zed-1 Oct 28 09:52:22.989196 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-627b329d-4af6-4cb2-a924-258e55a92802 req-8fbb0d3e-2a9b-4dde-aeba-a224e81c025b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065336 Oct 28 09:52:22.990302 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 237/467] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:23.001252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:23.002421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:23.010414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=17 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:23.018029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.019731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.020557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.021957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.023144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.024037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.137251 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8863b1c9-fc18-487e-8724-d97fc8d0dd0a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee/action" status: 202 len: 0 microversion: 2.1 time: 2.765434 Oct 28 09:52:23.139455 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 231/468] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:52:20 2022] POST /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee/action => generated 0 bytes in 2783 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:23.170026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89953e7d-4454-4ec9-9154-6bbf9a54ea9a tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Calling method '.version_select at 0x7fca33dfc1f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:23.191117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-89953e7d-4454-4ec9-9154-6bbf9a54ea9a tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'a85c88bc4e1a4e7989c1761102ee215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104fb3926d1943d29ac30dabd56ab2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89953e7d-4454-4ec9-9154-6bbf9a54ea9a tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Request method failure captured: Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hosts/n-d-zed-1/reboot HTTP/1.1 Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZPXpQ9HE3Cjyln9yzQIYBbuHXJrF_Yof2GJ8D09agj_zk8gvVJnQs2zYIaGa-7BJaHOPq30wjLOW1Y1CcHl2znARb-cJbDEx078iEKbh2wkQVeJXAGxTz-D5zUdhnNWN4xPtpikQ1TFYsHJAIdfOWEQNJELepax-8RlcvaLo74QUc Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:52:23.202635 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_104fb3926d1943d29ac30dabd56ab2d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/104fb3926d1943d29ac30dabd56ab2d2"}]}] Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a85c88bc4e1a4e7989c1761102ee215c Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'n-d-zed-1'} Oct 28 09:52:23.205317 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:23.206923 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 28 09:52:23.210103 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:23.230202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89953e7d-4454-4ec9-9154-6bbf9a54ea9a tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:23.238342 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-89953e7d-4454-4ec9-9154-6bbf9a54ea9a tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-zed-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.091748 Oct 28 09:52:23.242069 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 232/469] 10.222.0.16 () {58 vars in 1179 bytes} [Fri Oct 28 09:52:23 2022] GET /compute/v2.1/os-hosts/n-d-zed-1/reboot => generated 111 bytes in 102 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:23.273460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:23.279755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:23.318463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.320390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.336105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.338406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.340048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.341895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.803994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:23.818918 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85605bec-417e-4e69-835d-17d06a944dae tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1316 microversion: 2.1 time: 0.826478 Oct 28 09:52:23.836626 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 238/470] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:22 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1316 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:23.859264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:23.860014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:23.868488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.869397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.870004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:23.870901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:23.872701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:23.873390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.290457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7f32477-df47-47b0-b8d1-68945ea8e769 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.452338 Oct 28 09:52:24.306998 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 239/471] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 09:52:23 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee/os-security-groups => generated 1156 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:24.314776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-915bed5d-9c9d-458a-866e-ad4a57b7c116 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Calling method '.version_select at 0x7fca33d3bca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.328501 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-915bed5d-9c9d-458a-866e-ad4a57b7c116 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-915bed5d-9c9d-458a-866e-ad4a57b7c116 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:52:24.332211 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'nonexistent_hostname'} Oct 28 09:52:24.333577 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:52:24.334368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 09:52:24.335448 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:24.336547 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:24.338531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-915bed5d-9c9d-458a-866e-ad4a57b7c116 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:24.339611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-915bed5d-9c9d-458a-866e-ad4a57b7c116 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.031305 Oct 28 09:52:24.344845 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 240/472] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Oct 28 09:52:24 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:52:24.354701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.356556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:24.359832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:24.376084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.377114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.378594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.379719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f54ff25f-c214-469d-a5ae-7daf47e6939a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1584 microversion: 2.1 time: 1.135437 Oct 28 09:52:24.380029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.380761 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 233/473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:23 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1584 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:24.381213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.382188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.386125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0086c84b-6313-4600-ac20-68fd59d9487d req-1c12f72c-1dfd-4e33-9ffe-79f9b1ebbc45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e315df11-58a5-4ed8-98b2-0077c5ab20ee", "tag": "c3c34cfd-4412-4272-92b8-e0b27f33eb05"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:24.415151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0086c84b-6313-4600-ac20-68fd59d9487d req-1c12f72c-1dfd-4e33-9ffe-79f9b1ebbc45 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.415724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0086c84b-6313-4600-ac20-68fd59d9487d req-1c12f72c-1dfd-4e33-9ffe-79f9b1ebbc45 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.416212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0086c84b-6313-4600-ac20-68fd59d9487d req-1c12f72c-1dfd-4e33-9ffe-79f9b1ebbc45 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.441308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0086c84b-6313-4600-ac20-68fd59d9487d req-1c12f72c-1dfd-4e33-9ffe-79f9b1ebbc45 service nova] Creating event network-changed:c3c34cfd-4412-4272-92b8-e0b27f33eb05 for instance e315df11-58a5-4ed8-98b2-0077c5ab20ee on n-h2-zed-1 Oct 28 09:52:24.447832 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0086c84b-6313-4600-ac20-68fd59d9487d req-1c12f72c-1dfd-4e33-9ffe-79f9b1ebbc45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065044 Oct 28 09:52:24.448043 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 234/474] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:24.472349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:24.473111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:24.486474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.490982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.491510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.492288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:24.492751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:24.497742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:24.505071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:24.519618 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a7a971e-8390-41b2-a967-62862d86de37 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1277 microversion: 2.1 time: 0.175800 Oct 28 09:52:24.521709 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 241/475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:24 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:24.536582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba4ce9a9-2f2b-4cf4-a6e8-ea0ac02e6ee1 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33d3b700>, body: {"security_group": {"name": " tempest-securitygroup -1553155267 ", "description": "tempest-description-1728556849"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:25.001386 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba4ce9a9-2f2b-4cf4-a6e8-ea0ac02e6ee1 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.476374 Oct 28 09:52:25.002716 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 242/476] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:52:24 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:25.013256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6008bbb-b1f7-430b-ae4d-8a8c1397331d tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Calling method '.version_select at 0x7fca33cc4e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:25.015767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6008bbb-b1f7-430b-ae4d-8a8c1397331d tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'a85c88bc4e1a4e7989c1761102ee215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104fb3926d1943d29ac30dabd56ab2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6008bbb-b1f7-430b-ae4d-8a8c1397331d tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Request method failure captured: Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hosts/n-d-zed-1 HTTP/1.1 Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZPXpQ9HE3Cjyln9yzQIYBbuHXJrF_Yof2GJ8D09agj_zk8gvVJnQs2zYIaGa-7BJaHOPq30wjLOW1Y1CcHl2znARb-cJbDEx078iEKbh2wkQVeJXAGxTz-D5zUdhnNWN4xPtpikQ1TFYsHJAIdfOWEQNJELepax-8RlcvaLo74QUc Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:25.023930 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_104fb3926d1943d29ac30dabd56ab2d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/104fb3926d1943d29ac30dabd56ab2d2"}]}] Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a85c88bc4e1a4e7989c1761102ee215c Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'n-d-zed-1'} Oct 28 09:52:25.025487 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:25.026395 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 28 09:52:25.028288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:25.031060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6008bbb-b1f7-430b-ae4d-8a8c1397331d tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:25.032651 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6008bbb-b1f7-430b-ae4d-8a8c1397331d tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-zed-1" status: 403 len: 109 microversion: 2.1 time: 0.028748 Oct 28 09:52:25.037733 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 243/477] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:52:25 2022] GET /compute/v2.1/os-hosts/n-d-zed-1 => generated 109 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:25.057641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:25.058904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:25.078168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:25.079117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:25.079911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:25.081323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:25.082212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:25.082977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:25.400625 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d76335c-301e-4351-9a65-10ef42df7f99 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.360986 Oct 28 09:52:25.401372 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 244/478] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 09:52:25 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0/os-interface => generated 284 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:25.415436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:25.417170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:25.435989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:25.442590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:25.443305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:25.444543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:25.445266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:25.445906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:26.429826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:26.446058 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ac1dbe1-6a32-4a6d-a36f-d3667264c991 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1466 microversion: 2.1 time: 1.034879 Oct 28 09:52:26.447415 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 245/479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:25 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1466 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:26.464310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c702f713-59d3-4e87-ace4-90e233b4c178 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33c80d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:26.530004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:26.548325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=15 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:26.550742 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-521f9673-7c74-4ea5-9334-1bc8a3eaf845 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1472 microversion: 2.1 time: 2.101330 Oct 28 09:52:26.552317 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 235/480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:24 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1472 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:26.557661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f41f5cc4-56c1-4ca7-964b-74a0dc99da6e tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Calling method '.version_select at 0x7fca38137310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:26.569973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=34 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:26.571795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f41f5cc4-56c1-4ca7-964b-74a0dc99da6e tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:26.573188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=74 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f41f5cc4-56c1-4ca7-964b-74a0dc99da6e tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:52:26.575484 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'nonexistent_hostname'} Oct 28 09:52:26.577222 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:26.578057 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:26.579356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:26.583018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f41f5cc4-56c1-4ca7-964b-74a0dc99da6e tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:26.591163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f41f5cc4-56c1-4ca7-964b-74a0dc99da6e tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.030486 Oct 28 09:52:26.605467 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 236/481] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 09:52:26 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:52:26.613042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:26.614657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:26.627473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:26.628675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:26.629593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:26.631771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:26.632977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:26.633831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:26.891397 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c702f713-59d3-4e87-ace4-90e233b4c178 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8" status: 200 len: 224 microversion: 2.1 time: 0.442254 Oct 28 09:52:26.903382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 246/482] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:52:26 2022] GET /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8 => generated 224 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:27.086640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:27.100817 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4f5f71b-4c48-473b-b91d-728745c0619e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.493718 Oct 28 09:52:27.101464 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 237/483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:26 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:27.119734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d43ce92a-0866-4584-9467-47dd964e2dd3 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Calling method '.version_select at 0x7fca33c8f9d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:27.123879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d43ce92a-0866-4584-9467-47dd964e2dd3 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'a85c88bc4e1a4e7989c1761102ee215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104fb3926d1943d29ac30dabd56ab2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d43ce92a-0866-4584-9467-47dd964e2dd3 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Request method failure captured: Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hosts/n-d-zed-1/shutdown HTTP/1.1 Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZPXpQ9HE3Cjyln9yzQIYBbuHXJrF_Yof2GJ8D09agj_zk8gvVJnQs2zYIaGa-7BJaHOPq30wjLOW1Y1CcHl2znARb-cJbDEx078iEKbh2wkQVeJXAGxTz-D5zUdhnNWN4xPtpikQ1TFYsHJAIdfOWEQNJELepax-8RlcvaLo74QUc Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:52:27.133205 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_104fb3926d1943d29ac30dabd56ab2d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/104fb3926d1943d29ac30dabd56ab2d2"}]}] Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a85c88bc4e1a4e7989c1761102ee215c Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'n-d-zed-1'} Oct 28 09:52:27.137286 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:27.138851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 28 09:52:27.141773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:27.142842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d43ce92a-0866-4584-9467-47dd964e2dd3 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:27.142842 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d43ce92a-0866-4584-9467-47dd964e2dd3 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-zed-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.029210 Oct 28 09:52:27.142842 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 238/484] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 09:52:27 2022] GET /compute/v2.1/os-hosts/n-d-zed-1/shutdown => generated 113 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:27.152995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f62cc63-6f5f-4f5c-af9c-7e72e9c3a528 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33cf5700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:27.244528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:27.245186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:27.253578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:27.254091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:27.254535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:27.255312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:27.255970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:27.256593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:27.917608 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8f62cc63-6f5f-4f5c-af9c-7e72e9c3a528 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8" status: 202 len: 0 microversion: 2.1 time: 0.780819 Oct 28 09:52:27.919995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 239/485] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:52:27 2022] DELETE /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8 => generated 0 bytes in 784 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:27.993745 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d5ea1ba-dace-4727-b21f-dfca94a1371e tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1611 microversion: 2.1 time: 1.084916 Oct 28 09:52:27.998770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 247/486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:26 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1611 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:28.014643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c47d0962-d3af-4e43-b9f9-ea1e4cdbbc38 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Calling method '.version_select at 0x7fca33c85040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.019075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7d6841f-a9cc-4cee-947e-b3dee84fb6a0 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Calling method '.version_select at 0x7fca33c80ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.047847 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b7d6841f-a9cc-4cee-947e-b3dee84fb6a0 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7d6841f-a9cc-4cee-947e-b3dee84fb6a0 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:52:28.050473 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'nonexistent_hostname'} Oct 28 09:52:28.052044 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:52:28.053117 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 09:52:28.054516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:28.055955 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.060073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7d6841f-a9cc-4cee-947e-b3dee84fb6a0 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:28.062617 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b7d6841f-a9cc-4cee-947e-b3dee84fb6a0 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.059730 Oct 28 09:52:28.063987 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 248/487] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 09:52:27 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:52:28.073486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.075828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:28.085444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.091037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.091856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.092871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.095786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.096854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.128743 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c47d0962-d3af-4e43-b9f9-ea1e4cdbbc38 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 371 microversion: 2.1 time: 0.203418 Oct 28 09:52:28.140306 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 240/488] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 09:52:27 2022] GET /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 371 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:28.146189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bbe95a6-e65e-4376-bb16-cea932adf970 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33c8f670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.263387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-0bbe95a6-e65e-4376-bb16-cea932adf970 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:52:28.264807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-0bbe95a6-e65e-4376-bb16-cea932adf970 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 31b64d5c-f537-4394-8382-57d088f46dd8 not found {{(pid=128748) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:52:28.266219 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-0bbe95a6-e65e-4376-bb16-cea932adf970 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:52:28.266219 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-fdbfb10d-933e-487e-a8ed-f6a7d8da3d8e'] Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bbe95a6-e65e-4376-bb16-cea932adf970 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8 HTTP/1.1 Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:52:28.274038 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-fdbfb10d-933e-487e-a8ed-f6a7d8da3d8e'] Oct 28 09:52:28.276167 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '31b64d5c-f537-4394-8382-57d088f46dd8'} Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:28.277646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdbfb10d-933e-487e-a8ed-f6a7d8da3d8e'] Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:52:28.279785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdbfb10d-933e-487e-a8ed-f6a7d8da3d8e'] Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdbfb10d-933e-487e-a8ed-f6a7d8da3d8e'] Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.281552 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.283419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.283419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.283419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:28.283419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:28.283419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:52:28.283419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fdbfb10d-933e-487e-a8ed-f6a7d8da3d8e'] Oct 28 09:52:28.283419 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.285447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bbe95a6-e65e-4376-bb16-cea932adf970 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:52:28.285447 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-fdbfb10d-933e-487e-a8ed-f6a7d8da3d8e'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:28.287252 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0bbe95a6-e65e-4376-bb16-cea932adf970 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8" status: 404 len: 194 microversion: 2.1 time: 0.145224 Oct 28 09:52:28.288633 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 241/489] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:52:28 2022] GET /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8 => generated 194 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:28.295669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:28.296275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a52da432-f939-4637-a5a7-c7424ab989f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: .version_select at 0x7fca33bc5a60>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1562964467", "policies": ["affinity"]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:28.310087 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-13b5a2ad-ed57-4f91-9b2d-04dfd9b25f7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.241296 Oct 28 09:52:28.310900 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 249/490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:28 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:28.330394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c99729a6-2919-4dc7-a18e-fff3b3a4ba60 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Calling method '.version_select at 0x7fca33d3bd30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.337920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c99729a6-2919-4dc7-a18e-fff3b3a4ba60 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'a85c88bc4e1a4e7989c1761102ee215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104fb3926d1943d29ac30dabd56ab2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:28.340482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c99729a6-2919-4dc7-a18e-fff3b3a4ba60 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Request method failure captured: Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hosts/n-d-zed-1/startup HTTP/1.1 Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZPXpQ9HE3Cjyln9yzQIYBbuHXJrF_Yof2GJ8D09agj_zk8gvVJnQs2zYIaGa-7BJaHOPq30wjLOW1Y1CcHl2znARb-cJbDEx078iEKbh2wkQVeJXAGxTz-D5zUdhnNWN4xPtpikQ1TFYsHJAIdfOWEQNJELepax-8RlcvaLo74QUc Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:28.341094 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_104fb3926d1943d29ac30dabd56ab2d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/104fb3926d1943d29ac30dabd56ab2d2"}]}] Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a85c88bc4e1a4e7989c1761102ee215c Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'n-d-zed-1'} Oct 28 09:52:28.343229 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:28.344434 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 28 09:52:28.346268 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:28.351607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a52da432-f939-4637-a5a7-c7424ab989f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:28.354266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c99729a6-2919-4dc7-a18e-fff3b3a4ba60 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:28.354266 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c99729a6-2919-4dc7-a18e-fff3b3a4ba60 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] 10.222.0.16 "GET /compute/v2.1/os-hosts/n-d-zed-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.038156 Oct 28 09:52:28.354266 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 250/491] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 09:52:28 2022] GET /compute/v2.1/os-hosts/n-d-zed-1/startup => generated 110 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:28.361166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a52da432-f939-4637-a5a7-c7424ab989f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:28.365524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.366832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:28.377635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.378208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.378865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.379810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.380289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.380726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.462020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a52da432-f939-4637-a5a7-c7424ab989f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:28.468528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a52da432-f939-4637-a5a7-c7424ab989f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:28.492347 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a52da432-f939-4637-a5a7-c7424ab989f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.201920 Oct 28 09:52:28.504942 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 242/492] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 09:52:28 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:28.521295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Action: 'update', calling method: .version_select at 0x7fca33bc5ee0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:28.740160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.742795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.743392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.743536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:28.758985 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f797ca0e-7eea-4bf0-b9be-c33003f0d03f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.399330 Oct 28 09:52:28.765262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.767603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.769392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.775823 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 251/493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:28 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:28.804025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:28.805324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:28.824276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.825000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.825581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.830631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:28.831167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:28.831617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:28.947574 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-83aa244b-d4df-45a1-932d-ec8b05f18c59 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 328 microversion: 2.1 time: 0.451287 Oct 28 09:52:28.962221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 243/494] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:28 2022] PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 328 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:28.986050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-bfdbe740-b032-4814-a3c3-feaa74e12111 req-2a73ad0f-2928-4236-b993-9fdc7ae28d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18fa029b-3f20-4349-818b-d177d0e8b0d0", "tag": "c056cd56-d958-460c-9dfa-be289a2b2478"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:29.018007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bfdbe740-b032-4814-a3c3-feaa74e12111 req-2a73ad0f-2928-4236-b993-9fdc7ae28d75 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:29.018502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bfdbe740-b032-4814-a3c3-feaa74e12111 req-2a73ad0f-2928-4236-b993-9fdc7ae28d75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:29.021345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bfdbe740-b032-4814-a3c3-feaa74e12111 req-2a73ad0f-2928-4236-b993-9fdc7ae28d75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:29.074426 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-bfdbe740-b032-4814-a3c3-feaa74e12111 req-2a73ad0f-2928-4236-b993-9fdc7ae28d75 service nova] Creating event network-changed:c056cd56-d958-460c-9dfa-be289a2b2478 for instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 on n-h2-zed-1 Oct 28 09:52:29.088049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-bfdbe740-b032-4814-a3c3-feaa74e12111 req-2a73ad0f-2928-4236-b993-9fdc7ae28d75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124230 Oct 28 09:52:29.091238 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 244/495] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:29.097348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a316652b-2e53-4420-bd72-67eb973a2666 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33bd6310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1928618301", "description": "tempest-description-1827792943"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:29.494287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:29.509404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d03017d0-79cc-4014-9427-0519a25c0e2a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1584 microversion: 2.1 time: 0.729714 Oct 28 09:52:29.511318 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 252/496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:28 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1584 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:29.531346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d8eafdf-3da2-4980-956d-4a1e87541fef tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Calling method '.version_select at 0x7fca33d3b700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:29.551072 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6d8eafdf-3da2-4980-956d-4a1e87541fef tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d8eafdf-3da2-4980-956d-4a1e87541fef tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:52:29.554038 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'nonexistent_hostname'} Oct 28 09:52:29.555605 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:52:29.556365 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 28 09:52:29.557507 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:29.558607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:29.561705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d8eafdf-3da2-4980-956d-4a1e87541fef tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:29.562835 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d8eafdf-3da2-4980-956d-4a1e87541fef tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.050241 Oct 28 09:52:29.563628 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 253/497] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Oct 28 09:52:29 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:52:29.578705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1437632018", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "727288b3-d308-4dea-be42-b1e59c4250d1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:29.672677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:29.702817 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a316652b-2e53-4420-bd72-67eb973a2666 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.609741 Oct 28 09:52:29.703430 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 245/498] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:52:29 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:29.709126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6b24b8cc-8ff6-4300-b9f5-64fd411c1f38 req-363e64c9-8424-47ee-994c-72fb08a3b18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c28120-7ffa-4702-bf23-8354ac0117bf", "tag": "230ba441-692a-4982-ac79-1154dd8d6c8c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:29.733771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6b24b8cc-8ff6-4300-b9f5-64fd411c1f38 req-363e64c9-8424-47ee-994c-72fb08a3b18f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:29.735525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6b24b8cc-8ff6-4300-b9f5-64fd411c1f38 req-363e64c9-8424-47ee-994c-72fb08a3b18f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:29.736008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6b24b8cc-8ff6-4300-b9f5-64fd411c1f38 req-363e64c9-8424-47ee-994c-72fb08a3b18f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:29.758725 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6b24b8cc-8ff6-4300-b9f5-64fd411c1f38 req-363e64c9-8424-47ee-994c-72fb08a3b18f service nova] Creating event network-changed:230ba441-692a-4982-ac79-1154dd8d6c8c for instance 34c28120-7ffa-4702-bf23-8354ac0117bf on n-h2-zed-1 Oct 28 09:52:29.773148 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6b24b8cc-8ff6-4300-b9f5-64fd411c1f38 req-363e64c9-8424-47ee-994c-72fb08a3b18f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067960 Oct 28 09:52:29.773772 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 246/499] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:29.923344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-460238900", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:30.085116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:30.248032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:30.248473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:30.248976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:30.249472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:30.249894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:30.314240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:30.315653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:30.316682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:30.318353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:30.320978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:30.322043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:30.363705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:30.369136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:30.385604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Going to run 2 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:52:30.389095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:30.444025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128747) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 09:52:30.487495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:30.496188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:30.565974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:30.572511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:30.593494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=d797eca4-cd96-4170-8c7d-c0cb62f84495,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:30.670794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:30.679171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:30.784292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:30.803567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:30.806232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:30.807520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:30.809431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:30.810650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:30.811917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:30.845394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:30.847123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:30.850989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:30.853211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:30.854539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:30.856630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:30.879825 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c6ac44b-583e-4505-a91e-896ed255ef18 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.311140 Oct 28 09:52:30.886091 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 254/500] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 1321 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:52:30.893745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:30.900124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:30.913728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:30.921011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:30.922015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:30.925989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:30.927015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:30.927735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:30.947410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Getting quotas for project 9db49c69ff8648759c5d61d8b149dedd. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:30.962699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Getting quotas for user b31f31eb0a7b4c14be4317c2baa47182 and project 9db49c69ff8648759c5d61d8b149dedd. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:30.985237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.utils [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] cores quota exceeded for 9db49c69ff8648759c5d61d8b149dedd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128748) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 09:52:30.986107 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Request method failure captured: Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 144 Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZZ60Rqp-3jEpVOPBQ1cKP-wEQJk4ESTaXNLawKhkqPrfpWlTe74Q5WQWno8Z34lgRdMPpcsRuY5Ecd2V9N9uHwasL1sfsBmVmMXwJioNqQxf-HB6PE0ly6VAa6fJRakNEgbulMPYc6KwGd0V59R0mpdRjjVJELSxQOQJhYJyHlZRY Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:52:30.990581 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9db49c69ff8648759c5d61d8b149dedd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9db49c69ff8648759c5d61d8b149dedd"}]}] Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b31f31eb0a7b4c14be4317c2baa47182 Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-460238900", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} Oct 28 09:52:30.993712 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-460238900', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452'}}} Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 09:52:30.995298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:30.998280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.003721 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e2786b7-061f-42dc-ba09-78bb26780372 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.218101 Oct 28 09:52:31.009372 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 247/501] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:29 2022] POST /compute/v2.1/servers => generated 111 bytes in 1220 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:31.015765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27ac768d-f48d-4ad9-81bf-8536d7010773 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Action: 'update', calling method: .version_select at 0x7fca33be2b80>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27ac768d-f48d-4ad9-81bf-8536d7010773 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/os-hosts/n-d-zed-1 HTTP/1.1 Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 51 Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:52:31.020352 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: {"status": "enable", "maintenance_mode": "invalid"} Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:31.023455 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'n-d-zed-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance: Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.025705 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.033269 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:31.035515 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:31.035515 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:52:31.035515 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:52:31.035515 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.035515 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.042098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27ac768d-f48d-4ad9-81bf-8536d7010773 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:31.044799 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-27ac768d-f48d-4ad9-81bf-8536d7010773 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-zed-1" status: 400 len: 199 microversion: 2.1 time: 0.044527 Oct 28 09:52:31.045859 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 248/502] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 09:52:30 2022] PUT /compute/v2.1/os-hosts/n-d-zed-1 => generated 199 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:52:31.053822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1fafda05-a220-4713-a37c-be8ad22260e3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33be1670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1683703350", "description": "tempest-description-1262817790"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:31.433330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1fafda05-a220-4713-a37c-be8ad22260e3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.383976 Oct 28 09:52:31.435050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:31.443648 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 249/503] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:52:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:31.451461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:31.452426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:31.462862 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23552c2b-d8f1-4290-80c7-49119ba665d5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.575230 Oct 28 09:52:31.463582 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 255/504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:30 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:31.471509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:31.477679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:31.478736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Searching by: {'deleted': False, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:52:31.485923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:31.492390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:31.494412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:31.496491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:31.497895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:31.498753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:31.502235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:31.504017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:31.504806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:31.505901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:31.506795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:31.507520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:31.646698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:52:31.825811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:31.841218 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-740011ad-023c-4c53-8588-1b3af1e79821 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.401758 Oct 28 09:52:31.842410 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 250/505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:31 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:31.847462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9edda95e-3d4c-42df-aa41-ad63f21f52b9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.382134 Oct 28 09:52:31.848205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Action: 'update', calling method: .version_select at 0x7fca33be2b80>, body: {"quota_set": {"cores": 20}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:31.848381 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 256/506] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 09:52:31 2022] GET /compute/v2.1/servers => generated 1003 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:31.882458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f01f738d-608d-4bd6-b908-c76101869600 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Action: 'update', calling method: .version_select at 0x7fca33cb5a60>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f01f738d-608d-4bd6-b908-c76101869600 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: request: PUT /compute/v2.1/os-hosts/n-d-zed-1 HTTP/1.1 Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 51 Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:52:31.908680 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: {"status": "invalid", "maintenance_mode": "enable"} Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:31.910176 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'n-d-zed-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance: Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.911036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:31.920893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f01f738d-608d-4bd6-b908-c76101869600 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f01f738d-608d-4bd6-b908-c76101869600 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-zed-1" status: 400 len: 189 microversion: 2.1 time: 0.061133 Oct 28 09:52:31.924193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 257/507] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 09:52:31 2022] PUT /compute/v2.1/os-hosts/n-d-zed-1 => generated 189 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:52:31.927272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6185ff53-4434-4d65-ad18-fb0371e67ad2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33c32790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2108680683", "description": "tempest-description-1511837841"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:31.953147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:31.953734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:31.954244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:31.955262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:31.955875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:31.956410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:31.972862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:32.072251 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-222dde9a-0746-449a-b4f8-87a0f6ad63f9 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 329 microversion: 2.1 time: 0.228196 Oct 28 09:52:32.077857 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 251/508] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:31 2022] PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 329 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:32.099247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d44f94b-96b7-4ca2-8401-1fba3f948d42 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:32.100434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d44f94b-96b7-4ca2-8401-1fba3f948d42 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:32.164150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d44f94b-96b7-4ca2-8401-1fba3f948d42 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:32.183356 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d44f94b-96b7-4ca2-8401-1fba3f948d42 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1219 microversion: 2.1 time: 0.102569 Oct 28 09:52:32.185768 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 252/509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:32 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:32.197907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b129e00e-7685-4393-a9ba-740e5f7109c2 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Action: 'update', calling method: .version_select at 0x7fca33b6e430>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:32.210302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b129e00e-7685-4393-a9ba-740e5f7109c2 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'a85c88bc4e1a4e7989c1761102ee215c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '104fb3926d1943d29ac30dabd56ab2d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b129e00e-7685-4393-a9ba-740e5f7109c2 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Request method failure captured: Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/os-hosts/n-d-zed-1 HTTP/1.1 Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 50 Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZPXpQ9HE3Cjyln9yzQIYBbuHXJrF_Yof2GJ8D09agj_zk8gvVJnQs2zYIaGa-7BJaHOPq30wjLOW1Y1CcHl2znARb-cJbDEx078iEKbh2wkQVeJXAGxTz-D5zUdhnNWN4xPtpikQ1TFYsHJAIdfOWEQNJELepax-8RlcvaLo74QUc Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:52:32.216155 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/104fb3926d1943d29ac30dabd56ab2d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_104fb3926d1943d29ac30dabd56ab2d2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/104fb3926d1943d29ac30dabd56ab2d2"}]}] Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 104fb3926d1943d29ac30dabd56ab2d2 Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-917505098 Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a85c88bc4e1a4e7989c1761102ee215c Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HostsAdminNegativeTestJSON-917505098-project Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 09:52:32.217819 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'n-d-zed-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:32.218649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 28 09:52:32.219810 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.222089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b129e00e-7685-4393-a9ba-740e5f7109c2 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:32.222991 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b129e00e-7685-4393-a9ba-740e5f7109c2 tempest-HostsAdminNegativeTestJSON-917505098 tempest-HostsAdminNegativeTestJSON-917505098-project] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-zed-1" status: 403 len: 111 microversion: 2.1 time: 0.036023 Oct 28 09:52:32.226626 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 253/510] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 09:52:32 2022] PUT /compute/v2.1/os-hosts/n-d-zed-1 => generated 111 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:32.238050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3eb9b045-ef2a-4a21-aca2-c1f40caf50e7 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Calling method '.version_select at 0x7fca33c8f670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:32.377273 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3eb9b045-ef2a-4a21-aca2-c1f40caf50e7 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 371 microversion: 2.1 time: 0.148904 Oct 28 09:52:32.385881 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 254/511] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 09:52:32 2022] GET /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:32.391061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5555e82a-0ba5-4d96-94bb-f2af40313f47 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Action: 'update', calling method: .version_select at 0x7fca33be1940>, body: {"status": null, "maintenance_mode": null} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5555e82a-0ba5-4d96-94bb-f2af40313f47 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/os-hosts/n-d-zed-1 HTTP/1.1 Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 42 Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:52:32.396528 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: {"status": null, "maintenance_mode": null} Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 09:52:32.398117 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'n-d-zed-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'disable', Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'Enable', Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'Disable', Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance: Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi None Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:32.398937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:32.400696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:32.402834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 09:52:32.402834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 09:52:32.402834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 28 09:52:32.402834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.404395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5555e82a-0ba5-4d96-94bb-f2af40313f47 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:32.405310 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5555e82a-0ba5-4d96-94bb-f2af40313f47 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/n-d-zed-1" status: 400 len: 127 microversion: 2.1 time: 0.018295 Oct 28 09:52:32.410446 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 255/512] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 09:52:32 2022] PUT /compute/v2.1/os-hosts/n-d-zed-1 => generated 127 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:52:32.421365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Action: 'update', calling method: .version_select at 0x7fca33b52c10>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:32.617284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:32.617914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:32.618280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:32.619055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:32.619571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:32.619998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:32.689304 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73fd2758-b5be-4ad0-9687-cadf3fb008cd tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 328 microversion: 2.1 time: 0.275484 Oct 28 09:52:32.699061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 256/513] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:32 2022] PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 328 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:32.728567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9b44ea9-f229-4dd0-a436-0023faac8270 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Action: 'update', calling method: .version_select at 0x7fca33b6e3a0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:32.739667 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.hosts [None req-c9b44ea9-f229-4dd0-a436-0023faac8270 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Enabling host nonexistent_hostname. Oct 28 09:52:32.756541 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c9b44ea9-f229-4dd0-a436-0023faac8270 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9b44ea9-f229-4dd0-a436-0023faac8270 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Request method failure captured: Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 50 Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZSf3u-ef_c3bsczSbmzyNiEzU_6ryDvngADdeH1EAZcyhst581vHx-ZMTmWnF-5VKDBBo3i5voUTER9L9dOlkm2H44MdFGmne869OXwAw8R5IED61chsRAX43WbdcPnfzG5Bmc9tA4HEsy57_jWw6Kqr2g0lVOxY9dPc_BVj_bDSk Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:52:32.760563 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/50103cb27ce1440b807401655a4c0820"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_50103cb27ce1440b807401655a4c0820", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/50103cb27ce1440b807401655a4c0820"}]}] Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 50103cb27ce1440b807401655a4c0820 Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-14118532 Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1481c34ced9b4af4a9f149215f35e8c4 Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HostsAdminNegativeTestJSON-14118532-project-admin Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: {"status": "enable", "maintenance_mode": "enable"} Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:32.762107 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 28 09:52:32.763041 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:32.764091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:52:32.765355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9b44ea9-f229-4dd0-a436-0023faac8270 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:32.768220 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9b44ea9-f229-4dd0-a436-0023faac8270 tempest-HostsAdminNegativeTestJSON-14118532 tempest-HostsAdminNegativeTestJSON-14118532-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.059929 Oct 28 09:52:32.768220 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 257/514] 10.222.0.16 () {60 vars in 1211 bytes} [Fri Oct 28 09:52:32 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:52:32.781433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:32.786224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:32.791648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:32.792248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:32.792788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:32.794477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:32.795053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:32.795579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:33.019643 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6185ff53-4434-4d65-ad18-fb0371e67ad2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.105672 Oct 28 09:52:33.021332 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 258/515] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:52:31 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:33.028668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2120535519", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:33.042203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:33.130968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:33.199868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:33.223763 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22b1cdae-f265-428e-bcec-dd2755d886f2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.454070 Oct 28 09:52:33.227143 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 258/516] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:32 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:33.234111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:33.235067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:33.242383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:33.256061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:33.261493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:33.265514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:33.282229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:33.288516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:33.604517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:33.605282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:33.605806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:33.606373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:33.606958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:33.624305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:33.624715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:33.625192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:33.625943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:33.626402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:33.633170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:33.637750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:33.652339 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8de05687-5483-41f2-b912-9b7451088c65 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.422906 Oct 28 09:52:33.655287 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 259/517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:33 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:33.664326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a687a8b-7101-4786-9620-8fd1236a0537 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33be1ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:33.704828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Getting quotas for project 9db49c69ff8648759c5d61d8b149dedd. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:33.730070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Getting quotas for user b31f31eb0a7b4c14be4317c2baa47182 and project 9db49c69ff8648759c5d61d8b149dedd. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:33.760245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.utils [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] instances quota exceeded for 9db49c69ff8648759c5d61d8b149dedd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128747) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 09:52:33.763143 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Request method failure captured: Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 145 Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZZ60Rqp-3jEpVOPBQ1cKP-wEQJk4ESTaXNLawKhkqPrfpWlTe74Q5WQWno8Z34lgRdMPpcsRuY5Ecd2V9N9uHwasL1sfsBmVmMXwJioNqQxf-HB6PE0ly6VAa6fJRakNEgbulMPYc6KwGd0V59R0mpdRjjVJELSxQOQJhYJyHlZRY Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:33.768239 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9db49c69ff8648759c5d61d8b149dedd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9db49c69ff8648759c5d61d8b149dedd"}]}] Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b31f31eb0a7b4c14be4317c2baa47182 Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2120535519", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} Oct 28 09:52:33.771164 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2120535519', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452'}}} Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 09:52:33.773226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:33.777346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:33.780327 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-545c68bf-901f-4ce7-a309-3ae9a28bf37d tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.749675 Oct 28 09:52:33.783240 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 259/518] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:33 2022] POST /compute/v2.1/servers => generated 119 bytes in 756 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:33.796057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:33.796998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:33.837371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:33.837906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:33.838554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:33.839339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:33.839815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:33.843763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:33.888362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:33.991928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:34.014064 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bdd1e13c-c9c1-47cd-9d2a-a3a3d560d250 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1215 microversion: 2.1 time: 0.227530 Oct 28 09:52:34.016023 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 260/519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:33 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:34.023223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Action: 'update', calling method: .version_select at 0x7fca33ad8940>, body: {"quota_set": {"instances": 10}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:34.488192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:34.488943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:34.489514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:34.490508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:34.491492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:34.492345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:34.585628 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-deb041be-7a72-47d6-a30f-70ac7b9e98f6 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 329 microversion: 2.1 time: 0.565424 Oct 28 09:52:34.585628 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 261/520] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:34 2022] PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 329 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:34.590886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:34.592864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:34.594890 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1a687a8b-7101-4786-9620-8fd1236a0537 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1834 microversion: 2.1 time: 0.937621 Oct 28 09:52:34.596262 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 260/521] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:52:33 2022] GET /compute/v2.1/os-security-groups => generated 1834 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:34.612753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:34.613722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:34.614466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:34.615477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:34.616313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:34.616986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:34.726041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-334811429", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "22fc5637-6732-4716-999d-9f8191adb350"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:34.760599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:34.831084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] validate_networks() for [('22fc5637-6732-4716-999d-9f8191adb350', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:34.967169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:34.976186 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-833c3e17-4ab3-4a82-ba23-3795192cee0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.390378 Oct 28 09:52:34.985823 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 262/522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:34 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:35.008869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4a19a858-361b-4ce5-81f7-9178de7c22a4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Calling method '.version_select at 0x7fca33ab1e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:35.410929 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a19a858-361b-4ce5-81f7-9178de7c22a4 tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 371 microversion: 2.1 time: 0.422769 Oct 28 09:52:35.415195 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 263/523] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 09:52:34 2022] GET /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 371 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:35.427170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6471eed-96c7-4bb7-953d-e05020b5a146 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33ad81f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:36.109377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:36.111310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:36.113764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:36.114867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:36.117624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:36.147340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:36.147852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:36.148302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:36.149136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:36.149611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:36.150048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:36.194725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:36.205358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for user d76e0eb51a9b418bb28e81b5ac1520f9 and project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:36.211184 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6471eed-96c7-4bb7-953d-e05020b5a146 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51" status: 202 len: 0 microversion: 2.1 time: 0.793266 Oct 28 09:52:36.212235 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 264/524] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:52:35 2022] DELETE /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51 => generated 0 bytes in 796 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:36.222947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:52:36.226225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:36.229659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:36.232320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:36.277718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:36.280853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:36.284252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:36.289111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:36.291424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:36.293612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:36.341880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d49678aa-36ce-468e-a6e2-02b437f819f3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.744212 Oct 28 09:52:36.346046 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 261/525] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:52:36.361534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:36.365093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:36.374800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:36.375526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:36.376002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:36.378138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:36.378644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:36.379082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:36.662038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:36.678604 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6ac1e4fe-a4ea-4e74-ad07-8083a4d682ff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1277 microversion: 2.1 time: 0.330604 Oct 28 09:52:36.679428 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 262/526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:36 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1277 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:36.691425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Action: 'update', calling method: .version_select at 0x7fca33cf5670>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:37.040863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:37.054735 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-60742987-780c-4e38-8de2-e81a1433e9b5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.835066 Oct 28 09:52:37.056708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 265/527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:36 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:37.078543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:37.079838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:37.093614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:37.104702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:37.105448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:37.112050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:37.118107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:37.118956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:37.546102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:37.547431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:37.548200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:37.551231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:37.552007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:37.553332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:37.607199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:37.625888 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a92b3ced-14ca-4dce-b195-010836a08b02 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.564862 Oct 28 09:52:37.628882 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 266/528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:37 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:37.647007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81f449e2-b902-40ce-9347-fd794f95ccd6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33abb790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:37.706719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07d504e4-bf67-44d6-8b47-13167d5537ac tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 325 microversion: 2.1 time: 1.026024 Oct 28 09:52:37.728436 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 263/529] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:36 2022] PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 325 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:37.734866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50474e75-b94f-4ebb-ab10-b4ef65a965c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:37.735772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50474e75-b94f-4ebb-ab10-b4ef65a965c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:37.861212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-81f449e2-b902-40ce-9347-fd794f95ccd6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:52:37.862301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-81f449e2-b902-40ce-9347-fd794f95ccd6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:52:37.865207 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-81f449e2-b902-40ce-9347-fd794f95ccd6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:52:37.865207 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-4ca4ee7d-a2af-4b3c-81df-c06f6c5e76b5'] Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81f449e2-b902-40ce-9347-fd794f95ccd6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51 HTTP/1.1 Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:37.877219 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-4ca4ee7d-a2af-4b3c-81df-c06f6c5e76b5'] Oct 28 09:52:37.880300 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '34fb2a9a-28d4-4679-97a6-9b24ad01cb51'} Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:37.881819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ca4ee7d-a2af-4b3c-81df-c06f6c5e76b5'] Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:52:37.884553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ca4ee7d-a2af-4b3c-81df-c06f6c5e76b5'] Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ca4ee7d-a2af-4b3c-81df-c06f6c5e76b5'] Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:37.891300 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:37.897234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:37.897234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:37.897234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:37.897234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:37.897234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:52:37.897234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4ca4ee7d-a2af-4b3c-81df-c06f6c5e76b5'] Oct 28 09:52:37.897234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:37.911182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81f449e2-b902-40ce-9347-fd794f95ccd6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:52:37.911182 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-4ca4ee7d-a2af-4b3c-81df-c06f6c5e76b5'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:37.920413 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81f449e2-b902-40ce-9347-fd794f95ccd6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51" status: 404 len: 194 microversion: 2.1 time: 0.281868 Oct 28 09:52:37.925541 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 267/530] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:52:37 2022] GET /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51 => generated 194 bytes in 296 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:37.958210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:37.958915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:37.968115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:37.968624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:37.969192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:37.970102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:37.970467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:37.970902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:38.067978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50474e75-b94f-4ebb-ab10-b4ef65a965c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:38.081093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50474e75-b94f-4ebb-ab10-b4ef65a965c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1210 microversion: 2.1 time: 0.349609 Oct 28 09:52:38.092253 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 264/531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:37 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1210 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:38.116230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38700101-137a-4a85-8092-80dcf2d86043 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33bd6940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:38.420772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:38.437597 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b7e26e9-b593-43ec-9cf0-20494eb28288 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.504042 Oct 28 09:52:38.444056 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 268/532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:37 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:38.459747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1702496772", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:38.575320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:38.872059 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38700101-137a-4a85-8092-80dcf2d86043 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f" status: 202 len: 0 microversion: 2.1 time: 0.766519 Oct 28 09:52:38.874196 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 265/533] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:52:38 2022] DELETE /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:38.885623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:38.886579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:38.899742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:38.902637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:38.904581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:38.909455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:38.910185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:38.912313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.254982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:39.291495 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c8c783c-9988-4da7-a54f-5436f37df3d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.410417 Oct 28 09:52:39.294690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:39.295352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:39.296029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:39.296608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:39.297212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:39.306640 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 266/534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:38 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:39.319307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.320741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.321414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:39.321663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.322264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.323350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.324012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.324710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.343024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.344951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.346754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.349820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.351169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.352430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.372445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Getting quotas for project 9db49c69ff8648759c5d61d8b149dedd. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:39.384802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Getting quotas for user b31f31eb0a7b4c14be4317c2baa47182 and project 9db49c69ff8648759c5d61d8b149dedd. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:39.423902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.utils [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] ram quota exceeded for 9db49c69ff8648759c5d61d8b149dedd, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128747) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 28 09:52:39.424585 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Request method failure captured: Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 145 Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZZ60Rqp-3jEpVOPBQ1cKP-wEQJk4ESTaXNLawKhkqPrfpWlTe74Q5WQWno8Z34lgRdMPpcsRuY5Ecd2V9N9uHwasL1sfsBmVmMXwJioNqQxf-HB6PE0ly6VAa6fJRakNEgbulMPYc6KwGd0V59R0mpdRjjVJELSxQOQJhYJyHlZRY Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:39.426466 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9db49c69ff8648759c5d61d8b149dedd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9db49c69ff8648759c5d61d8b149dedd"}]}] Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b31f31eb0a7b4c14be4317c2baa47182 Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1702496772", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} Oct 28 09:52:39.427770 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1702496772', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452'}}} Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 09:52:39.428526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:39.429634 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.432323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-01350a78-75e1-45a8-9490-c22732796861 tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.982851 Oct 28 09:52:39.434986 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 269/535] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:38 2022] POST /compute/v2.1/servers => generated 110 bytes in 987 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:39.437499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1ab3fd0-fbcf-47cb-9803-33ef0b0b1288 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33ad8550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.566701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-d1ab3fd0-fbcf-47cb-9803-33ef0b0b1288 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:52:39.567316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-d1ab3fd0-fbcf-47cb-9803-33ef0b0b1288 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:52:39.567846 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d1ab3fd0-fbcf-47cb-9803-33ef0b0b1288 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:52:39.567846 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-1208126f-5d29-4ee0-958a-a6523cbec67d'] Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1ab3fd0-fbcf-47cb-9803-33ef0b0b1288 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f HTTP/1.1 Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:39.569762 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-1208126f-5d29-4ee0-958a-a6523cbec67d'] Oct 28 09:52:39.571100 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '992bfd71-6af6-4cb2-ac7c-b7df4e52830f'} Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:39.571879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1208126f-5d29-4ee0-958a-a6523cbec67d'] Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:52:39.573138 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1208126f-5d29-4ee0-958a-a6523cbec67d'] Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1208126f-5d29-4ee0-958a-a6523cbec67d'] Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.574196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:39.575450 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:39.575450 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:39.575450 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:39.575450 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:39.575450 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:52:39.575450 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1208126f-5d29-4ee0-958a-a6523cbec67d'] Oct 28 09:52:39.575450 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:39.578330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1ab3fd0-fbcf-47cb-9803-33ef0b0b1288 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:52:39.578330 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-1208126f-5d29-4ee0-958a-a6523cbec67d'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:39.579622 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d1ab3fd0-fbcf-47cb-9803-33ef0b0b1288 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f" status: 404 len: 194 microversion: 2.1 time: 0.146682 Oct 28 09:52:39.581279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 270/536] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:52:39 2022] GET /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:39.598415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-165b846b-014a-4811-bb9a-2e62039f36ac req-8ca442d9-2c41-41e0-81d8-35ab7dc1fcd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d797eca4-cd96-4170-8c7d-c0cb62f84495", "tag": "b13047c4-d5fd-42f3-91c6-1bc7f76b3f4b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:39.637532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-165b846b-014a-4811-bb9a-2e62039f36ac req-8ca442d9-2c41-41e0-81d8-35ab7dc1fcd6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.641942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-165b846b-014a-4811-bb9a-2e62039f36ac req-8ca442d9-2c41-41e0-81d8-35ab7dc1fcd6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.642686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-165b846b-014a-4811-bb9a-2e62039f36ac req-8ca442d9-2c41-41e0-81d8-35ab7dc1fcd6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.666189 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-165b846b-014a-4811-bb9a-2e62039f36ac req-8ca442d9-2c41-41e0-81d8-35ab7dc1fcd6 service nova] Creating event network-changed:b13047c4-d5fd-42f3-91c6-1bc7f76b3f4b for instance d797eca4-cd96-4170-8c7d-c0cb62f84495 on n-h1-zed-1 Oct 28 09:52:39.673264 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-165b846b-014a-4811-bb9a-2e62039f36ac req-8ca442d9-2c41-41e0-81d8-35ab7dc1fcd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090303 Oct 28 09:52:39.674731 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 271/537] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:39.692716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.697725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:39.711203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.712202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.712803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.713831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.718073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.721059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.876596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:39.908087 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-223252d3-2bc0-415d-9253-fbcb73954373 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1268 microversion: 2.1 time: 0.231003 Oct 28 09:52:39.910748 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 272/538] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:39 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1268 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:39.916200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Action: 'update', calling method: .version_select at 0x7fca33b76670>, body: {"quota_set": {"ram": 51200}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:39.923905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:39.943760 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a25688e-9799-4bbb-96b1-c49f96e686a6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.635803 Oct 28 09:52:39.949920 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 267/539] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:39 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:39.964551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:39.966320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:39.979523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.980027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.980507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:39.981311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:39.981778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:39.982213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.238144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.238652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.240382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.241338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.241890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.242337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.313355 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a42aebd9-32af-4f4a-855b-ddb882a2ecee tempest-QuotasAdminNegativeTest-2103020901 tempest-QuotasAdminNegativeTest-2103020901-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 200 len: 329 microversion: 2.1 time: 0.401139 Oct 28 09:52:40.313951 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 273/540] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:39 2022] PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 329 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:40.319065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d74fe41a-f309-420f-a54c-aaec75d595bd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33b76550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:40.631254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:40.645495 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74fcaf4e-8d6b-4e01-b030-0ec50679ccbc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.692048 Oct 28 09:52:40.667204 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 268/541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:39 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:40.686288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ea37f74e-39f1-41c6-80ed-35e1246d9f40 req-05dadd46-cd08-4c69-8d7c-c825b439c18a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c28120-7ffa-4702-bf23-8354ac0117bf", "name": "network-vif-plugged", "status": "completed", "tag": "230ba441-692a-4982-ac79-1154dd8d6c8c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:40.697863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ea37f74e-39f1-41c6-80ed-35e1246d9f40 req-05dadd46-cd08-4c69-8d7c-c825b439c18a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.698615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ea37f74e-39f1-41c6-80ed-35e1246d9f40 req-05dadd46-cd08-4c69-8d7c-c825b439c18a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.699061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ea37f74e-39f1-41c6-80ed-35e1246d9f40 req-05dadd46-cd08-4c69-8d7c-c825b439c18a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.712743 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ea37f74e-39f1-41c6-80ed-35e1246d9f40 req-05dadd46-cd08-4c69-8d7c-c825b439c18a service nova] Creating event network-vif-plugged:230ba441-692a-4982-ac79-1154dd8d6c8c for instance 34c28120-7ffa-4702-bf23-8354ac0117bf on n-h2-zed-1 Oct 28 09:52:40.718408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ea37f74e-39f1-41c6-80ed-35e1246d9f40 req-05dadd46-cd08-4c69-8d7c-c825b439c18a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039300 Oct 28 09:52:40.719766 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 269/542] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:40.815258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Calling method '.version_select at 0x7fca33be10d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:40.817335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.821952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.822491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.840692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.841341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.841850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.854436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.855034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.856071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.863204 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f02739ae-3220-4235-bb2d-ec57beb8380f tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.142022 Oct 28 09:52:40.863936 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 270/543] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:52:40 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:40.869413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0ec77611-2cbd-4776-9343-233818f01c5a req-d9d9a803-3b23-4b05-b257-864493f33e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e3a96bd-336e-4033-b37e-ccaa89b078b1", "tag": "f5462778-8f5b-453c-9384-f7173f4d6944"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:40.881424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ec77611-2cbd-4776-9343-233818f01c5a req-d9d9a803-3b23-4b05-b257-864493f33e2b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.881702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ec77611-2cbd-4776-9343-233818f01c5a req-d9d9a803-3b23-4b05-b257-864493f33e2b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.882146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ec77611-2cbd-4776-9343-233818f01c5a req-d9d9a803-3b23-4b05-b257-864493f33e2b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.894984 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0ec77611-2cbd-4776-9343-233818f01c5a req-d9d9a803-3b23-4b05-b257-864493f33e2b service nova] Creating event network-changed:f5462778-8f5b-453c-9384-f7173f4d6944 for instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 on n-h1-zed-1 Oct 28 09:52:40.899878 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0ec77611-2cbd-4776-9343-233818f01c5a req-d9d9a803-3b23-4b05-b257-864493f33e2b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034499 Oct 28 09:52:40.900491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 271/544] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:40.905556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:40.906264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:40.912753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.913486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.913928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:40.914682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:40.915136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:40.915746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.062789 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d74fe41a-f309-420f-a54c-aaec75d595bd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710" status: 202 len: 0 microversion: 2.1 time: 0.747483 Oct 28 09:52:41.068501 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 274/545] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:52:40 2022] DELETE /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710 => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:52:41.074495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1342f37c-16ff-4696-8abf-cb89a3f8a16b tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Action: 'update', calling method: .version_select at 0x7fca33ab13a0>, body: {"quota_set": {"ram": 0}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:41.080321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1342f37c-16ff-4696-8abf-cb89a3f8a16b tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'b31f31eb0a7b4c14be4317c2baa47182', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db49c69ff8648759c5d61d8b149dedd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1342f37c-16ff-4696-8abf-cb89a3f8a16b tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Request method failure captured: Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: request: PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd HTTP/1.1 Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 25 Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZZ60Rqp-3jEpVOPBQ1cKP-wEQJk4ESTaXNLawKhkqPrfpWlTe74Q5WQWno8Z34lgRdMPpcsRuY5Ecd2V9N9uHwasL1sfsBmVmMXwJioNqQxf-HB6PE0ly6VAa6fJRakNEgbulMPYc6KwGd0V59R0mpdRjjVJELSxQOQJhYJyHlZRY Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:41.082736 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9db49c69ff8648759c5d61d8b149dedd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9db49c69ff8648759c5d61d8b149dedd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9db49c69ff8648759c5d61d8b149dedd"}]}] Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9db49c69ff8648759c5d61d8b149dedd Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-647553987 Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b31f31eb0a7b4c14be4317c2baa47182 Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-QuotasAdminNegativeTest-647553987-project Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: {"quota_set": {"ram": 0}} Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 09:52:41.084186 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '9db49c69ff8648759c5d61d8b149dedd', 'body': {'quota_set': {'ram': 0}}} Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:41.085053 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.086160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:41.087923 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:41.087923 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:41.087923 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:52:41.087923 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:52:41.087923 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 28 09:52:41.087923 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.090982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1342f37c-16ff-4696-8abf-cb89a3f8a16b tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:41.092060 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1342f37c-16ff-4696-8abf-cb89a3f8a16b tempest-QuotasAdminNegativeTest-647553987 tempest-QuotasAdminNegativeTest-647553987-project] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd" status: 403 len: 116 microversion: 2.1 time: 0.022034 Oct 28 09:52:41.093652 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 275/546] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 09:52:41 2022] PUT /compute/v2.1/os-quota-sets/9db49c69ff8648759c5d61d8b149dedd => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:41.112942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Calling method '.version_select at 0x7fca33ad8c10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.115846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.117080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.118436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.137796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.138488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.139010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.163470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.181933 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c892a174-1860-4570-a781-3ba10dfaccf1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.280166 Oct 28 09:52:41.183760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.184531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.185215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.194179 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f40fb3e-893e-460f-81f4-9e07daff3b36 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-zed-1/servers" status: 200 len: 509 microversion: 2.1 time: 0.098996 Oct 28 09:52:41.195024 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 276/547] 10.222.0.16 () {58 vars in 1203 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/os-hypervisors/n-h1-zed-1/servers => generated 509 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:41.199522 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 272/548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:40 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:41.205219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.205859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:41.206698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.207319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:41.213462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.214145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.214593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.215941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.216068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.216437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.218331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.218438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.218527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.218624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.218624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.219044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.411639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.421584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad695eb0-90f5-4ede-8446-5a149b48f6d0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.225154 Oct 28 09:52:41.421851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:41.422246 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 277/549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:41.427592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd63e121-368e-4bcb-b862-52176a09f016 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33ab1040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.431815 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eea0fac9-2a70-40ae-bf49-8ca4e697074f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.230678 Oct 28 09:52:41.432400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 273/550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:41.444236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Calling method '.version_select at 0x7fca33cf59d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.446782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.448089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.448562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.455525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-bd63e121-368e-4bcb-b862-52176a09f016 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:52:41.456416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-bd63e121-368e-4bcb-b862-52176a09f016 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 78e43231-d344-466a-b068-2a3ad7792710 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:52:41.456997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-bd63e121-368e-4bcb-b862-52176a09f016 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:52:41.456997 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-c10c4304-e1d4-47ee-bdf1-b5aff1c9867a'] Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd63e121-368e-4bcb-b862-52176a09f016 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710 HTTP/1.1 Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:52:41.458971 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-c10c4304-e1d4-47ee-bdf1-b5aff1c9867a'] Oct 28 09:52:41.460801 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '78e43231-d344-466a-b068-2a3ad7792710'} Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:41.462118 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10c4304-e1d4-47ee-bdf1-b5aff1c9867a'] Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:52:41.464042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10c4304-e1d4-47ee-bdf1-b5aff1c9867a'] Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10c4304-e1d4-47ee-bdf1-b5aff1c9867a'] Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.466526 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c10c4304-e1d4-47ee-bdf1-b5aff1c9867a'] Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd63e121-368e-4bcb-b862-52176a09f016 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-c10c4304-e1d4-47ee-bdf1-b5aff1c9867a'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd63e121-368e-4bcb-b862-52176a09f016 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710" status: 404 len: 194 microversion: 2.1 time: 0.037683 Oct 28 09:52:41.468418 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 278/551] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710 => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:52:41.471074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74e87715-b57c-4598-8887-0b1ff0f79a82 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33ad8b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.474305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.474942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.475459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.492649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.493430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.494035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.502572 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-51fb4622-98e0-49bc-8ad0-fa613a814f59 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.063928 Oct 28 09:52:41.503708 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 274/552] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:41.515167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Calling method '.version_select at 0x7fca33cf5a60>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.517067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.517557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.517998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.552406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.553735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.556278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.565441 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e53099d1-c305-48f7-921f-98853019b686 tempest-HypervisorAdminUnderV252Test-1707073295 tempest-HypervisorAdminUnderV252Test-1707073295-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-zed-1/search" status: 200 len: 101 microversion: 2.1 time: 0.054874 Oct 28 09:52:41.566798 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 275/553] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/os-hypervisors/n-h1-zed-1/search => generated 101 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:41.691419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:41.692045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:41.698595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.699050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.701790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.702737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:41.703369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:41.703962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:41.877215 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74e87715-b57c-4598-8887-0b1ff0f79a82 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 1156 microversion: 2.1 time: 0.409705 Oct 28 09:52:41.879366 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 279/554] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/os-security-groups => generated 1156 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:41.912714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-652d1e23-24ae-453d-b757-a24ef1d152c2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33ad8670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1729126286", "description": "tempest-description-497631355"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:42.117222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.151043 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e2a6851-f9ae-495b-a808-af0ed93b5594 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.463095 Oct 28 09:52:42.161577 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 276/555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:41 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:42.205734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:42.206393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:42.214594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.215164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.215609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.216735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.217379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.218191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.243860 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-652d1e23-24ae-453d-b757-a24ef1d152c2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.351541 Oct 28 09:52:42.247585 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 280/556] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:52:41 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:42.264280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad13e29a-8762-40bc-ac33-2cb969ab0b64 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33ad83a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1012353304", "description": "tempest-description-927949292"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:42.556342 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad13e29a-8762-40bc-ac33-2cb969ab0b64 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.299415 Oct 28 09:52:42.557813 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 281/557] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:52:42 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:42.562287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.572415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:42.575739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:42.605355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.606776 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9930074-2335-449f-a208-ec3d5a6ca043 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1319 microversion: 2.1 time: 0.404940 Oct 28 09:52:42.607725 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 277/558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:42 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1319 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:42.612541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:42.612802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.613203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:42.613843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.614675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.616765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.617293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.625516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.634130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.635082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.640263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:42.642133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:42.644203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:42.985409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:42.993596 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80a5884e-f5fd-464d-a0bd-946ca8eb6bfc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.434182 Oct 28 09:52:42.997308 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 282/559] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:42 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:43.013098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-168888569", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b6147248-3c85-49a3-b087-eb8439f76f93"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:43.119289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] validate_networks() for [('b6147248-3c85-49a3-b087-eb8439f76f93', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:43.274042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:43.290939 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bc07f5f5-b54b-4f74-98e3-94a8e2bdbc02 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.681722 Oct 28 09:52:43.291903 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 278/560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:42 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:43.335688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-64544b13-da70-43e1-b951-9d9efc2b789f req-d98c7038-218d-42d3-a57d-b0ea34395095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b982ea-8435-4b99-ac22-6dfe4fdb0f31", "tag": "bd7a6588-4a23-403b-8d3d-0767543db082"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:43.373378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-64544b13-da70-43e1-b951-9d9efc2b789f req-d98c7038-218d-42d3-a57d-b0ea34395095 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.373928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-64544b13-da70-43e1-b951-9d9efc2b789f req-d98c7038-218d-42d3-a57d-b0ea34395095 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.374552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-64544b13-da70-43e1-b951-9d9efc2b789f req-d98c7038-218d-42d3-a57d-b0ea34395095 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.394870 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-64544b13-da70-43e1-b951-9d9efc2b789f req-d98c7038-218d-42d3-a57d-b0ea34395095 service nova] Creating event network-changed:bd7a6588-4a23-403b-8d3d-0767543db082 for instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 on n-h2-zed-1 Oct 28 09:52:43.405313 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-64544b13-da70-43e1-b951-9d9efc2b789f req-d98c7038-218d-42d3-a57d-b0ea34395095 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108733 Oct 28 09:52:43.406875 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 279/561] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:43.415164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:43.416229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:43.425223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.430088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.430759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.431764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.432242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.432677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.797231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:43.803996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:43.817939 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ba39f0d-6bb7-4019-9f07-90d83c359e51 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.409151 Oct 28 09:52:43.837780 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 280/562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:43 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:43.853823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:43.854521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:43.872770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:43.875578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:43.878583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:43.879645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:43.882686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:43.887875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.889500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.891234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.895224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.898269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.899484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.923563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.926066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.932811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.932811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:43.932811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:43.942712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:43.991779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Getting quotas for project 28e5a1214de9496d87b690d38ba80ea4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:43.999462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Getting quotas for user a7e06c8681bd48ce9422147f306cd27c and project 28e5a1214de9496d87b690d38ba80ea4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:44.027973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:52:44.034463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:44.121435 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c1daf8e-fc59-4b01-95a3-1dc4a9c651a3 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.122833 Oct 28 09:52:44.122287 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 283/563] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:52:44.146572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:44.147212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:44.160194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:44.161895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:44.162860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:44.164182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:44.164980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:44.165748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:44.349202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.366018 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34078c6f-8af5-4aac-8f7b-739167c2e0b1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1469 microversion: 2.1 time: 0.527014 Oct 28 09:52:44.375199 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 281/564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:43 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1469 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:44.380291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-91d998e8-4461-47e7-aeb5-b96f5bd68244 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:44.380949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-91d998e8-4461-47e7-aeb5-b96f5bd68244 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:44.528665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-91d998e8-4461-47e7-aeb5-b96f5bd68244 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.536090 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-91d998e8-4461-47e7-aeb5-b96f5bd68244 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1215 microversion: 2.1 time: 0.159550 Oct 28 09:52:44.539302 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 282/565] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:44 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:44.553122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:44.554173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:44.567116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:44.568161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:44.568847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:44.569744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:44.570286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:44.570725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:44.572825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:44.617069 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ec23a6a-0fa8-4227-93a0-dc80bf5f60e2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1477 microversion: 2.1 time: 0.470415 Oct 28 09:52:44.621948 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 284/566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:44 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1477 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:45.109327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1179851845", "block_migration": true, "disk_over_commit": false}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:45.115883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:45.132408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:45.137386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:45.146107 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-faf5ff03-fe1a-400a-8c23-c1a73597be32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.604982 Oct 28 09:52:45.146696 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 283/567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:44 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:45.161264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.161264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.163312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.169210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:45.170531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:45.172626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.175839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.176660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.177599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.178298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.178896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.179776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.180392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.181003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.292762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lazy-loading 'flavor' on Instance uuid 34c28120-7ffa-4702-bf23-8354ac0117bf {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:52:45.362126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Going to try to live migrate instance to tempest-host-1179851845 {{(pid=128747) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:52:45.370687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] HTTP exception thrown: Compute host tempest-host-1179851845 could not be found. Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Request method failure captured: Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf/action HTTP/1.1 Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 107 Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZOPNMZRXJ8xj7K_gCfMHdTQ9wj7JRUNim2R-y4jqsm5tlXyZySo0CD29tkj03rEo_Uchpq27HEcxmCG_Gy64Wtp5saEBSmAkONPZHrRBHxwm3U8lecyeYwBSPrU6tlfW_i842zMWmNh9Z1NZCqlbOFy7zHSPHfKbBtPGKSeAMkdc0 Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 5531e84096ee46eabd5df958c2eeba45 Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveMigrationNegativeTest-1124265264 Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:52:45.376608 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5531e84096ee46eabd5df958c2eeba45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5531e84096ee46eabd5df958c2eeba45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5531e84096ee46eabd5df958c2eeba45", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5531e84096ee46eabd5df958c2eeba45"}]}] Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveMigrationNegativeTest-1124265264 Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 5531e84096ee46eabd5df958c2eeba45 Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1124265264 Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveMigrationNegativeTest-1124265264-project-admin Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2ac52977718e4fadbac8a3a1e410a1ba Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveMigrationNegativeTest-1124265264-project-admin Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: {"os-migrateLive": {"host": "tempest-host-1179851845", "block_migration": true, "disk_over_commit": false}} Oct 28 09:52:45.378213 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: exception: Compute host tempest-host-1179851845 could not be found. Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '34c28120-7ffa-4702-bf23-8354ac0117bf', 'body': {'os-migrateLive': {'host': 'tempest-host-1179851845', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:52:45.379073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1179851845 could not be found. Oct 28 09:52:45.380214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1179851845 could not be found. Oct 28 09:52:45.381368 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1179851845 could not be found. Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Returning 400 to user: Compute host tempest-host-1179851845 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5130022f-14ea-4ca7-9750-2efa074d4b2f tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf/action" status: 400 len: 100 microversion: 2.1 time: 0.754848 Oct 28 09:52:45.382545 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 285/568] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 09:52:44 2022] POST /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf/action => generated 100 bytes in 756 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:52:45.389664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:45.390428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:45.406838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.407619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.408246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.409181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.409820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.410648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.685621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:45.727453 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b9d3a3b-7045-4090-8e35-ac8994d6ba30 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.563205 Oct 28 09:52:45.741803 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 284/569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:45 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:45.758988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-79b41bce-2224-4930-a4b6-2c6f2eb2cd37 req-4e90d0c4-a0dd-468a-a1e9-90cf439f6f88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d797eca4-cd96-4170-8c7d-c0cb62f84495", "name": "network-vif-plugged", "status": "completed", "tag": "b13047c4-d5fd-42f3-91c6-1bc7f76b3f4b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:45.776508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79b41bce-2224-4930-a4b6-2c6f2eb2cd37 req-4e90d0c4-a0dd-468a-a1e9-90cf439f6f88 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.777191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79b41bce-2224-4930-a4b6-2c6f2eb2cd37 req-4e90d0c4-a0dd-468a-a1e9-90cf439f6f88 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.778156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79b41bce-2224-4930-a4b6-2c6f2eb2cd37 req-4e90d0c4-a0dd-468a-a1e9-90cf439f6f88 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.806872 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-79b41bce-2224-4930-a4b6-2c6f2eb2cd37 req-4e90d0c4-a0dd-468a-a1e9-90cf439f6f88 service nova] Creating event network-vif-plugged:b13047c4-d5fd-42f3-91c6-1bc7f76b3f4b for instance d797eca4-cd96-4170-8c7d-c0cb62f84495 on n-h1-zed-1 Oct 28 09:52:45.812320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-79b41bce-2224-4930-a4b6-2c6f2eb2cd37 req-4e90d0c4-a0dd-468a-a1e9-90cf439f6f88 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063500 Oct 28 09:52:45.813559 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 285/570] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:45.819167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:45.820360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:45.828557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.829503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.830153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.831061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:45.831696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:45.832313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:45.939305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:45.951794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8178dbd-7418-480a-b61d-9069095a580c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1219 microversion: 2.1 time: 0.136013 Oct 28 09:52:45.953145 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 286/571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:45 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1219 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:45.968518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:45.975558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:45.977736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:45.977905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-272fe6d0-86b7-4f8c-9cb8-0ee13b1d10b4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1469 microversion: 2.1 time: 0.594427 Oct 28 09:52:45.979829 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 286/572] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:45 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1469 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:46.001862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.002707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.003817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.004781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.005280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.008869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.174186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:46.174807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:46.182764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.186207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.189563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.190554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.191197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.192346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.326037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:46.335794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d5779c27-3a1f-4c52-99c5-e15b3176d19e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1476 microversion: 2.1 time: 0.381217 Oct 28 09:52:46.337205 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 287/573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:45 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1476 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:46.361060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-938421239", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:46.428246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:46.515456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:46.524956 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aee417cf-5837-4094-b636-81a705cc0019 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.354539 Oct 28 09:52:46.525814 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 287/574] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:46 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:46.721164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:46.722343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:46.722992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:46.723574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:46.724300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:46.737430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.738236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.745843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.745843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.745843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.745843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.756167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=17 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:46.758224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:46.758993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:46.769252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.770829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.771283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.772023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:46.772486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:46.772950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:46.778570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Getting quotas for project cdc8b6c3e715487293067ca378466ca4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:46.785657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Getting quotas for user 66a05c50f8b744f0b5c22c7a33e88530 and project cdc8b6c3e715487293067ca378466ca4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:46.804309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:52:46.807348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:46.849628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:46.877703 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5cab2332-6497-4de9-95ca-113e6b2f2634 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.526016 Oct 28 09:52:46.878917 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 288/575] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:52:46.891234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe4c1759-aa09-4995-9af6-ab01883b4655 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:46.891966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe4c1759-aa09-4995-9af6-ab01883b4655 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:47.000543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fe4c1759-aa09-4995-9af6-ab01883b4655 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.017686 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe4c1759-aa09-4995-9af6-ab01883b4655 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1218 microversion: 2.1 time: 0.130983 Oct 28 09:52:47.019115 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 289/576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:46 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1218 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:47.048442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:47.070525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.078341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:47.131286 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4159b3de-907a-44bb-ae0d-f21b14fbc801 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.371245 Oct 28 09:52:47.132062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.135854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.138423 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 288/577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:46 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:47.140975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.145229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.150643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.155342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.368943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:47.370201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:47.380713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.381474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.383076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.384681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.385372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.385988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.664163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.666850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:47.677748 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1105f422-b495-49e2-9bc2-665800f8f1ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1476 microversion: 2.1 time: 0.313966 Oct 28 09:52:47.679435 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 289/578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:47 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1476 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:47.686555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:47.687664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:47.687964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:47.696852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.697686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.700528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.701582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:47.702259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:47.703031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:47.735333 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3880b5c1-b072-454d-bbed-3c2a0cd4dd5e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1219 microversion: 2.1 time: 0.711298 Oct 28 09:52:47.740701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 290/579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:47 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1219 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:48.055582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.088734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a34622b-bff8-4fab-a5a2-45f4e665d3e0 tempest-InstanceUsageAuditLogTestJSON-1975108184 tempest-InstanceUsageAuditLogTestJSON-1975108184-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.093516 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6483be7-631a-4454-a88c-e932200526af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.412210 Oct 28 09:52:48.094598 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 290/580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:47 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:48.113594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3a96bd-336e-4033-b37e-ccaa89b078b1", "name": "network-vif-plugged", "status": "completed", "tag": "f5462778-8f5b-453c-9384-f7173f4d6944"}, {"server_uuid": "b43bf398-e1f4-4d70-a0f3-95206e038e24", "name": "network-vif-unplugged", "status": "completed", "tag": "83e59ddf-79e4-4360-a974-08584405f59f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:48.116759 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a34622b-bff8-4fab-a5a2-45f4e665d3e0 tempest-InstanceUsageAuditLogTestJSON-1975108184 tempest-InstanceUsageAuditLogTestJSON-1975108184-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28 09:52:47" status: 200 len: 318 microversion: 2.1 time: 0.277857 Oct 28 09:52:48.127425 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 291/581] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 09:52:47 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-28%2009%3A52%3A47 => generated 318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:48.133905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.134710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:48.136589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.137763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.138392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.142701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.143457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.144302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.145558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.147840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.148522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.173626 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] Creating event network-vif-plugged:f5462778-8f5b-453c-9384-f7173f4d6944 for instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 on n-h1-zed-1 Oct 28 09:52:48.174544 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] Creating event network-vif-unplugged:83e59ddf-79e4-4360-a974-08584405f59f for instance b43bf398-e1f4-4d70-a0f3-95206e038e24 on n-h1-zed-1 Oct 28 09:52:48.189783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] Instance b43bf398-e1f4-4d70-a0f3-95206e038e24 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:52:48.202877 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1d3d3b9f-2eb1-4ddf-9c0c-32f787c756cd req-16d3c8b3-decc-43a1-8b15-ef2ce75bef51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.102827 Oct 28 09:52:48.203940 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 291/582] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:48.212200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22771af4-bd07-48bc-9d90-6a392e5f30b5 tempest-InstanceUsageAuditLogTestJSON-1975108184 tempest-InstanceUsageAuditLogTestJSON-1975108184-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.240571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22771af4-bd07-48bc-9d90-6a392e5f30b5 tempest-InstanceUsageAuditLogTestJSON-1975108184 tempest-InstanceUsageAuditLogTestJSON-1975108184-project-admin] 10.222.0.16 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.034643 Oct 28 09:52:48.241353 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 292/583] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 09:52:48 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:48.246901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.247649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:48.254506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.255251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.256265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.257209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.257699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.258128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.296253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.307370 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d89ab1ab-f4cd-4672-9df3-6f2387e04151 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1222 microversion: 2.1 time: 0.177676 Oct 28 09:52:48.309274 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 292/584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:48 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1222 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:48.464457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.497274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec345530-78ea-4b9e-a8cd-882c7739fbab tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.253700 Oct 28 09:52:48.499541 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 293/585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:48 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:48.743981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.745544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:48.759074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.760225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.761353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.763220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.764307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.765102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.769048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:48.769859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:48.792527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.793802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.804717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.813777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:48.814314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:48.828471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:48.969744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:48.980034 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4f6c77ec-714e-4a99-8750-5f164cb38513 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1474 microversion: 2.1 time: 0.261692 Oct 28 09:52:48.998104 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 293/586] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:48 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1474 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:49.127065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:49.129305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:49.144172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.145085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.145999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.148142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.149097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.149680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.192486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.218381 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-125ba319-cfc6-4471-a62d-32c05eed5e9c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1273 microversion: 2.1 time: 0.454118 Oct 28 09:52:49.250108 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 294/587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:48 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1273 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:49.331612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:49.332241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:49.338906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.339642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.340618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.341646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.342123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.342556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.430815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.442667 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-936f1f63-4bf9-4ff5-8d72-4bb644cf7f40 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.325377 Oct 28 09:52:49.443602 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 294/588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:49 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:49.470105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.484021 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a72b3510-c84b-4ccf-a285-6cd9f8ede25f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1270 microversion: 2.1 time: 0.156206 Oct 28 09:52:49.497511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 295/589] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:49 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1270 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:49.546012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:49.547448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:49.563661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.565216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.567661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.568792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:49.571055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:49.571816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:49.853963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:49.869673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c6e47e93-38fd-4164-a98b-7021b3a6fc61 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1319 microversion: 2.1 time: 0.331370 Oct 28 09:52:49.870270 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 295/590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:49 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:50.004370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:50.004998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:50.017500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.018059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.018509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.019272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.019801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.020173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.265207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:50.266141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:50.282016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.284660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.285549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.286495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.289582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.290255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.609308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.654767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-364aa6d5-4d0f-4c1b-b59b-5431905064b5 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1273 microversion: 2.1 time: 0.392555 Oct 28 09:52:50.658022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 296/591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:50 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1273 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:50.672076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:50.673711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:50.687545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.688756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.689477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.690542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.691594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.692277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.752191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.761731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-afda2dac-1a67-44b4-a48f-bf844df71c81 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1471 microversion: 2.1 time: 0.761121 Oct 28 09:52:50.777054 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 296/592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:49 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1471 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:50.782510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:50.783319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:50.789883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.790391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.790834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.791560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.792017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.792447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:50.949265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.958622 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-77fe5e82-e15f-4caa-b264-53e492e51f16 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1276 microversion: 2.1 time: 0.179915 Oct 28 09:52:50.969472 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 297/593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:50 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1276 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:50.981727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:50.985629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:50.990819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:50.997081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-03b7a75d-39e0-467f-99e1-8a4c76a4671b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.336188 Oct 28 09:52:50.997750 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 297/594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:50 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:50.998526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:50.999202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:50.999980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.001486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.002161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.002756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.025609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.027577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:51.055229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.060050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.063510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.067661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.069573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.076356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.096758 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a37b11b6-2e7d-4139-9f87-e3b4094c46ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24/action" status: 204 len: 0 microversion: 2.1 time: 0.125381 Oct 28 09:52:51.097992 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 298/595] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:52:50 2022] POST /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24/action => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:52:51.115388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.123224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:51.151435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.152478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.153236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.154472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.155127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.155769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.471219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:51.483409 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9034a2c7-1708-4cce-a522-a63f0dd1fd04 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1468 microversion: 2.1 time: 0.478888 Oct 28 09:52:51.487144 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 298/596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:51 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1468 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:51.510798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.511408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:51.519390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.520149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.520774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.521711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.522358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.522823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.898440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:51.912337 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a925db1e-324d-4e86-b44f-3b244ed2911d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1471 microversion: 2.1 time: 0.807528 Oct 28 09:52:51.920209 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 299/597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:51 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1471 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:51.922011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:51.936636 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b438756-35a1-47f4-bc08-8c6686b51cfb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1469 microversion: 2.1 time: 0.429731 Oct 28 09:52:51.937667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.938456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 299/598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:51 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:51.942275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:51.957376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.962306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.963446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:51.965784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:51.981286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:51.982593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Searching by: {'reservation_id': 'r-4het1l6e', 'deleted': False, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:52:51.984959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:51.985470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:51.985919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:52.004612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:52.005816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:52.006596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:52.009514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:52.011236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:52.012555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:52.349764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:52:52.625393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:52.642715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:52.645397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:52.657191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:52.818916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:52.844155 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3b114ef-f63b-4b92-adb0-11173646ba8a tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.909812 Oct 28 09:52:52.845420 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 300/599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:51 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:52.851003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:52.856755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:52.879672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:52.880343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:52.880938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:52.881900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:52.882577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:52.883212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.033775 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1239cdb9-8b51-45df-9664-8faf3bb20e6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-4het1l6e" status: 200 len: 2930 microversion: 2.1 time: 1.073480 Oct 28 09:52:53.041989 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 300/600] 10.222.0.16 () {58 vars in 1197 bytes} [Fri Oct 28 09:52:51 2022] GET /compute/v2.1/servers/detail?reservation_id=r-4het1l6e => generated 2930 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:53.049939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:53.052140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:53.064132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.065309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.066006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.067717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.068730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.069223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.128873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:53.350781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:53.363375 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ef3d45a-8227-4f09-a077-96fd6a1c1a9b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 0.516521 Oct 28 09:52:53.366679 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 301/601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:52 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:53.372804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4418f7bd-1906-426c-9e3b-d8de9c8e7268 req-b3ee85c3-dbdb-4ebd-a277-f01a8ec7a2ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b982ea-8435-4b99-ac22-6dfe4fdb0f31", "name": "network-vif-plugged", "status": "completed", "tag": "bd7a6588-4a23-403b-8d3d-0767543db082"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:53.384047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4418f7bd-1906-426c-9e3b-d8de9c8e7268 req-b3ee85c3-dbdb-4ebd-a277-f01a8ec7a2ab service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.384944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4418f7bd-1906-426c-9e3b-d8de9c8e7268 req-b3ee85c3-dbdb-4ebd-a277-f01a8ec7a2ab service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.385616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4418f7bd-1906-426c-9e3b-d8de9c8e7268 req-b3ee85c3-dbdb-4ebd-a277-f01a8ec7a2ab service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.399127 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4418f7bd-1906-426c-9e3b-d8de9c8e7268 req-b3ee85c3-dbdb-4ebd-a277-f01a8ec7a2ab service nova] Creating event network-vif-plugged:bd7a6588-4a23-403b-8d3d-0767543db082 for instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 on n-h2-zed-1 Oct 28 09:52:53.405725 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4418f7bd-1906-426c-9e3b-d8de9c8e7268 req-b3ee85c3-dbdb-4ebd-a277-f01a8ec7a2ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037462 Oct 28 09:52:53.407036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 302/602] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:53.412530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:53.414249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:53.423697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.424755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.425593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.426558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.427237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.428063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.491232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:53.526402 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-80bae2a9-f30a-4e00-a887-76ce116d22c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.482882 Oct 28 09:52:53.530936 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 301/603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:53 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:53.556946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a34dc107-5921-4582-abfd-6e0e630b4f3c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:53.671366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.server_groups [None req-a34dc107-5921-4582-abfd-6e0e630b4f3c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Querying cell 308273ef-dc1c-40ee-a51c-31916410c877(cell1) for 2 instances {{(pid=128748) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 09:52:53.672387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a34dc107-5921-4582-abfd-6e0e630b4f3c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.673762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a34dc107-5921-4582-abfd-6e0e630b4f3c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.674474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a34dc107-5921-4582-abfd-6e0e630b4f3c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.741337 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a34dc107-5921-4582-abfd-6e0e630b4f3c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/727288b3-d308-4dea-be42-b1e59c4250d1" status: 200 len: 266 microversion: 2.1 time: 0.208422 Oct 28 09:52:53.745214 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 302/604] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:52:53 2022] GET /compute/v2.1/os-server-groups/727288b3-d308-4dea-be42-b1e59c4250d1 => generated 266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:53.751459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-483a4503-d285-4cbc-adc5-a483d0d84ec8 req-d6f76c39-057f-4262-b757-96b7d4c71459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e582ac2f-c01c-4fe6-8735-daf68aa50d30", "tag": "4a973efe-1839-49a3-86e3-b685f02a879e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:53.768631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-483a4503-d285-4cbc-adc5-a483d0d84ec8 req-d6f76c39-057f-4262-b757-96b7d4c71459 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.769531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-483a4503-d285-4cbc-adc5-a483d0d84ec8 req-d6f76c39-057f-4262-b757-96b7d4c71459 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.770196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-483a4503-d285-4cbc-adc5-a483d0d84ec8 req-d6f76c39-057f-4262-b757-96b7d4c71459 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.784793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-483a4503-d285-4cbc-adc5-a483d0d84ec8 req-d6f76c39-057f-4262-b757-96b7d4c71459 service nova] Creating event network-changed:4a973efe-1839-49a3-86e3-b685f02a879e for instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 on n-h2-zed-1 Oct 28 09:52:53.792307 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-483a4503-d285-4cbc-adc5-a483d0d84ec8 req-d6f76c39-057f-4262-b757-96b7d4c71459 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044687 Oct 28 09:52:53.794234 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 303/605] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:53.802150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:53.803191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:53.813859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.814780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.815465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.816445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:53.817477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:53.818579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:53.975150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=14 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:54.224828 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a762a936-8288-4e5a-b1d9-3399c346dcc4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1613 microversion: 2.1 time: 0.428199 Oct 28 09:52:54.247513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 304/606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:53 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1613 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:54.252461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:54.254228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:54.262291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.263267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.263697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.264731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.265322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.265836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.477349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.500218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.506015 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-044f5da6-43a9-45ec-bb5c-93ca1f6c5d58 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1471 microversion: 2.1 time: 1.097472 Oct 28 09:52:54.508800 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 303/607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:53 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1471 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:54.531721 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-581c6da5-19ff-4026-a586-3e50639b216b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.282903 Oct 28 09:52:54.532450 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 305/608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:54 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:54.534459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:54.540354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:54.544995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:54.549881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:54.553465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.555491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.555966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.556715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.557189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.557629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.565717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.566461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.567093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.567997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.568627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.569254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.878265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:54.887633 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01b203f9-57d2-4c0d-afe2-9e1590f1ded4 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 0.353597 Oct 28 09:52:54.888712 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 306/609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:54 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:54.904613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:54.905344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:54.913379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.914277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.914473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.915263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:54.915612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:54.916065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:54.929406 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bba4feea-8538-4654-94f5-85f894473a89 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1614 microversion: 2.1 time: 0.406971 Oct 28 09:52:54.929991 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 304/610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:54 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1614 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:54.960402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a8f3e3f-2f47-4de7-9b86-c98b4e4565e8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: .version_select at 0x7fca33929e50>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1376219959", "policies": ["anti-affinity"]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:54.979565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8a8f3e3f-2f47-4de7-9b86-c98b4e4565e8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:54.986322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8a8f3e3f-2f47-4de7-9b86-c98b4e4565e8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:55.094003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8a8f3e3f-2f47-4de7-9b86-c98b4e4565e8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:55.100544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8a8f3e3f-2f47-4de7-9b86-c98b4e4565e8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:55.130593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a8f3e3f-2f47-4de7-9b86-c98b4e4565e8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.173175 Oct 28 09:52:55.132584 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 305/611] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 09:52:54 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:52:55.345015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:55.354101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1845752383", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "23fbb2c7-2d21-406b-a5af-6d99cb136ba8"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:55.369048 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e3a68c2e-2953-4576-aea8-26667033b0d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1310 microversion: 2.1 time: 0.473852 Oct 28 09:52:55.369677 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 307/612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:54 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1310 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:55.391798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-731c1b81-a195-4330-8be7-19dd07ec7bdd req-59871f2c-7004-4eea-b96b-04b66bbcd6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e019b782-6ea3-43ca-ae24-885467cd2353", "tag": "0f46a022-e804-4156-8382-6c4d7322b410"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:55.404317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-731c1b81-a195-4330-8be7-19dd07ec7bdd req-59871f2c-7004-4eea-b96b-04b66bbcd6b8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.405372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-731c1b81-a195-4330-8be7-19dd07ec7bdd req-59871f2c-7004-4eea-b96b-04b66bbcd6b8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.406013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-731c1b81-a195-4330-8be7-19dd07ec7bdd req-59871f2c-7004-4eea-b96b-04b66bbcd6b8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.442610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-731c1b81-a195-4330-8be7-19dd07ec7bdd req-59871f2c-7004-4eea-b96b-04b66bbcd6b8 service nova] Creating event network-changed:0f46a022-e804-4156-8382-6c4d7322b410 for instance e019b782-6ea3-43ca-ae24-885467cd2353 on n-h2-zed-1 Oct 28 09:52:55.448016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-731c1b81-a195-4330-8be7-19dd07ec7bdd req-59871f2c-7004-4eea-b96b-04b66bbcd6b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061601 Oct 28 09:52:55.449443 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 308/613] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:55.454782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7c2ab190-5984-443e-97df-3cba4c8fc906 req-301eb496-2257-41da-a1b2-24b2b2157139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43bf398-e1f4-4d70-a0f3-95206e038e24", "name": "network-vif-plugged", "status": "completed", "tag": "83e59ddf-79e4-4360-a974-08584405f59f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:55.459476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:52:55.467424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c2ab190-5984-443e-97df-3cba4c8fc906 req-301eb496-2257-41da-a1b2-24b2b2157139 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.468188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c2ab190-5984-443e-97df-3cba4c8fc906 req-301eb496-2257-41da-a1b2-24b2b2157139 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.468893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c2ab190-5984-443e-97df-3cba4c8fc906 req-301eb496-2257-41da-a1b2-24b2b2157139 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.482362 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7c2ab190-5984-443e-97df-3cba4c8fc906 req-301eb496-2257-41da-a1b2-24b2b2157139 service nova] Creating event network-vif-plugged:83e59ddf-79e4-4360-a974-08584405f59f for instance b43bf398-e1f4-4d70-a0f3-95206e038e24 on n-h1-zed-1 Oct 28 09:52:55.488113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7c2ab190-5984-443e-97df-3cba4c8fc906 req-301eb496-2257-41da-a1b2-24b2b2157139 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037077 Oct 28 09:52:55.493342 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 309/614] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:55.539766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:55.540716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:55.555639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.559782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.562491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.563581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.564400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.566632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.927609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:52:55.929552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:52:55.930300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:52:55.930721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:52:55.931446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:52:55.953919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.954648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.955326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.956278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:55.956890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:55.957528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:55.983993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:55.988843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:56.003712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Going to run 2 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:52:56.006997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:56.034710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.047000 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-281deb3d-b1a0-42ef-bccb-4b253f2fcc69 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1463 microversion: 2.1 time: 0.510667 Oct 28 09:52:56.047635 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 310/615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:55 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1463 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:56.057545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.059243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:56.066673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.067932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.068374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.069161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.069831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.070435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.083563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:56.096289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:56.151296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:56.153770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:56.156146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:56.173169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=3d45eb16-2631-4068-bd85-d26fb3f25d98,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:52:56.250739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:56.256610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:56.331292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:56.337778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'server_group_members'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:56.357012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.367499 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99a2eee6-cd1a-491d-8d48-f8ec81a5f663 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.318781 Oct 28 09:52:56.371093 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 311/616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:56 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:56.389466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.390348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:56.390836 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95d9c1b7-fa1a-4734-9686-06bc461e8a9b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.040569 Oct 28 09:52:56.392751 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 306/617] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:52:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 28 09:52:56.396446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.397104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:56.405625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.409157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.409629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.409781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.410101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.410718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.410853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.411267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.411698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.412315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.412945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.414862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.755906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.762966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.763712 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c05fadab-cf7d-4ee2-9bb3-ff9cb43d52f6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1463 microversion: 2.1 time: 0.370876 Oct 28 09:52:56.767032 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 307/618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:56 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1463 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:56.773074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.775707 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e2f59a2-f140-4a88-a54a-eeeadb405f8e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 0.401708 Oct 28 09:52:56.778374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:56.778780 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 312/619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:56 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:56.779166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Searching by: {'deleted': False, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:52:56.787890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:56.792023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:56.805770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.806334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.806927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.807764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.808708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.810137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.810637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.810807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.812481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.813915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:56.814837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:56.815866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:56.880152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:52:56.917325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:56.947183 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0fdeebd-8641-4a4d-b82e-5b6041d2e940 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.179024 Oct 28 09:52:56.948853 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 308/620] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 09:52:56 2022] GET /compute/v2.1/servers => generated 1665 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:56.954125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6343c1aa-0e93-4f5c-86a0-4ace156ba54d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'create', calling method: .version_select at 0x7fca338e9ee0>, body: {"keypair": {"name": "tempest-keypair-1871682523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeerKsbQ8fbvKE9aPBVFCPWsMgEarzX2jS+T1AjDrtEZtxDeKspauYXf71FNjF6jwrRfmd2KS6V5z5xvTR6wj2/deo4m9cTm6sf2941TgAwsgxLGu1W3n/S0ygdp1E7uQ=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:56.976216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=93 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:52:56.986080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-6343c1aa-0e93-4f5c-86a0-4ace156ba54d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:52:56.997491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-6343c1aa-0e93-4f5c-86a0-4ace156ba54d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for user 9dc12014773b4f9fb34ff214c07d7f61 and project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:52:57.043918 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6343c1aa-0e93-4f5c-86a0-4ace156ba54d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.092839 Oct 28 09:52:57.045136 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 309/621] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 09:52:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:57.050387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d515ed6d-641b-43f5-a5d2-fbcfaa789128 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:57.051134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d515ed6d-641b-43f5-a5d2-fbcfaa789128 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:57.134815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d515ed6d-641b-43f5-a5d2-fbcfaa789128 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.136468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:57.148293 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c256e165-e0ea-40bc-a7c1-8196350f5a26 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1494 microversion: 2.1 time: 0.367969 Oct 28 09:52:57.157173 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d515ed6d-641b-43f5-a5d2-fbcfaa789128 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1219 microversion: 2.1 time: 0.101656 Oct 28 09:52:57.157310 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 313/622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:56 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1494 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:57.157405 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 310/623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:57 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:57.400434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:57.401433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:57.416806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:57.417722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:57.418453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:57.419593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:57.420601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:57.421419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:57.447382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:57.450644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:57.470072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:57.472023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:57.473796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:57.476426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:57.478131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:57.480032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.102798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:58.112937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-817807f6-7338-4606-8c84-a4783b06a870 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1639 microversion: 2.1 time: 0.944569 Oct 28 09:52:58.115338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf3321fc-c101-4890-83fa-4a78f4f13f10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.721046 Oct 28 09:52:58.124935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 311/624] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:57 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:52:58.132894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:58.132894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:58.137459 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 314/625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:57 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1639 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:58.146012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.150610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.151171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.151928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.152442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.152875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.153844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:58.154473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:58.172998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.173499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.173939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.174653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.175108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.175537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.915186 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39eb9e86-1454-4f5c-9f13-4982645bd172 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1639 microversion: 2.1 time: 0.776474 Oct 28 09:52:58.917549 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 315/626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:58 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1639 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:58.935472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:58.936351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:58.948336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.958747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.967690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:58.973545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:58.974439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:58.977854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.076244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:59.091460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-28f67ca0-23ce-46df-a1fa-511f92e1295b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 0.972815 Oct 28 09:52:59.107217 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 312/627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:58 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:59.112630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:59.122329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.130583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.131869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.133135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.133752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.134446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.175461 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-019306e6-6a9c-4532-b8b5-cb9319201b60 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 0.066311 Oct 28 09:52:59.182429 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 313/628] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 09:52:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:52:59.191188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:52:59.194298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:59.196288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:52:59.208799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.211090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.213272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.214204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.217378 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa2c425d-c850-4c67-afcb-50116fec5b3d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1271 microversion: 2.1 time: 0.296782 Oct 28 09:52:59.217855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.218282 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 316/629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:58 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1271 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:52:59.218822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.222813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-zed-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:52:59.225356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:52:59.240518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.241496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.242115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.242993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:52:59.246681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:52:59.247478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:52:59.462160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lazy-loading 'flavor' on Instance uuid d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:52:59.575843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Going to try to live migrate instance to n-h1-zed-1 {{(pid=128748) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:53:00.190546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.205981 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a234b986-2153-48eb-9b23-e204976d42ca tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 1.022124 Oct 28 09:53:00.207578 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 314/630] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:52:59 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:00.218960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:00.219583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:00.245479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:00.246319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:00.246954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:00.247869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:00.248502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:00.249130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:00.711194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.724012 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-291bcc04-6981-4840-a315-bc744376dbc5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 0.515134 Oct 28 09:53:00.733315 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 315/631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:00 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:00.742828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:00.747096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:00.757792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:00.758798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:00.759548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:00.760460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:00.761189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:00.762327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:00.857273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:00.873725 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46fa8103-b0ff-4581-a144-a2bfce558dda tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1277 microversion: 2.1 time: 0.138374 Oct 28 09:53:00.874878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 316/632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:00 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1277 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:01.233798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:01.235648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:01.257110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:01.257663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:01.258128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:01.265929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:01.267861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:01.270017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:01.690086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:01.701053 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0138d85f-40e9-48df-b34d-41f4949fab28 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.473773 Oct 28 09:53:01.717955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 317/633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:01 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:01.750187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:01.750983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:01.759163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:01.760874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:01.764529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:01.765524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:01.766133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:01.768505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:02.128880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:02.130868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:02.146250 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3eba0e2e-2bf1-427d-8574-c099c5d230ea tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 0.402030 Oct 28 09:53:02.156894 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 318/634] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:01 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:02.256615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-97384c02-32a9-47d1-bfdf-ceeb1b135ba3 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Action: 'create', calling method: .version_select at 0x7fca338e9af0>, body: {"pool": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:02.619911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=76 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:06.517706 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-02f9a532-01ec-49fb-bde9-1405de07fa18 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31/action" status: 202 len: 0 microversion: 2.1 time: 7.293334 Oct 28 09:53:06.523896 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 317/635] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:52:59 2022] POST /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31/action => generated 0 bytes in 7305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:06.540314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:06.545205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:06.559730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:06.560433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:06.561529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:06.566112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:06.566994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:06.567149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:06.646012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:07.142637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=5 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:07.298546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.322833 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d09cd33-b00d-4297-bd9a-b3c5f33167f5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1319 microversion: 2.1 time: 0.797607 Oct 28 09:53:07.325072 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 318/636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:06 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1319 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:07.356743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:07.358509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:07.385944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:07.387291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:07.390495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:07.397125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:07.398524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:07.399766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:07.908394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:07.921867 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49ce4ad5-10b6-4323-9d8e-9092d8cd5c10 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.592228 Oct 28 09:53:07.939573 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 319/637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:07 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:07.952840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9f3b40a-5a85-4b4c-b716-335f45782dad tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '.version_select at 0x7fca338e9dc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:07.960333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9f3b40a-5a85-4b4c-b716-335f45782dad tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:07.960831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9f3b40a-5a85-4b4c-b716-335f45782dad tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:07.961446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9f3b40a-5a85-4b4c-b716-335f45782dad tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:07.984742 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9f3b40a-5a85-4b4c-b716-335f45782dad tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1150 microversion: 2.1 time: 0.043721 Oct 28 09:53:08.005259 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 320/638] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:53:07 2022] GET /compute/v2.1/os-migrations => generated 1150 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:08.015015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.016170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:08.031526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.038420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.039532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.040600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.041227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.041955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.751560 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-97384c02-32a9-47d1-bfdf-ceeb1b135ba3 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.601623 Oct 28 09:53:08.761187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 319/639] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 09:53:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:08.766646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-80f5364f-7789-465b-a96f-e7c1f4a447dc req-262313d7-f7ad-40ab-a7de-7d583b1bb1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e618b41c-1036-4406-8bdd-152212526ef2", "tag": "422b35b6-0138-4c3e-82f4-6f0638f98c6e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:08.771168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:08.781848 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76f8b84d-44a9-4383-ae39-211bfd4a07f1 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 0.774894 Oct 28 09:53:08.782754 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 321/640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:08 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:08.787692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fb597b82-ecd9-4dcb-8f71-37741cf01f00 req-3cd0f618-e12f-4764-9238-3dd0845d5492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d45eb16-2631-4068-bd85-d26fb3f25d98", "tag": "87606c16-1569-4633-b64b-9a7a85b0c2d6"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:08.800534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fb597b82-ecd9-4dcb-8f71-37741cf01f00 req-3cd0f618-e12f-4764-9238-3dd0845d5492 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.801060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fb597b82-ecd9-4dcb-8f71-37741cf01f00 req-3cd0f618-e12f-4764-9238-3dd0845d5492 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.801709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fb597b82-ecd9-4dcb-8f71-37741cf01f00 req-3cd0f618-e12f-4764-9238-3dd0845d5492 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.806397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80f5364f-7789-465b-a96f-e7c1f4a447dc req-262313d7-f7ad-40ab-a7de-7d583b1bb1f3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.806900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80f5364f-7789-465b-a96f-e7c1f4a447dc req-262313d7-f7ad-40ab-a7de-7d583b1bb1f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.807337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80f5364f-7789-465b-a96f-e7c1f4a447dc req-262313d7-f7ad-40ab-a7de-7d583b1bb1f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.815166 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fb597b82-ecd9-4dcb-8f71-37741cf01f00 req-3cd0f618-e12f-4764-9238-3dd0845d5492 service nova] Creating event network-changed:87606c16-1569-4633-b64b-9a7a85b0c2d6 for instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 on n-h1-zed-1 Oct 28 09:53:08.822716 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fb597b82-ecd9-4dcb-8f71-37741cf01f00 req-3cd0f618-e12f-4764-9238-3dd0845d5492 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038094 Oct 28 09:53:08.823921 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 322/641] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:08.826886 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-80f5364f-7789-465b-a96f-e7c1f4a447dc req-262313d7-f7ad-40ab-a7de-7d583b1bb1f3 service nova] Creating event network-changed:422b35b6-0138-4c3e-82f4-6f0638f98c6e for instance e618b41c-1036-4406-8bdd-152212526ef2 on n-h2-zed-1 Oct 28 09:53:08.829645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.830355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:08.833429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-80f5364f-7789-465b-a96f-e7c1f4a447dc req-262313d7-f7ad-40ab-a7de-7d583b1bb1f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070623 Oct 28 09:53:08.834694 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 320/642] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:08.846882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.849396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.849940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.850708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.851309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.851816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.853713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-de7c6d79-e9e1-40a0-af16-09f29eb6d10b req-b2560b3b-d829-440d-ab4b-bdf619993001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e582ac2f-c01c-4fe6-8735-daf68aa50d30", "name": "network-vif-plugged", "status": "completed", "tag": "4a973efe-1839-49a3-86e3-b685f02a879e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:08.869227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de7c6d79-e9e1-40a0-af16-09f29eb6d10b req-b2560b3b-d829-440d-ab4b-bdf619993001 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.870012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de7c6d79-e9e1-40a0-af16-09f29eb6d10b req-b2560b3b-d829-440d-ab4b-bdf619993001 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.870628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de7c6d79-e9e1-40a0-af16-09f29eb6d10b req-b2560b3b-d829-440d-ab4b-bdf619993001 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.886161 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-de7c6d79-e9e1-40a0-af16-09f29eb6d10b req-b2560b3b-d829-440d-ab4b-bdf619993001 service nova] Creating event network-vif-plugged:4a973efe-1839-49a3-86e3-b685f02a879e for instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 on n-h2-zed-1 Oct 28 09:53:08.893325 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-de7c6d79-e9e1-40a0-af16-09f29eb6d10b req-b2560b3b-d829-440d-ab4b-bdf619993001 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048078 Oct 28 09:53:08.894207 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 321/643] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:08.900282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0adc7b9-b50e-4390-9a84-ac7ca1d9f656 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.912745 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0adc7b9-b50e-4390-9a84-ac7ca1d9f656 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016859 Oct 28 09:53:08.913576 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 322/644] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:53:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:08.924008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:08.925127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:08.933232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.934173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.934839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:08.935927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:08.936639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:08.937341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:09.127949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:09.137341 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f276390-f5d2-4b23-bc4a-d0679c282950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.311345 Oct 28 09:53:09.143099 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 323/645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:08 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:09.145823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:09.150639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-64464c2f-631c-47f3-bb09-eb03a219021c tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Action: 'create', calling method: .version_select at 0x7fca338e7a60>, body: {"pool": null} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:09.215915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:09.231238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f039ca0b-c99c-49d5-98a8-7897c6ee6c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1319 microversion: 2.1 time: 0.315542 Oct 28 09:53:09.244826 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 323/646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:08 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1319 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:09.264395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3318a506-d268-4602-aa09-a2fd70c39bb2 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1316314978", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:09.303345 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3318a506-d268-4602-aa09-a2fd70c39bb2 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.055360 Oct 28 09:53:09.312641 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 324/647] 10.222.0.16 () {60 vars in 1146 bytes} [Fri Oct 28 09:53:09 2022] POST /compute/v2.1/flavors => generated 499 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:09.319239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:09.320248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:09.328251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:09.329200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:09.329858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:09.330898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:09.331602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:09.332240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:10.401070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:10.418914 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f8f2e8f-5ee1-4044-a682-9f4ab176f463 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 1.103600 Oct 28 09:53:10.429167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 325/648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:09 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:10.446226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-457422a8-cf8f-4bba-962c-99d5be2d6e10 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:10.459009 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-457422a8-cf8f-4bba-962c-99d5be2d6e10 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.028300 Oct 28 09:53:10.472996 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 326/649] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 09:53:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:10.481292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:10.483037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:10.491531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:10.492707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:10.494219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:10.495315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:10.496105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:10.496826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:11.574872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:11.593656 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6486ef1-702f-4676-984a-4265cb2eaba2 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1318 microversion: 2.1 time: 1.118605 Oct 28 09:53:11.594892 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 327/650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:10 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1318 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:11.600142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:11.601089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:11.610505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:11.611324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:11.612687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:11.614548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:11.615369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:11.616164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:11.925494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:11.937132 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-218b3791-398e-4775-a669-7947b5dd59d6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.340912 Oct 28 09:53:11.937740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 328/651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:11 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:11.965390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:11.970838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:11.986769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:11.987458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:11.987919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:11.988692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:11.991106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:11.991561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:12.287726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:12.299116 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ce6ca01-06ec-49f8-bcbd-8c0fd0f790a3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1319 microversion: 2.1 time: 0.337862 Oct 28 09:53:12.299769 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 329/652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:11 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:12.316514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1626513065", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "b57cd1cd-e88e-49e8-9fec-4e8d995accde"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:12.434205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:53:13.198406 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-64464c2f-631c-47f3-bb09-eb03a219021c tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.053944 Oct 28 09:53:13.201724 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 324/653] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 09:53:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4058 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:13.215644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6c6680a3-f827-4463-926a-75089e8df7a6 req-5657a81c-85f9-45ef-a968-801ff27dfb44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b982ea-8435-4b99-ac22-6dfe4fdb0f31", "name": "network-vif-unplugged", "status": "completed", "tag": "bd7a6588-4a23-403b-8d3d-0767543db082"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:13.224091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:13.224853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:13.225564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:13.226081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:13.226947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:13.244949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6c6680a3-f827-4463-926a-75089e8df7a6 req-5657a81c-85f9-45ef-a968-801ff27dfb44 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.246828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6c6680a3-f827-4463-926a-75089e8df7a6 req-5657a81c-85f9-45ef-a968-801ff27dfb44 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.248252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6c6680a3-f827-4463-926a-75089e8df7a6 req-5657a81c-85f9-45ef-a968-801ff27dfb44 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.274120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.274342 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6c6680a3-f827-4463-926a-75089e8df7a6 req-5657a81c-85f9-45ef-a968-801ff27dfb44 service nova] Creating event network-vif-unplugged:bd7a6588-4a23-403b-8d3d-0767543db082 for instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 on n-h2-zed-1 Oct 28 09:53:13.275932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.276655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.279084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.279854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.280597 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6c6680a3-f827-4463-926a-75089e8df7a6 req-5657a81c-85f9-45ef-a968-801ff27dfb44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.076759 Oct 28 09:53:13.281014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.281728 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 325/654] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:13.289353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ef5df636-1236-491c-86e3-09da517194e4 req-e480648a-0313-4ca3-b89d-2330a6b5b50b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e019b782-6ea3-43ca-ae24-885467cd2353", "name": "network-vif-plugged", "status": "completed", "tag": "0f46a022-e804-4156-8382-6c4d7322b410"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:13.304481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ef5df636-1236-491c-86e3-09da517194e4 req-e480648a-0313-4ca3-b89d-2330a6b5b50b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.306259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ef5df636-1236-491c-86e3-09da517194e4 req-e480648a-0313-4ca3-b89d-2330a6b5b50b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.306714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ef5df636-1236-491c-86e3-09da517194e4 req-e480648a-0313-4ca3-b89d-2330a6b5b50b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.323664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:53:13.323882 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ef5df636-1236-491c-86e3-09da517194e4 req-e480648a-0313-4ca3-b89d-2330a6b5b50b service nova] Creating event network-vif-plugged:0f46a022-e804-4156-8382-6c4d7322b410 for instance e019b782-6ea3-43ca-ae24-885467cd2353 on n-h2-zed-1 Oct 28 09:53:13.331927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:13.337078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for user 9dc12014773b4f9fb34ff214c07d7f61 and project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:53:13.337882 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ef5df636-1236-491c-86e3-09da517194e4 req-e480648a-0313-4ca3-b89d-2330a6b5b50b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054677 Oct 28 09:53:13.339073 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 326/655] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:13.350059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:13.351505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:13.357991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:53:13.359582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.360256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.361188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.361314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:53:13.362553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.363771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.364399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.447976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-760bedb9-d09f-4889-b769-352f6c15fa5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.143611 Oct 28 09:53:13.449698 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 330/656] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:53:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:53:13.464248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:13.465316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:13.479038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.479657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.480207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.482535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:13.483154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:13.484349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:13.868398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:13.893287 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aeb05505-4f94-42b4-b2f5-40100684a99d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.551776 Oct 28 09:53:13.938767 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 327/657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:13 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:13.947103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:13.948323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:13.949811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:13.961343 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98da66a4-cbe3-4549-971b-9b32bb1fa694 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1468 microversion: 2.1 time: 0.502803 Oct 28 09:53:13.963956 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 331/658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:13 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1468 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:13.984780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-294ee90a-af8e-44b9-8920-f7d31efca870 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Action: 'create', calling method: .version_select at 0x7fca338e99d0>, body: {"pool": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:14.007296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.008952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.046s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.014741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.015887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.016533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.017381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.287969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:14.297651 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-109e3e69-1965-48dc-84e5-de861cda8d62 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.357208 Oct 28 09:53:14.298801 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 328/659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:13 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:14.303856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:14.304551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:14.312205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.313025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.313619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.314519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.315130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.315725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.538369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:14.548507 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d46979d-5b5a-4e6f-86a2-62187291fa60 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1319 microversion: 2.1 time: 0.248452 Oct 28 09:53:14.551998 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 329/660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:14 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:14.560517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:14.566041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:14.577663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.578159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.585369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.586442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.587085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.588525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.709593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:14.721913 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25648b8f-a7fc-4fa7-976a-7cafce2c5d35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1275 microversion: 2.1 time: 0.167475 Oct 28 09:53:14.723118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 330/661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:14 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1275 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:14.732426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:14.738392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:14.745765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.747185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.747863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.748767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.749326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.749834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.776698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lazy-loading 'flavor' on Instance uuid e582ac2f-c01c-4fe6-8735-daf68aa50d30 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:14.863353 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-971440e2-a7fd-40f4-af57-e9c8b39a2dbc tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30/action" status: 202 len: 0 microversion: 2.1 time: 0.138440 Oct 28 09:53:14.867042 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 331/662] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:14 2022] POST /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:14.878220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:14.879450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:14.890152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.891286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.891978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:14.893153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:14.893880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:14.894630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.139621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:15.149294 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87d95852-18b6-45f9-9115-54a66e813177 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1476 microversion: 2.1 time: 0.275697 Oct 28 09:53:15.150233 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 332/663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:14 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1476 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:15.155636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:15.156262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:15.163596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.164183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.164627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.165399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.165901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.166344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.368326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:15.384814 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d4ba6b6c-b755-4e3e-9a6f-5f013e730265 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1315 microversion: 2.1 time: 0.233454 Oct 28 09:53:15.390723 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 333/664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:15 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:15.401260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:15.401910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:15.410801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.411299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.411745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.412867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.413387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.413984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.616128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:15.626950 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e80f4249-ca73-43dd-b9e0-342d0aece5e0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.232396 Oct 28 09:53:15.628027 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 334/665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:15 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:15.633332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9f0db0a3-408f-45b2-a8b9-1abd7aa0705a req-cddf5aa3-9bd7-46d6-88ad-5c8fe9a8e088 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b982ea-8435-4b99-ac22-6dfe4fdb0f31", "tag": "bd7a6588-4a23-403b-8d3d-0767543db082"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:15.645330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9f0db0a3-408f-45b2-a8b9-1abd7aa0705a req-cddf5aa3-9bd7-46d6-88ad-5c8fe9a8e088 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.645920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9f0db0a3-408f-45b2-a8b9-1abd7aa0705a req-cddf5aa3-9bd7-46d6-88ad-5c8fe9a8e088 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.646415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9f0db0a3-408f-45b2-a8b9-1abd7aa0705a req-cddf5aa3-9bd7-46d6-88ad-5c8fe9a8e088 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.662552 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9f0db0a3-408f-45b2-a8b9-1abd7aa0705a req-cddf5aa3-9bd7-46d6-88ad-5c8fe9a8e088 service nova] Creating event network-changed:bd7a6588-4a23-403b-8d3d-0767543db082 for instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 on n-h2-zed-1 Oct 28 09:53:15.669369 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9f0db0a3-408f-45b2-a8b9-1abd7aa0705a req-cddf5aa3-9bd7-46d6-88ad-5c8fe9a8e088 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039545 Oct 28 09:53:15.675340 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 335/666] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:15.682397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-86083c11-586d-43b9-9b86-ed928ef55402 req-3a319868-3437-4980-a218-e238431abfaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e618b41c-1036-4406-8bdd-152212526ef2", "name": "network-vif-plugged", "status": "completed", "tag": "422b35b6-0138-4c3e-82f4-6f0638f98c6e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:15.703848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-86083c11-586d-43b9-9b86-ed928ef55402 req-3a319868-3437-4980-a218-e238431abfaa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.708619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-86083c11-586d-43b9-9b86-ed928ef55402 req-3a319868-3437-4980-a218-e238431abfaa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.709359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-86083c11-586d-43b9-9b86-ed928ef55402 req-3a319868-3437-4980-a218-e238431abfaa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.722539 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-86083c11-586d-43b9-9b86-ed928ef55402 req-3a319868-3437-4980-a218-e238431abfaa service nova] Creating event network-vif-plugged:422b35b6-0138-4c3e-82f4-6f0638f98c6e for instance e618b41c-1036-4406-8bdd-152212526ef2 on n-h2-zed-1 Oct 28 09:53:15.729558 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-86083c11-586d-43b9-9b86-ed928ef55402 req-3a319868-3437-4980-a218-e238431abfaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050977 Oct 28 09:53:15.732954 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 336/667] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:15.747438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:15.749054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:15.768289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:15.773311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.774068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.774871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:15.776146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:15.779033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:15.779033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:16.019389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:16.028350 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7062081-e2c2-41a7-95f2-392c4be85b68 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1319 microversion: 2.1 time: 0.292993 Oct 28 09:53:16.045924 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 337/668] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:15 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:16.054597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:16.055398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:16.063768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:16.064325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:16.064772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:16.065545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:16.066007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:16.066439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:16.071538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:16.203291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:16.214661 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-66f2186c-0e67-44c6-83d4-2b7725923cd3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1331 microversion: 2.1 time: 0.167220 Oct 28 09:53:16.229579 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 338/669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:16 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1331 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:16.237987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:16.238707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:16.246731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:16.247303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:16.247757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:16.248577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:16.249120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:16.249555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:16.761021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:16.773145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dd602f00-7eba-4126-8e65-4af3f5ae006d tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1476 microversion: 2.1 time: 0.541576 Oct 28 09:53:16.783919 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 339/670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:16 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1476 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:16.788873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:16.794061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:16.817300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:16.818981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:16.819887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:16.822917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:16.823580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:16.825443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.035259 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-294ee90a-af8e-44b9-8920-f7d31efca870 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.065913 Oct 28 09:53:17.037285 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 332/671] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 09:53:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:17.042393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:17.043555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:17.062153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.063509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.065650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.067114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.069345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.070182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.289250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:17.305885 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70e5d55a-3a4a-41ae-a29a-c92d302ab40e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1503 microversion: 2.1 time: 0.531184 Oct 28 09:53:17.318773 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 340/672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:16 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1503 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:17.333546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:17.334476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:17.343176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:17.363007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.363546 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8be25842-69ae-41b8-972a-20861e007839 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.315979 Oct 28 09:53:17.365886 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 333/673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:17 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:17.366190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.366928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.370034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.371104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.375144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.378914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dbe473e1-c111-4098-9135-a5cef928dd0e tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Action: 'create', calling method: .version_select at 0x7fca338ffaf0>, body: {"pool": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:17.853682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:17.874032 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7bc6671-14f8-45dd-9d65-98e8b28e5f13 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1319 microversion: 2.1 time: 0.552443 Oct 28 09:53:17.876652 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 341/674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:17 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:17.883760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:17.884702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:17.897795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.899557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.901358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:17.903494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:17.904388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:17.905284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:18.275475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:18.317445 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c345ef59-f3ab-4c99-bdc0-bf4885c8d9d3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1379 microversion: 2.1 time: 0.439033 Oct 28 09:53:18.344522 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 342/675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:17 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1379 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:18.361836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1729126286"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:18.363010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:18.375586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:18.376860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:18.408525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:18.413265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:18.421795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:18.423771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:19.173832 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.network.security_group_api [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Adding security group 28392a37-b29c-44ca-96f4-517145f23255 to port 0f46a022-e804-4156-8382-6c4d7322b410 Oct 28 09:53:20.017959 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6055d11b-ca2a-4944-8269-96cb75bafb1c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353/action" status: 202 len: 0 microversion: 2.1 time: 1.667596 Oct 28 09:53:20.020420 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 343/676] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:18 2022] POST /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353/action => generated 0 bytes in 1675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:20.043305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e091e185-cec9-4e58-947c-4eb3d9634217 req-92c6f7df-186e-4db6-b0ab-7ad5b0fea833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d45eb16-2631-4068-bd85-d26fb3f25d98", "name": "network-vif-plugged", "status": "completed", "tag": "87606c16-1569-4633-b64b-9a7a85b0c2d6"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:20.088351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e091e185-cec9-4e58-947c-4eb3d9634217 req-92c6f7df-186e-4db6-b0ab-7ad5b0fea833 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.090186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e091e185-cec9-4e58-947c-4eb3d9634217 req-92c6f7df-186e-4db6-b0ab-7ad5b0fea833 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.091830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e091e185-cec9-4e58-947c-4eb3d9634217 req-92c6f7df-186e-4db6-b0ab-7ad5b0fea833 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.131049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e091e185-cec9-4e58-947c-4eb3d9634217 req-92c6f7df-186e-4db6-b0ab-7ad5b0fea833 service nova] Creating event network-vif-plugged:87606c16-1569-4633-b64b-9a7a85b0c2d6 for instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 on n-h1-zed-1 Oct 28 09:53:20.147608 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e091e185-cec9-4e58-947c-4eb3d9634217 req-92c6f7df-186e-4db6-b0ab-7ad5b0fea833 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122473 Oct 28 09:53:20.148561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 344/677] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:20.174364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.175273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:20.190291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.194620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.195325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.197503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.207606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.208256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.488659 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dbe473e1-c111-4098-9135-a5cef928dd0e tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.120449 Oct 28 09:53:20.489340 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 334/678] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 09:53:17 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:20.503948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.504663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:20.515131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.515906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.516713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.517977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.518704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.519402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.703365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:20.707330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:20.715311 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30a5835b-3c84-4f11-a9b8-57adb912c621 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.223912 Oct 28 09:53:20.716763 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 335/679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:20 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:20.723571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.724592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:20.734130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.735969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.736864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.737907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.738616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.739287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.931771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:20.932008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:20.945499 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ce9e3f2-5ceb-4343-9128-8188f731f350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1469 microversion: 2.1 time: 0.226622 Oct 28 09:53:20.945681 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-61703f1d-80a7-4d84-8b3e-72b5ca463bb3 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1459 microversion: 2.1 time: 0.789001 Oct 28 09:53:20.947333 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 336/680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:20 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:20.957554 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 345/681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:20 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1459 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:20.961436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:20.962218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:20.969952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e13531d2-291d-4996-83c0-b2285a36f803 req-6d5e6ef6-5003-4b23-bad1-d88e49d30e66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e019b782-6ea3-43ca-ae24-885467cd2353", "tag": "0f46a022-e804-4156-8382-6c4d7322b410"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:20.978123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.978626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.979070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.979908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.980401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.980828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:20.987487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e13531d2-291d-4996-83c0-b2285a36f803 req-6d5e6ef6-5003-4b23-bad1-d88e49d30e66 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:20.990179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e13531d2-291d-4996-83c0-b2285a36f803 req-6d5e6ef6-5003-4b23-bad1-d88e49d30e66 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:20.990619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e13531d2-291d-4996-83c0-b2285a36f803 req-6d5e6ef6-5003-4b23-bad1-d88e49d30e66 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:21.014411 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e13531d2-291d-4996-83c0-b2285a36f803 req-6d5e6ef6-5003-4b23-bad1-d88e49d30e66 service nova] Creating event network-changed:0f46a022-e804-4156-8382-6c4d7322b410 for instance e019b782-6ea3-43ca-ae24-885467cd2353 on n-h2-zed-1 Oct 28 09:53:21.027718 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e13531d2-291d-4996-83c0-b2285a36f803 req-6d5e6ef6-5003-4b23-bad1-d88e49d30e66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065969 Oct 28 09:53:21.028964 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 346/682] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:21.038268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af4d9bce-1d43-48e9-90a2-39e5ac108846 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca338ec940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:21.253141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-af4d9bce-1d43-48e9-90a2-39e5ac108846 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use.", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:21.254562 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-af4d9bce-1d43-48e9-90a2-39e5ac108846 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use. Oct 28 09:53:21.254562 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-76156308-656a-43eb-a5e1-6df2ee7b34c2'] Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af4d9bce-1d43-48e9-90a2-39e5ac108846 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255 HTTP/1.1 Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:21.257793 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: exception: Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use. Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-76156308-656a-43eb-a5e1-6df2ee7b34c2'] Oct 28 09:53:21.259394 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '28392a37-b29c-44ca-96f4-517145f23255'} Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:21.260280 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use. Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76156308-656a-43eb-a5e1-6df2ee7b34c2'] Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use. Oct 28 09:53:21.262007 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76156308-656a-43eb-a5e1-6df2ee7b34c2'] Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use. Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76156308-656a-43eb-a5e1-6df2ee7b34c2'] Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:21.263247 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:21.264763 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:21.264763 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:21.264763 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:21.264763 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use. Oct 28 09:53:21.264763 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-76156308-656a-43eb-a5e1-6df2ee7b34c2'] Oct 28 09:53:21.264763 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:21.265263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af4d9bce-1d43-48e9-90a2-39e5ac108846 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 400 to user: Security Group 28392a37-b29c-44ca-96f4-517145f23255 in use. Oct 28 09:53:21.265263 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-76156308-656a-43eb-a5e1-6df2ee7b34c2'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:21.268955 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af4d9bce-1d43-48e9-90a2-39e5ac108846 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255" status: 400 len: 185 microversion: 2.1 time: 0.235896 Oct 28 09:53:21.268955 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 347/683] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:21 2022] DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255 => generated 185 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:53:21.269758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:21.281194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d79cf3c-83ce-4d9c-90d5-f27ec0b11e52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1379 microversion: 2.1 time: 0.332424 Oct 28 09:53:21.282285 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 337/684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:20 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1379 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:21.288080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49a1eba2-f241-4fd6-98cf-49180921998e tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Calling method '.version_select at 0x7fca338ffaf0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:21.463848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-538222220", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7035122b-a147-4d22-80a1-0879f4691bf4"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:21.543433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] validate_networks() for [('7035122b-a147-4d22-80a1-0879f4691bf4', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:53:21.696758 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49a1eba2-f241-4fd6-98cf-49180921998e tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/e524ad0b-6242-4a0d-a18d-cf9886bec2dc" status: 200 len: 141 microversion: 2.1 time: 0.412839 Oct 28 09:53:21.701482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 338/685] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 09:53:21 2022] GET /compute/v2.1/os-floating-ips/e524ad0b-6242-4a0d-a18d-cf9886bec2dc => generated 141 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:21.708301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:21.709320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:21.716558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:21.717393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:21.718025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:21.719280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:21.720076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:21.721014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.197229 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19ea62f0-9385-46d6-8140-863b3533cfdf tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1604 microversion: 2.1 time: 0.493740 Oct 28 09:53:22.219630 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 339/686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:21 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1604 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:22.225691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:22.232806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:22.245104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.246327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.246993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.247823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.248409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.249097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.510394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:22.525640 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d68a4d26-052d-49b2-a81e-0aca54790c6e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1468 microversion: 2.1 time: 0.304519 Oct 28 09:53:22.526253 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 340/687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:22 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1468 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:22.556761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:22.561546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:22.567696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:22.568533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:22.568755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:22.569207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:22.569619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:22.576198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.577553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.578574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.580186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.591295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.593313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.594130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.594742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.595695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.597009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.597827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.602102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.639226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:53:22.647281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for user 52e08cff441e4fb0b01886d81a7b5ad6 and project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:53:22.661091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:53:22.664177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:53:22.721795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16c41e85-05da-4d76-bc6d-d0bc8833e643 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.453701 Oct 28 09:53:22.730103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 348/688] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:53:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1462 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:53:22.742424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45a2ffca-6468-467f-86f9-dfd7150fc2d2 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Calling method '.version_select at 0x7fca338e3dc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:22.781317 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d3ac1ee-8128-4efa-815d-8335a5fd038d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353/action" status: 202 len: 0 microversion: 2.1 time: 0.242475 Oct 28 09:53:22.786687 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 341/689] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:22 2022] POST /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:22.808484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:22.812187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:22.824687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.838720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.839190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:22.841682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:22.842229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:22.843089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.156319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:23.168756 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e3df34a-c612-4c53-a4b9-7b747f69f950 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.379503 Oct 28 09:53:23.193545 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 342/690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:22 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:23.206158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:23.214022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:23.219098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:23.219627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.220459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:23.221088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:23.221537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.276192 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f199b58d-df17-4ba9-821c-efa060fa8db1 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 0.081412 Oct 28 09:53:23.276825 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 343/691] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 09:53:23 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:23.288292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:23.289195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:23.303502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:23.306073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:23.306952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.309768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:23.311602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:23.313278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.388362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:23.727123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:23.739519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e67f0a3-01de-44b2-a6da-1f52324172c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1379 microversion: 2.1 time: 0.454396 Oct 28 09:53:23.753799 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 344/692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:23 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1379 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:23.783259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:23.796308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:23.797577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Searching by: {'reservation_id': 'r-37vkey98', 'deleted': False, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:53:23.806185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:23.807039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:23.810019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.813799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:23.814525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:23.815214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:23.959601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:53:24.034363 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-45a2ffca-6468-467f-86f9-dfd7150fc2d2 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/e524ad0b-6242-4a0d-a18d-cf9886bec2dc" status: 202 len: 0 microversion: 2.1 time: 1.303358 Oct 28 09:53:24.035936 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 349/693] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:53:22 2022] DELETE /compute/v2.1/os-floating-ips/e524ad0b-6242-4a0d-a18d-cf9886bec2dc => generated 0 bytes in 1306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:24.041631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:24.042611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:24.052884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.054462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.055521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.056755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.057416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.058016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.096804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.109513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.110194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.110750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.173767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.189904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.198122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.199350 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7a38dcd-8a74-4f6a-8c1a-d97fa6efa785 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1257 microversion: 2.25 time: 0.162173 Oct 28 09:53:24.200161 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 350/694] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:24 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1257 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:24.219843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:24.221135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:24.249148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.249458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.250122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.251095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.258850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.259602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.645857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5e33e57-ee5f-46fc-b40b-b4a5297d0fff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?reservation_id=r-37vkey98" status: 200 len: 2930 microversion: 2.1 time: 0.890530 Oct 28 09:53:24.646591 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 345/695] 10.222.0.16 () {58 vars in 1197 bytes} [Fri Oct 28 09:53:23 2022] GET /compute/v2.1/servers/detail?reservation_id=r-37vkey98 => generated 2930 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:24.661169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-51b366e1-3c3e-409d-89a5-75a901027110 req-5c4e275b-d150-4500-a51e-9655fffc96de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:24.693340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-51b366e1-3c3e-409d-89a5-75a901027110 req-5c4e275b-d150-4500-a51e-9655fffc96de service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.695753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-51b366e1-3c3e-409d-89a5-75a901027110 req-5c4e275b-d150-4500-a51e-9655fffc96de service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.696541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-51b366e1-3c3e-409d-89a5-75a901027110 req-5c4e275b-d150-4500-a51e-9655fffc96de service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.723054 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-51b366e1-3c3e-409d-89a5-75a901027110 req-5c4e275b-d150-4500-a51e-9655fffc96de service nova] Creating event network-changed:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h1-zed-1 Oct 28 09:53:24.736357 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-51b366e1-3c3e-409d-89a5-75a901027110 req-5c4e275b-d150-4500-a51e-9655fffc96de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088141 Oct 28 09:53:24.740129 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 346/696] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:24.746708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:24.750740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-zed-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:24.764751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:24.766190 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2cf9e30f-95f9-4fae-a30f-5897e32a416f tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1574 microversion: 2.1 time: 0.558141 Oct 28 09:53:24.767112 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 351/697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:24 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1574 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:24.775779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d227f71-0b74-4428-a85c-7e41db28f8d7 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Calling method '.version_select at 0x7fca3387dd30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:24.805254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.807231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.807889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.808895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.809590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.812677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.880780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Lazy-loading 'flavor' on Instance uuid e582ac2f-c01c-4fe6-8735-daf68aa50d30 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:24.914766 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 while it is in vm_state suspended Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Request method failure captured: Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30/action HTTP/1.1 Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 94 Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZOPNMZRXJ8xj7K_gCfMHdTQ9wj7JRUNim2R-y4jqsm5tlXyZySo0CD29tkj03rEo_Uchpq27HEcxmCG_Gy64Wtp5saEBSmAkONPZHrRBHxwm3U8lecyeYwBSPrU6tlfW_i842zMWmNh9Z1NZCqlbOFy7zHSPHfKbBtPGKSeAMkdc0 Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 5531e84096ee46eabd5df958c2eeba45 Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveMigrationNegativeTest-1124265264 Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:53:24.917329 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5531e84096ee46eabd5df958c2eeba45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5531e84096ee46eabd5df958c2eeba45"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5531e84096ee46eabd5df958c2eeba45", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5531e84096ee46eabd5df958c2eeba45"}]}] Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveMigrationNegativeTest-1124265264 Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 5531e84096ee46eabd5df958c2eeba45 Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1124265264 Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveMigrationNegativeTest-1124265264-project-admin Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2ac52977718e4fadbac8a3a1e410a1ba Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveMigrationNegativeTest-1124265264-project-admin Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: {"os-migrateLive": {"host": "n-h1-zed-1", "block_migration": true, "disk_over_commit": false}} Oct 28 09:53:24.918986 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: exception: Cannot 'os-migrateLive' instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 while it is in vm_state suspended Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e582ac2f-c01c-4fe6-8735-daf68aa50d30', 'body': {'os-migrateLive': {'host': 'n-h1-zed-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 09:53:24.919834 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:53:24.921264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 while it is in vm_state suspended Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 while it is in vm_state suspended Oct 28 09:53:24.922554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:24.923582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 while it is in vm_state suspended {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:24.923582 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c2b7809c-d6f6-4116-a9c5-4e5d19de9ee6 tempest-LiveMigrationNegativeTest-1124265264 tempest-LiveMigrationNegativeTest-1124265264-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30/action" status: 409 len: 155 microversion: 2.1 time: 0.177438 Oct 28 09:53:24.925091 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 347/698] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:24 2022] POST /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30/action => generated 155 bytes in 184 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:53:24.935863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:24.936499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:24.951425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.951791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.954901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:24.956392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:24.957268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:24.957879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.305512 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d227f71-0b74-4428-a85c-7e41db28f8d7 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.534264 Oct 28 09:53:25.306934 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 352/699] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 09:53:24 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:53:25.318519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d7f540e-9cce-404a-87f5-1447a68aaaaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:25.343831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.server_groups [None req-6d7f540e-9cce-404a-87f5-1447a68aaaaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Querying cell 308273ef-dc1c-40ee-a51c-31916410c877(cell1) for 2 instances {{(pid=128748) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 09:53:25.344795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d7f540e-9cce-404a-87f5-1447a68aaaaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:25.346445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d7f540e-9cce-404a-87f5-1447a68aaaaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:25.346445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d7f540e-9cce-404a-87f5-1447a68aaaaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.559646 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6d7f540e-9cce-404a-87f5-1447a68aaaaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/23fbb2c7-2d21-406b-a5af-6d99cb136ba8" status: 200 len: 271 microversion: 2.1 time: 0.251026 Oct 28 09:53:25.561229 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 353/700] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:53:25 2022] GET /compute/v2.1/os-server-groups/23fbb2c7-2d21-406b-a5af-6d99cb136ba8 => generated 271 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:25.566670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:25.568227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:25.576376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:25.577922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:25.578597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.579594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:25.580282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:25.580934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.712606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:25.733400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f2c58b5c-51ba-4a07-8331-bd826c183aae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1504 microversion: 2.1 time: 0.806298 Oct 28 09:53:25.735561 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 348/701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:24 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1504 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:25.745308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:25.746657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:25.760363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:25.763888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:25.764833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.765836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:25.766350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:25.766866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:25.835543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:53:26.070975 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9e0503e8-adaa-4fd8-b635-1f47195027d0 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 204 len: 0 microversion: 2.1 time: 0.332559 Oct 28 09:53:26.072052 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 349/702] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:25 2022] DELETE /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:26.085536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.086251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:26.093896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.094350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.094797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.095511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.095971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.096398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.097443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.111875 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3d175adb-61b7-4866-b091-a96a04356c21 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1379 microversion: 2.1 time: 0.548867 Oct 28 09:53:26.112935 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 354/703] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:25 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1379 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:26.121755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0b08137-8bd2-4337-8e7b-a88f8a97289e tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Calling method '.version_select at 0x7fca33d9f3a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.175190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.185821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.188169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.190480 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-84bd6157-0368-46b9-89c5-85704279c4f1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1319 microversion: 2.25 time: 0.115890 Oct 28 09:53:26.191556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 350/704] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1319 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:26.196807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.197464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:26.204970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.205471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.205913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.206635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.207095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.207523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.243934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:26.448130 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-41228f80-b9b5-4ca8-8633-1dae4af92fa8 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1613 microversion: 2.1 time: 0.255042 Oct 28 09:53:26.450644 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 351/705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1613 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:26.461164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.462414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:26.476456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.477429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.478250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.479624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.481163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.481979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.555103 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0b08137-8bd2-4337-8e7b-a88f8a97289e tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.440155 Oct 28 09:53:26.557495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 355/706] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:26.568815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.569558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:26.576580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.577116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.577561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.578985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.579132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.579550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.760878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.773728 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4bec6f07-3b22-44af-b186-93061726fccf tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1572 microversion: 2.1 time: 0.320532 Oct 28 09:53:26.792036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 352/707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1572 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:26.799559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:26.799794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.800747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:26.807688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.808264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.808482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9516b0c5-ece5-4bdb-bbc5-0ef8fa0f2df9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1465 microversion: 2.1 time: 0.249263 Oct 28 09:53:26.808737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.809117 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 356/708] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1465 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:26.809666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:26.810373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:26.810704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:26.814520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a664020-27d0-445e-920b-1b3758ebc912 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Calling method '.version_select at 0x7fca338010d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:26.977882 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b7512f23-d886-47f9-a390-03dd51d9da4f tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 200 len: 1614 microversion: 2.1 time: 0.191462 Oct 28 09:53:26.989398 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 353/709] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 1614 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:27.007797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:27.008789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:27.018960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.019781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.020958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.021862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.023186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.023937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.222943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:27.232507 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-86b17daa-c796-47e6-8cb1-d1077cd23c87 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1494 microversion: 2.1 time: 0.241902 Oct 28 09:53:27.233370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 354/710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:26 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1494 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:27.239525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1012353304"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:27.240084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:27.247847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.249022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.249502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.250253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:27.250725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:27.251165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:27.430905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.network.security_group_api [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Adding security group 92974217-9a6d-4772-b7a6-76e9da2767d3 to port 0f46a022-e804-4156-8382-6c4d7322b410 Oct 28 09:53:28.056304 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a664020-27d0-445e-920b-1b3758ebc912 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/73fef66e-342c-4df5-9753-4aa4b75e93cb" status: 202 len: 0 microversion: 2.1 time: 1.245894 Oct 28 09:53:28.057902 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 357/711] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:53:26 2022] DELETE /compute/v2.1/os-floating-ips/73fef66e-342c-4df5-9753-4aa4b75e93cb => generated 0 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:28.068098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:28.069316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:28.084573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.086184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.087754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.089181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.090515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.091474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.104939 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-68a94557-b564-4116-865b-0a977eae3304 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353/action" status: 202 len: 0 microversion: 2.1 time: 0.870270 Oct 28 09:53:28.114264 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 355/712] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:27 2022] POST /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353/action => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:28.123946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-508495774", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "05112b40-6767-428e-8884-474dd5e18ae9"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:28.261272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:53:28.511171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.528723 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea109fdd-7074-465d-9c87-6cc7048d20b4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1379 microversion: 2.1 time: 0.464663 Oct 28 09:53:28.530525 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 358/713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:28 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1379 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:28.538552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:28.540700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:28.550952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.551865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.552564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.553520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.554212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.555582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.862907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.876169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.877722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:28.878910 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e4f10bb-2c2e-4d56-a6d3-9f6da90fbea3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.346972 Oct 28 09:53:28.879481 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 359/714] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:28 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:28.896544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97f33cdd-767d-4ea3-857d-a4be01e7a577 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '.version_select at 0x7fca33b0e040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:28.903296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97f33cdd-767d-4ea3-857d-a4be01e7a577 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.904021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97f33cdd-767d-4ea3-857d-a4be01e7a577 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.904652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97f33cdd-767d-4ea3-857d-a4be01e7a577 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.922625 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97f33cdd-767d-4ea3-857d-a4be01e7a577 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1148 microversion: 2.1 time: 0.025019 Oct 28 09:53:28.933290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 360/715] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:53:28 2022] GET /compute/v2.1/os-migrations => generated 1148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:28.945128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:28.946040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:28.953633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.954406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.955143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:28.956121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:28.956590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:28.957211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:29.049953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:29.063132 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-187cfc95-7f9a-4131-8f40-e99dfae8d9f5 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 200 len: 1423 microversion: 2.1 time: 0.126772 Oct 28 09:53:29.063767 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 361/716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:28 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 1423 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:29.072080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f725813c-7e81-4077-8088-dcc315e852c2 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Calling method '.version_select at 0x7fca33b115e0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:29.115071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:29.116247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:29.116989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:29.117615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:29.118260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:29.142967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:29.143819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:29.144757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:29.145998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:29.146849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:29.147619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:29.200747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:53:29.208697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:53:29.223954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:53:29.226534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:53:29.297548 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4cc7a1a-d99e-4898-887a-ec658c196c8a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.181392 Oct 28 09:53:29.298564 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 356/717] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:53:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:53:29.306645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8e3857af-45eb-4890-8bd6-7dfe5e7f1441 req-00c09342-6117-435d-a44c-999b596d7ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "name": "network-vif-plugged", "status": "completed", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:29.346357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8e3857af-45eb-4890-8bd6-7dfe5e7f1441 req-00c09342-6117-435d-a44c-999b596d7ba3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:29.348316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8e3857af-45eb-4890-8bd6-7dfe5e7f1441 req-00c09342-6117-435d-a44c-999b596d7ba3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:29.349004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8e3857af-45eb-4890-8bd6-7dfe5e7f1441 req-00c09342-6117-435d-a44c-999b596d7ba3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:29.368166 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8e3857af-45eb-4890-8bd6-7dfe5e7f1441 req-00c09342-6117-435d-a44c-999b596d7ba3 service nova] Creating event network-vif-plugged:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h1-zed-1 Oct 28 09:53:29.374363 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8e3857af-45eb-4890-8bd6-7dfe5e7f1441 req-00c09342-6117-435d-a44c-999b596d7ba3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073951 Oct 28 09:53:29.375805 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 357/718] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:29.381780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ca7e2d43-3a6d-4f0f-bc0a-1f43a4bb950b req-c4fdf5b0-7321-400a-b618-250d16604fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e019b782-6ea3-43ca-ae24-885467cd2353", "tag": "0f46a022-e804-4156-8382-6c4d7322b410"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:29.394495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ca7e2d43-3a6d-4f0f-bc0a-1f43a4bb950b req-c4fdf5b0-7321-400a-b618-250d16604fba service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:29.395531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ca7e2d43-3a6d-4f0f-bc0a-1f43a4bb950b req-c4fdf5b0-7321-400a-b618-250d16604fba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:29.396992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ca7e2d43-3a6d-4f0f-bc0a-1f43a4bb950b req-c4fdf5b0-7321-400a-b618-250d16604fba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:29.416456 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ca7e2d43-3a6d-4f0f-bc0a-1f43a4bb950b req-c4fdf5b0-7321-400a-b618-250d16604fba service nova] Creating event network-changed:0f46a022-e804-4156-8382-6c4d7322b410 for instance e019b782-6ea3-43ca-ae24-885467cd2353 on n-h2-zed-1 Oct 28 09:53:29.448029 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ca7e2d43-3a6d-4f0f-bc0a-1f43a4bb950b req-c4fdf5b0-7321-400a-b618-250d16604fba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067561 Oct 28 09:53:29.452837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 358/719] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:29.473814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52a151ea-6e6a-4193-b2cc-ab8a8c2a2141 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca384d0dc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.053832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-52a151ea-6e6a-4193-b2cc-ab8a8c2a2141 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use.", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:30.054537 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-52a151ea-6e6a-4193-b2cc-ab8a8c2a2141 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use. Oct 28 09:53:30.054537 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-ff35db2d-5c89-46d9-b491-cc7dfd7b8894'] Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52a151ea-6e6a-4193-b2cc-ab8a8c2a2141 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3 HTTP/1.1 Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:30.056867 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: exception: Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use. Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-ff35db2d-5c89-46d9-b491-cc7dfd7b8894'] Oct 28 09:53:30.059029 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '92974217-9a6d-4772-b7a6-76e9da2767d3'} Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:30.060101 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use. Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff35db2d-5c89-46d9-b491-cc7dfd7b8894'] Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use. Oct 28 09:53:30.061412 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff35db2d-5c89-46d9-b491-cc7dfd7b8894'] Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use. Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff35db2d-5c89-46d9-b491-cc7dfd7b8894'] Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:30.062663 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use. Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff35db2d-5c89-46d9-b491-cc7dfd7b8894'] Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52a151ea-6e6a-4193-b2cc-ab8a8c2a2141 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 400 to user: Security Group 92974217-9a6d-4772-b7a6-76e9da2767d3 in use. Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-ff35db2d-5c89-46d9-b491-cc7dfd7b8894'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52a151ea-6e6a-4193-b2cc-ab8a8c2a2141 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3" status: 400 len: 185 microversion: 2.1 time: 0.599676 Oct 28 09:53:30.064086 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 359/720] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:29 2022] DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3 => generated 185 bytes in 605 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:53:30.069563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.070326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:30.079263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.080027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.080656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.081478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.082264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.082711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.372698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2326443b-b21a-4d4c-9a46-7ef4b09d7e6f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1639 microversion: 2.1 time: 0.308610 Oct 28 09:53:30.385135 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 360/721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:30 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1639 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:30.385135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-74078f93-ab09-47eb-82df-75e7d55b6bb3 req-7c213d76-2b2a-4142-95b3-81f3f67f92cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e582ac2f-c01c-4fe6-8735-daf68aa50d30", "name": "network-vif-deleted", "tag": "4a973efe-1839-49a3-86e3-b685f02a879e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:30.394891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-74078f93-ab09-47eb-82df-75e7d55b6bb3 req-7c213d76-2b2a-4142-95b3-81f3f67f92cd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.396012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-74078f93-ab09-47eb-82df-75e7d55b6bb3 req-7c213d76-2b2a-4142-95b3-81f3f67f92cd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.396991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-74078f93-ab09-47eb-82df-75e7d55b6bb3 req-7c213d76-2b2a-4142-95b3-81f3f67f92cd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.436830 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-74078f93-ab09-47eb-82df-75e7d55b6bb3 req-7c213d76-2b2a-4142-95b3-81f3f67f92cd service nova] Creating event network-vif-deleted:4a973efe-1839-49a3-86e3-b685f02a879e for instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 on n-h2-zed-1 Oct 28 09:53:30.446982 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-74078f93-ab09-47eb-82df-75e7d55b6bb3 req-7c213d76-2b2a-4142-95b3-81f3f67f92cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070619 Oct 28 09:53:30.448000 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 361/722] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:30.465560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.466902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:30.477901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.478870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.479562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.480622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.481412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.482243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.606379 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f725813c-7e81-4077-8088-dcc315e852c2 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/0c0291c2-3370-4683-b308-f11df48c5594" status: 202 len: 0 microversion: 2.1 time: 1.539474 Oct 28 09:53:30.607312 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 362/723] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:53:29 2022] DELETE /compute/v2.1/os-floating-ips/0c0291c2-3370-4683-b308-f11df48c5594 => generated 0 bytes in 1543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:30.616767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.617431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:30.639318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.639897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.640420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.643903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.644735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.645213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.665779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.679357 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1dc3dcc4-bf27-45d8-8e5f-2847b7e429d9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1220 microversion: 2.1 time: 0.229630 Oct 28 09:53:30.680683 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 362/724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:30 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1220 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:30.690439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.691346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:30.699528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.700850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.701708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.703165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.704089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.704695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.916364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:30.927945 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92bd8d83-3f8f-49ea-8509-3db7992a9240 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1379 microversion: 2.1 time: 0.315844 Oct 28 09:53:30.928713 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 363/725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:30 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1379 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:30.937232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:30.941488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:30.954914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.957782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.960070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.961128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:30.962954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:30.963657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:30.969600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:30.993873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:53:31.125917 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d3ea93cd-ba72-4c61-9a42-410c3acf0e52 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 204 len: 0 microversion: 2.1 time: 0.194166 Oct 28 09:53:31.126673 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 364/726] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:30 2022] DELETE /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:31.126803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.134319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:31.135085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: e582ac2f-c01c-4fe6-8735-daf68aa50d30] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:31.140229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.141743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:31.143051 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d774393e-ef25-4e7c-8f86-0a428538fe82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.460837 Oct 28 09:53:31.143519 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 363/727] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:30 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:31.144338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.144967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.145647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:31.146554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.147013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.147444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:31.160946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-82c95a57-161f-469f-869c-f50abf63e8b5 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] Calling method '.version_select at 0x7fca3805b310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:31.164144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] HTTP exception thrown: Instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 could not be found. Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Request method failure captured: Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 HTTP/1.1 Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZMIIVQuMH6tNXonGpniLphc6XfuOyJ-SdlrBK79feI9BuN60RE7FAF-4v5AVcl60MJlD9EWRGnRQsYwcQ9Ai0TeKbgtMUrbJG1zmB24B0O3GJXfiAwKhXkkbD6N9srO2CJ_3l6WtNpYgiTkh8FQVRX-wbLydFsUKuYBnovOf7j0TY Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cdc8b6c3e715487293067ca378466ca4 Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-LiveMigrationNegativeTest-1025114281 Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:31.165871 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc8b6c3e715487293067ca378466ca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc8b6c3e715487293067ca378466ca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc8b6c3e715487293067ca378466ca4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc8b6c3e715487293067ca378466ca4"}]}] Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-LiveMigrationNegativeTest-1025114281 Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cdc8b6c3e715487293067ca378466ca4 Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1025114281 Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-LiveMigrationNegativeTest-1025114281-project Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 66a05c50f8b744f0b5c22c7a33e88530 Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-LiveMigrationNegativeTest-1025114281-project Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 could not be found. Oct 28 09:53:31.167685 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e582ac2f-c01c-4fe6-8735-daf68aa50d30'} Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 could not be found. Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:31.168710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 could not be found. Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 could not be found. Oct 28 09:53:31.172054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:31.173836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Returning 404 to user: Instance e582ac2f-c01c-4fe6-8735-daf68aa50d30 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:31.173836 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-173bfeaf-f17b-4d97-b8e2-bb97327b3e68 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30" status: 404 len: 111 microversion: 2.1 time: 0.039273 Oct 28 09:53:31.173836 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 365/728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:31 2022] GET /compute/v2.1/servers/e582ac2f-c01c-4fe6-8735-daf68aa50d30 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:31.174232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-255054057", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "22fc5637-6732-4716-999d-9f8191adb350"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:31.236447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] validate_networks() for [('22fc5637-6732-4716-999d-9f8191adb350', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:53:31.701950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:31.705052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:31.705585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:31.706047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:31.706836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:31.717350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.718519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.719364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:31.720202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.720672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.721142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:31.755107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:53:31.760838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for user d76e0eb51a9b418bb28e81b5ac1520f9 and project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:53:31.777625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:53:31.780031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:53:31.838841 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dc7c3095-951c-4cf0-a25b-92df6cc32dfc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669571 Oct 28 09:53:31.840409 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 366/729] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:53:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:53:31.845398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:31.846036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:31.853942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.854443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.854888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:31.856186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:31.856853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:31.857476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.028129 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-82c95a57-161f-469f-869c-f50abf63e8b5 tempest-FloatingIPDetailsTestJSON-1405324828 tempest-FloatingIPDetailsTestJSON-1405324828-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/8eb9f2e0-e87a-4b60-96e1-171afe846af0" status: 202 len: 0 microversion: 2.1 time: 0.871060 Oct 28 09:53:32.028872 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 364/730] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:53:31 2022] DELETE /compute/v2.1/os-floating-ips/8eb9f2e0-e87a-4b60-96e1-171afe846af0 => generated 0 bytes in 885 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:32.034693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.035204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.049294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.049809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.053607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.054193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.054985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.055610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.092447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.098029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:53:32.111370 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b573b35a-07cf-4f9f-bf71-9947b952090b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1647 microversion: 2.1 time: 0.269953 Oct 28 09:53:32.112154 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 367/731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:31 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1647 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:32.119290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8958d9b1-636e-4338-a5d3-8355f0bdb234 req-85b06a98-4772-45d5-987e-908735437a3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439c52f5-ba7c-4756-916f-ac9323d6303d", "tag": "e03e33d3-7264-4573-b3db-caf9a93bd750"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:32.138732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8958d9b1-636e-4338-a5d3-8355f0bdb234 req-85b06a98-4772-45d5-987e-908735437a3a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.139216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8958d9b1-636e-4338-a5d3-8355f0bdb234 req-85b06a98-4772-45d5-987e-908735437a3a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.139648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8958d9b1-636e-4338-a5d3-8355f0bdb234 req-85b06a98-4772-45d5-987e-908735437a3a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.163502 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8958d9b1-636e-4338-a5d3-8355f0bdb234 req-85b06a98-4772-45d5-987e-908735437a3a service nova] Creating event network-changed:e03e33d3-7264-4573-b3db-caf9a93bd750 for instance 439c52f5-ba7c-4756-916f-ac9323d6303d on n-h2-zed-1 Oct 28 09:53:32.174148 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8958d9b1-636e-4338-a5d3-8355f0bdb234 req-85b06a98-4772-45d5-987e-908735437a3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059939 Oct 28 09:53:32.174821 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 368/732] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:32.181593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.182772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.191986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.192750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.193461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.194475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.195167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.196393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.236306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-377d53f6-00e7-4ef8-9744-3e7383074c8f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "DELETE /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 204 len: 0 microversion: 2.1 time: 0.205965 Oct 28 09:53:32.238568 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 365/733] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:32 2022] DELETE /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:32.259768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1dcde268-d542-4fcc-8c51-fa2ef1e24a7d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.262315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1dcde268-d542-4fcc-8c51-fa2ef1e24a7d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.266427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:32.281769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.291654 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99fa9906-d073-4cac-891a-c276140ae17d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1268 microversion: 2.1 time: 0.114836 Oct 28 09:53:32.293693 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 369/734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:32 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1268 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:32.299630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.300591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.308573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.309189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.309627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.310532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.311003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.311436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.374303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1dcde268-d542-4fcc-8c51-fa2ef1e24a7d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.382444 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1dcde268-d542-4fcc-8c51-fa2ef1e24a7d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1210 microversion: 2.1 time: 0.140783 Oct 28 09:53:32.385848 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 366/735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:32 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:32.396125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.396963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.405690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.406902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.407668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.408640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.409353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.410035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.512038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.523237 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-89cadd90-5b98-4953-a240-0e97aab378aa tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1529 microversion: 2.1 time: 0.228130 Oct 28 09:53:32.524149 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 370/736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:32 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1529 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:32.529452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.530852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.537508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.538286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.538453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.539391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.540254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.540397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.722091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.728871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.736536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.742692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:32.744055 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8849a00-3302-4a51-b38e-d052e280273a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.356978 Oct 28 09:53:32.749599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b847ce27-04a3-4a50-bed2-3eac0e40da9e tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1475 microversion: 2.1 time: 0.224688 Oct 28 09:53:32.750197 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 371/737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:32 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1475 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:32.750890 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 367/738] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:32 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:32.755923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:32.756751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:32.771806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.772617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.773909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:32.774375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:32.774934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:32.775501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.141832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.142571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:33.150872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.151442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.152000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.152792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.153345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.153906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.306604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.322803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6eff272-26ce-4cb9-b623-e6b80690f2bd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1529 microversion: 2.1 time: 0.570483 Oct 28 09:53:33.323947 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 368/739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:32 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1529 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:33.329465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.330205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:33.332596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.343705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.344345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.344866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.345702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.346242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.346754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.348078 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbceb9c4-c7c0-4c66-8301-cc6402324758 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1647 microversion: 2.1 time: 0.210253 Oct 28 09:53:33.348992 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 372/740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:33 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1647 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:33.356558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41b1b429-52a8-4653-8aa6-362803b1a906 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.379091 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41b1b429-52a8-4653-8aa6-362803b1a906 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/b57cd1cd-e88e-49e8-9fec-4e8d995accde" status: 202 len: 0 microversion: 2.1 time: 0.029095 Oct 28 09:53:33.380601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:33 2022] DELETE /compute/v2.1/flavors/b57cd1cd-e88e-49e8-9fec-4e8d995accde => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:33.389751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40cc281a-c012-4f54-8e73-327cd11f49b9 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.394893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:33.413241 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-40cc281a-c012-4f54-8e73-327cd11f49b9 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5818 microversion: 2.1 time: 0.027216 Oct 28 09:53:33.414103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 374/742] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:53:33 2022] GET /compute/v2.1/flavors/detail => generated 5818 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:33.419954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.421203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:33.429619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.430122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.430571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.431290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.431758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.432190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.439861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.457015 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e190d30-20dc-4938-af3d-2ab03eb783ea tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1268 microversion: 2.1 time: 0.127995 Oct 28 09:53:33.457015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 369/743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:33 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1268 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:33.461764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:33.465343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:33.474406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.475231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.475668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.476627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.477270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.477821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.514780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.531263 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97ad1ef2-0d3e-49ba-84bc-d444a6402548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1262 microversion: 2.1 time: 0.116015 Oct 28 09:53:33.534251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 375/744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:33 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1262 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:33.592009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:33.604481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Old instance type tempest-test_resize_flavor_-1316314978, new instance type m1.heat {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 09:53:33.613440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:33.614002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:33.614738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:33.615296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:33.615895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:33.761088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-de3d313a-198c-411a-8de1-b212d3178215 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0/action" status: 202 len: 0 microversion: 2.1 time: 0.305008 Oct 28 09:53:33.765285 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 370/745] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:33 2022] POST /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:33.781302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.782158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:33.789701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.790757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.790993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.791776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.792387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.793675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.803202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:33.822311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:33.824840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:33.836729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.837690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.838259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:33.839137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:33.840554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:33.841118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.006731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.025456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5fe9707b-f182-4b11-8489-9b1297417eef tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1538 microversion: 2.1 time: 0.256680 Oct 28 09:53:34.027508 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 376/746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:33 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1538 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:34.032667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:34.033845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:34.056103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.058446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.059107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.060076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.060730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.061605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.223213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.255584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.255936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80786b13-f45c-4c7c-b0c6-6625ecb4538b tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1475 microversion: 2.1 time: 0.479867 Oct 28 09:53:34.272463 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 371/747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:33 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1475 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:34.304592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.312841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.315152 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b0206a1-6128-4ac4-8baa-4ddb137bf206 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.286106 Oct 28 09:53:34.332040 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 377/748] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:34 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:34.376611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:34.378068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:34.385610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.386118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.387087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.387794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.388255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.388686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.478523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:34.479410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:34.486583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.487549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.488381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.494118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.495044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.495687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.583760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.594093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-03b8fa23-abfb-457f-8164-1ebda505113d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1268 microversion: 2.1 time: 0.119642 Oct 28 09:53:34.608841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 378/749] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:34 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1268 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:34.615493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:34.617430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:34.627040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.627713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.628159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.628875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:34.629356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:34.629835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:34.698954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.708141 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b41933db-7768-49dc-8057-1f58454ecf38 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1268 microversion: 2.1 time: 0.096979 Oct 28 09:53:34.708750 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 379/750] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:34 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1268 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:34.825464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:34.833957 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d853a69a-2ac3-4e65-accc-f801e9f34b38 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1647 microversion: 2.1 time: 0.463086 Oct 28 09:53:34.845729 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 372/751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:34 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1647 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:35.069361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:35.070174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:35.082202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.083172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.083718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.084713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.085624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.086133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.291693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:35.293487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:35.305947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.306858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.307655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.309046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.310544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.312587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.363240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:35.409738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee5c1431-6cf9-4188-9a6b-b9785e3510ad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1538 microversion: 2.1 time: 0.345130 Oct 28 09:53:35.417817 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 380/752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:35 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1538 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:35.447786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:35.458158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:35.483090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.484784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.486421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.490521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.492350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.494702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.719338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:35.735908 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d93c3d9-3a64-4811-b706-c68752defb53 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1475 microversion: 2.1 time: 0.452282 Oct 28 09:53:35.737078 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 373/753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:35 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1475 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:35.744827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c67ee818-80f9-429f-a688-f1ad07a88d3a req-4de02fe6-f814-42e1-b518-f7a68580e51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e019b782-6ea3-43ca-ae24-885467cd2353", "name": "network-vif-deleted", "tag": "0f46a022-e804-4156-8382-6c4d7322b410"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:35.763418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c67ee818-80f9-429f-a688-f1ad07a88d3a req-4de02fe6-f814-42e1-b518-f7a68580e51b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.764146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c67ee818-80f9-429f-a688-f1ad07a88d3a req-4de02fe6-f814-42e1-b518-f7a68580e51b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.765100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c67ee818-80f9-429f-a688-f1ad07a88d3a req-4de02fe6-f814-42e1-b518-f7a68580e51b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.780552 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c67ee818-80f9-429f-a688-f1ad07a88d3a req-4de02fe6-f814-42e1-b518-f7a68580e51b service nova] Creating event network-vif-deleted:0f46a022-e804-4156-8382-6c4d7322b410 for instance e019b782-6ea3-43ca-ae24-885467cd2353 on n-h2-zed-1 Oct 28 09:53:35.793385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c67ee818-80f9-429f-a688-f1ad07a88d3a req-4de02fe6-f814-42e1-b518-f7a68580e51b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054013 Oct 28 09:53:35.797096 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 374/754] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:35.803216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:35.804275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:35.812776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.813604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.814255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.814967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.815431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.815856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.908325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:35.917991 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cba753c0-846a-4992-b87c-67841f80487b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1276 microversion: 2.1 time: 0.118704 Oct 28 09:53:35.919279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 375/755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:35 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1276 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:35.924750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:35.925630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:35.932285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.933435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.934086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.935121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:35.935602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:35.936071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:35.968149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:35.986465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:35.988564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:35.990051 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76d7ae25-422f-4b72-bcb7-0764dd91a977 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.570730 Oct 28 09:53:35.991227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 381/756] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:35 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:35.996946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:35.998389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:36.006158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.007033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.007671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.008848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.009510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.011886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.131600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:36.143681 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0323e55b-6259-4659-80a6-dbd3ffd4eab6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1467 microversion: 2.1 time: 0.150493 Oct 28 09:53:36.144934 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 382/757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:35 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1467 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:36.244849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:36.254993 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e541f427-4053-4161-a393-de144fcb0a32 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.334369 Oct 28 09:53:36.268512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 376/758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:35 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:36.460671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:36.461337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:36.471900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.472409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.472893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.473602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.474562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.475936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.480946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:36.768349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:36.770052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:36.783825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.784304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.785010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.786211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.786893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.787675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.796375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:36.821553 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3fbba94b-4853-481e-83ef-2b6052b1bd31 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1538 microversion: 2.1 time: 0.366172 Oct 28 09:53:36.837625 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 383/759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:36 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1538 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:36.837625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8154ad3d-ebc2-4d48-a7f8-1b734b4ea86f req-c0cc3fd1-ab47-4a43-9251-0829a3a7af0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5cc4e4d-4dff-444f-ac54-f4821dccae07", "tag": "aaabdd70-5e8c-41df-8b5d-9902110dc424"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:36.847358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8154ad3d-ebc2-4d48-a7f8-1b734b4ea86f req-c0cc3fd1-ab47-4a43-9251-0829a3a7af0d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.848149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8154ad3d-ebc2-4d48-a7f8-1b734b4ea86f req-c0cc3fd1-ab47-4a43-9251-0829a3a7af0d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.849416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8154ad3d-ebc2-4d48-a7f8-1b734b4ea86f req-c0cc3fd1-ab47-4a43-9251-0829a3a7af0d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.865238 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8154ad3d-ebc2-4d48-a7f8-1b734b4ea86f req-c0cc3fd1-ab47-4a43-9251-0829a3a7af0d service nova] Creating event network-changed:aaabdd70-5e8c-41df-8b5d-9902110dc424 for instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 on n-h1-zed-1 Oct 28 09:53:36.873684 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8154ad3d-ebc2-4d48-a7f8-1b734b4ea86f req-c0cc3fd1-ab47-4a43-9251-0829a3a7af0d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047829 Oct 28 09:53:36.874959 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 384/760] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:36.944078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:36.944704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:36.951372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.951907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.952416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:36.953158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:36.953802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:36.954210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.059631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.071705 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-10cc3a35-05be-4fae-96e3-50e199b0e6b1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1276 microversion: 2.1 time: 0.132041 Oct 28 09:53:37.072608 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 385/761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:36 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:37.087849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:37.087849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:37.099892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.101188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.101923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.103280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.103941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.104543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.412153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.425252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.426976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.428100 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-420c36e1-2e9c-437d-8383-e4a69adf939a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.354235 Oct 28 09:53:37.430553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:37.440001 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa7b45b6-dd62-485c-b782-9289bd8e514a tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1475 microversion: 2.1 time: 0.678820 Oct 28 09:53:37.441621 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 386/762] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:37 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:37.450352 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 377/763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:36 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1475 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:37.452499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:37.453302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:37.462539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:37.463283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:37.475616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.476120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.476751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.477587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.480579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.481413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.482590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.483092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.490621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:37.491872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:37.492525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:37.493184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.024217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.036756 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dee7d475-76b3-42da-8e84-20cc7995d95e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.584291 Oct 28 09:53:38.039287 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 378/764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:37 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:38.046549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:38.047486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:38.057585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.061452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.061924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.062960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.063446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.063884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.163610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.173263 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d8c6f8e1-1370-4fdd-a488-3cc21d5fab57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 200 len: 1467 microversion: 2.1 time: 0.730368 Oct 28 09:53:38.174717 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 387/765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:37 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 1467 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:38.180033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:38.181207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:38.188456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.189074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.189893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.190919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.191396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.192429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.313651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.323214 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-18a7d0a7-4ed9-49b9-82fc-983e717ca54e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1274 microversion: 2.1 time: 0.146837 Oct 28 09:53:38.324413 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 388/766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:38 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:38.424985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.437383 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4d4afe6-84ec-460d-aa18-ca9bbcd1efc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1538 microversion: 2.1 time: 0.396094 Oct 28 09:53:38.437991 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 379/767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:38 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1538 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:38.462339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:38.463562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:38.477953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:38.478478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:38.480263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.481468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.482307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.483281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.484046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.484745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.484953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.485293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.495045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.496609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.497170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.497704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.942675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:38.955259 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d03e886d-c1a7-4455-9971-ee2ff8fb5e7f tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1475 microversion: 2.1 time: 0.481180 Oct 28 09:53:38.956600 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 380/768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:38 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1475 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:38.963559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-958a60c5-160a-4772-bcda-0941d2f42a2c req-0beae867-b23e-4833-9f49-da98ed05ffb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c28120-7ffa-4702-bf23-8354ac0117bf", "name": "network-vif-deleted", "tag": "230ba441-692a-4982-ac79-1154dd8d6c8c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:38.976099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-958a60c5-160a-4772-bcda-0941d2f42a2c req-0beae867-b23e-4833-9f49-da98ed05ffb7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:38.976588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-958a60c5-160a-4772-bcda-0941d2f42a2c req-0beae867-b23e-4833-9f49-da98ed05ffb7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:38.977273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-958a60c5-160a-4772-bcda-0941d2f42a2c req-0beae867-b23e-4833-9f49-da98ed05ffb7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:38.995589 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-958a60c5-160a-4772-bcda-0941d2f42a2c req-0beae867-b23e-4833-9f49-da98ed05ffb7 service nova] Creating event network-vif-deleted:230ba441-692a-4982-ac79-1154dd8d6c8c for instance 34c28120-7ffa-4702-bf23-8354ac0117bf on n-h2-zed-1 Oct 28 09:53:39.002970 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-958a60c5-160a-4772-bcda-0941d2f42a2c req-0beae867-b23e-4833-9f49-da98ed05ffb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044367 Oct 28 09:53:39.008044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 381/769] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:39.063851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.064877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:39.084945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.085593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.086053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.090664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.091452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.091912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.168946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:39.177213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.198245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.199940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.201364 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0dccf37b-6cf3-47ac-aba0-008c9597c005 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.747514 Oct 28 09:53:39.225382 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 389/770] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:38 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:39.241437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.244251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:39.255146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.256693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.257398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.258528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.259236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.259893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.297263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.311536 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8966e5b-1a8a-4f90-8ea5-ac5407f2ed13 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.253577 Oct 28 09:53:39.312935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 382/771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:39 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:39.329128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 HTTP/1.1 Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:39.331649 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:39.333041 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e019b782-6ea3-43ca-ae24-885467cd2353'} Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:39.333800 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:39.335054 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:39.337891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:39.337891 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-582a3108-5493-4acc-9597-5b78d0a33a5d tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 404 len: 111 microversion: 2.1 time: 0.104419 Oct 28 09:53:39.341045 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 390/772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:39 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:39.343715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2545f3c0-77c1-4376-99fd-6f0bb8eecde7 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca386b74c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.375523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.376466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:39.383703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.384475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.385159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.386293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.387495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.388318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.510663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:39.522085 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63cb7b00-7ed5-43c3-84f7-356c89d323fd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1274 microversion: 2.1 time: 0.153082 Oct 28 09:53:39.522855 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 391/773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:39 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1274 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:39.527730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:39.528616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:39.536273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.537079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.537704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.539158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:39.539803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:39.540247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:39.603434 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2545f3c0-77c1-4376-99fd-6f0bb8eecde7 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255" status: 202 len: 0 microversion: 2.1 time: 0.264280 Oct 28 09:53:39.606898 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 383/774] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:39 2022] DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:39.627285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f377e993-0c36-4c9c-8cf8-13916c5b146e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca38714d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:40.044027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.062519 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-715a6620-852e-4f0a-b4e9-3014d81d100e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1538 microversion: 2.1 time: 0.537971 Oct 28 09:53:40.075839 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 392/775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:39 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1538 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:40.098967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:40.099746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:40.107909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.108720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.109463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.110204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.110685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.111250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.192265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.193181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.193947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.194960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lazy-loading 'fault' on Instance uuid 34c28120-7ffa-4702-bf23-8354ac0117bf {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:40.206593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f377e993-0c36-4c9c-8cf8-13916c5b146e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3" status: 202 len: 0 microversion: 2.1 time: 0.597348 Oct 28 09:53:40.217461 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 384/776] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:39 2022] DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3 => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:40.227712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b673c62a-4bf5-49a7-a2d8-e3fbec5eb521 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'create', calling method: .version_select at 0x7fca33ab1f70>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2124195004", "description": "tempest-description-771280746"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:40.266711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66a05c50f8b744f0b5c22c7a33e88530', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdc8b6c3e715487293067ca378466ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.277651 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d402a971-4d3e-4408-a19f-32fd94604848 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 200 len: 1309 microversion: 2.1 time: 0.198674 Oct 28 09:53:40.278747 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 393/777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:40 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:40.285037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:40.285908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:40.295357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.296581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.297351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.298766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.299508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.300174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.697485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.698250 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b673c62a-4bf5-49a7-a2d8-e3fbec5eb521 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.473587 Oct 28 09:53:40.706261 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 385/778] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 09:53:40 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:53:40.713767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.716107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:40.722586 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd8d619f-3c2f-4787-a7fa-7cb9b065d3cc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.442238 Oct 28 09:53:40.723469 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 394/779] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:40 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:40.728420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:40.739910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:40.746966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.747732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.749527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.750497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.753593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:40.759620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:40.766751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.769594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.773528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.774367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.782427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:40.788016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:40.789107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:40.792506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.071135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:41.084253 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-332381e1-6ee3-47b5-a6bd-afd59c62433d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.374902 Oct 28 09:53:41.089361 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 386/780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:40 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:41.096130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2e830f7a-9c42-4327-b218-a5045a6bba70 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Action: 'update', calling method: .version_select at 0x7fca380d0ee0>, body: {"security_group": {"name": "tempest-sg-hth-200533487", "description": "tempest-description-hth-68424951"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:41.246424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:41.260139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8845858f-9bd9-4f39-bc21-4c7413b692ec tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.535259 Oct 28 09:53:41.260765 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 395/781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:40 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:41.271448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:41.272083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:41.290880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.291643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.294494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.295477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.296213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.296651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.390709 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2e830f7a-9c42-4327-b218-a5045a6bba70 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/5e341748-6d4c-4975-b6f1-1e7f10ca7c35" status: 200 len: 215 microversion: 2.1 time: 0.298519 Oct 28 09:53:41.399806 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 387/782] 10.222.0.16 () {60 vars in 1290 bytes} [Fri Oct 28 09:53:41 2022] PUT /compute/v2.1/os-security-groups/5e341748-6d4c-4975-b6f1-1e7f10ca7c35 => generated 215 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:41.406991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:41.408002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] [instance: 34c28120-7ffa-4702-bf23-8354ac0117bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:41.417252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.418117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.418761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.419658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.420332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.421380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.457348 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] HTTP exception thrown: Instance 34c28120-7ffa-4702-bf23-8354ac0117bf could not be found. Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Request method failure captured: Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf HTTP/1.1 Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZMIIVQuMH6tNXonGpniLphc6XfuOyJ-SdlrBK79feI9BuN60RE7FAF-4v5AVcl60MJlD9EWRGnRQsYwcQ9Ai0TeKbgtMUrbJG1zmB24B0O3GJXfiAwKhXkkbD6N9srO2CJ_3l6WtNpYgiTkh8FQVRX-wbLydFsUKuYBnovOf7j0TY Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cdc8b6c3e715487293067ca378466ca4 Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveMigrationNegativeTest-1025114281 Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:41.461231 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc8b6c3e715487293067ca378466ca4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdc8b6c3e715487293067ca378466ca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdc8b6c3e715487293067ca378466ca4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdc8b6c3e715487293067ca378466ca4"}]}] Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveMigrationNegativeTest-1025114281 Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cdc8b6c3e715487293067ca378466ca4 Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1025114281 Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveMigrationNegativeTest-1025114281-project Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 66a05c50f8b744f0b5c22c7a33e88530 Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveMigrationNegativeTest-1025114281-project Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 34c28120-7ffa-4702-bf23-8354ac0117bf could not be found. Oct 28 09:53:41.462910 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '34c28120-7ffa-4702-bf23-8354ac0117bf'} Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c28120-7ffa-4702-bf23-8354ac0117bf could not be found. Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:41.463771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c28120-7ffa-4702-bf23-8354ac0117bf could not be found. Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c28120-7ffa-4702-bf23-8354ac0117bf could not be found. Oct 28 09:53:41.465048 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:41.467987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] Returning 404 to user: Instance 34c28120-7ffa-4702-bf23-8354ac0117bf could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:41.469440 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b628b5eb-0df2-4281-b80c-c332e237c8d9 tempest-LiveMigrationNegativeTest-1025114281 tempest-LiveMigrationNegativeTest-1025114281-project] 10.222.0.16 "GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf" status: 404 len: 111 microversion: 2.1 time: 0.067948 Oct 28 09:53:41.471024 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 388/783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:41 2022] GET /compute/v2.1/servers/34c28120-7ffa-4702-bf23-8354ac0117bf => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:41.478256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea639c1a-96fa-4507-b271-785a1c97829b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca3805b280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:41.591967 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea639c1a-96fa-4507-b271-785a1c97829b tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/5e341748-6d4c-4975-b6f1-1e7f10ca7c35" status: 200 len: 215 microversion: 2.1 time: 0.117723 Oct 28 09:53:41.595418 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 389/784] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 09:53:41 2022] GET /compute/v2.1/os-security-groups/5e341748-6d4c-4975-b6f1-1e7f10ca7c35 => generated 215 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:41.627543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64c191c4-7bea-4e35-9f34-bed8f307c079 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca3802fc10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:41.733627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:41.770372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:41.948997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:41.959187 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-db87c58d-caa5-4adf-83cb-190981b4e5fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1538 microversion: 2.1 time: 0.694397 Oct 28 09:53:41.975216 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 396/785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:41 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1538 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:41.983224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:41.984110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:41.991842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.992738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.993431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:41.995244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:41.996492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:41.998023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.063106 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64c191c4-7bea-4e35-9f34-bed8f307c079 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/5e341748-6d4c-4975-b6f1-1e7f10ca7c35" status: 202 len: 0 microversion: 2.1 time: 0.449304 Oct 28 09:53:42.065302 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 390/786] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:41 2022] DELETE /compute/v2.1/os-security-groups/5e341748-6d4c-4975-b6f1-1e7f10ca7c35 => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:42.070832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6d990da8-1412-4a04-852e-c30779cfbc04 req-1fdefbb4-067b-4231-af78-d12696ae4c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439c52f5-ba7c-4756-916f-ac9323d6303d", "name": "network-vif-plugged", "status": "completed", "tag": "e03e33d3-7264-4573-b3db-caf9a93bd750"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:42.083738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6d990da8-1412-4a04-852e-c30779cfbc04 req-1fdefbb4-067b-4231-af78-d12696ae4c3f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.084570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6d990da8-1412-4a04-852e-c30779cfbc04 req-1fdefbb4-067b-4231-af78-d12696ae4c3f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.085304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6d990da8-1412-4a04-852e-c30779cfbc04 req-1fdefbb4-067b-4231-af78-d12696ae4c3f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.105922 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6d990da8-1412-4a04-852e-c30779cfbc04 req-1fdefbb4-067b-4231-af78-d12696ae4c3f service nova] Creating event network-vif-plugged:e03e33d3-7264-4573-b3db-caf9a93bd750 for instance 439c52f5-ba7c-4756-916f-ac9323d6303d on n-h2-zed-1 Oct 28 09:53:42.112114 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6d990da8-1412-4a04-852e-c30779cfbc04 req-1fdefbb4-067b-4231-af78-d12696ae4c3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045246 Oct 28 09:53:42.112772 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 391/787] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:42.119053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:42.119864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:42.127853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.128679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.129560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.130596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.131293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.131757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.150503 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 HTTP/1.1 Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:42.152763 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.154585 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e019b782-6ea3-43ca-ae24-885467cd2353'} Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:42.160002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.162125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.163631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:42.163631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6e4ecc6e-05d0-4373-9d53-f6811adeade2 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 404 len: 111 microversion: 2.1 time: 0.040318 Oct 28 09:53:42.163631 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 392/788] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:42 2022] DELETE /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:42.163631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:42.163631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:42.169584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.170084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.170526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.171508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.173069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.174022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.380665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=10 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:42.467949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.491940 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c45aa54-2acc-4577-9523-a7098faf0770 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.335553 Oct 28 09:53:42.494044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 393/789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:42 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:42.505624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:42.525817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e019b782-6ea3-43ca-ae24-885467cd2353] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:42.544120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.551030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.552941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.555835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.557348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.560950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.561976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.564462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.566012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.573101 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-88610474-ffed-4725-b929-e0560beb9d12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.596439 Oct 28 09:53:42.577118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 397/790] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:41 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:42.583709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:42.584565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:42.596731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.605017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.606304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.607078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:42.607960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:42.608396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:42.651930 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 HTTP/1.1 Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:42.655589 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.658592 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e019b782-6ea3-43ca-ae24-885467cd2353'} Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:42.661119 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. Oct 28 09:53:42.663864 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.669750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Instance e019b782-6ea3-43ca-ae24-885467cd2353 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:42.669997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-61433067-0e38-4d42-aa31-deb44e9afa57 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353" status: 404 len: 111 microversion: 2.1 time: 0.170305 Oct 28 09:53:42.674693 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 394/791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:42 2022] GET /compute/v2.1/servers/e019b782-6ea3-43ca-ae24-885467cd2353 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:42.692804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-444d32d5-ec75-45f9-9328-58d001b7baec tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33ab1040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:42.802666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-444d32d5-ec75-45f9-9328-58d001b7baec tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:42.804009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-444d32d5-ec75-45f9-9328-58d001b7baec tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 92974217-9a6d-4772-b7a6-76e9da2767d3 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:53:42.805368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-444d32d5-ec75-45f9-9328-58d001b7baec tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist Oct 28 09:53:42.805368 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-f2c862c6-1ca2-49d6-b170-5c309c972a55'] Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-444d32d5-ec75-45f9-9328-58d001b7baec tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3 HTTP/1.1 Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:42.809775 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-f2c862c6-1ca2-49d6-b170-5c309c972a55'] Oct 28 09:53:42.812690 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '92974217-9a6d-4772-b7a6-76e9da2767d3'} Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.814523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c862c6-1ca2-49d6-b170-5c309c972a55'] Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:53:42.817498 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c862c6-1ca2-49d6-b170-5c309c972a55'] Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c862c6-1ca2-49d6-b170-5c309c972a55'] Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.819818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f2c862c6-1ca2-49d6-b170-5c309c972a55'] Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-444d32d5-ec75-45f9-9328-58d001b7baec tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 92974217-9a6d-4772-b7a6-76e9da2767d3 does not exist Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-f2c862c6-1ca2-49d6-b170-5c309c972a55'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:42.826863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-444d32d5-ec75-45f9-9328-58d001b7baec tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3" status: 404 len: 194 microversion: 2.1 time: 0.147571 Oct 28 09:53:42.833780 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 395/792] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:42 2022] DELETE /compute/v2.1/os-security-groups/92974217-9a6d-4772-b7a6-76e9da2767d3 => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:42.866774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:42.876067 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-78dd3f1c-89e5-4752-9d42-44825653ebb1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.296993 Oct 28 09:53:42.876665 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 398/793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:42 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:42.888097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ea14554-b7f5-4177-a9a8-1a565339585e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33e8a430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:42.950432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-9ea14554-b7f5-4177-a9a8-1a565339585e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:42.951443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-9ea14554-b7f5-4177-a9a8-1a565339585e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 28392a37-b29c-44ca-96f4-517145f23255 not found {{(pid=128748) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:53:42.952297 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9ea14554-b7f5-4177-a9a8-1a565339585e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist Oct 28 09:53:42.952297 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-35eca6ba-ed5e-4bfa-b9bd-38e64c615891'] Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ea14554-b7f5-4177-a9a8-1a565339585e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255 HTTP/1.1 Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:42.954683 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-35eca6ba-ed5e-4bfa-b9bd-38e64c615891'] Oct 28 09:53:42.956067 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '28392a37-b29c-44ca-96f4-517145f23255'} Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.956952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35eca6ba-ed5e-4bfa-b9bd-38e64c615891'] Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:53:42.958294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35eca6ba-ed5e-4bfa-b9bd-38e64c615891'] Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35eca6ba-ed5e-4bfa-b9bd-38e64c615891'] Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.959728 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-35eca6ba-ed5e-4bfa-b9bd-38e64c615891'] Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ea14554-b7f5-4177-a9a8-1a565339585e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 28392a37-b29c-44ca-96f4-517145f23255 does not exist Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-35eca6ba-ed5e-4bfa-b9bd-38e64c615891'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ea14554-b7f5-4177-a9a8-1a565339585e tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255" status: 404 len: 194 microversion: 2.1 time: 0.076008 Oct 28 09:53:42.965894 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 399/794] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:42 2022] DELETE /compute/v2.1/os-security-groups/28392a37-b29c-44ca-96f4-517145f23255 => generated 194 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:42.968296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4c1b17e-6527-43a5-b880-cc41b4adffcd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33e1b310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.014402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-a4c1b17e-6527-43a5-b880-cc41b4adffcd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:43.014615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-a4c1b17e-6527-43a5-b880-cc41b4adffcd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 78e43231-d344-466a-b068-2a3ad7792710 not found {{(pid=128748) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:53:43.015037 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a4c1b17e-6527-43a5-b880-cc41b4adffcd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:53:43.015037 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-6ac21af5-b681-4ad8-b717-153e071e520b'] Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4c1b17e-6527-43a5-b880-cc41b4adffcd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710 HTTP/1.1 Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:43.019613 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-6ac21af5-b681-4ad8-b717-153e071e520b'] Oct 28 09:53:43.021288 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '78e43231-d344-466a-b068-2a3ad7792710'} Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.022081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac21af5-b681-4ad8-b717-153e071e520b'] Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:53:43.023196 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac21af5-b681-4ad8-b717-153e071e520b'] Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac21af5-b681-4ad8-b717-153e071e520b'] Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.024244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6ac21af5-b681-4ad8-b717-153e071e520b'] Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4c1b17e-6527-43a5-b880-cc41b4adffcd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 78e43231-d344-466a-b068-2a3ad7792710 does not exist Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-6ac21af5-b681-4ad8-b717-153e071e520b'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a4c1b17e-6527-43a5-b880-cc41b4adffcd tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710" status: 404 len: 194 microversion: 2.1 time: 0.058864 Oct 28 09:53:43.025878 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 400/795] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:42 2022] DELETE /compute/v2.1/os-security-groups/78e43231-d344-466a-b068-2a3ad7792710 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:53:43.029659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.034941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:43.052277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.052809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.061570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.075552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.076214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.077319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.099679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a86c21c-3afa-4d70-972b-d673af125a12 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] 10.222.0.16 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.264073 Oct 28 09:53:43.100395 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 396/796] 10.222.0.16 () {58 vars in 1128 bytes} [Fri Oct 28 09:53:42 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 09:53:43.117457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c8e30e6-899c-4461-af96-1f9a9f5918ea tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca3819a160>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.158592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-2c8e30e6-899c-4461-af96-1f9a9f5918ea tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:43.159826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-2c8e30e6-899c-4461-af96-1f9a9f5918ea tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:53:43.160984 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2c8e30e6-899c-4461-af96-1f9a9f5918ea tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:53:43.160984 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-4e8de3df-8d47-4166-bd8a-0c245f27eb25'] Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c8e30e6-899c-4461-af96-1f9a9f5918ea tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f HTTP/1.1 Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:43.163519 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-4e8de3df-8d47-4166-bd8a-0c245f27eb25'] Oct 28 09:53:43.165067 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '992bfd71-6af6-4cb2-ac7c-b7df4e52830f'} Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.165985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8de3df-8d47-4166-bd8a-0c245f27eb25'] Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:53:43.167324 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8de3df-8d47-4166-bd8a-0c245f27eb25'] Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8de3df-8d47-4166-bd8a-0c245f27eb25'] Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.169519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e8de3df-8d47-4166-bd8a-0c245f27eb25'] Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c8e30e6-899c-4461-af96-1f9a9f5918ea tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 992bfd71-6af6-4cb2-ac7c-b7df4e52830f does not exist Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-4e8de3df-8d47-4166-bd8a-0c245f27eb25'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.172841 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c8e30e6-899c-4461-af96-1f9a9f5918ea tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f" status: 404 len: 194 microversion: 2.1 time: 0.067391 Oct 28 09:53:43.174243 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 397/797] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/os-security-groups/992bfd71-6af6-4cb2-ac7c-b7df4e52830f => generated 194 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:43.178031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26aa1e90-0387-4d3e-ac9a-a58c302b8691 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Calling method '.version_select at 0x7fca33ab1d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.222563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-26aa1e90-0387-4d3e-ac9a-a58c302b8691 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] HTTP exception thrown: Image not found. Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26aa1e90-0387-4d3e-ac9a-a58c302b8691 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Request method failure captured: Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6amBlkYk5HQpxf9OuZUSg6hKmXNfcrR63vFPlWhb6QuBMSdEqJOHi9trUowJvwY3YktDMkqFY9RjTPdL9ATRpBronPHtBc-LZg9z69o35fPhhVyXbDWBDX9yJte-tFzkk_NKcapJFUu8ykP29EpAHbVJSBy-Z4oOxY8BPPsafidcmE Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:43.226389 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ea35e35fa5d46d88631ebdea3befcfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ea35e35fa5d46d88631ebdea3befcfa"}]}] Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2d3eb659dfce47439521ebc65c7c7505 Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '-1'} Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.228032 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.234818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.237079 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26aa1e90-0387-4d3e-ac9a-a58c302b8691 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-26aa1e90-0387-4d3e-ac9a-a58c302b8691 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] 10.222.0.16 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.054652 Oct 28 09:53:43.239508 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 398/798] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:53:43.241655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8720d1da-38f0-4964-9632-8d6fa945ee01 req-1965d8e5-2156-47d4-95a8-6fe0e14aba64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2aae186-313a-4f4d-8751-52c9df62b486", "tag": "8803f705-6e47-4629-ad45-8006f013267d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:43.251388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8720d1da-38f0-4964-9632-8d6fa945ee01 req-1965d8e5-2156-47d4-95a8-6fe0e14aba64 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.252091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8720d1da-38f0-4964-9632-8d6fa945ee01 req-1965d8e5-2156-47d4-95a8-6fe0e14aba64 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.252874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8720d1da-38f0-4964-9632-8d6fa945ee01 req-1965d8e5-2156-47d4-95a8-6fe0e14aba64 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.269151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8720d1da-38f0-4964-9632-8d6fa945ee01 req-1965d8e5-2156-47d4-95a8-6fe0e14aba64 service nova] Creating event network-changed:8803f705-6e47-4629-ad45-8006f013267d for instance a2aae186-313a-4f4d-8751-52c9df62b486 on n-h2-zed-1 Oct 28 09:53:43.275202 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8720d1da-38f0-4964-9632-8d6fa945ee01 req-1965d8e5-2156-47d4-95a8-6fe0e14aba64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043773 Oct 28 09:53:43.275841 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 399/799] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:43.282133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1ba0b81-b658-42ac-af87-412d013f6d8c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca381f3940>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.289290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.299331 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffe60537-2de2-4e66-9286-5f0d7a8e9f5e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.275112 Oct 28 09:53:43.300326 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 401/800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:43 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:43.306897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b3d5ad2-2327-4980-86f8-5bc666f8b8b1 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Calling method '.version_select at 0x7fca33eb0430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.315451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-e1ba0b81-b658-42ac-af87-412d013f6d8c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:43.316051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-e1ba0b81-b658-42ac-af87-412d013f6d8c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:53:43.316584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e1ba0b81-b658-42ac-af87-412d013f6d8c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:53:43.316584 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-3f8d2811-bdd3-4808-8158-a578fd48fdda'] Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1ba0b81-b658-42ac-af87-412d013f6d8c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51 HTTP/1.1 Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:43.318688 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-3f8d2811-bdd3-4808-8158-a578fd48fdda'] Oct 28 09:53:43.320341 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '34fb2a9a-28d4-4679-97a6-9b24ad01cb51'} Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.321786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f8d2811-bdd3-4808-8158-a578fd48fdda'] Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:53:43.322884 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f8d2811-bdd3-4808-8158-a578fd48fdda'] Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f8d2811-bdd3-4808-8158-a578fd48fdda'] Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.324008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3f8d2811-bdd3-4808-8158-a578fd48fdda'] Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1ba0b81-b658-42ac-af87-412d013f6d8c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 34fb2a9a-28d4-4679-97a6-9b24ad01cb51 does not exist Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-3f8d2811-bdd3-4808-8158-a578fd48fdda'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1ba0b81-b658-42ac-af87-412d013f6d8c tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51" status: 404 len: 194 microversion: 2.1 time: 0.043268 Oct 28 09:53:43.325399 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 400/801] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/os-security-groups/34fb2a9a-28d4-4679-97a6-9b24ad01cb51 => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:43.333028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b02c494-1c05-400a-893c-63c77ebb5697 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca3385a820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.337760 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6b3d5ad2-2327-4980-86f8-5bc666f8b8b1 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] HTTP exception thrown: Image not found. Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b3d5ad2-2327-4980-86f8-5bc666f8b8b1 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Request method failure captured: Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/1a0ee682-4873-4ced-a9cf-dac109153a7j HTTP/1.1 Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6amBlkYk5HQpxf9OuZUSg6hKmXNfcrR63vFPlWhb6QuBMSdEqJOHi9trUowJvwY3YktDMkqFY9RjTPdL9ATRpBronPHtBc-LZg9z69o35fPhhVyXbDWBDX9yJte-tFzkk_NKcapJFUu8ykP29EpAHbVJSBy-Z4oOxY8BPPsafidcmE Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:43.339836 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ea35e35fa5d46d88631ebdea3befcfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ea35e35fa5d46d88631ebdea3befcfa"}]}] Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2d3eb659dfce47439521ebc65c7c7505 Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1a0ee682-4873-4ced-a9cf-dac109153a7j'} Oct 28 09:53:43.341384 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1a0ee682-4873-4ced-a9cf-dac109153a7j to delete Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.342203 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1a0ee682-4873-4ced-a9cf-dac109153a7j could not be found. Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.344036 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b3d5ad2-2327-4980-86f8-5bc666f8b8b1 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.346164 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b3d5ad2-2327-4980-86f8-5bc666f8b8b1 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] 10.222.0.16 "DELETE /compute/v2.1/images/1a0ee682-4873-4ced-a9cf-dac109153a7j" status: 404 len: 62 microversion: 2.1 time: 0.039212 Oct 28 09:53:43.348237 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 402/802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/images/1a0ee682-4873-4ced-a9cf-dac109153a7j => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:53:43.356793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-841987f4-50a6-4dd7-9881-6a04ca80dd9c tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Calling method '.version_select at 0x7fca33e8a820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.372851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-0b02c494-1c05-400a-893c-63c77ebb5697 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:53:43.373737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-0b02c494-1c05-400a-893c-63c77ebb5697 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Neutron security group 31b64d5c-f537-4394-8382-57d088f46dd8 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 09:53:43.374316 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-0b02c494-1c05-400a-893c-63c77ebb5697 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:53:43.374316 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-61a82758-90e0-4932-931e-04f4d31c2d5a'] Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b02c494-1c05-400a-893c-63c77ebb5697 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8 HTTP/1.1 Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:43.377608 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-61a82758-90e0-4932-931e-04f4d31c2d5a'] Oct 28 09:53:43.379189 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '31b64d5c-f537-4394-8382-57d088f46dd8'} Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.380175 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a82758-90e0-4932-931e-04f4d31c2d5a'] Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 09:53:43.381604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a82758-90e0-4932-931e-04f4d31c2d5a'] Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a82758-90e0-4932-931e-04f4d31c2d5a'] Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.383086 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.384322 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.384322 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.384322 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.384322 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.384322 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:53:43.384322 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-61a82758-90e0-4932-931e-04f4d31c2d5a'] Oct 28 09:53:43.384322 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.384744 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-841987f4-50a6-4dd7-9881-6a04ca80dd9c tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] HTTP exception thrown: Image not found. Oct 28 09:53:43.384834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b02c494-1c05-400a-893c-63c77ebb5697 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Security group 31b64d5c-f537-4394-8382-57d088f46dd8 does not exist Oct 28 09:53:43.384834 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-61a82758-90e0-4932-931e-04f4d31c2d5a'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.384834 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b02c494-1c05-400a-893c-63c77ebb5697 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8" status: 404 len: 194 microversion: 2.1 time: 0.052178 Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-841987f4-50a6-4dd7-9881-6a04ca80dd9c tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Request method failure captured: Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/a1e64622-42f0-4485-bf72-59b6c43cd0911 HTTP/1.1 Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6amBlkYk5HQpxf9OuZUSg6hKmXNfcrR63vFPlWhb6QuBMSdEqJOHi9trUowJvwY3YktDMkqFY9RjTPdL9ATRpBronPHtBc-LZg9z69o35fPhhVyXbDWBDX9yJte-tFzkk_NKcapJFUu8ykP29EpAHbVJSBy-Z4oOxY8BPPsafidcmE Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:43.385085 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ea35e35fa5d46d88631ebdea3befcfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ea35e35fa5d46d88631ebdea3befcfa"}]}] Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2d3eb659dfce47439521ebc65c7c7505 Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'a1e64622-42f0-4485-bf72-59b6c43cd0911'} Oct 28 09:53:43.387283 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a1e64622-42f0-4485-bf72-59b6c43cd0911 to delete Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.388085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a1e64622-42f0-4485-bf72-59b6c43cd0911 could not be found. Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.389448 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:53:43.392189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.393223 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 401/803] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/os-security-groups/31b64d5c-f537-4394-8382-57d088f46dd8 => generated 194 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:53:43.393321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-841987f4-50a6-4dd7-9881-6a04ca80dd9c tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.393321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-841987f4-50a6-4dd7-9881-6a04ca80dd9c tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] 10.222.0.16 "DELETE /compute/v2.1/images/a1e64622-42f0-4485-bf72-59b6c43cd0911" status: 404 len: 62 microversion: 2.1 time: 0.033882 Oct 28 09:53:43.393321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 403/804] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/images/a1e64622-42f0-4485-bf72-59b6c43cd0911 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:53:43.395395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b33764e1-1916-44f2-9550-39891731a6e8 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Calling method '.version_select at 0x7fca33eb0700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.396652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.397352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:43.406321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.406321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.406321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.406960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.407227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.407614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.423512 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b33764e1-1916-44f2-9550-39891731a6e8 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] HTTP exception thrown: Image not found. Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b33764e1-1916-44f2-9550-39891731a6e8 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Request method failure captured: Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/tempest-invalid-1166871923 HTTP/1.1 Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6amBlkYk5HQpxf9OuZUSg6hKmXNfcrR63vFPlWhb6QuBMSdEqJOHi9trUowJvwY3YktDMkqFY9RjTPdL9ATRpBronPHtBc-LZg9z69o35fPhhVyXbDWBDX9yJte-tFzkk_NKcapJFUu8ykP29EpAHbVJSBy-Z4oOxY8BPPsafidcmE Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:43.425360 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ea35e35fa5d46d88631ebdea3befcfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ea35e35fa5d46d88631ebdea3befcfa"}]}] Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2d3eb659dfce47439521ebc65c7c7505 Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'tempest-invalid-1166871923'} Oct 28 09:53:43.427233 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1166871923 to delete Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.428099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1166871923 could not be found. Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.429298 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b33764e1-1916-44f2-9550-39891731a6e8 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.431237 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b33764e1-1916-44f2-9550-39891731a6e8 tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] 10.222.0.16 "DELETE /compute/v2.1/images/tempest-invalid-1166871923" status: 404 len: 62 microversion: 2.1 time: 0.036251 Oct 28 09:53:43.432190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 404/805] 10.222.0.16 () {58 vars in 1206 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/images/tempest-invalid-1166871923 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:53:43.442988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7161531-b36b-42aa-b30a-3440d84421ef tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Calling method '.version_select at 0x7fca33877f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.448085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:53:43.470308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f7161531-b36b-42aa-b30a-3440d84421ef tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] HTTP exception thrown: Image not found. Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7161531-b36b-42aa-b30a-3440d84421ef tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Request method failure captured: Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/81dc99b8-a0f3-4571-898d-6d01190423d6 HTTP/1.1 Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6amBlkYk5HQpxf9OuZUSg6hKmXNfcrR63vFPlWhb6QuBMSdEqJOHi9trUowJvwY3YktDMkqFY9RjTPdL9ATRpBronPHtBc-LZg9z69o35fPhhVyXbDWBDX9yJte-tFzkk_NKcapJFUu8ykP29EpAHbVJSBy-Z4oOxY8BPPsafidcmE Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:53:43.472130 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1ea35e35fa5d46d88631ebdea3befcfa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1ea35e35fa5d46d88631ebdea3befcfa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1ea35e35fa5d46d88631ebdea3befcfa"}]}] Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1ea35e35fa5d46d88631ebdea3befcfa Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207 Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2d3eb659dfce47439521ebc65c7c7505 Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1365177207-project Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '81dc99b8-a0f3-4571-898d-6d01190423d6'} Oct 28 09:53:43.475444 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 81dc99b8-a0f3-4571-898d-6d01190423d6 to delete Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.477388 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 81dc99b8-a0f3-4571-898d-6d01190423d6 could not be found. Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:43.482070 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7161531-b36b-42aa-b30a-3440d84421ef tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:43.483244 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7161531-b36b-42aa-b30a-3440d84421ef tempest-ImagesDeleteNegativeTestJSON-1365177207 tempest-ImagesDeleteNegativeTestJSON-1365177207-project] 10.222.0.16 "DELETE /compute/v2.1/images/81dc99b8-a0f3-4571-898d-6d01190423d6" status: 404 len: 62 microversion: 2.1 time: 0.038525 Oct 28 09:53:43.484255 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 405/806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/images/81dc99b8-a0f3-4571-898d-6d01190423d6 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:53:43.526561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:43.527401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.528528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:43.543899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.544493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.545023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.546095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.546570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.547005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.574193 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-79ac380e-6ef8-4067-90fb-1ab8d88e8837 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 204 len: 0 microversion: 2.1 time: 0.181844 Oct 28 09:53:43.583666 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 402/807] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:43 2022] DELETE /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:43.600701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.601943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:43.615573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.616063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.616723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.617859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.619463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.620309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.858815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:43.868104 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d5ae258-4b32-493d-be65-f4167bbbe815 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1648 microversion: 2.1 time: 0.281886 Oct 28 09:53:43.868560 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 403/808] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:43 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1648 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:43.888442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:43.889434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:43.896050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.896416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.897148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:43.897869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:43.899234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:43.899234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.099617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.109698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:44.113670 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5160323d-533f-4716-a6f6-a0599f7d864f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.599995 Oct 28 09:53:44.114968 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 406/809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:43 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:44.120098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:44.121250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:44.134262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.134815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.135260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.135990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.137192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.137631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.150146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.163926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.165996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.169299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9af7684d-9e84-4fcb-947d-f60cd9ef3f95 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1361 microversion: 2.25 time: 0.284825 Oct 28 09:53:44.170200 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 404/810] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:43 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:44.314005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.324796 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a833cbce-23fe-4c70-8418-105b7f187aa6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.208499 Oct 28 09:53:44.326673 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 407/811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:44 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:44.327922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:44.328767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:44.336431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.337852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.338448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.339865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.340321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.340944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.539219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:44.554990 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eab1d175-c212-4cd9-87b1-1a296863dc33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.232004 Oct 28 09:53:44.569470 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 405/812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:44 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:44.891727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:44.892649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:44.899668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.900170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.900963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:44.901451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:44.902484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:44.902917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.076145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.085529 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a313987-15c4-49d3-9fdb-e4d3735ff558 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1648 microversion: 2.1 time: 0.197941 Oct 28 09:53:45.086712 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 408/813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:44 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1648 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:45.138265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.138773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.146512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.147391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.148364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.149305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.149935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.150551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.197993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.199392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.216626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.217193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.217630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.218377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.218860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.219289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.393052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.412401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-702670ea-306e-46d8-9cda-7f29c2d90877 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.269474 Oct 28 09:53:45.412401 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 406/814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:45 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:45.421629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.424942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.437247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.437776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.438585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.439608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.440077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.440750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.471579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.488424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.492680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.495051 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b24e588-c672-4a36-9ff0-40187c9172c9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1558 microversion: 2.25 time: 0.302228 Oct 28 09:53:45.504966 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 409/815] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:45 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1558 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:45.625616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.640045 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf206347-7a20-49f4-9bb6-3d33d37acbf3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.235446 Oct 28 09:53:45.657326 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 407/816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:45 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:45.662986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.663896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.671778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.672271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.672931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.673851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.674310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.675035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.845580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:45.858844 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8d1c901b-7dd6-4f31-ad97-288e647d5930 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.199845 Oct 28 09:53:45.873561 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 408/817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:45 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:45.933632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:45.934613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:45.941736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.942707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.943240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:45.944080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:45.944778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:45.945496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.114201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:46.115041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:46.124510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.125086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.125949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.126966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.127508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.128066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.260156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 439c52f5-ba7c-4756-916f-ac9323d6303d {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:46.328456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:46.331325 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1abf706-d10b-4fa6-8aa0-82fdb166ee6e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 2044 microversion: 2.25 time: 0.811771 Oct 28 09:53:46.332454 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 410/818] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:45 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 2044 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:46.337826 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30c682e3-2b3e-4718-8ffe-bdd24e8528d0 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1648 microversion: 2.1 time: 0.229586 Oct 28 09:53:46.338953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 409/819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:46 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1648 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:46.358467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:46.358733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:46.365881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.365881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.366244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.366971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.367436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.367881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.428111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:46.429180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:46.436365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.437264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.437798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.438709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.439368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.440036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.619836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:46.635545 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3779b66-1c47-4535-a9c6-85199d3a3548 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.211307 Oct 28 09:53:46.637851 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 410/820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:46 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:46.658836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 439c52f5-ba7c-4756-916f-ac9323d6303d {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:46.675052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d11d184d-266b-4c0a-8521-767cff5ed6c0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 2044 microversion: 2.25 time: 0.321043 Oct 28 09:53:46.688933 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 411/821] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:46 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 2044 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:46.689137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:46.689137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:46.690502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.691288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.691953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.693342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.694051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.695207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.704113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:46.708039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.708533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.709000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.713047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.714502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.716241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.765176 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ca7e64b-cc71-4ddd-b052-77ec617371bc tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 418 microversion: 2.25 time: 0.067063 Oct 28 09:53:46.765799 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 412/822] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 09:53:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 418 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:53:46.778476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-zed-1", "block_migration": "auto"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:46.781301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:46.798808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.799685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.800229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.802755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:46.803478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:46.804147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:46.855353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'flavor' on Instance uuid 439c52f5-ba7c-4756-916f-ac9323d6303d {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:46.873151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Going to try to live migrate instance to n-h1-zed-1 {{(pid=128748) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:53:46.929975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:46.939428 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24bab66a-58f9-40f7-b926-a9e89f4daaaa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.275992 Oct 28 09:53:46.953486 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 411/823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:46 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:47.101078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Action: 'update', calling method: .version_select at 0x7fca33abb820>, body: {"quota_set": {"ram": "5120"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:47.204508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.211606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.212697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.213568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.214042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.214520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.283477 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af0858ba-14e6-42ce-9f6a-cac2c4fcb34d tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8" status: 200 len: 240 microversion: 2.36 time: 0.328523 Oct 28 09:53:47.290743 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 412/824] 10.222.0.16 () {62 vars in 1303 bytes} [Fri Oct 28 09:53:46 2022] PUT /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8 => generated 240 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:47.296679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7b5ba5db-5d14-49ef-b6cc-e94a3a89ba2a req-0789670c-bb98-493c-b2a2-138f2977f625 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e315df11-58a5-4ed8-98b2-0077c5ab20ee", "name": "network-vif-deleted", "tag": "c3c34cfd-4412-4272-92b8-e0b27f33eb05"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:47.311924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7b5ba5db-5d14-49ef-b6cc-e94a3a89ba2a req-0789670c-bb98-493c-b2a2-138f2977f625 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.312427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7b5ba5db-5d14-49ef-b6cc-e94a3a89ba2a req-0789670c-bb98-493c-b2a2-138f2977f625 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.312861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7b5ba5db-5d14-49ef-b6cc-e94a3a89ba2a req-0789670c-bb98-493c-b2a2-138f2977f625 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.342491 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7b5ba5db-5d14-49ef-b6cc-e94a3a89ba2a req-0789670c-bb98-493c-b2a2-138f2977f625 service nova] Creating event network-vif-deleted:c3c34cfd-4412-4272-92b8-e0b27f33eb05 for instance e315df11-58a5-4ed8-98b2-0077c5ab20ee on n-h2-zed-1 Oct 28 09:53:47.348178 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7b5ba5db-5d14-49ef-b6cc-e94a3a89ba2a req-0789670c-bb98-493c-b2a2-138f2977f625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055871 Oct 28 09:53:47.348801 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 413/825] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:47.354221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.357057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:47.361715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.362212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.362656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.365224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.365851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.366179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.539158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:47.547699 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5253716-dfab-4778-9160-fada6be8e923 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.197674 Oct 28 09:53:47.548273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 414/826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:47 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:47.552672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-961d4053-1b14-4d32-a97f-37cf05a60722 req-a30e7112-1fa4-46c2-bad8-669f6e61928c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cc4e4d-4dff-444f-ac54-f4821dccae07", "name": "network-vif-plugged", "status": "completed", "tag": "aaabdd70-5e8c-41df-8b5d-9902110dc424"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:47.562435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-961d4053-1b14-4d32-a97f-37cf05a60722 req-a30e7112-1fa4-46c2-bad8-669f6e61928c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.563027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-961d4053-1b14-4d32-a97f-37cf05a60722 req-a30e7112-1fa4-46c2-bad8-669f6e61928c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.563462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-961d4053-1b14-4d32-a97f-37cf05a60722 req-a30e7112-1fa4-46c2-bad8-669f6e61928c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.575522 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-961d4053-1b14-4d32-a97f-37cf05a60722 req-a30e7112-1fa4-46c2-bad8-669f6e61928c service nova] Creating event network-vif-plugged:aaabdd70-5e8c-41df-8b5d-9902110dc424 for instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 on n-h1-zed-1 Oct 28 09:53:47.580303 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-961d4053-1b14-4d32-a97f-37cf05a60722 req-a30e7112-1fa4-46c2-bad8-669f6e61928c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030932 Oct 28 09:53:47.580930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 415/827] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:47.585812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Calling method '.version_select at 0x7fca33a585e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.639562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:47.649730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.650212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.650650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.651377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.652378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.652805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.676369 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-94d7ae54-8412-4e14-9900-94a23f56b1fc tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8/detail" status: 200 len: 672 microversion: 2.36 time: 0.094240 Oct 28 09:53:47.677018 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 416/828] 10.222.0.16 () {60 vars in 1304 bytes} [Fri Oct 28 09:53:47 2022] GET /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8/detail => generated 672 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:47.681775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.682537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:47.688614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.689141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.689659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.690276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.690722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.691145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.723425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.723910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.724345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.724790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lazy-loading 'fault' on Instance uuid e315df11-58a5-4ed8-98b2-0077c5ab20ee {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:47.773223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:47.782448 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c60af9c-f426-4ec4-839f-3cdc085c2bff tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1306 microversion: 2.1 time: 0.104388 Oct 28 09:53:47.792943 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 417/829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:47 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1306 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:47.792943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98dfb9d6-996e-4c7f-a23e-8dc6bf1d1542 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33abb820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.838246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98dfb9d6-996e-4c7f-a23e-8dc6bf1d1542 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/ce50a6d2-1a90-4df0-bcc8-33f9774ba089" status: 200 len: 662 microversion: 2.1 time: 0.053164 Oct 28 09:53:47.838830 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 418/830] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:47 2022] GET /compute/v2.1/images/ce50a6d2-1a90-4df0-bcc8-33f9774ba089 => generated 662 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:47.844145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:47.844763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:47.851595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.852084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.852524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.853252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:47.853714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:47.854142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:47.985766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:47.993434 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-199eaa91-e8db-4fe5-9ea3-ffb201096256 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.153002 Oct 28 09:53:47.994004 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 419/831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:47 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:47.998391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Action: 'update', calling method: .version_select at 0x7fca33ab1ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:48.058941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.059420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.059851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.060568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.061045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.061467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.093905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.094377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.094820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.095521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.095969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.096389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.147310 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-949b38cc-2539-4f77-ac5f-bc2dc225d42e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8?user_id=59224bcfc2f642eab39e59216fc0e682" status: 200 len: 240 microversion: 2.36 time: 0.152252 Oct 28 09:53:48.154229 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 420/832] 10.222.0.16 () {62 vars in 1384 bytes} [Fri Oct 28 09:53:47 2022] PUT /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8?user_id=59224bcfc2f642eab39e59216fc0e682 => generated 240 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:48.154229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-35c6f94c-313b-4752-b944-86190d9e9ca2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3371b4c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:48.192924 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-35c6f94c-313b-4752-b944-86190d9e9ca2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/ce50a6d2-1a90-4df0-bcc8-33f9774ba089" status: 200 len: 662 microversion: 2.1 time: 0.043902 Oct 28 09:53:48.193502 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 421/833] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:48 2022] GET /compute/v2.1/images/ce50a6d2-1a90-4df0-bcc8-33f9774ba089 => generated 662 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:48.198230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:48.198586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:48.205368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.205861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.206308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.207017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.207475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.207906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.343822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:48.351462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce3baf14-a148-4eb4-bb1c-412b0ea346d2 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.156986 Oct 28 09:53:48.352022 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 422/834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:48 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:48.356554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c1b31950-557c-4660-a34e-616c79a2053e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] Calling method '.version_select at 0x7fca33a58a60>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:48.429868 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c1b31950-557c-4660-a34e-616c79a2053e tempest-QuotasAdminTestV236-562872917 tempest-QuotasAdminTestV236-562872917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8?user_id=59224bcfc2f642eab39e59216fc0e682" status: 200 len: 282 microversion: 2.36 time: 0.076780 Oct 28 09:53:48.430451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 423/835] 10.222.0.16 () {60 vars in 1364 bytes} [Fri Oct 28 09:53:48 2022] GET /compute/v2.1/os-quota-sets/185b02aab0664605b27f84cdf7b357d8?user_id=59224bcfc2f642eab39e59216fc0e682 => generated 282 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:53:48.576641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:48.577299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:48.584252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.584929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.585672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.587043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.587950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.588763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.737085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:48.745348 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2a7762a6-165a-4ee0-ae10-18471e2c5f91 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.176795 Oct 28 09:53:48.746523 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 424/836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:48 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:48.809525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:48.810069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:48.816123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.816621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.817116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.817826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.818283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.818716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.822824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:48.851673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:48.852168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:48.852617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:48.853101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lazy-loading 'fault' on Instance uuid e315df11-58a5-4ed8-98b2-0077c5ab20ee {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:48.899206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:48.907609 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-814cf047-6878-4352-b4d7-809a025bd420 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1306 microversion: 2.1 time: 0.102794 Oct 28 09:53:48.908189 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 425/837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:48 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1306 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:49.016282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.016930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:49.022984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.023474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.023910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.024782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.025285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.025776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.169304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:49.178313 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5fc3683c-094c-4f0f-ba7b-86372363732a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1310 microversion: 2.1 time: 0.165721 Oct 28 09:53:49.178886 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 426/838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:49 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1310 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:49.374875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.375568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:49.383258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.383715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.384362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.385216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.385788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.387017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.579004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:49.598519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85985902-b0db-4117-8ef4-1b32e9cda727 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.227443 Oct 28 09:53:49.599603 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 427/839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:49 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:49.770286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:49.770923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:49.783497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.783990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.784441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:49.785412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:49.786266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:49.787613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.039436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.052224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e8a0036b-0b73-43fc-9adc-1901b9d9961f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.286154 Oct 28 09:53:50.053259 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 428/840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:49 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:53:50.059812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-775b2448-c875-47e6-940a-9d1583a633ba tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca339f7af0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.113367 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-775b2448-c875-47e6-940a-9d1583a633ba tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/cfa1019c-3456-498f-a0d7-ecea518f879e" status: 200 len: 662 microversion: 2.1 time: 0.058623 Oct 28 09:53:50.114331 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 429/841] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/images/cfa1019c-3456-498f-a0d7-ecea518f879e => generated 662 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:50.125745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.127226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:50.136253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.136875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.137271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.137954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.138420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.139209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.190063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.190652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.191293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.191763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lazy-loading 'fault' on Instance uuid e315df11-58a5-4ed8-98b2-0077c5ab20ee {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:50.283467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7e06c8681bd48ce9422147f306cd27c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28e5a1214de9496d87b690d38ba80ea4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.291778 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a3fd1d8-c5e9-4741-a5fd-eacfbedec640 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 200 len: 1306 microversion: 2.1 time: 0.172799 Oct 28 09:53:50.305433 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 430/842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 1306 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:50.317858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26560a09-7989-4b2e-959b-3497e9f1877a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33ab11f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.382603 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-26560a09-7989-4b2e-959b-3497e9f1877a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/cfa1019c-3456-498f-a0d7-ecea518f879e" status: 200 len: 662 microversion: 2.1 time: 0.075725 Oct 28 09:53:50.383704 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 431/843] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/images/cfa1019c-3456-498f-a0d7-ecea518f879e => generated 662 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:50.388934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.389894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:50.397631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.398521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.399318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.400293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.401212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.402463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.481562 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-acfc0762-d201-41dd-818b-eb00e27fdb82 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d/action" status: 202 len: 0 microversion: 2.25 time: 3.706729 Oct 28 09:53:50.482780 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 413/844] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:53:46 2022] POST /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d/action => generated 0 bytes in 3709 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:53:50.492693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.493796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:50.516730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.517325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.517942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.518808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.519787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.520152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.582236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.594646 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3d019e1-8797-4649-8da5-a1e155200225 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1494 microversion: 2.1 time: 0.209522 Oct 28 09:53:50.595470 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 432/845] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1494 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:50.621327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.622446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:50.638734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.639267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.639970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.640735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.641450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.642096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.813512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2106b70-b819-4dc4-9807-0184bb2a10f0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1639 microversion: 2.1 time: 0.196117 Oct 28 09:53:50.814519 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 433/846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1639 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:50.821123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.822207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:50.837035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.837503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.838003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.838832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.840334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.840937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.849411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.858689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.865170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:50.866453 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd52d264-17b5-4c8d-9b9b-980f23325f91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.379360 Oct 28 09:53:50.867122 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 414/847] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:50.881754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:50.883743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:50.893698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.894309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.894754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:50.895899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:50.896365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:50.897901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.050074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:51.059441 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-28dcaedc-9f87-40f0-b5b4-5b1caeb96da3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.243224 Oct 28 09:53:51.060402 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 434/848] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:51.081730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:51.082477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:51.092142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.093429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.094169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.095721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.096588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.098086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.164621 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c1915b4-fe1a-4a54-a244-0ba1929b4b93 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1639 microversion: 2.1 time: 0.290869 Oct 28 09:53:51.181669 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 415/849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:50 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1639 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:51.196878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:51.203000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.205091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.205829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.206883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.207627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.209088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.257250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb0d9074-f583-4417-b086-894d9ecd4cb5 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 0.064515 Oct 28 09:53:51.268513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 416/850] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 09:53:51 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:51.274904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:51.276044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:51.284226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:51.285449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.286301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.287451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.288701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.289451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.290106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.294353 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ceb74082-dd03-4fbb-8a24-540d9f9a237e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.217877 Oct 28 09:53:51.295505 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 435/851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:51 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:51.321082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:51.322540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] [instance: e315df11-58a5-4ed8-98b2-0077c5ab20ee] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:51.332154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.332949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.333906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.334843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.335613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.336240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.359262 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] HTTP exception thrown: Instance e315df11-58a5-4ed8-98b2-0077c5ab20ee could not be found. Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Request method failure captured: Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee HTTP/1.1 Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Yy9TIBdte9RufhxYrnIKZzNyIj38K00Zy6y_DyJj7q_OsaMGEz81gva7ILjkpG0Nz8KGJtIs9pW19-N3tRrIQLgpbDSlUQMuZbCUk1XEGZ8lehLc1FgO1TsQHwbTa2MJ_7ERBITJiBNtsdskp-tjmpFlzj4oB8lPuGgHEGtnMQxxA Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:53:51.363997 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/28e5a1214de9496d87b690d38ba80ea4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_28e5a1214de9496d87b690d38ba80ea4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/28e5a1214de9496d87b690d38ba80ea4"}]}] Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 28e5a1214de9496d87b690d38ba80ea4 Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1889494508 Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a7e06c8681bd48ce9422147f306cd27c Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupsTestJSON-1889494508-project Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e315df11-58a5-4ed8-98b2-0077c5ab20ee could not be found. Oct 28 09:53:51.366397 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e315df11-58a5-4ed8-98b2-0077c5ab20ee'} Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e315df11-58a5-4ed8-98b2-0077c5ab20ee could not be found. Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:53:51.367144 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e315df11-58a5-4ed8-98b2-0077c5ab20ee could not be found. Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e315df11-58a5-4ed8-98b2-0077c5ab20ee could not be found. Oct 28 09:53:51.368334 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:53:51.373410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Returning 404 to user: Instance e315df11-58a5-4ed8-98b2-0077c5ab20ee could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:53:51.376364 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94d23933-5f7c-46b4-b80a-6f355340af9d tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07/action" status: 202 len: 0 microversion: 2.1 time: 0.105500 Oct 28 09:53:51.376593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f78228fe-8223-4e15-af53-1495d6d1f871 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee" status: 404 len: 111 microversion: 2.1 time: 0.058477 Oct 28 09:53:51.378422 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 417/852] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:51 2022] POST /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:51.381439 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 436/853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:51 2022] GET /compute/v2.1/servers/e315df11-58a5-4ed8-98b2-0077c5ab20ee => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:53:51.387525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:51.387718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-48c837a5-40f7-48aa-981b-3ef56c151a16 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33e3aa60>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:51.388641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:51.395750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.396259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.396763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.397777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.398141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.398577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.580144 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6fecf194-3271-449f-8730-58e4eb45362a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1644 microversion: 2.1 time: 0.197491 Oct 28 09:53:51.581277 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 437/854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:51 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1644 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:51.807141 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-48c837a5-40f7-48aa-981b-3ef56c151a16 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/189664d2-bb4a-40d1-8995-db87735d1d8f" status: 202 len: 0 microversion: 2.1 time: 0.424275 Oct 28 09:53:51.809301 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 418/855] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:51 2022] DELETE /compute/v2.1/os-security-groups/189664d2-bb4a-40d1-8995-db87735d1d8f => generated 0 bytes in 427 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:51.824242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5663b404-98f7-4b24-9491-8e86a704f5f6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] Calling method '.version_select at 0x7fca33863dc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:51.898133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:51.898957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:51.911240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.912017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.912664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:51.913588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:51.915355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:51.915967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.189282 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5663b404-98f7-4b24-9491-8e86a704f5f6 tempest-SecurityGroupsTestJSON-1889494508 tempest-SecurityGroupsTestJSON-1889494508-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/244ec2e3-a160-4bf7-93b5-119c9f04decf" status: 202 len: 0 microversion: 2.1 time: 0.372722 Oct 28 09:53:52.191543 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 438/856] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 09:53:51 2022] DELETE /compute/v2.1/os-security-groups/244ec2e3-a160-4bf7-93b5-119c9f04decf => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:52.206311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:52.208838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:52.221923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:52.233967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:52.235492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:52.236682 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-306ec458-43f5-4c5d-99a6-4cb9c2e7789c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.342701 Oct 28 09:53:52.237326 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 419/857] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:51 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:53:52.238858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.240137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.241115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.243847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.245305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.247149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.253223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fead4769-2d07-41b3-baf1-b53166e3c499 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33f480d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:52.326396 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fead4769-2d07-41b3-baf1-b53166e3c499 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/81e273d4-88a6-41a5-8177-4d7cbe124511" status: 200 len: 662 microversion: 2.1 time: 0.087758 Oct 28 09:53:52.335610 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 420/858] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:52 2022] GET /compute/v2.1/images/81e273d4-88a6-41a5-8177-4d7cbe124511 => generated 662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:52.335610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:52.335610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:52.342883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.343720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.344369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.345392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.345860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.346776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.681363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:52.690563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc013580-c7d7-42f3-ab37-1d4a803a9b61 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.362085 Oct 28 09:53:52.691236 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 421/859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:52 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:52.696763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c489d57c-00a7-4ad0-a1a5-7d057aff39d4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33e13670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:52.748212 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c489d57c-00a7-4ad0-a1a5-7d057aff39d4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/81e273d4-88a6-41a5-8177-4d7cbe124511" status: 200 len: 662 microversion: 2.1 time: 0.055222 Oct 28 09:53:52.757140 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 422/860] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:53:52 2022] GET /compute/v2.1/images/81e273d4-88a6-41a5-8177-4d7cbe124511 => generated 662 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:52.778883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:52.780087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:52.787119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.787622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.788243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.789009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.789766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.790206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.851875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:52.867149 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a0e7b38-2395-47d1-a6c0-b860d4bf8ed4 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.673495 Oct 28 09:53:52.870227 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 439/861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:52 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:52.895427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1946f5d3-fe8a-418f-98f1-5a32c2994510 req-fe46c014-281c-486e-b3c3-b926620dffd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439c52f5-ba7c-4756-916f-ac9323d6303d", "name": "network-vif-unplugged", "status": "completed", "tag": "e03e33d3-7264-4573-b3db-caf9a93bd750"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:52.921936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1946f5d3-fe8a-418f-98f1-5a32c2994510 req-fe46c014-281c-486e-b3c3-b926620dffd5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:52.928434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1946f5d3-fe8a-418f-98f1-5a32c2994510 req-fe46c014-281c-486e-b3c3-b926620dffd5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:52.929087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1946f5d3-fe8a-418f-98f1-5a32c2994510 req-fe46c014-281c-486e-b3c3-b926620dffd5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:52.945256 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1946f5d3-fe8a-418f-98f1-5a32c2994510 req-fe46c014-281c-486e-b3c3-b926620dffd5 service nova] Creating event network-vif-unplugged:e03e33d3-7264-4573-b3db-caf9a93bd750 for instance 439c52f5-ba7c-4756-916f-ac9323d6303d on n-h2-zed-1 Oct 28 09:53:52.952136 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1946f5d3-fe8a-418f-98f1-5a32c2994510 req-fe46c014-281c-486e-b3c3-b926620dffd5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078702 Oct 28 09:53:52.953362 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 440/862] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:52.960530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1122271823", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:53.075224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:53:53.290954 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb88e1b7-d8b1-4d32-8073-f2480b0d068e tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1624 microversion: 2.1 time: 0.532378 Oct 28 09:53:53.292842 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 423/863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:52 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1624 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:53.309577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c011192d-9a19-4a0d-a2f6-d57accf6052b req-3791e840-bfb5-4358-b00b-269c34716a3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2aae186-313a-4f4d-8751-52c9df62b486", "name": "network-vif-plugged", "status": "completed", "tag": "8803f705-6e47-4629-ad45-8006f013267d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:53.323097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c011192d-9a19-4a0d-a2f6-d57accf6052b req-3791e840-bfb5-4358-b00b-269c34716a3e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.324178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c011192d-9a19-4a0d-a2f6-d57accf6052b req-3791e840-bfb5-4358-b00b-269c34716a3e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.325225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c011192d-9a19-4a0d-a2f6-d57accf6052b req-3791e840-bfb5-4358-b00b-269c34716a3e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.330621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:53.342918 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c011192d-9a19-4a0d-a2f6-d57accf6052b req-3791e840-bfb5-4358-b00b-269c34716a3e service nova] Creating event network-vif-plugged:8803f705-6e47-4629-ad45-8006f013267d for instance a2aae186-313a-4f4d-8751-52c9df62b486 on n-h2-zed-1 Oct 28 09:53:53.352155 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c011192d-9a19-4a0d-a2f6-d57accf6052b req-3791e840-bfb5-4358-b00b-269c34716a3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057354 Oct 28 09:53:53.353328 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 424/864] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:53.361441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:53.363116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:53.372826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.373791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.374486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.375489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.376406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.377134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.486234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:53.486668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:53.487156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:53.487570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:53.488245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:53.498586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.499081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.499524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.500284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.500749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.501214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.521618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Getting quotas for project f80fef68c5b24dc8b5340141bc1f837d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:53:53.526544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Getting quotas for user dbd28dab6bef44c28e487a58cc99cb5c and project f80fef68c5b24dc8b5340141bc1f837d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:53:53.541582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:53:53.544698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:53:53.598045 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f9796d2c-88d4-4dab-80dd-6a4c05541ad6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.641506 Oct 28 09:53:53.609383 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 441/865] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:53:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:53:53.614593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-zed-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:53.618082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:53.626514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.627069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.627527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.628357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:53.628767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:53.629244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:53.662084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lazy-loading 'flavor' on Instance uuid f5cc4e4d-4dff-444f-ac54-f4821dccae07 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:53:53.679236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Going to try to live migrate instance to n-h2-zed-1 {{(pid=128747) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:53:54.059244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:54.078110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:54.080487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:54.082819 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9caa92a5-3cf6-40d0-8db0-e4d750b36ac0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.727806 Oct 28 09:53:54.102801 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 425/866] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:53 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:54.120413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:54.121391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:54.131142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:54.132218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:54.133328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:54.134888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:54.135676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:54.136699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:54.175904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:53:54.304022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:53:54.310980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75b34942-63d1-4653-b517-8d79d72341e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 204 len: 0 microversion: 2.1 time: 0.204230 Oct 28 09:53:54.311794 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 426/867] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:53:54 2022] DELETE /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:53:54.319919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:54.320944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:54.329092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:54.330145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:54.330717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:54.331806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:54.332509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:54.333371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:54.660837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:54.681160 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1979531a-1dff-49da-9cc1-236572dd7e49 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.367898 Oct 28 09:53:54.685760 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 427/868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:54 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:54.688261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1511470988", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:54.748002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:53:55.168519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:53:55.168958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:53:55.169680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:53:55.170114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:53:55.170608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:53:55.189039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:55.189544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:55.189995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:55.190744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:55.191212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:55.191759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:55.223605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Getting quotas for project f80fef68c5b24dc8b5340141bc1f837d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:53:55.236044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Getting quotas for user dbd28dab6bef44c28e487a58cc99cb5c and project f80fef68c5b24dc8b5340141bc1f837d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:53:55.258050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:53:55.260440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:53:55.390227 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e6c4aac4-8683-4d8f-b4a8-74bfd0b86e4e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705288 Oct 28 09:53:55.397795 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 428/869] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:53:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:53:55.411439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:55.413752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:55.438292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:55.439762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:55.440457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:55.454549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:55.455275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:55.456182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:55.957968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:55.968254 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-43c75534-89df-4be8-b429-b04989800ddc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.568972 Oct 28 09:53:55.968884 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 429/870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:55 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:55.978806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:55.979437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:56.000715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.001238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.001909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.002816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.003508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.004111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.258599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:56.271221 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8347a9a3-9cd0-4657-82ca-e2486ae6d2f2 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1709 microversion: 2.1 time: 0.296314 Oct 28 09:53:56.284940 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 430/871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:55 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1709 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:56.284940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-da79e47a-5fbd-48df-a281-757e19bc8326 req-29ccce60-7a7a-4174-bbcb-0d056c3d7e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "439c52f5-ba7c-4756-916f-ac9323d6303d", "tag": "e03e33d3-7264-4573-b3db-caf9a93bd750"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:53:56.288842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-da79e47a-5fbd-48df-a281-757e19bc8326 req-29ccce60-7a7a-4174-bbcb-0d056c3d7e16 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.288842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-da79e47a-5fbd-48df-a281-757e19bc8326 req-29ccce60-7a7a-4174-bbcb-0d056c3d7e16 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.288842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-da79e47a-5fbd-48df-a281-757e19bc8326 req-29ccce60-7a7a-4174-bbcb-0d056c3d7e16 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.308863 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-da79e47a-5fbd-48df-a281-757e19bc8326 req-29ccce60-7a7a-4174-bbcb-0d056c3d7e16 service nova] Creating event network-changed:e03e33d3-7264-4573-b3db-caf9a93bd750 for instance 439c52f5-ba7c-4756-916f-ac9323d6303d on n-h2-zed-1 Oct 28 09:53:56.315413 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-da79e47a-5fbd-48df-a281-757e19bc8326 req-29ccce60-7a7a-4174-bbcb-0d056c3d7e16 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041808 Oct 28 09:53:56.318190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 431/872] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:53:56.324438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:56.325192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:56.335937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.336506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.336991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.337738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.338211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.338678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.522199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:56.533387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:56.534881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:56.536169 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73fd35b8-623e-4e2f-b12d-36a3631d39ad tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.216604 Oct 28 09:53:56.537007 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 432/873] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:56 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:53:56.565407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:56.566204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:56.587482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.588507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.589082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.596474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.597792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.598976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.741715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:56.755822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b67a99b4-5ffb-41cc-b032-723dd3ece931 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1222 microversion: 2.1 time: 0.212983 Oct 28 09:53:56.756440 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 433/874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:56 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1222 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:56.777541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:56.778187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:56.795441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.796211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.796661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:56.797432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:56.797903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:56.798345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.203817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:57.213301 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a6d2701a-5aeb-40e7-8f21-d35ac3101c3d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.440135 Oct 28 09:53:57.214287 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 434/875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:56 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:57.236995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:57.238054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:57.247267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.248105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.249074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.250642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.251958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.252638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.880251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:57.919455 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7022a00b-8ec6-4fd2-b10a-28c9916e4f89 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1316 microversion: 2.1 time: 0.688417 Oct 28 09:53:57.920288 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 435/876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:57 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1316 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:57.958896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:57.961752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:57.976540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.978943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.979880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:57.982142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:57.983403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:57.984048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:58.702066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:58.720062 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb5bc550-a9d0-4458-bc9c-39b5197bd925 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1709 microversion: 2.1 time: 0.796675 Oct 28 09:53:58.720062 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 436/877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:57 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1709 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:58.738792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:58.748845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:58.775919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:58.778981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:58.779809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:58.782011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:58.783768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:58.785819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:59.494779 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef0c1925-e935-4143-ae69-7e2c1d061d50 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07/action" status: 202 len: 0 microversion: 2.1 time: 5.884077 Oct 28 09:53:59.496394 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 442/878] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:53:53 2022] POST /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07/action => generated 0 bytes in 5886 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:53:59.502072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:59.502979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:59.523593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:59.524372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:59.525058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:59.526002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:59.527205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:59.527818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:59.686662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:53:59.695157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ae56540-6d8d-4087-8e62-d7f2765263a6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1270 microversion: 2.1 time: 0.197332 Oct 28 09:53:59.695989 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 443/879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:59 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1270 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:53:59.717609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:53:59.718537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:53:59.726044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:59.726842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:59.727462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:59.728460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:53:59.729158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:53:59.729818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:53:59.755881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:00.220870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:00.236685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:00.240730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:00.243937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d2079b0a-b947-471a-bab9-e9b28d26e8c2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 1.509242 Oct 28 09:54:00.245967 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 437/880] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:53:58 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:00.298766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:00.299866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:00.315878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:00.318222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:00.324069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:00.325993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:00.337355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:00.338323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:00.421408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:00.440438 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e597a39d-2cdd-41be-912e-7b7cfcba40ca tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.729646 Oct 28 09:54:00.441583 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 444/881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:53:59 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:00.450114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:00.451039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:00.454697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:00.464045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:00.464869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:00.467623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:00.468926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:00.469411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:00.470071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.061259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:01.080056 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24340890-3248-4da0-a3d6-a412d02be27a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.636739 Oct 28 09:54:01.080665 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 445/882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:00 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:01.114368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:01.115836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:01.134600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.135077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.135524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.136351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.136820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.143636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.392193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:01.420062 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca588b80-ee01-4e70-add4-f25fd2730eaf tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1466 microversion: 2.1 time: 1.169666 Oct 28 09:54:01.420878 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 438/883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:00 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1466 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:01.440718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:01.441444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:01.449493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.450010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.450461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.455817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:01.456311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.456821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.457803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.466337 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-810ff7a5-74b1-43b7-bf3d-3a770a7c014a tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1643 microversion: 2.1 time: 0.372862 Oct 28 09:54:01.466940 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 446/884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:01 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1643 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:01.484241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:01.485417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:01.507035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.508027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.508646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.510697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.511988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.512621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.622516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:01.649128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3c7ba92-7338-415d-a06f-f8f06365eb93 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1276 microversion: 2.1 time: 0.225649 Oct 28 09:54:01.650164 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 439/885] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:01 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1276 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:01.659620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:01.660657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:01.674586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.675499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.676656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:01.680448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:01.681794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:01.682839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:02.082715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:02.095852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:02.097695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:02.102251 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80dfa5a7-9cd4-494d-ae12-d2b2e5327f5f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.634265 Oct 28 09:54:02.103478 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 447/886] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:01 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:02.117109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:02.118140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:02.140882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:02.141868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:02.142561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:02.144439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:02.145229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:02.145909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:02.288795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-801557b5-40af-438d-94af-ddcd632b54b1 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1611 microversion: 2.1 time: 0.636832 Oct 28 09:54:02.291228 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 440/887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:01 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1611 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:02.318633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:02.323933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:02.355766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:02.355766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:02.355766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:02.356298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:02.356298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:02.362023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:02.389436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:02.614147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:02.623490 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe45cb08-d7ae-48f2-8c7e-aa5234823037 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1543 microversion: 2.1 time: 0.517777 Oct 28 09:54:02.642591 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 448/888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:02 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1543 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:02.648069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:02.649105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:02.656851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:02.657903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:02.658612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:02.659592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:02.660314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:02.661064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:02.981910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:02.997194 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f63e1a0d-8405-457d-848a-305dea91f56b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.701844 Oct 28 09:54:02.999625 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 441/889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:02 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:03.020772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1407392104", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["05112b40-6767-428e-8884-474dd5e18ae9"]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:03.142119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:54:03.380700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a60610c78b5844f78f3ac3a7d421df53', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4dca7afa40438cba45411cead48103', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:03.420694 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e40dc797-c978-4ec9-a6b3-75f92a7e3144 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 200 len: 1643 microversion: 2.1 time: 0.772964 Oct 28 09:54:03.425286 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 449/890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:02 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 1643 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:03.453776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:03.456192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:03.483896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:03.488300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:03.489552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:03.492417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:03.493683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:03.495293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:03.561437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=11 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:03.565512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=32 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:04.103132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:04.117919 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12b1cba1-22cd-4cee-9b57-ab91a1d65e45 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.677757 Oct 28 09:54:04.118410 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 450/891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:03 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:04.124372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-07ffd74e-3bb3-4806-aedb-f03f310d0ce4 req-dce5c79e-afcf-4dba-8ad0-a96882ff5382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18fa029b-3f20-4349-818b-d177d0e8b0d0", "name": "network-vif-deleted", "tag": "c056cd56-d958-460c-9dfa-be289a2b2478"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:04.152285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-07ffd74e-3bb3-4806-aedb-f03f310d0ce4 req-dce5c79e-afcf-4dba-8ad0-a96882ff5382 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:04.155646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-07ffd74e-3bb3-4806-aedb-f03f310d0ce4 req-dce5c79e-afcf-4dba-8ad0-a96882ff5382 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:04.161795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-07ffd74e-3bb3-4806-aedb-f03f310d0ce4 req-dce5c79e-afcf-4dba-8ad0-a96882ff5382 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:04.194338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-07ffd74e-3bb3-4806-aedb-f03f310d0ce4 req-dce5c79e-afcf-4dba-8ad0-a96882ff5382 service nova] Creating event network-vif-deleted:c056cd56-d958-460c-9dfa-be289a2b2478 for instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 on n-h2-zed-1 Oct 28 09:54:04.210267 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-07ffd74e-3bb3-4806-aedb-f03f310d0ce4 req-dce5c79e-afcf-4dba-8ad0-a96882ff5382 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086729 Oct 28 09:54:04.212145 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 451/892] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:04.224614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:04.225918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:04.239647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:04.240672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:04.241631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:04.243174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:04.244315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:04.245418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:04.893347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:04.918655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:04.920686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:04.922660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b1f1c18-31ea-4235-aae6-691bc628c2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.707583 Oct 28 09:54:04.923920 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 452/893] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:04 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:04.929755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:04.930710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:04.939300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:04.940250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:04.941136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:04.942159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:04.942884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:04.943612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.200587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:05.247698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:05.415733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:54:05.416173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:54:05.416651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:54:05.417111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:54:05.419220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:54:05.455236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.456052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.460428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.463587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.473560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.474111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.514355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:05.532115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:05.560517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:54:05.567087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:54:05.647667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:05.657181 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-27863f28-59f8-4436-8958-06b8993e7c79 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1542 microversion: 2.1 time: 0.731578 Oct 28 09:54:05.678711 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 453/894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:04 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1542 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:05.683733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:05.684767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:05.699769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.702882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.703508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.703717 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6faecb18-d42c-4602-b492-001cc55ae360 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.701147 Oct 28 09:54:05.704445 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 442/895] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:54:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:54:05.714906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.719559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:05.720500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:05.721734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.722777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.727854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.728636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.729294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.730840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.731488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.732086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.780296 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] HTTP exception thrown: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Request method failure captured: Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 HTTP/1.1 Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XYan4f6OakDdTGuZ1QUbmqPKLeEKQBL69kZcF8GvkbLF-xl_GOD6I226GRTmx1BCmHtDNgr0QX3rSWyN7tKVA4NyaUCBGCLeiCTTtY7M7hbmCLNLw5sPRqodjL5MFBk5S0GRjutbPtdhXJ-0ehUhVwOReHoHC6RNOrEToBtn4OY40 Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:54:05.800140 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f4dca7afa40438cba45411cead48103", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f4dca7afa40438cba45411cead48103"}]}] Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a60610c78b5844f78f3ac3a7d421df53 Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:05.802631 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '18fa029b-3f20-4349-818b-d177d0e8b0d0'} Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:05.803646 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:05.805993 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:05.808841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Returning 404 to user: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:05.810076 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b11ba94f-1681-4542-89e5-79d3f9df6e8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 404 len: 111 microversion: 2.1 time: 0.102023 Oct 28 09:54:05.811519 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 443/896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:05 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:05.818675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:05.819560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:05.843185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.847396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.848073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:05.849036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:05.849867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:05.850598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:06.308618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:06.342508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca43ae0b-5a54-4d32-abae-94ed7ab03592 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.662429 Oct 28 09:54:06.343770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 454/897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:05 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:06.353571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3dcdffaa-02de-4f20-a50e-b7bb90496842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:06.355335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3dcdffaa-02de-4f20-a50e-b7bb90496842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:06.524606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3dcdffaa-02de-4f20-a50e-b7bb90496842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:06.533471 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3dcdffaa-02de-4f20-a50e-b7bb90496842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1217 microversion: 2.1 time: 0.188127 Oct 28 09:54:06.534909 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 455/898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:06 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1217 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:06.541345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:06.542249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:06.550911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:06.553688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:06.555304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:06.556551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:06.558061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:06.558763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:06.580285 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] HTTP exception thrown: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Request method failure captured: Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 HTTP/1.1 Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XYan4f6OakDdTGuZ1QUbmqPKLeEKQBL69kZcF8GvkbLF-xl_GOD6I226GRTmx1BCmHtDNgr0QX3rSWyN7tKVA4NyaUCBGCLeiCTTtY7M7hbmCLNLw5sPRqodjL5MFBk5S0GRjutbPtdhXJ-0ehUhVwOReHoHC6RNOrEToBtn4OY40 Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:54:06.583593 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f4dca7afa40438cba45411cead48103", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f4dca7afa40438cba45411cead48103"}]}] Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a60610c78b5844f78f3ac3a7d421df53 Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:06.585030 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '5ecfe35a-7658-4371-947c-581fc4879381'} Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:06.585784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:06.587003 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:06.592928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Returning 404 to user: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:06.594076 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a25ddee-5902-4ae0-b28c-32e4739802e8 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 404 len: 111 microversion: 2.1 time: 0.057768 Oct 28 09:54:06.595143 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 456/899] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:54:06 2022] DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:06.600707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:06.602448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:06.610428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:06.611261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:06.611960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:06.613341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:06.614165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:06.614919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:06.813751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:06.834853 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f3b09311-948d-45c8-90ac-306d55a13686 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 1.021665 Oct 28 09:54:06.851618 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 444/900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:05 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:06.858942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-65657301-09a6-4b17-a4dc-d4e353aae30b req-24a1e9e6-a99e-40ab-811c-ad1347781343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8fd254e-662a-4020-9421-b76fb300937d", "tag": "a53f8536-805c-4547-b056-8cc4428c8aba"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:06.890236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-65657301-09a6-4b17-a4dc-d4e353aae30b req-24a1e9e6-a99e-40ab-811c-ad1347781343 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:06.891103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-65657301-09a6-4b17-a4dc-d4e353aae30b req-24a1e9e6-a99e-40ab-811c-ad1347781343 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:06.891717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-65657301-09a6-4b17-a4dc-d4e353aae30b req-24a1e9e6-a99e-40ab-811c-ad1347781343 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:06.909550 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-65657301-09a6-4b17-a4dc-d4e353aae30b req-24a1e9e6-a99e-40ab-811c-ad1347781343 service nova] Creating event network-changed:a53f8536-805c-4547-b056-8cc4428c8aba for instance a8fd254e-662a-4020-9421-b76fb300937d on n-h2-zed-1 Oct 28 09:54:06.916840 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-65657301-09a6-4b17-a4dc-d4e353aae30b req-24a1e9e6-a99e-40ab-811c-ad1347781343 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063204 Oct 28 09:54:06.918539 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 445/901] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:06.926105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b5690ba8-033e-4690-8e18-ddf0b3e640a5 req-8ff1b6d8-2ab3-4f41-96b5-f5e1ef6d3fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cc4e4d-4dff-444f-ac54-f4821dccae07", "name": "network-vif-unplugged", "status": "completed", "tag": "aaabdd70-5e8c-41df-8b5d-9902110dc424"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:06.942561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b5690ba8-033e-4690-8e18-ddf0b3e640a5 req-8ff1b6d8-2ab3-4f41-96b5-f5e1ef6d3fb6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:06.943379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b5690ba8-033e-4690-8e18-ddf0b3e640a5 req-8ff1b6d8-2ab3-4f41-96b5-f5e1ef6d3fb6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:06.944185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b5690ba8-033e-4690-8e18-ddf0b3e640a5 req-8ff1b6d8-2ab3-4f41-96b5-f5e1ef6d3fb6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:06.973610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b5690ba8-033e-4690-8e18-ddf0b3e640a5 req-8ff1b6d8-2ab3-4f41-96b5-f5e1ef6d3fb6 service nova] Creating event network-vif-unplugged:aaabdd70-5e8c-41df-8b5d-9902110dc424 for instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 on n-h1-zed-1 Oct 28 09:54:06.988106 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b5690ba8-033e-4690-8e18-ddf0b3e640a5 req-8ff1b6d8-2ab3-4f41-96b5-f5e1ef6d3fb6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064821 Oct 28 09:54:07.007072 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 446/902] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:07.047698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:07.060955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:07.116025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.116548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.117035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:07.120541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.121067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.124891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:07.178321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] HTTP exception thrown: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Request method failure captured: Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 HTTP/1.1 Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XYan4f6OakDdTGuZ1QUbmqPKLeEKQBL69kZcF8GvkbLF-xl_GOD6I226GRTmx1BCmHtDNgr0QX3rSWyN7tKVA4NyaUCBGCLeiCTTtY7M7hbmCLNLw5sPRqodjL5MFBk5S0GRjutbPtdhXJ-0ehUhVwOReHoHC6RNOrEToBtn4OY40 Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:54:07.185910 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f4dca7afa40438cba45411cead48103", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f4dca7afa40438cba45411cead48103"}]}] Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a60610c78b5844f78f3ac3a7d421df53 Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:07.187631 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5ecfe35a-7658-4371-947c-581fc4879381'} Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:07.188543 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:07.190085 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:07.196097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Returning 404 to user: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:07.197382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-667027d5-3038-40fb-9c7d-ceaba4ced744 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 404 len: 111 microversion: 2.1 time: 0.188515 Oct 28 09:54:07.199187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:07.203358 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 447/903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:07 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:07.211463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:07.216552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:07.222128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:07.223897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:07.228062 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a12cd10b-3084-4477-a917-974c4fe16aff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.631515 Oct 28 09:54:07.234146 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 457/904] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:06 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:07.241109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c3e45fe-f78c-40fa-87f8-9f5255b34778 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '.version_select at 0x7fca33695790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:07.246149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.247113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.247927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:07.261584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.273255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.273255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:07.323944 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c3e45fe-f78c-40fa-87f8-9f5255b34778 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318270117" status: 202 len: 0 microversion: 2.1 time: 0.088078 Oct 28 09:54:07.329234 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 458/905] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 09:54:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1318270117 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:07.374990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:07.376055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:07.386751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.388031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.389353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:07.391016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.391709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.392390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:07.866760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:07.886067 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e08fdecd-d890-4b58-b4e2-a32fed14886d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.517354 Oct 28 09:54:07.886844 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 459/906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:07 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:07.909334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:07.909950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:07.948194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.954173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.955483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:07.957073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:07.957924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:07.961887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:08.242494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:08.257660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e9ed5a6b-bde5-4b57-9c22-9643a07a768e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1269 microversion: 2.1 time: 0.357628 Oct 28 09:54:08.272933 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 460/907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:07 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1269 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:08.272933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:08.272933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:08.282507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:08.283155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:08.283601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:08.285343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:08.286671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:08.287267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:08.633683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:08.648852 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e84f6fd-db45-4f7b-a7ad-e6b6a48bf273 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1542 microversion: 2.1 time: 1.442727 Oct 28 09:54:08.649585 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 448/908] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:07 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1542 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:08.660169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:08.661377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:08.686348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:08.687102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:08.688011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:08.689995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:08.690551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:08.691170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.009313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:09.021078 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c334f922-6a1d-4cb9-9cd7-f11915d14f9d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.754498 Oct 28 09:54:09.025975 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 461/909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:08 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:09.035094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:09.036002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:09.050344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.053323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.054105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.055744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.059470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.060334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.481027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:09.525313 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bdedcda-704e-4fc5-8ca0-b26b010e75eb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.495979 Oct 28 09:54:09.536554 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 462/910] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:09 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:09.581625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:09.610143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5ee36c21-2c29-484b-b1a2-cd8b4f2e326a req-40f6b046-0713-49f1-a231-f265fba2de4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54ac7f33-0abb-4958-8a4b-42eaec67578a", "tag": "e54700aa-52ee-4f0a-b07e-8955746bd325"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:09.611652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:09.622796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:09.624409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5ee36c21-2c29-484b-b1a2-cd8b4f2e326a req-40f6b046-0713-49f1-a231-f265fba2de4a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.625143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5ee36c21-2c29-484b-b1a2-cd8b4f2e326a req-40f6b046-0713-49f1-a231-f265fba2de4a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.625772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5ee36c21-2c29-484b-b1a2-cd8b4f2e326a req-40f6b046-0713-49f1-a231-f265fba2de4a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.626152 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9c38a858-0fba-4d8b-afd1-220c9f51b3b6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1568 microversion: 2.25 time: 0.975285 Oct 28 09:54:09.629317 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 449/911] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:08 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1568 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:09.658858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-338c6a8e-62b0-47ac-8dfe-6732a0928c1e req-bd6be91f-75a1-4bab-9026-c532b2568bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "name": "network-vif-unplugged", "status": "completed", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:09.666176 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5ee36c21-2c29-484b-b1a2-cd8b4f2e326a req-40f6b046-0713-49f1-a231-f265fba2de4a service nova] Creating event network-changed:e54700aa-52ee-4f0a-b07e-8955746bd325 for instance 54ac7f33-0abb-4958-8a4b-42eaec67578a on n-h2-zed-1 Oct 28 09:54:09.683938 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5ee36c21-2c29-484b-b1a2-cd8b4f2e326a req-40f6b046-0713-49f1-a231-f265fba2de4a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144911 Oct 28 09:54:09.685036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 463/912] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:09.697727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:09.698593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:09.698723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-338c6a8e-62b0-47ac-8dfe-6732a0928c1e req-bd6be91f-75a1-4bab-9026-c532b2568bf8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.699174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-338c6a8e-62b0-47ac-8dfe-6732a0928c1e req-bd6be91f-75a1-4bab-9026-c532b2568bf8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.699614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-338c6a8e-62b0-47ac-8dfe-6732a0928c1e req-bd6be91f-75a1-4bab-9026-c532b2568bf8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.715324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.716311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.717458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.721667 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-338c6a8e-62b0-47ac-8dfe-6732a0928c1e req-bd6be91f-75a1-4bab-9026-c532b2568bf8 service nova] Creating event network-vif-unplugged:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h2-zed-1 Oct 28 09:54:09.723249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.723863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.724417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.732287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-338c6a8e-62b0-47ac-8dfe-6732a0928c1e req-bd6be91f-75a1-4bab-9026-c532b2568bf8 service nova] Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:54:09.752299 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-338c6a8e-62b0-47ac-8dfe-6732a0928c1e req-bd6be91f-75a1-4bab-9026-c532b2568bf8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.119996 Oct 28 09:54:09.753913 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 450/913] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:09.774950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:09.775687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:09.799923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.801235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.801919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.802866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:09.806727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:09.807477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:09.858942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:09.861571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:09.877986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-68ba1f25-a5c4-4fec-a34e-453f83b2e095 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1275 microversion: 2.1 time: 0.191555 Oct 28 09:54:09.878803 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 464/914] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:09 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:10.137756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1279397735", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7104c522-8e80-4620-8f10-5dbfa96003cc"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:10.270477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] validate_networks() for [('7104c522-8e80-4620-8f10-5dbfa96003cc', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:54:10.414170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:10.423756 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a17acd4b-d59f-45a8-ab96-2ea8f8f52822 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1542 microversion: 2.1 time: 0.668139 Oct 28 09:54:10.437532 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 451/915] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:09 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1542 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:10.449571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:10.450604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:10.458540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:10.459430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:10.460092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:10.462090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:10.463241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:10.467062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:10.731464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:10.742165 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-798771b7-abef-4ae3-a249-023e8e87dc1d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.303015 Oct 28 09:54:10.743486 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 452/916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:10 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:10.764572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:10.766559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:10.774972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:10.776098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:10.776853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:10.777912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:10.779364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:10.780115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:11.499622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:54:11.500658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:54:11.501193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:54:11.501778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:54:11.502568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:54:11.521354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:11.522213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:11.523817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:11.525748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:11.526430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:11.528013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:11.576849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Getting quotas for project 57eeba8f69124206b8e6a8c8eb875c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:11.586244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:11.590963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Getting quotas for user a21c5e160ca7460d892ce593d4644240 and project 57eeba8f69124206b8e6a8c8eb875c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:11.611505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:54:11.615421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:54:11.616937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b6e33b1-7f1e-4b49-8d38-66d48912a6b4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.871660 Oct 28 09:54:11.618028 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 453/917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:10 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:11.655428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97128900-ce2f-4598-9351-d36a6f6c6cb3 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:11.708193 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97128900-ce2f-4598-9351-d36a6f6c6cb3 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/2060246220" status: 202 len: 0 microversion: 2.1 time: 0.080086 Oct 28 09:54:11.711768 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 454/918] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:54:11 2022] DELETE /compute/v2.1/flavors/2060246220 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:11.733357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:11.737834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:11.747237 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1ef01f5-22d0-4205-862f-d5327b20109a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.865371 Oct 28 09:54:11.765474 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 465/919] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:54:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:54:11.770175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:11.770685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:11.771131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:11.771869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:11.772339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:11.774919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:11.776325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:11.785992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:11.787223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:11.788249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:11.789066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:11.790160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:11.790944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:11.792018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:12.009568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:12.023793 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9e9e6c2d-dc41-44eb-96e6-7ae808ff8acc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1275 microversion: 2.1 time: 0.253636 Oct 28 09:54:12.043584 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 466/920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:11 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1275 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:12.052969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:12.054848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:12.070736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:12.071265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:12.071740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:12.074482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:12.074984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:12.075422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:12.446563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:12.459620 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8338d4da-08ae-45cc-9a0d-7d3ac519c30a tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1542 microversion: 2.1 time: 0.414651 Oct 28 09:54:12.464170 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 467/921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:12 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1542 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:12.474203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff2f9889-e3d4-43b3-b37b-4ceb4a668dc8 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:12.521030 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff2f9889-e3d4-43b3-b37b-4ceb4a668dc8 tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.050953 Oct 28 09:54:12.521569 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 468/922] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:54:12 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:12.532050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:12.532744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:12.540444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:12.541169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:12.541912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:12.543463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:12.544182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:12.544855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:12.690625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:12.712344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:12.716690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:12.719673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e38cec2f-5612-44b0-b008-4e80ccf63464 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1558 microversion: 2.25 time: 1.005243 Oct 28 09:54:12.721505 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 455/923] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:11 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1558 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:12.731779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-727231863", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7104c522-8e80-4620-8f10-5dbfa96003cc"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:12.909731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] validate_networks() for [('7104c522-8e80-4620-8f10-5dbfa96003cc', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:54:13.306598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:13.348957 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02c191dc-db73-40c3-a3a9-6db2444c5fc4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.825841 Oct 28 09:54:13.350593 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 469/924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:12 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:13.372849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}, {"name": "network-changed", "server_uuid": "f5cc4e4d-4dff-444f-ac54-f4821dccae07", "tag": "aaabdd70-5e8c-41df-8b5d-9902110dc424"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:13.414422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:13.421719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:13.423057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:13.462033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] Creating event network-changed:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h2-zed-1 Oct 28 09:54:13.462563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] Creating event network-changed:aaabdd70-5e8c-41df-8b5d-9902110dc424 for instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 on n-h1-zed-1 Oct 28 09:54:13.496417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:54:13.523388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-79c2d070-284b-4e83-9598-2f11fd6f558a req-ba4cecda-4dee-4941-a43b-bad650d66602 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.170698 Oct 28 09:54:13.525706 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 470/925] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:13.533773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-261e788a-c68a-4923-844f-5bcb0c361b3f tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:13.563395 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-261e788a-c68a-4923-844f-5bcb0c361b3f tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/544091907" status: 202 len: 0 microversion: 2.1 time: 0.033930 Oct 28 09:54:13.565684 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 471/926] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:54:13 2022] DELETE /compute/v2.1/flavors/544091907 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:13.585307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:13.593303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:13.620796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:13.622839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:13.623654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:13.625220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:13.626190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:13.627021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:13.814751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:54:13.817397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:54:13.818409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:54:13.822169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:54:13.823150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:54:13.853670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:13.857876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:13.858882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:13.860842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:13.861789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:13.862414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:13.944068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Getting quotas for project 57eeba8f69124206b8e6a8c8eb875c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:13.951375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:13.953849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Getting quotas for user a21c5e160ca7460d892ce593d4644240 and project 57eeba8f69124206b8e6a8c8eb875c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:13.978530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:54:13.983802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:54:14.076890 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf03ec0c-1598-4199-a981-d6dd7cd7bf5f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.353099 Oct 28 09:54:14.078514 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 456/927] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:54:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:54:14.086492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3dc883ee-f5ad-47a7-919c-f742e58a0cf9 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '.version_select at 0x7fca33ef9790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:14.103510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3dc883ee-f5ad-47a7-919c-f742e58a0cf9 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:14.107111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3dc883ee-f5ad-47a7-919c-f742e58a0cf9 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:14.108430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3dc883ee-f5ad-47a7-919c-f742e58a0cf9 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:14.150180 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3dc883ee-f5ad-47a7-919c-f742e58a0cf9 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2963 microversion: 2.25 time: 0.069942 Oct 28 09:54:14.162441 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 457/928] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 09:54:14 2022] GET /compute/v2.1/os-migrations => generated 2963 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:14.162672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:14.174720 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d855e08-f82e-4b4e-a1c4-29136e8c8b81 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.600474 Oct 28 09:54:14.177654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:14.178293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:14.180070 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 472/929] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:13 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:14.187096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:14.187704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:14.214109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:14.214622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:14.216585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:14.227056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:14.227857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:14.228803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:14.230461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:14.233397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:14.236733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:14.240545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:14.244730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:14.245338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:15.548999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:15.571610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c556cc24-ecc0-4972-9fa1-c767be492379 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 1.417579 Oct 28 09:54:15.578968 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 458/930] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:14 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:15.591131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1b64e4a-efa7-428b-a03d-670c6e0328ee tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:15.671089 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1b64e4a-efa7-428b-a03d-670c6e0328ee tempest-ServersWithSpecificFlavorTestJSON-1663689388 tempest-ServersWithSpecificFlavorTestJSON-1663689388-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090585 Oct 28 09:54:15.671962 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 459/931] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:54:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:15.693925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:15.699113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:15.715821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:15.716640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:15.717126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:15.718542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:15.719022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:15.719443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:15.746306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:15.780795 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f29a2e8-1d1f-4855-b206-c5ab79f9d835 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1542 microversion: 2.1 time: 1.596839 Oct 28 09:54:15.781976 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 473/932] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:14 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1542 bytes in 1601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:15.846991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-869608252", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "451", "networks": [{"uuid": "7104c522-8e80-4620-8f10-5dbfa96003cc"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:15.974137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] validate_networks() for [('7104c522-8e80-4620-8f10-5dbfa96003cc', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:54:16.365885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 439c52f5-ba7c-4756-916f-ac9323d6303d {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:54:16.392618 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-88c11320-9011-43f5-8623-e7e8520291bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 2044 microversion: 2.25 time: 0.719546 Oct 28 09:54:16.408943 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 460/933] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:15 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 2044 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:16.408943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:16.408943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:16.429665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:16.430532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:16.430691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:16.431391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:16.431937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:16.439129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:17.327346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:17.338979 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6e75fc5e-bf38-41e2-ad71-f1174502a8f5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.944084 Oct 28 09:54:17.342811 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 461/934] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:16 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:17.378885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:17.379809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:17.398549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:17.399326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:17.399875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:17.401878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:17.404669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:17.406505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.562347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:54:18.566621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:54:18.568571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:54:18.571355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:54:18.580712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:18.587096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:54:18.601308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1355dd39-f432-4167-bd38-2360c4fe453c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 1.238290 Oct 28 09:54:18.608875 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 462/935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:17 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:18.631016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.635096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.640891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:18.642516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.645250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:18.649209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.654437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.661978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.704214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.709775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.714324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.718147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.719159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.721955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.774517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Getting quotas for project 57eeba8f69124206b8e6a8c8eb875c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:18.782622 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] HTTP exception thrown: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:18.788409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Getting quotas for user a21c5e160ca7460d892ce593d4644240 and project 57eeba8f69124206b8e6a8c8eb875c6f. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Request method failure captured: Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 HTTP/1.1 Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XYan4f6OakDdTGuZ1QUbmqPKLeEKQBL69kZcF8GvkbLF-xl_GOD6I226GRTmx1BCmHtDNgr0QX3rSWyN7tKVA4NyaUCBGCLeiCTTtY7M7hbmCLNLw5sPRqodjL5MFBk5S0GRjutbPtdhXJ-0ehUhVwOReHoHC6RNOrEToBtn4OY40 Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:54:18.795772 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f4dca7afa40438cba45411cead48103", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f4dca7afa40438cba45411cead48103"}]}] Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a60610c78b5844f78f3ac3a7d421df53 Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:18.797957 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '18fa029b-3f20-4349-818b-d177d0e8b0d0'} Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:18.798857 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:18.803394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:18.810787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Returning 404 to user: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:18.825478 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2adac7b-02e5-4d58-b638-b1a672b48340 tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 404 len: 111 microversion: 2.1 time: 0.202034 Oct 28 09:54:18.826479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:54:18.828789 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 463/936] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:54:18 2022] DELETE /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:18.829074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:54:18.849080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1722612105", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7035122b-a147-4d22-80a1-0879f4691bf4"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:18.921038 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df58a82f-1cee-40cb-a024-0b00a87c03a7 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.087554 Oct 28 09:54:18.922749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 474/937] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:54:18.934038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:18.935044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:18.943819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.944665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.945333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:18.946276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:18.947232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:18.947892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:19.030026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] validate_networks() for [('7035122b-a147-4d22-80a1-0879f4691bf4', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:54:19.755125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:19.766060 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd4ed3ca-14c9-4ea8-a371-068c19962189 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.841817 Oct 28 09:54:19.781937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 475/938] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:18 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:19.788320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:19.789447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:19.797082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:19.809778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:19.810660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:19.811922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:19.812640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:19.813371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.191684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:54:20.192264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:54:20.193043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:54:20.193551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:54:20.196016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:54:20.207938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.208520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.209386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.210143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.210798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.211289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.231822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:20.236350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for user 52e08cff441e4fb0b01886d81a7b5ad6 and project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:20.251377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:54:20.254212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:54:20.304702 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-61f92e8d-ae6e-40a8-867a-7bd1fd93903e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.473962 Oct 28 09:54:20.305309 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 464/939] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:54:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:54:20.310619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8f0d7f7e-9959-471e-a097-530ca8ab384b req-b33202b6-0a13-4c6b-b5ec-ddb1615362d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd254e-662a-4020-9421-b76fb300937d", "name": "network-vif-plugged", "status": "completed", "tag": "a53f8536-805c-4547-b056-8cc4428c8aba"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:20.322840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8f0d7f7e-9959-471e-a097-530ca8ab384b req-b33202b6-0a13-4c6b-b5ec-ddb1615362d7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.324268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8f0d7f7e-9959-471e-a097-530ca8ab384b req-b33202b6-0a13-4c6b-b5ec-ddb1615362d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.324987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8f0d7f7e-9959-471e-a097-530ca8ab384b req-b33202b6-0a13-4c6b-b5ec-ddb1615362d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.338683 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8f0d7f7e-9959-471e-a097-530ca8ab384b req-b33202b6-0a13-4c6b-b5ec-ddb1615362d7 service nova] Creating event network-vif-plugged:a53f8536-805c-4547-b056-8cc4428c8aba for instance a8fd254e-662a-4020-9421-b76fb300937d on n-h2-zed-1 Oct 28 09:54:20.345374 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8f0d7f7e-9959-471e-a097-530ca8ab384b req-b33202b6-0a13-4c6b-b5ec-ddb1615362d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038525 Oct 28 09:54:20.346438 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 465/940] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:20.352229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:20.353370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:20.361738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.362835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.363713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.365172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.365898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.366570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.375281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:20.393480 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08870c94-f731-4a8f-9673-90c9f525b22f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1474 microversion: 2.1 time: 0.609924 Oct 28 09:54:20.394847 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 476/941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:19 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1474 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:20.399873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:20.401025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 18fa029b-3f20-4349-818b-d177d0e8b0d0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:20.407634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:20.410748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.411700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.412391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.413536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.414294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.414963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.418658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:20.462010 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] HTTP exception thrown: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Request method failure captured: Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 HTTP/1.1 Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XYan4f6OakDdTGuZ1QUbmqPKLeEKQBL69kZcF8GvkbLF-xl_GOD6I226GRTmx1BCmHtDNgr0QX3rSWyN7tKVA4NyaUCBGCLeiCTTtY7M7hbmCLNLw5sPRqodjL5MFBk5S0GRjutbPtdhXJ-0ehUhVwOReHoHC6RNOrEToBtn4OY40 Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:54:20.464018 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f4dca7afa40438cba45411cead48103", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f4dca7afa40438cba45411cead48103"}]}] Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a60610c78b5844f78f3ac3a7d421df53 Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:20.465648 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '18fa029b-3f20-4349-818b-d177d0e8b0d0'} Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:20.466486 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. Oct 28 09:54:20.467687 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:20.468860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Returning 404 to user: Instance 18fa029b-3f20-4349-818b-d177d0e8b0d0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:20.468860 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81b74935-5d45-4f32-870d-98c206324d8d tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0" status: 404 len: 111 microversion: 2.1 time: 0.069449 Oct 28 09:54:20.468860 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 477/942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:20 2022] GET /compute/v2.1/servers/18fa029b-3f20-4349-818b-d177d0e8b0d0 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:20.488387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:20.493690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:20.522336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.523035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.523534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.524322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.524792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.525376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.626059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:20.664875 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-58ffaac3-7a5b-4c04-9c1d-5d5c36dbc174 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.315872 Oct 28 09:54:20.666018 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 466/943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:20 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:20.674047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fbb9ec60-be0b-4ecb-9d0d-0f36237d7162 req-7fe6b2ca-4fde-4e23-b015-37fe62ca3f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e8eb614-33b5-4970-a2bf-5e520088cfbc", "tag": "86643eab-f01a-464c-b28c-1c96c81ce94d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:20.686225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fbb9ec60-be0b-4ecb-9d0d-0f36237d7162 req-7fe6b2ca-4fde-4e23-b015-37fe62ca3f13 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.687193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fbb9ec60-be0b-4ecb-9d0d-0f36237d7162 req-7fe6b2ca-4fde-4e23-b015-37fe62ca3f13 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.689187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fbb9ec60-be0b-4ecb-9d0d-0f36237d7162 req-7fe6b2ca-4fde-4e23-b015-37fe62ca3f13 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.708352 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fbb9ec60-be0b-4ecb-9d0d-0f36237d7162 req-7fe6b2ca-4fde-4e23-b015-37fe62ca3f13 service nova] Creating event network-changed:86643eab-f01a-464c-b28c-1c96c81ce94d for instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc on n-h2-zed-1 Oct 28 09:54:20.721899 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fbb9ec60-be0b-4ecb-9d0d-0f36237d7162 req-7fe6b2ca-4fde-4e23-b015-37fe62ca3f13 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052584 Oct 28 09:54:20.730868 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 467/944] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:20.740312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:20.741395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:20.750168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.750945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.751556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.752944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:20.753607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:20.754219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:20.849309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:20.864893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4596d597-f577-4cc5-8324-d5e7320892fa tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1224 microversion: 2.1 time: 0.392518 Oct 28 09:54:20.865649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 478/945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:20 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1224 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:20.871139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6507be09-ccd8-4ed2-b47b-d3aa8a97695d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:20.871913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6507be09-ccd8-4ed2-b47b-d3aa8a97695d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:21.008865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:21.024252 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28465556-40fb-45fb-87fa-77c0e1ba9fc2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.291626 Oct 28 09:54:21.026020 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 468/946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:20 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:21.038733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:21.041873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:21.054635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.055150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.058788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.060463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.062504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.064529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.105461 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] HTTP exception thrown: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Request method failure captured: Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 HTTP/1.1 Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XYan4f6OakDdTGuZ1QUbmqPKLeEKQBL69kZcF8GvkbLF-xl_GOD6I226GRTmx1BCmHtDNgr0QX3rSWyN7tKVA4NyaUCBGCLeiCTTtY7M7hbmCLNLw5sPRqodjL5MFBk5S0GRjutbPtdhXJ-0ehUhVwOReHoHC6RNOrEToBtn4OY40 Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:54:21.107588 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f4dca7afa40438cba45411cead48103", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f4dca7afa40438cba45411cead48103"}]}] Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a60610c78b5844f78f3ac3a7d421df53 Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.109186 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5ecfe35a-7658-4371-947c-581fc4879381'} Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:21.110038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.111387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.115256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Returning 404 to user: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:21.119961 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6e56a56d-8131-42ab-bcdb-70fbde328d6e tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 404 len: 111 microversion: 2.1 time: 0.091032 Oct 28 09:54:21.121995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 469/947] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:54:21 2022] DELETE /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:21.134298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6507be09-ccd8-4ed2-b47b-d3aa8a97695d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:21.137033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:21.138031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:21.152606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.153601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.160202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.160561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6507be09-ccd8-4ed2-b47b-d3aa8a97695d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:21.161694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.162410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6507be09-ccd8-4ed2-b47b-d3aa8a97695d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:21.162707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.163380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.163569 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6507be09-ccd8-4ed2-b47b-d3aa8a97695d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1262 microversion: 2.25 time: 0.296971 Oct 28 09:54:21.172706 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 479/948] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:20 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1262 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:21.188697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:21.190658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] [instance: 5ecfe35a-7658-4371-947c-581fc4879381] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:21.212104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.213461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.217145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.220184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.222682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.224024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.264712 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] HTTP exception thrown: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Request method failure captured: Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 HTTP/1.1 Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XYan4f6OakDdTGuZ1QUbmqPKLeEKQBL69kZcF8GvkbLF-xl_GOD6I226GRTmx1BCmHtDNgr0QX3rSWyN7tKVA4NyaUCBGCLeiCTTtY7M7hbmCLNLw5sPRqodjL5MFBk5S0GRjutbPtdhXJ-0ehUhVwOReHoHC6RNOrEToBtn4OY40 Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:54:21.269196 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2f4dca7afa40438cba45411cead48103"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2f4dca7afa40438cba45411cead48103", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2f4dca7afa40438cba45411cead48103"}]}] Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2f4dca7afa40438cba45411cead48103 Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961 Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a60610c78b5844f78f3ac3a7d421df53 Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1960682961-project Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.271061 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '5ecfe35a-7658-4371-947c-581fc4879381'} Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:21.272104 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. Oct 28 09:54:21.273777 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:21.278761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] Returning 404 to user: Instance 5ecfe35a-7658-4371-947c-581fc4879381 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:21.280235 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-246b8cb2-6728-42b9-94c6-b1dd4f95e30b tempest-ServersWithSpecificFlavorTestJSON-1960682961 tempest-ServersWithSpecificFlavorTestJSON-1960682961-project] 10.222.0.16 "GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381" status: 404 len: 111 microversion: 2.1 time: 0.106253 Oct 28 09:54:21.281501 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 480/949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:21 2022] GET /compute/v2.1/servers/5ecfe35a-7658-4371-947c-581fc4879381 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:21.426241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:21.427285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:21.442919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.445718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.446508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.448502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.451071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.452857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.635189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:21.670421 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b24e0ded-81c6-4326-9b37-b7fd9e43486a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.543985 Oct 28 09:54:21.670421 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 470/950] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:21 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:21.721122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:21.722182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:21.746639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.747789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.748732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:21.750217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:21.751218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:21.752292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.108696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.121053 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8c92e37-d280-437d-ad6d-d05b3f10daa9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.423206 Oct 28 09:54:22.122709 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 471/951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:21 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:22.128182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:22.129221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:22.137176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.138062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.138786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.139735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.140436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.141569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.258517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.271797 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d022f2dc-333f-4e5e-927a-ba20b99aeb18 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1216 microversion: 2.1 time: 0.147184 Oct 28 09:54:22.274299 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 472/952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:22 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:22.281239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:22.282232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:22.290366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.291281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.292079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.293060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.293791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.294469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.428486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.462053 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-917b9068-6a7f-4bdf-a331-61377b218e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1474 microversion: 2.1 time: 1.040716 Oct 28 09:54:22.463762 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 481/953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:21 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1474 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:22.470396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:22.471415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:22.481300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.482274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.482944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.483933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.485403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.487517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.693672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.725654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.730630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.733547 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3c35a2bc-9b95-48bd-9714-24dfa17c8088 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1258 microversion: 2.25 time: 0.267775 Oct 28 09:54:22.750870 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 482/954] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:22 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1258 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:22.780798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:22.782691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-dd2fe0aa-0709-45b3-b5b9-c7d1af585911 req-14192d3c-ec8e-4762-a289-3401687e872a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ac7f33-0abb-4958-8a4b-42eaec67578a", "name": "network-vif-plugged", "status": "completed", "tag": "e54700aa-52ee-4f0a-b07e-8955746bd325"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:22.798620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dd2fe0aa-0709-45b3-b5b9-c7d1af585911 req-14192d3c-ec8e-4762-a289-3401687e872a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.799508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dd2fe0aa-0709-45b3-b5b9-c7d1af585911 req-14192d3c-ec8e-4762-a289-3401687e872a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.800242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dd2fe0aa-0709-45b3-b5b9-c7d1af585911 req-14192d3c-ec8e-4762-a289-3401687e872a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.819326 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-dd2fe0aa-0709-45b3-b5b9-c7d1af585911 req-14192d3c-ec8e-4762-a289-3401687e872a service nova] Creating event network-vif-plugged:e54700aa-52ee-4f0a-b07e-8955746bd325 for instance 54ac7f33-0abb-4958-8a4b-42eaec67578a on n-h2-zed-1 Oct 28 09:54:22.821777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7eb522c3-d062-48e6-88ca-ae14587bef70 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.545511 Oct 28 09:54:22.823353 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 473/955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:22 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:22.826137 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-dd2fe0aa-0709-45b3-b5b9-c7d1af585911 req-14192d3c-ec8e-4762-a289-3401687e872a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066895 Oct 28 09:54:22.827530 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 483/956] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:22.832246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:22.841415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:22.858432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.859063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.859626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:22.860531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:22.861136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:22.862420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.162166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:23.162892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:23.201725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.202529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.203338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.204662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.229403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.230625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.483066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:23.521143 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f10f756e-eca0-4d21-91fa-52ed8d35a56b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.695648 Oct 28 09:54:23.537161 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 474/957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:22 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:23.551405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:23.553183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:23.575453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.576841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.578656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.601348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.610422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.611254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.726237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:23.735857 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07eed68e-5f2d-496f-9a12-72ecbebd45b3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1216 microversion: 2.1 time: 0.201372 Oct 28 09:54:23.756819 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 475/958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:23 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:23.766002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-edd423c8-a458-4c28-8e53-be0787c22645 req-74b4a213-7f4f-45e0-85f6-df563e18c2e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8bca161-a586-4715-a853-495bacc34c9e", "tag": "a70c91bc-a9ad-4fbe-905f-84d7e6f0ad55"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:23.781777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-edd423c8-a458-4c28-8e53-be0787c22645 req-74b4a213-7f4f-45e0-85f6-df563e18c2e1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.783113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-edd423c8-a458-4c28-8e53-be0787c22645 req-74b4a213-7f4f-45e0-85f6-df563e18c2e1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.783797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-edd423c8-a458-4c28-8e53-be0787c22645 req-74b4a213-7f4f-45e0-85f6-df563e18c2e1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.801322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-edd423c8-a458-4c28-8e53-be0787c22645 req-74b4a213-7f4f-45e0-85f6-df563e18c2e1 service nova] Creating event network-changed:a70c91bc-a9ad-4fbe-905f-84d7e6f0ad55 for instance a8bca161-a586-4715-a853-495bacc34c9e on n-h1-zed-1 Oct 28 09:54:23.808793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-edd423c8-a458-4c28-8e53-be0787c22645 req-74b4a213-7f4f-45e0-85f6-df563e18c2e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049119 Oct 28 09:54:23.810283 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 476/959] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:23.815875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:23.816976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:23.879051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.879051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.879051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:23.879051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:23.879597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:23.879597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.212959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:24.222651 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-116aed1f-a8f8-434e-840a-7e796ddda036 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 1.077361 Oct 28 09:54:24.235694 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 484/960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:23 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:24.254356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:24.256550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:24.285847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.287890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.292105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.297551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.298386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.299752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.486924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:24.504771 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2555ca20-afa0-41cf-b93f-b27cba7b198d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1471 microversion: 2.1 time: 0.692939 Oct 28 09:54:24.506079 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 477/961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:23 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1471 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:24.511624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:24.514444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:24.528485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.529345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.530845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.537783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.538561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.539255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.730248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:24.750159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:24.752371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:24.752957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:24.754752 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-711de3b3-f750-497c-9d5c-a829d0000376 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1258 microversion: 2.25 time: 0.517534 Oct 28 09:54:24.755836 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 485/962] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:24 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1258 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:24.764096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:24.764939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:24.782496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.783854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-65366426-bed4-4ad0-b8e1-05158eb86209 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.276485 Oct 28 09:54:24.784731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.785594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 478/963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:24 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:24.786172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.788215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.789649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.790921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.798444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:24.800200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:24.813810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.817265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.818392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.819462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.821796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.825262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.896524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.897376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.898323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.898814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:24.899536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:24.900519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:24.929648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:24.952610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for user 9dc12014773b4f9fb34ff214c07d7f61 and project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:24.977886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:25.175082 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24365d07-5185-457e-82e4-3e81d47d1434 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0/action" status: 202 len: 0 microversion: 2.1 time: 0.417046 Oct 28 09:54:25.176071 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 486/964] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:54:24 2022] POST /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0/action => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:54:25.185477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:25.186819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:25.197261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:25.199803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.200968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.201469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.202442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.202946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.203341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.213755 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eebec198-5546-4f88-974a-9d028a70ffdc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.421668 Oct 28 09:54:25.216070 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 479/965] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:24 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:25.251193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ac71fbb8-0f4b-469b-abf2-657ca8510f0b req-17abf784-eecb-4646-b869-aebaf8ce58d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "name": "network-vif-plugged", "status": "completed", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:25.263298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ac71fbb8-0f4b-469b-abf2-657ca8510f0b req-17abf784-eecb-4646-b869-aebaf8ce58d7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.264223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ac71fbb8-0f4b-469b-abf2-657ca8510f0b req-17abf784-eecb-4646-b869-aebaf8ce58d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.264884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ac71fbb8-0f4b-469b-abf2-657ca8510f0b req-17abf784-eecb-4646-b869-aebaf8ce58d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.284710 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ac71fbb8-0f4b-469b-abf2-657ca8510f0b req-17abf784-eecb-4646-b869-aebaf8ce58d7 service nova] Creating event network-vif-plugged:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h2-zed-1 Oct 28 09:54:25.292600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-ac71fbb8-0f4b-469b-abf2-657ca8510f0b req-17abf784-eecb-4646-b869-aebaf8ce58d7 service nova] Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:54:25.305429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ac71fbb8-0f4b-469b-abf2-657ca8510f0b req-17abf784-eecb-4646-b869-aebaf8ce58d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065484 Oct 28 09:54:25.306118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 480/966] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:25.313817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:25.314657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:25.321622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.322121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.322778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.323540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.324020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.324802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.413308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:25.432715 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ae166d0-0e67-41fa-9386-19119456501e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1272 microversion: 2.1 time: 0.254458 Oct 28 09:54:25.448960 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 487/967] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:25 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1272 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:25.462934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:25.465109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:25.476638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.478088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.480742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.483491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.484487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.485195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.512077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:25.527575 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af8425f6-8cdf-4a7e-ab17-9f05f08d2a52 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1470 microversion: 2.1 time: 0.219434 Oct 28 09:54:25.529934 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 481/968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:25 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1470 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:25.785116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:25.785965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:25.793252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.793755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.794197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.794925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.795420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.795885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.869615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:25.887307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:25.890450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:25.893050 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf3f38d9-ae1f-4ed2-b90a-7bf72cb4b289 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1258 microversion: 2.25 time: 0.112981 Oct 28 09:54:25.894008 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 482/969] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:25 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1258 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:54:25.922204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:25.922204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:25.929549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.930053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.930498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:25.931222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:25.931696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:25.932408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.109214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:26.118163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-58bae144-c6f0-44ae-ae39-4d3ca14f9ec1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.222266 Oct 28 09:54:26.119030 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 483/970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:25 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:26.123910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-20b570a3-88ee-4c24-a8fb-1e41bd7b5032 req-ebf258e5-5ca9-4533-b7f8-0105958f00d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4b413ab-c900-43bb-8658-18beccaeb37a", "tag": "a4c5de3a-f9d1-4336-8f45-16778a9df2de"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:26.134752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-20b570a3-88ee-4c24-a8fb-1e41bd7b5032 req-ebf258e5-5ca9-4533-b7f8-0105958f00d7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.135189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-20b570a3-88ee-4c24-a8fb-1e41bd7b5032 req-ebf258e5-5ca9-4533-b7f8-0105958f00d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.135633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-20b570a3-88ee-4c24-a8fb-1e41bd7b5032 req-ebf258e5-5ca9-4533-b7f8-0105958f00d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.150746 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-20b570a3-88ee-4c24-a8fb-1e41bd7b5032 req-ebf258e5-5ca9-4533-b7f8-0105958f00d7 service nova] Creating event network-changed:a4c5de3a-f9d1-4336-8f45-16778a9df2de for instance d4b413ab-c900-43bb-8658-18beccaeb37a on n-h1-zed-1 Oct 28 09:54:26.156945 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-20b570a3-88ee-4c24-a8fb-1e41bd7b5032 req-ebf258e5-5ca9-4533-b7f8-0105958f00d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036617 Oct 28 09:54:26.157702 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 484/971] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:26.213994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:26.222899 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-554c7411-3d82-40ee-a5d8-d95ffcd4bd7b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.778341 Oct 28 09:54:26.223504 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 488/972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:25 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:26.252220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:26.253452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:26.263023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.263708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.264591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.265484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.266023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.266592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.467012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:26.472285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:26.473404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:26.480113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.480726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.481478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.482848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.483726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.484337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.487673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1481241f-a0ff-4100-8975-88d15aafd353 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.243491 Oct 28 09:54:26.489773 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 485/973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:26 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:26.571449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:26.572544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:26.583180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.583840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.584597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.585846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.586454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.587299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.606080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:26.626849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:26.648313 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-54f8d157-a7ef-4b10-94f9-39df86464b9b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1272 microversion: 2.1 time: 0.180225 Oct 28 09:54:26.649575 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 489/974] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:26 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1272 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:26.792829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:26.804381 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76ef070e-553d-4eee-a8fb-8f1616996e9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1470 microversion: 2.1 time: 0.238223 Oct 28 09:54:26.805047 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 486/975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:26 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:26.923415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:26.924298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:26.933885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.934402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.934850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:26.935590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:26.936329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:26.936582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.132957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:27.143652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:27.147546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:27.149422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eaf2ce77-2334-496d-b1f9-fe838193581d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1258 microversion: 2.25 time: 0.230483 Oct 28 09:54:27.150910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:27.152263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:27.168126 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 490/976] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:26 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1258 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:27.169301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.169790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.170238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.170944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.171415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.172083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.249525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:27.250535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:27.258967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.259877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.260573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.262315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.263035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.263702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.394600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:27.407237 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7748a81-c47b-4a1c-b97b-ab2051c8f366 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 0.259760 Oct 28 09:54:27.418000 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 487/977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:27 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:27.513879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:27.515971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:27.540456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.542652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.543451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.544682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.545646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.546394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.798919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:27.819554 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67118cb8-32e5-4a1a-8213-271b06fed740 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.311193 Oct 28 09:54:27.843650 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 488/978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:27 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:27.855106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:27.855106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:27.866223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.866772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.867240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.868385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:27.868845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:27.869293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:27.995433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:28.003739 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c846cf53-1f67-4d03-bb40-03966fd5246b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1272 microversion: 2.1 time: 0.158617 Oct 28 09:54:28.018940 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 489/979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:27 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1272 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:28.024040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:28.024615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:28.031591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.032111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.032536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.033299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.033760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.034196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.128872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:28.139250 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04a4f572-a6e7-49c9-aca0-0626e8e79667 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1318 microversion: 2.1 time: 0.895833 Oct 28 09:54:28.139864 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 491/980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:27 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1318 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:28.179566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:28.180195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:28.198776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.199227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.200217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.202377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.203933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.205576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.336245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:28.396057 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e2ed6a9f-9c70-4dfb-a218-89956cd1c6a5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1470 microversion: 2.1 time: 0.372687 Oct 28 09:54:28.415355 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 490/981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:28 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:28.460329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:28.460884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:28.502161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.508367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:28.509091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.509822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.511255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.511814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.512272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.537680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:28.539953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:28.541645 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d032ae86-7b00-45b5-84d5-4d41fc3f9e74 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1258 microversion: 2.25 time: 0.366338 Oct 28 09:54:28.542927 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 492/982] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:28 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1258 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:28.868730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:28.871585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:28.892044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.897433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.898133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:28.901182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:28.902280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:28.907775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.240095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:29.258424 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85fba15d-974e-4a79-91a9-21dd8d7c2b86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.401953 Oct 28 09:54:29.273430 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 493/983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:28 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:29.280887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:29.293334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:29.300403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.301315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.301975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.302924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.303648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.306875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.415562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:29.466937 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bdeecd7e-5456-43dc-8519-1058792fbb0f tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1280 microversion: 2.1 time: 0.190642 Oct 28 09:54:29.494531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 494/984] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:29 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1280 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:29.504101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:29.509844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:29.529008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.529914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.530613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.531673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.533548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.540789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.624418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:29.636840 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38d3b101-c106-4096-89fc-f48eba4805c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1504 microversion: 2.1 time: 1.184165 Oct 28 09:54:29.659770 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 491/985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:28 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1504 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:29.678780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:29.688868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:29.738582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.739387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.739849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.749141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:29.749768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:29.753572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:29.931112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:29.943801 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-128a73f3-dcf7-4962-a597-70ef2e1d8560 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1468 microversion: 2.1 time: 0.447661 Oct 28 09:54:29.948827 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 495/986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:29 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:29.975685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:29.978296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:30.002996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.003991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.004672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.005676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.006401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.007074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.141920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:30.160508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:30.162258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:30.163958 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1feeed39-150a-45ad-82ba-30f7f0bbc315 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1314 microversion: 2.25 time: 0.213871 Oct 28 09:54:30.165173 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 496/987] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:29 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:30.200386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:30.212663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:30.220940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:30.236432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.237781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.238355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.239539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.240439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.245391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=18 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:30.259790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.923908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:30.937478 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-be427441-1435-4090-be22-b4a084de4ac8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1468 microversion: 2.1 time: 0.770851 Oct 28 09:54:30.941986 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 497/988] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:30 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1468 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:30.958340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:30.961310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:30.975453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.978934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.982053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:30.986917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:30.987782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:30.989614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:31.140840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=16 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:31.852022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:31.866779 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-569e20ca-fcdc-4ea4-913f-d2202315bcad tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1470 microversion: 2.1 time: 2.205580 Oct 28 09:54:31.880251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 492/989] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:29 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1470 bytes in 2219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:31.897573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:31.899510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:31.907482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:31.908242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:31.908974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:31.909934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:31.911351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:31.912007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.089577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:32.099970 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-667d2227-ae8e-405a-87e4-0f9c9d46f1bb tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 1.156566 Oct 28 09:54:32.106246 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 498/990] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:30 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:32.134243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:32.135077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:32.157174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.158266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.160418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.161410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.165600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.166358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.234588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:32.252805 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd263222-39e7-4b2d-9a30-1e237c3afcd1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1278 microversion: 2.1 time: 0.366910 Oct 28 09:54:32.256488 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 493/991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:31 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1278 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:32.273203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-828335374"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:32.279891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:32.296363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.299421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.300524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.304573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.309515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.313422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.622982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:32.649904 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0fda621-0750-4e2f-ad11-6ab8534d54d2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1479 microversion: 2.1 time: 0.534987 Oct 28 09:54:32.650523 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 499/992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:32 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1479 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:32.665158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:32.668355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:32.678650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.684262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.684936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.685875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.686698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.687302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.859585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:32.868224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:32.875983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:32.877371 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d4a3e8d4-8fda-4d24-8711-0c6c9e713297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1320 microversion: 2.25 time: 0.225696 Oct 28 09:54:32.879430 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 500/993] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:32 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1320 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:32.896497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-902faa5d-d07b-4d90-a598-ccd28004f61c tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '.version_select at 0x7fca336848b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:32.900723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-902faa5d-d07b-4d90-a598-ccd28004f61c tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.902029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-902faa5d-d07b-4d90-a598-ccd28004f61c tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.908826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-902faa5d-d07b-4d90-a598-ccd28004f61c tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.935962 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-902faa5d-d07b-4d90-a598-ccd28004f61c tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2273 microversion: 2.1 time: 0.054682 Oct 28 09:54:32.940318 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 501/994] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:54:32 2022] GET /compute/v2.1/os-migrations => generated 2273 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:32.957723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:32.958781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:32.983829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.985344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.986080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:32.987069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:32.987765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:32.988419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:33.010455 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1caa849-22ce-483a-90bf-6598171a24aa tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "POST /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d/action" status: 202 len: 0 microversion: 2.1 time: 0.750136 Oct 28 09:54:33.012426 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 494/995] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:54:32 2022] POST /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 09:54:33.019524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:33.020464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:33.034760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:33.035527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:33.036008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:33.036858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:33.037457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:33.037934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:33.040656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:33.444581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:33.460472 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c145ae01-388c-403a-b9e7-84ed451b789b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1470 microversion: 2.1 time: 0.515932 Oct 28 09:54:33.461891 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 502/996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:32 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1470 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:33.474048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1fc69c95-9af6-4bc9-8f22-81b7c087fa2b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3367d280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:33.578904 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1fc69c95-9af6-4bc9-8f22-81b7c087fa2b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.115451 Oct 28 09:54:33.611854 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 503/997] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:33 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:33.621373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:33.622931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:33.633136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:33.633921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:33.634597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:33.636211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:33.638427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:33.639172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:33.989641 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-390f8de8-3a9b-4418-b6d5-b2f9f92b1f80 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1624 microversion: 2.1 time: 0.975963 Oct 28 09:54:33.992335 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 495/998] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:33 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1624 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:34.005522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:34.007980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:34.027533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:34.033268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:34.035266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:34.037779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:34.038947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:34.039673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:34.041112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:34.050640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:34.061879 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2094ce9d-c379-42f4-bed5-1bc0256ff341 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.446309 Oct 28 09:54:34.071303 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 504/999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:33 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:34.091733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:34.102366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:34.117211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:34.118350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:34.119125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:34.120302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:34.121788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:34.122483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:34.282456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:34.294012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-647fc23f-c037-4b62-a346-863fbc564520 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1278 microversion: 2.1 time: 0.298610 Oct 28 09:54:34.296626 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 496/1000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:33 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1278 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:34.306303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ecd138e-5ec3-446e-9905-32ac7ddbcdad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Action: 'create', calling method: .version_select at 0x7fca337c5940>, body: {"keypair": {"name": "tempest-keypair-409309044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjRsr3VBcfzZ6Sh23qQbPWSMVn+/zhDPqlWc3yDonSjfekSP97mXTTK7kXA1LuOuG6ihWLtP5n8mv3Shxl0Zg/NEJnZ5bJ/rz+V9oWGuOyziCLlVDAKY3uxg5Tedxn6Cg=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:34.360253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5ecd138e-5ec3-446e-9905-32ac7ddbcdad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:34.370298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5ecd138e-5ec3-446e-9905-32ac7ddbcdad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for user d76e0eb51a9b418bb28e81b5ac1520f9 and project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:34.429130 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ecd138e-5ec3-446e-9905-32ac7ddbcdad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130808 Oct 28 09:54:34.431000 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 497/1001] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 09:54:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:34.443461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ee5743e9-472f-45bd-a118-f8c6c8edeb5d req-b859e05c-f28c-47f7-8daf-c72c5f5b0d31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bca161-a586-4715-a853-495bacc34c9e", "name": "network-vif-plugged", "status": "completed", "tag": "a70c91bc-a9ad-4fbe-905f-84d7e6f0ad55"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:34.475708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ee5743e9-472f-45bd-a118-f8c6c8edeb5d req-b859e05c-f28c-47f7-8daf-c72c5f5b0d31 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:34.480270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ee5743e9-472f-45bd-a118-f8c6c8edeb5d req-b859e05c-f28c-47f7-8daf-c72c5f5b0d31 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:34.481464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ee5743e9-472f-45bd-a118-f8c6c8edeb5d req-b859e05c-f28c-47f7-8daf-c72c5f5b0d31 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:34.509649 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ee5743e9-472f-45bd-a118-f8c6c8edeb5d req-b859e05c-f28c-47f7-8daf-c72c5f5b0d31 service nova] Creating event network-vif-plugged:a70c91bc-a9ad-4fbe-905f-84d7e6f0ad55 for instance a8bca161-a586-4715-a853-495bacc34c9e on n-h1-zed-1 Oct 28 09:54:34.526015 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ee5743e9-472f-45bd-a118-f8c6c8edeb5d req-b859e05c-f28c-47f7-8daf-c72c5f5b0d31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087362 Oct 28 09:54:34.527770 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 498/1002] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:34.538414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:34.539480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:34.553858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:34.556473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:34.557170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:34.558523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:34.560857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:34.563193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:34.914016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=7 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:35.056637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:35.084462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:35.087821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:35.088315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:35.089932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ace94767-fd91-4bf1-bde9-2615283b67c4 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 1.016977 Oct 28 09:54:35.092247 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 505/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:34 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:35.098224 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d7bd0a0f-d0b1-451b-a909-bc370a7f06ac tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1470 microversion: 2.1 time: 0.567168 Oct 28 09:54:35.099519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0e5ab2f-4a99-44e7-8c9e-00657fd02d9f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3367dc10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:35.108779 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 499/1004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:34 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1470 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:35.113986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:35.114538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:35.139495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:35.139899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:35.140316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:35.141059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:35.141523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:35.141954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:35.227021 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0e5ab2f-4a99-44e7-8c9e-00657fd02d9f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.132720 Oct 28 09:54:35.231608 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 506/1005] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:35 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:35.325991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:35.326693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:35.339525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:35.340035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:35.340481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:35.341224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:35.348299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:35.348853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:35.612479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:35.622958 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6dec9c10-a133-41de-8556-962c7d1e7b70 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.512964 Oct 28 09:54:35.623549 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 500/1006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:35 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:35.802442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:35.819230 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5fcad210-a6ef-4c1a-8b19-88bd3b5d1038 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.495444 Oct 28 09:54:35.821035 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 507/1007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:35 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:36.147243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:36.147947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:36.148350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:36.149226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:36.163717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:36.164631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:36.165344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:36.166334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:36.167832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:36.168610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:36.169088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:36.169279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:36.169871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:36.172307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:36.172773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:36.174261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:36.679345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:36.699961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:36.710606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:36.712593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bcafe7eb-c226-479d-b18c-eab239c2d8a9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 0.569310 Oct 28 09:54:36.715258 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 508/1008] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:36 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:36.730650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a82a1eb4-e428-493c-a054-97cebeed4e0a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33695c10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:36.850738 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a82a1eb4-e428-493c-a054-97cebeed4e0a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.122189 Oct 28 09:54:36.862025 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 509/1009] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:36 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:36.873737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3cd88461-b600-42ef-8ceb-8785bb6ced1b req-26191999-4c0c-4b17-9c9e-f1573f100c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8eb614-33b5-4970-a2bf-5e520088cfbc", "name": "network-vif-plugged", "status": "completed", "tag": "86643eab-f01a-464c-b28c-1c96c81ce94d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:36.894167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:36.913579 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b7d35ab-e5b6-456d-8077-92bfe3b9eb55 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1470 microversion: 2.1 time: 0.770020 Oct 28 09:54:36.925523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 501/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:36 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1470 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:36.936201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f080b1f8-a1b6-4f4c-96b6-afc3525f29e2 req-3deb0ca9-7f43-4535-8cff-c5c7ab85d2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc7662d-f778-4cd9-8b6f-4f29a6954ce4", "tag": "8cb76f58-dfbc-420d-b4ac-b6ed3360ea99"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:36.941323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3cd88461-b600-42ef-8ceb-8785bb6ced1b req-26191999-4c0c-4b17-9c9e-f1573f100c81 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:36.942451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3cd88461-b600-42ef-8ceb-8785bb6ced1b req-26191999-4c0c-4b17-9c9e-f1573f100c81 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:36.945690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3cd88461-b600-42ef-8ceb-8785bb6ced1b req-26191999-4c0c-4b17-9c9e-f1573f100c81 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:36.989049 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3cd88461-b600-42ef-8ceb-8785bb6ced1b req-26191999-4c0c-4b17-9c9e-f1573f100c81 service nova] Creating event network-vif-plugged:86643eab-f01a-464c-b28c-1c96c81ce94d for instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc on n-h2-zed-1 Oct 28 09:54:36.991039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f080b1f8-a1b6-4f4c-96b6-afc3525f29e2 req-3deb0ca9-7f43-4535-8cff-c5c7ab85d2f3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:36.992540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f080b1f8-a1b6-4f4c-96b6-afc3525f29e2 req-3deb0ca9-7f43-4535-8cff-c5c7ab85d2f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:36.993532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f080b1f8-a1b6-4f4c-96b6-afc3525f29e2 req-3deb0ca9-7f43-4535-8cff-c5c7ab85d2f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:37.021803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3cd88461-b600-42ef-8ceb-8785bb6ced1b req-26191999-4c0c-4b17-9c9e-f1573f100c81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154258 Oct 28 09:54:37.030484 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 510/1011] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:37.039655 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f080b1f8-a1b6-4f4c-96b6-afc3525f29e2 req-3deb0ca9-7f43-4535-8cff-c5c7ab85d2f3 service nova] Creating event network-changed:8cb76f58-dfbc-420d-b4ac-b6ed3360ea99 for instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 on n-h2-zed-1 Oct 28 09:54:37.055662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f080b1f8-a1b6-4f4c-96b6-afc3525f29e2 req-3deb0ca9-7f43-4535-8cff-c5c7ab85d2f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126470 Oct 28 09:54:37.055978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:37.059212 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 502/1012] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:37.059682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:37.075512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:37.080110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:37.085020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:37.085875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:37.092064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:37.095285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:37.096550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:37.100235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:37.100853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:37.101848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:37.102512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:37.105491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:37.106172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:37.108659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:37.585717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:37.596610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:37.607563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9721eee-7aa0-4c57-8b31-c37732a72197 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.538710 Oct 28 09:54:37.618722 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 503/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:37 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:37.721303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:37.735684 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-145eafcc-be31-4ca5-8c4f-c825365c665e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.703474 Oct 28 09:54:37.736524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 511/1014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:37 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:37.758959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:37.760189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:37.774208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:37.775269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:37.782890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:37.784494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:37.785250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:37.786212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:37.867186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c70fc08-4116-46b6-807c-7a8aa3b89830 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3367d9d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:37.970506 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c70fc08-4116-46b6-807c-7a8aa3b89830 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.107548 Oct 28 09:54:37.981399 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 512/1015] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:37 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:54:37.987405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:37.988408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:38.002895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:38.004348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:38.005148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:38.006332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:38.007034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:38.007754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:38.362048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:38.372860 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b94bcc20-5277-4fba-8563-a415b310bfde tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1536 microversion: 2.1 time: 0.389870 Oct 28 09:54:38.376750 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 513/1016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:37 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1536 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:38.637933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:38.638730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:38.652103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:38.653447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:38.654131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:38.657227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:38.658027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:38.658736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.011339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.020575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.022369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.023727 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-180d4481-7ecd-4c79-a215-c8c9c56519b1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 1.268893 Oct 28 09:54:39.032734 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 504/1017] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:37 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:39.048027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:39.049722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:39.071185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:39.071850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:39.072401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.073969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:39.074723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:39.075381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.328288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.341354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.349817 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1dced8a3-e328-4550-8346-42ccdf47c919 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.315558 Oct 28 09:54:39.350041 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46e9c253-233e-4980-9d21-c0a344a2f109 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.715977 Oct 28 09:54:39.360936 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 514/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:38 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:39.365555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d5718dd-9c3e-49f6-aba3-39e3566c9a6a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3371b790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:39.373674 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 505/1019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:39 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:39.378845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-46212631-7ce4-4541-9004-558a388ce69d req-bf4d8c62-3f22-400e-80a6-07ccf1a787d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b413ab-c900-43bb-8658-18beccaeb37a", "name": "network-vif-plugged", "status": "completed", "tag": "a4c5de3a-f9d1-4336-8f45-16778a9df2de"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:39.412527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-46212631-7ce4-4541-9004-558a388ce69d req-bf4d8c62-3f22-400e-80a6-07ccf1a787d8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:39.413431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-46212631-7ce4-4541-9004-558a388ce69d req-bf4d8c62-3f22-400e-80a6-07ccf1a787d8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:39.414036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-46212631-7ce4-4541-9004-558a388ce69d req-bf4d8c62-3f22-400e-80a6-07ccf1a787d8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.432015 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-46212631-7ce4-4541-9004-558a388ce69d req-bf4d8c62-3f22-400e-80a6-07ccf1a787d8 service nova] Creating event network-vif-plugged:a4c5de3a-f9d1-4336-8f45-16778a9df2de for instance d4b413ab-c900-43bb-8658-18beccaeb37a on n-h1-zed-1 Oct 28 09:54:39.439262 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-46212631-7ce4-4541-9004-558a388ce69d req-bf4d8c62-3f22-400e-80a6-07ccf1a787d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064057 Oct 28 09:54:39.442382 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d5718dd-9c3e-49f6-aba3-39e3566c9a6a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.087905 Oct 28 09:54:39.446196 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 506/1020] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:39.452584 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 515/1021] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:39 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:39.463850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:39.464853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:39.466455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-97e1d5de-cac7-4712-8d0b-2aba484a1133 req-8e18c709-6137-46bc-ad93-d923c5098a54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "name": "network-vif-unplugged", "status": "completed", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:39.472824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:39.473407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:39.474023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.474968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:39.476088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:39.476757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.484539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-97e1d5de-cac7-4712-8d0b-2aba484a1133 req-8e18c709-6137-46bc-ad93-d923c5098a54 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:39.498645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-97e1d5de-cac7-4712-8d0b-2aba484a1133 req-8e18c709-6137-46bc-ad93-d923c5098a54 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:39.499104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-97e1d5de-cac7-4712-8d0b-2aba484a1133 req-8e18c709-6137-46bc-ad93-d923c5098a54 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.529925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-97e1d5de-cac7-4712-8d0b-2aba484a1133 req-8e18c709-6137-46bc-ad93-d923c5098a54 service nova] Creating event network-vif-unplugged:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h1-zed-1 Oct 28 09:54:39.567782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-97e1d5de-cac7-4712-8d0b-2aba484a1133 req-8e18c709-6137-46bc-ad93-d923c5098a54 service nova] Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:54:39.600142 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-97e1d5de-cac7-4712-8d0b-2aba484a1133 req-8e18c709-6137-46bc-ad93-d923c5098a54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130363 Oct 28 09:54:39.601480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 516/1022] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:39.927423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b2361722-11e7-47e2-bc64-5b27689c3f09 req-08605999-078f-46aa-8a52-c5db6fccb250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad29dfd-d75a-4f22-bc12-f8e238bb961a", "tag": "40fad97c-a7e4-4ac3-ac01-8c3014ae5be8"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:39.944942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b2361722-11e7-47e2-bc64-5b27689c3f09 req-08605999-078f-46aa-8a52-c5db6fccb250 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:39.945432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b2361722-11e7-47e2-bc64-5b27689c3f09 req-08605999-078f-46aa-8a52-c5db6fccb250 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:39.949647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b2361722-11e7-47e2-bc64-5b27689c3f09 req-08605999-078f-46aa-8a52-c5db6fccb250 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:39.989497 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b2361722-11e7-47e2-bc64-5b27689c3f09 req-08605999-078f-46aa-8a52-c5db6fccb250 service nova] Creating event network-changed:40fad97c-a7e4-4ac3-ac01-8c3014ae5be8 for instance aad29dfd-d75a-4f22-bc12-f8e238bb961a on n-h2-zed-1 Oct 28 09:54:39.992799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:39.998624 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b2361722-11e7-47e2-bc64-5b27689c3f09 req-08605999-078f-46aa-8a52-c5db6fccb250 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075423 Oct 28 09:54:40.000218 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 517/1023] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:40.007145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-140b1b48-3fa0-4e2a-b3a1-71d13b3cc7fc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1536 microversion: 2.1 time: 0.555568 Oct 28 09:54:40.011413 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 507/1024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:39 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1536 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:40.055805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:40.056853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:40.071937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:40.072688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:40.073348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:40.074691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:40.075412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:40.076106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:40.379944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:40.380601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:40.388480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:40.389341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:40.389941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:40.390885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:40.391497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:40.392077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:40.443828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.466299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.469526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.474152 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07d98a0e-e9c7-4744-9083-b6c3966e1980 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 0.419799 Oct 28 09:54:40.475779 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 518/1025] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:40 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:40.512096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:40.512738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:40.527162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:40.527666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:40.528105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:40.528808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:40.529298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:40.531781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:40.721466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.733955 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-598c347e-e24f-4678-a04d-5e9e03d46a91 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.255325 Oct 28 09:54:40.749564 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 519/1026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:40 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:40.754753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ac10db5c-89ca-44fc-837b-2c72495c8f78 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33603160>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:40.771562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:40.783378 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6432fc25-f0a8-46c3-90d1-f2c8d2ba5314 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.407296 Oct 28 09:54:40.798882 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 508/1027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:40 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:40.806388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-543097957", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "22fc5637-6732-4716-999d-9f8191adb350"}], "security_groups": [{"name": "tempest-securitygroup--1015456064"}], "key_name": "tempest-keypair-409309044", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:40.806960 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ac10db5c-89ca-44fc-837b-2c72495c8f78 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.056174 Oct 28 09:54:40.807860 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 520/1028] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:40 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:40.978869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] validate_networks() for [('22fc5637-6732-4716-999d-9f8191adb350', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:54:41.039490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:41.040108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:41.047658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:41.048149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:41.048587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:41.050954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:41.051893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:41.053683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:41.322834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:41.334366 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6a2e705e-712f-47cb-9970-3fa99b80d1dd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1536 microversion: 2.1 time: 0.298473 Oct 28 09:54:41.349427 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 521/1029] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:41 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1536 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:41.462485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a5918a30-aa88-453e-ac6f-fafc31ffc455 req-ee486aa2-9de3-4d0e-8a84-ecae96cb317e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd254e-662a-4020-9421-b76fb300937d", "name": "network-vif-plugged", "status": "completed", "tag": "a53f8536-805c-4547-b056-8cc4428c8aba"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:41.491832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a5918a30-aa88-453e-ac6f-fafc31ffc455 req-ee486aa2-9de3-4d0e-8a84-ecae96cb317e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:41.497434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a5918a30-aa88-453e-ac6f-fafc31ffc455 req-ee486aa2-9de3-4d0e-8a84-ecae96cb317e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:41.498143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a5918a30-aa88-453e-ac6f-fafc31ffc455 req-ee486aa2-9de3-4d0e-8a84-ecae96cb317e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:41.532594 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a5918a30-aa88-453e-ac6f-fafc31ffc455 req-ee486aa2-9de3-4d0e-8a84-ecae96cb317e service nova] Creating event network-vif-plugged:a53f8536-805c-4547-b056-8cc4428c8aba for instance a8fd254e-662a-4020-9421-b76fb300937d on n-h2-zed-1 Oct 28 09:54:41.545837 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a5918a30-aa88-453e-ac6f-fafc31ffc455 req-ee486aa2-9de3-4d0e-8a84-ecae96cb317e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085248 Oct 28 09:54:41.546667 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 522/1030] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:54:41.561473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:41.563384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:41.579913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:41.580816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:41.581556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:41.582543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:41.583252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:41.584074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:41.881848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:41.894651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:41.896494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:41.898530 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-322dae72-523b-472c-9e1d-9306f68e35ab tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 0.349451 Oct 28 09:54:41.904719 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 523/1031] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:41 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:41.910166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c248d688-a5fa-4356-af69-5d838d006cd2 req-49ed711f-3b52-43bc-b5e7-6df3a66287d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:41.921463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c248d688-a5fa-4356-af69-5d838d006cd2 req-49ed711f-3b52-43bc-b5e7-6df3a66287d5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:41.923130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c248d688-a5fa-4356-af69-5d838d006cd2 req-49ed711f-3b52-43bc-b5e7-6df3a66287d5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:41.923817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c248d688-a5fa-4356-af69-5d838d006cd2 req-49ed711f-3b52-43bc-b5e7-6df3a66287d5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:41.954296 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c248d688-a5fa-4356-af69-5d838d006cd2 req-49ed711f-3b52-43bc-b5e7-6df3a66287d5 service nova] Creating event network-changed:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h1-zed-1 Oct 28 09:54:41.965564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-c248d688-a5fa-4356-af69-5d838d006cd2 req-49ed711f-3b52-43bc-b5e7-6df3a66287d5 service nova] Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:54:41.981917 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c248d688-a5fa-4356-af69-5d838d006cd2 req-49ed711f-3b52-43bc-b5e7-6df3a66287d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075252 Oct 28 09:54:41.983143 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 524/1032] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:41.988790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:41.999551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:54:42.001746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:54:42.005276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:54:42.007238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:54:42.007912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:54:42.018504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:42.036470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:42.038163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.039379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.039906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.041174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.041609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.042630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.043752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.044606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.046045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.046258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.046686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.048481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.105020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:54:42.112871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for user d76e0eb51a9b418bb28e81b5ac1520f9 and project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:54:42.128745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:54:42.132420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:54:42.208647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0bd9fbe1-69f5-43e3-85ed-420dd52c1e00 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.408601 Oct 28 09:54:42.209999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 509/1033] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:54:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:54:42.215490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:42.216568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:42.223855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.224620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.225324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.226206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.227074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.227850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.242284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.250168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1f58996-3612-4c14-8b4c-1faf98999b02 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 0.264760 Oct 28 09:54:42.267186 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 525/1034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:41 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:42.271995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8d4ff760-797f-4c56-b36a-24602eb1aab9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca338639d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:42.326024 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8d4ff760-797f-4c56-b36a-24602eb1aab9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.057597 Oct 28 09:54:42.327184 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 526/1035] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:42 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:42.331893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-54173098-2b8d-437a-b4e7-17ff9d53f2ec tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:42.332508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-54173098-2b8d-437a-b4e7-17ff9d53f2ec tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:42.389393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-54173098-2b8d-437a-b4e7-17ff9d53f2ec tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.398272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-54173098-2b8d-437a-b4e7-17ff9d53f2ec tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1233 microversion: 2.1 time: 0.070010 Oct 28 09:54:42.413408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 527/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:42 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:42.419264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:42.419887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:42.426961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.427459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.428722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.429102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.429564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.429982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.534015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.549053 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dc7821dc-78ae-41fc-85f0-9f982c9d32c2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.337642 Oct 28 09:54:42.572062 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 510/1037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:42 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:42.657756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:42.670092 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d6434a67-d4b0-4f12-b242-f783237dd795 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1536 microversion: 2.1 time: 0.255030 Oct 28 09:54:42.687522 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 528/1038] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:42 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1536 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:42.938214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:42.939761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:42.964966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.970121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.972366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:42.978549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:42.980431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:42.981302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:43.284636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:43.288229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:43.308946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:43.309542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:43.310003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:43.310753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:43.311223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:43.311830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:43.837519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:43.857279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:43.859050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:43.860459 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50cc2056-9e34-4dec-bffa-2aec73d5d7c1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 0.931221 Oct 28 09:54:43.873949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 511/1039] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:42 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:43.885329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5313a44b-cd69-47c8-aa3b-10b39ce5524e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca337e5ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:44.065619 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5313a44b-cd69-47c8-aa3b-10b39ce5524e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 0.190220 Oct 28 09:54:44.077117 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 512/1040] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:43 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:44.082682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:44.093912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:44.107050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:44.117735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:44.136699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:44.139656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:44.140389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:44.141306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:44.729704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:44.783866 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-133d4ee9-dd7c-48a1-bfe7-e23ab66613b8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1229 microversion: 2.1 time: 0.698538 Oct 28 09:54:44.822351 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 513/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:44 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1229 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:44.837507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:44.839160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:44.856659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:44.858356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:44.859300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:44.860391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:44.861774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:44.863187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:44.910336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:44.928763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:45.006954 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e24a6418-5cd3-4501-8386-910597fa2004 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1317 microversion: 2.1 time: 1.731435 Oct 28 09:54:45.014394 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 529/1042] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:43 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1317 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:45.064575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:45.080951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:45.147774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:45.148607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:45.172637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:45.189381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:45.198441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:45.199657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:45.876839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:45.918927 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c6584d5-cb59-4bc2-a0e7-72a1d81f97b2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1529 microversion: 2.1 time: 0.902318 Oct 28 09:54:45.933600 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 530/1043] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:45 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1529 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:45.953876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:45.970805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:46.017756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:46.021510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:46.023139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:46.023555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:46.024345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:46.024813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:46.025302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:46.033014 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c351eef-7685-4a29-a8ce-1032dccfc5a1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 1.207848 Oct 28 09:54:46.037168 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 514/1044] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:44 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:46.049862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01af5e9d-98c3-44b4-8327-56c90c981f05 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca338ecc10>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:47.144173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:47.158320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:47.165311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:47.168965 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f520267e-72a6-44ad-8042-1a18b3e76410 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 1.235999 Oct 28 09:54:47.174102 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 531/1045] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:45 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:47.184364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-2e138a0a-bc17-403e-898a-1a7c99a9b9f7 req-ee1077ef-e661-44be-b997-f8f1ad98f45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc7662d-f778-4cd9-8b6f-4f29a6954ce4", "name": "network-vif-plugged", "status": "completed", "tag": "8cb76f58-dfbc-420d-b4ac-b6ed3360ea99"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:47.209080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2e138a0a-bc17-403e-898a-1a7c99a9b9f7 req-ee1077ef-e661-44be-b997-f8f1ad98f45c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:47.214148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2e138a0a-bc17-403e-898a-1a7c99a9b9f7 req-ee1077ef-e661-44be-b997-f8f1ad98f45c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:47.214865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2e138a0a-bc17-403e-898a-1a7c99a9b9f7 req-ee1077ef-e661-44be-b997-f8f1ad98f45c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:47.249780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-2e138a0a-bc17-403e-898a-1a7c99a9b9f7 req-ee1077ef-e661-44be-b997-f8f1ad98f45c service nova] Creating event network-vif-plugged:8cb76f58-dfbc-420d-b4ac-b6ed3360ea99 for instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 on n-h2-zed-1 Oct 28 09:54:47.266626 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-2e138a0a-bc17-403e-898a-1a7c99a9b9f7 req-ee1077ef-e661-44be-b997-f8f1ad98f45c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091162 Oct 28 09:54:47.270541 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 532/1046] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:47.280167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:47.288088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:47.320541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:47.328080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:47.332538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:47.340447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:47.344714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:47.351326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:47.601986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:47.620742 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-427ace3d-8110-4162-96ec-9f20a2b670bb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1291 microversion: 2.1 time: 0.348132 Oct 28 09:54:47.642641 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 533/1047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:47 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1291 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:47.648536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:47.649574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:47.657324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:47.658098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:47.658762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:47.659724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:47.660370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:47.661015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:48.352311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:48.387079 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed85f38c-a46d-4eee-95b1-72036c6b81b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1529 microversion: 2.1 time: 0.740303 Oct 28 09:54:48.409008 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 534/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:47 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1529 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:48.422994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:48.426413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:48.442464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:48.445425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:48.448701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:48.452853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:48.453544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:48.457924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.177738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.195826 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7430efb-ffe5-4272-a430-8d72407005d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1466 microversion: 2.1 time: 0.800719 Oct 28 09:54:49.196742 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 535/1049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:48 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1466 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:49.201905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.202516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:49.222734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.223230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.223675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.224402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.224862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.225318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.696314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:49.720324 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a15a80fe-f926-4976-8dc4-11cd8dc41263 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.520695 Oct 28 09:54:49.721465 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 536/1050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:49 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:49.764539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:49.766098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:49.803731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.809848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.811289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:49.815262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:49.823369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:49.824782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:50.708515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:50.730850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:50.745976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:50.748445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02cf86a6-2712-4ac7-b548-b1df8469c007 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1362 microversion: 2.25 time: 1.019902 Oct 28 09:54:50.755438 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 537/1051] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:54:49 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1362 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:54:50.804385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5413da4-a8f0-4927-8bc2-1dfa550c46e8 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:50.826449 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c5413da4-a8f0-4927-8bc2-1dfa550c46e8 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] HTTP exception thrown: Flavor b57cd1cd-e88e-49e8-9fec-4e8d995accde could not be found. Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5413da4-a8f0-4927-8bc2-1dfa550c46e8 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Request method failure captured: Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/flavors/b57cd1cd-e88e-49e8-9fec-4e8d995accde HTTP/1.1 Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XPT8MlMX9mdXL4pTUfXEk5gAs_nEfpcwXVgkKm9rtDaMXjvz2QMPEXwbWD00pBFF5FmKkrCr-2BWn1yFKKhMwXuKuHo2mP_9h13mQQDzOPvTt011tKUkZqq5lJk81SL8Ygdsp1giX9OFQoim8Y5lMIHGuGC_b4rUoK3BrihLBgU74 Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 0844f17c02294217954ad90f41b9e2fd Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-MigrationsAdminTest-1734037692 Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:54:50.831815 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0844f17c02294217954ad90f41b9e2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0844f17c02294217954ad90f41b9e2fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0844f17c02294217954ad90f41b9e2fd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0844f17c02294217954ad90f41b9e2fd"}]}] Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-MigrationsAdminTest-1734037692 Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 0844f17c02294217954ad90f41b9e2fd Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-MigrationsAdminTest-1734037692 Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-MigrationsAdminTest-1734037692-project-admin Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8f6e3fb8d6584717b71970da75f27541 Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-MigrationsAdminTest-1734037692-project-admin Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: exception: Flavor b57cd1cd-e88e-49e8-9fec-4e8d995accde could not be found. Oct 28 09:54:50.833695 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'b57cd1cd-e88e-49e8-9fec-4e8d995accde'} Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor b57cd1cd-e88e-49e8-9fec-4e8d995accde could not be found. Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:50.834633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor b57cd1cd-e88e-49e8-9fec-4e8d995accde could not be found. Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor b57cd1cd-e88e-49e8-9fec-4e8d995accde could not be found. Oct 28 09:54:50.836200 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:54:50.838755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5413da4-a8f0-4927-8bc2-1dfa550c46e8 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Returning 404 to user: Flavor b57cd1cd-e88e-49e8-9fec-4e8d995accde could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:54:50.839890 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5413da4-a8f0-4927-8bc2-1dfa550c46e8 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/b57cd1cd-e88e-49e8-9fec-4e8d995accde" status: 404 len: 109 microversion: 2.1 time: 0.058023 Oct 28 09:54:50.844588 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 538/1052] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:54:50 2022] DELETE /compute/v2.1/flavors/b57cd1cd-e88e-49e8-9fec-4e8d995accde => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:54:50.866996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:50.868131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:50.937351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:50.938256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:50.941980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:50.944595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:50.951924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:50.953562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:51.912621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:51.937769 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6740c89-0935-4477-823b-ce570ffff0fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1359 microversion: 2.1 time: 1.091203 Oct 28 09:54:51.977806 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 539/1053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:50 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1359 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:51.988731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:52.003960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:52.036465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:52.037343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:52.038136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:52.039056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:52.044216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:52.045049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:52.086305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:52.122155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:52.400114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:52.953690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3122de6-07cc-4c43-9bcf-27c16827c776 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1611 microversion: 2.1 time: 0.971317 Oct 28 09:54:52.962250 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 540/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:51 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1611 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:52.975838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-027ba3cb-4e4a-4071-9faa-e822286c3116 req-8bfd9e2d-8547-485d-bc6d-bbd366586137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "name": "network-vif-plugged", "status": "completed", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:53.032150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-027ba3cb-4e4a-4071-9faa-e822286c3116 req-8bfd9e2d-8547-485d-bc6d-bbd366586137 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:53.034736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-027ba3cb-4e4a-4071-9faa-e822286c3116 req-8bfd9e2d-8547-485d-bc6d-bbd366586137 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:53.035554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-027ba3cb-4e4a-4071-9faa-e822286c3116 req-8bfd9e2d-8547-485d-bc6d-bbd366586137 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:53.113703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-027ba3cb-4e4a-4071-9faa-e822286c3116 req-8bfd9e2d-8547-485d-bc6d-bbd366586137 service nova] Creating event network-vif-plugged:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h1-zed-1 Oct 28 09:54:53.129696 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-027ba3cb-4e4a-4071-9faa-e822286c3116 req-8bfd9e2d-8547-485d-bc6d-bbd366586137 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162403 Oct 28 09:54:53.130603 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 541/1055] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:54:53.150234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:54:53.153747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:54:53.170279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:53.173724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:53.174461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:53.176497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:54:53.183870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:54:53.184608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:54:53.742064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:54:53.754527 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74fd03f8-0528-4d8a-b452-80005e9b7386 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.617123 Oct 28 09:54:53.757443 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 542/1056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:54:53 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:54:53.770615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-226076749", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:54:54.847821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:54:56.022997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=52 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:00.279785 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01af5e9d-98c3-44b4-8327-56c90c981f05 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1454 microversion: 2.1 time: 14.241111 Oct 28 09:55:00.287530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:55:00.289050 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 515/1057] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:54:46 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1454 bytes in 14251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:00.306724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:00.308344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:00.315363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.316351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.317044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.318060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.318728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.319389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.519273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.529971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.532502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.534081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ebc700e4-eace-4b24-9ffc-e76e4ad7867a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1559 microversion: 2.25 time: 0.243776 Oct 28 09:55:00.534820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 516/1058] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:00 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1559 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:00.562445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:00.563332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:00.568528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:55:00.569023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:55:00.569507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:55:00.569933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:55:00.570549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:55:00.579499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.580521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.581238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.581993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.582466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.582901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.588305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.588848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.589352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.590285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.590930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.591541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.635420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:00.640232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Getting quotas for user 9dc12014773b4f9fb34ff214c07d7f61 and project 386a18c232b949b793bf7ec70ed3b6c9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:00.654667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:55:00.657467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:55:00.728502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-647f4a9e-0ef6-4fa6-9c98-ba2b9113b75f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.969609 Oct 28 09:55:00.736495 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 543/1059] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:54:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 6978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:55:00.744271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1917611399", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "05112b40-6767-428e-8884-474dd5e18ae9"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:00.770987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:00.780785 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-24223f32-de2d-4014-9de9-945f3127b8a5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1359 microversion: 2.1 time: 0.229002 Oct 28 09:55:00.786029 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 517/1060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:00 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1359 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:00.794862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ae6d491b-bee3-4cc7-a549-93a39c2d23bd req-ef4837fd-57ad-4a4b-a536-370ecb5a1b40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f7b43e-9af7-48b0-b0fc-ad060328abbf", "tag": "5a5bee98-bf90-4c92-b3a5-a7436e5ffedb"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:00.832384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae6d491b-bee3-4cc7-a549-93a39c2d23bd req-ef4837fd-57ad-4a4b-a536-370ecb5a1b40 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.833996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae6d491b-bee3-4cc7-a549-93a39c2d23bd req-ef4837fd-57ad-4a4b-a536-370ecb5a1b40 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.837045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae6d491b-bee3-4cc7-a549-93a39c2d23bd req-ef4837fd-57ad-4a4b-a536-370ecb5a1b40 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.844369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:55:00.862439 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ae6d491b-bee3-4cc7-a549-93a39c2d23bd req-ef4837fd-57ad-4a4b-a536-370ecb5a1b40 service nova] Creating event network-changed:5a5bee98-bf90-4c92-b3a5-a7436e5ffedb for instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf on n-h1-zed-1 Oct 28 09:55:00.868711 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ae6d491b-bee3-4cc7-a549-93a39c2d23bd req-ef4837fd-57ad-4a4b-a536-370ecb5a1b40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080214 Oct 28 09:55:00.870165 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 518/1061] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:00.876728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:00.877834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:00.885486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.886297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.886650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:00.887365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:00.887824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:00.888260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.145590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:01.171339 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-718fe59f-5414-4cf1-90a6-daed2425fef5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.299286 Oct 28 09:55:01.185741 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 519/1062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:00 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:01.200863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-134ea1e8-6930-4ad6-ad4c-71e224cd2c43 req-56edb25f-aede-402a-8510-d811e800d7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad29dfd-d75a-4f22-bc12-f8e238bb961a", "name": "network-vif-plugged", "status": "completed", "tag": "40fad97c-a7e4-4ac3-ac01-8c3014ae5be8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:01.219257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-134ea1e8-6930-4ad6-ad4c-71e224cd2c43 req-56edb25f-aede-402a-8510-d811e800d7df service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:01.220543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-134ea1e8-6930-4ad6-ad4c-71e224cd2c43 req-56edb25f-aede-402a-8510-d811e800d7df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:01.221254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-134ea1e8-6930-4ad6-ad4c-71e224cd2c43 req-56edb25f-aede-402a-8510-d811e800d7df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.242200 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-134ea1e8-6930-4ad6-ad4c-71e224cd2c43 req-56edb25f-aede-402a-8510-d811e800d7df service nova] Creating event network-vif-plugged:40fad97c-a7e4-4ac3-ac01-8c3014ae5be8 for instance aad29dfd-d75a-4f22-bc12-f8e238bb961a on n-h2-zed-1 Oct 28 09:55:01.251856 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-134ea1e8-6930-4ad6-ad4c-71e224cd2c43 req-56edb25f-aede-402a-8510-d811e800d7df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056943 Oct 28 09:55:01.253192 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 520/1063] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:01.454391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:55:01.455479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:55:01.456199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:55:01.456824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:55:01.457474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:55:01.484360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:01.485216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:01.486135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.487103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:01.499751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:01.500295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.558267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:01.566584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Getting quotas for user 863b399a02b24f68acfbf4575cc3d257 and project 3ce2480a829d442c8b55476ffa5d3ba3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:01.568071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-740d56c8-3ba7-4689-9501-7b552528c897 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2011234595", "id": 1915392471, "os-flavor-access:is_public": "True"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:01.603006 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-740d56c8-3ba7-4689-9501-7b552528c897 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.345663 Oct 28 09:55:01.603838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:55:01.611707 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 521/1064] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:01 2022] POST /compute/v2.1/flavors => generated 430 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:01.611919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:55:01.705230 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f93c2173-c147-43a0-8122-34c23927263c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966349 Oct 28 09:55:01.706789 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 544/1065] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 970 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:55:01.716669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:01.719214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:01.726638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:01.727466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:01.728568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.729692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:01.730405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:01.731070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.795045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b76cf2a0-8368-439e-84b5-368eef708e82 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Action: 'create', calling method: .version_select at 0x7fca337d8160>, body: {"keypair": {"name": "tempest-keypair-1471561052", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeYFoLAPfrcKi/q6dqq/9Aa9Lu87eAf08U9sTxauZtA4Lim+gjMB3tC1IQiyvgLHI09m4exjn/HJ9Sp+D5IVS0PCEzcHuLe1T6JCcio/0j4l9EkqmUf6xVaNEZ7wsBmJQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:01.829989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b76cf2a0-8368-439e-84b5-368eef708e82 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Getting quotas for project 70725194c6a84c4a991a8acc16a8bf68. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:01.847136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b76cf2a0-8368-439e-84b5-368eef708e82 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Getting quotas for user a0a8b4be16e0439dbacf9d3c6cfeb527 and project 70725194c6a84c4a991a8acc16a8bf68. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:01.893202 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b76cf2a0-8368-439e-84b5-368eef708e82 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.286296 Oct 28 09:55:01.893892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 522/1066] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 09:55:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:01.911996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:01.913061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:01.922952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:01.923476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:01.924200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.924654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:01.925146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:01.925593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:01.992699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:02.020450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:02.035398 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6cec8316-eaef-4abf-b62f-a1a5d23b50fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1216 microversion: 2.1 time: 0.140438 Oct 28 09:55:02.040697 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 523/1067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:01 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.067817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b8c3495-851d-415a-bc08-ca0f55a20037 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33823e50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.160116 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24e3cdaa-4cdf-44a0-827f-f8bd0a81adc6 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 2046 microversion: 2.25 time: 0.451691 Oct 28 09:55:02.164583 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b8c3495-851d-415a-bc08-ca0f55a20037 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1463 microversion: 2.1 time: 0.122563 Oct 28 09:55:02.165894 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 524/1068] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1463 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.171911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0f7d1be-4d00-486e-bc88-6ae17b912073 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.175016 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 545/1069] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:01 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 2046 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:02.181771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f058983b-6839-450f-a32e-2260c6c8a114 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.182960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f058983b-6839-450f-a32e-2260c6c8a114 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:02.201730 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0f7d1be-4d00-486e-bc88-6ae17b912073 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1915392471" status: 202 len: 0 microversion: 2.1 time: 0.033193 Oct 28 09:55:02.203808 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 525/1070] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:02 2022] DELETE /compute/v2.1/flavors/1915392471 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:02.210729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.211937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:02.226276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.227522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.228148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.230218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.230941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.231706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.293289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f058983b-6839-450f-a32e-2260c6c8a114 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:02.304815 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f058983b-6839-450f-a32e-2260c6c8a114 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1217 microversion: 2.1 time: 0.128577 Oct 28 09:55:02.306054 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 546/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.322259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6065942b-d206-4e7a-abfb-8f75c2044c26 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca335c6280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.377938 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6065942b-d206-4e7a-abfb-8f75c2044c26 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 200 len: 1463 microversion: 2.1 time: 0.070442 Oct 28 09:55:02.381445 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 547/1072] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 1463 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.386327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.387809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:02.403004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.403546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.404015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.404763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.405313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.406475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.411603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:02.431393 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea394807-0810-4e69-a797-15fb36a1630c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1359 microversion: 2.1 time: 0.222912 Oct 28 09:55:02.442037 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 526/1073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.451089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.451963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:02.458270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.458783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.459253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.460043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.460491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.460963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.623444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:02.631596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:02.639240 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75a0789d-1b41-4dbb-a0fd-52c22a4606bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 2046 microversion: 2.25 time: 0.256507 Oct 28 09:55:02.640258 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 548/1074] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 2046 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:02.646450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e0f0b6f-85e7-4a5b-955e-bf2c3d5d1e8e tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.657495 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-665d5779-1bcc-41b1-8951-2a52b95fa8cc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.196951 Oct 28 09:55:02.659319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 527/1075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.671042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.671375 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e0f0b6f-85e7-4a5b-955e-bf2c3d5d1e8e tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028579 Oct 28 09:55:02.672772 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 549/1076] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.674901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:02.687505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.691055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.691632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.692481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.693099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.693605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.694410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.706142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.706620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.707058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.707802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.708256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.708677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.749519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2455fde-1d93-4b1e-9cd3-1fa1898456b4 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 418 microversion: 2.25 time: 0.061991 Oct 28 09:55:02.750150 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 550/1077] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 418 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:02.758502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c778eed0-e079-4971-8b02-8d90bfb9a073 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1788761700", "id": 1271972326, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:02.789033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c778eed0-e079-4971-8b02-8d90bfb9a073 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.037790 Oct 28 09:55:02.789632 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 551/1078] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:02 2022] POST /compute/v2.1/flavors => generated 417 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:02.801979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:02.806684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:02.813273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.814112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.814562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.815488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.816218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.816732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.861188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:02.871155 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87d0af69-b9d7-439c-be3f-a726cfcecb69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1481 microversion: 2.1 time: 0.210421 Oct 28 09:55:02.871974 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 528/1079] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1481 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.877461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01c6b7f2-4787-43a1-9e34-57e6b277c97f tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.918165 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1b0c88c-1161-4d02-844f-a56e6ce4f13f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4/action" status: 202 len: 0 microversion: 2.25 time: 0.120151 Oct 28 09:55:02.921219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 552/1080] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:55:02 2022] POST /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:02.928227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.929118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:02.931003 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01c6b7f2-4787-43a1-9e34-57e6b277c97f tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5398 microversion: 2.1 time: 0.057112 Oct 28 09:55:02.941059 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 529/1081] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/flavors/detail => generated 5398 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:02.941247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.941247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.941247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.941247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:02.941595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:02.941595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:02.963151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a953f2ac-6f84-4434-b55d-a09b1787b8b1 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:02.988942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:03.003284 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a953f2ac-6f84-4434-b55d-a09b1787b8b1 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1271972326" status: 202 len: 0 microversion: 2.1 time: 0.049075 Oct 28 09:55:03.004271 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 530/1082] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:02 2022] DELETE /compute/v2.1/flavors/1271972326 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:03.015761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36727f98-804d-4558-b148-55f7ddaf86c6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.055312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-36727f98-804d-4558-b148-55f7ddaf86c6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044247 Oct 28 09:55:03.068936 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 531/1083] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:03.080377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.081189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:03.098079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.098602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.099266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.099775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.100566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.101019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.210016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:03.219364 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-afb0de24-8c9e-4d0f-b455-45b3b8bde2b0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1264 microversion: 2.1 time: 0.155388 Oct 28 09:55:03.220041 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 532/1084] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:03.225927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7ecb4094-b214-46aa-a514-d7ad35235cc6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1451490010", "id": 1667173132, "os-flavor-access:is_public": "True"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:03.226069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:03.242485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6a0dc1c-d7ba-4d99-90b8-8ffe74df44ab tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 2051 microversion: 2.25 time: 0.318500 Oct 28 09:55:03.243933 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 553/1085] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:02 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 2051 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:03.248007 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7ecb4094-b214-46aa-a514-d7ad35235cc6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.026666 Oct 28 09:55:03.249157 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 533/1086] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:03 2022] POST /compute/v2.1/flavors => generated 429 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:03.277223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-735d4d2d-b886-4768-bb08-f9f9da995021 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.296139 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-735d4d2d-b886-4768-bb08-f9f9da995021 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1667173132" status: 202 len: 0 microversion: 2.1 time: 0.022520 Oct 28 09:55:03.297667 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 554/1087] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:03 2022] DELETE /compute/v2.1/flavors/1667173132 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:03.307039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-853ce46c-ea04-4022-809a-32966a14c5af tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.325691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5f320c3c-b4f5-4911-b5bc-04fb8b4615db req-b65fa11d-9b97-493f-978b-007dc798b5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f7b43e-9af7-48b0-b0fc-ad060328abbf", "name": "network-vif-plugged", "status": "completed", "tag": "5a5bee98-bf90-4c92-b3a5-a7436e5ffedb"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:03.337707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f320c3c-b4f5-4911-b5bc-04fb8b4615db req-b65fa11d-9b97-493f-978b-007dc798b5c1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.338203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f320c3c-b4f5-4911-b5bc-04fb8b4615db req-b65fa11d-9b97-493f-978b-007dc798b5c1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.338844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f320c3c-b4f5-4911-b5bc-04fb8b4615db req-b65fa11d-9b97-493f-978b-007dc798b5c1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.357502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5f320c3c-b4f5-4911-b5bc-04fb8b4615db req-b65fa11d-9b97-493f-978b-007dc798b5c1 service nova] Creating event network-vif-plugged:5a5bee98-bf90-4c92-b3a5-a7436e5ffedb for instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf on n-h1-zed-1 Oct 28 09:55:03.363213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5f320c3c-b4f5-4911-b5bc-04fb8b4615db req-b65fa11d-9b97-493f-978b-007dc798b5c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045958 Oct 28 09:55:03.365069 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 555/1088] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:03.372978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.374827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:03.377561 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-853ce46c-ea04-4022-809a-32966a14c5af tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075171 Oct 28 09:55:03.378996 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 534/1089] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:03.381636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.382141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.382598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.383316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.384011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.384463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.412778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f04e2cc6-614c-431c-beb5-d32a1664ab37 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-996899979", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:03.454761 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f04e2cc6-614c-431c-beb5-d32a1664ab37 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.056351 Oct 28 09:55:03.456401 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 535/1090] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:03 2022] POST /compute/v2.1/flavors => generated 506 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:03.468556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.469986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:03.481782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.482691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.483512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.484702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.485765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.486570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.497324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:03.507819 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d256e506-1ef6-4efd-a1ce-8a45eea5a253 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1269 microversion: 2.1 time: 0.141128 Oct 28 09:55:03.508426 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 556/1091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:03.513297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3612e10-c805-409a-9465-58e988ae735a tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.520362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:03.544475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b3612e10-c805-409a-9465-58e988ae735a tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/4a469bb2-4bf2-412a-8e8f-e61d3b838769" status: 202 len: 0 microversion: 2.1 time: 0.034800 Oct 28 09:55:03.549085 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 557/1092] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:03 2022] DELETE /compute/v2.1/flavors/4a469bb2-4bf2-412a-8e8f-e61d3b838769 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:03.557105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8c1ee39-b209-476a-b3d5-b3ee57da82fd tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.589544 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c8c1ee39-b209-476a-b3d5-b3ee57da82fd tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039064 Oct 28 09:55:03.590400 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 558/1093] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:03.613623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-437fc81b-9224-42d8-a26d-d55c7c277cd8 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1401040237", "id": "aebfd0ea-22a8-49c3-b75a-6ea4ed3402cb", "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:03.639706 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-437fc81b-9224-42d8-a26d-d55c7c277cd8 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.030596 Oct 28 09:55:03.640516 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 559/1094] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:03 2022] POST /compute/v2.1/flavors => generated 507 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:03.652787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-47e5874d-a380-4ed6-9c7e-46b0e5627201 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.656196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:03.668444 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3551f5e9-f039-4f9e-bfd0-7c463c327b43 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1359 microversion: 2.1 time: 0.209958 Oct 28 09:55:03.669432 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 536/1095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:03.672944 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-47e5874d-a380-4ed6-9c7e-46b0e5627201 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/aebfd0ea-22a8-49c3-b75a-6ea4ed3402cb" status: 202 len: 0 microversion: 2.1 time: 0.023337 Oct 28 09:55:03.674111 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 560/1096] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:03 2022] DELETE /compute/v2.1/flavors/aebfd0ea-22a8-49c3-b75a-6ea4ed3402cb => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:55:03.683014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a68e6901-7a33-4710-a418-d20020c972e3 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.695329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.697025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:03.710381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.712040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.713144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.715027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:03.716289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:03.717356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:03.732828 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a68e6901-7a33-4710-a418-d20020c972e3 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054345 Oct 28 09:55:03.733777 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 537/1097] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:03.767719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56a7d115-9069-4f36-93a2-74999abd2d04 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2096052673", "id": 1901161865, "os-flavor-access:is_public": "True"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:03.812242 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56a7d115-9069-4f36-93a2-74999abd2d04 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.055176 Oct 28 09:55:03.813788 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 538/1098] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:03 2022] POST /compute/v2.1/flavors => generated 414 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:03.831103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b83cfdbc-157b-4436-b1b8-38d8600a958c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:03.843894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b83cfdbc-157b-4436-b1b8-38d8600a958c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/1901161865" status: 200 len: 414 microversion: 2.1 time: 0.020208 Oct 28 09:55:03.845032 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 539/1099] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/flavors/1901161865 => generated 414 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:04.063392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d8c8ca2-3deb-432c-9451-90c1d7024283 tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.101866 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d8c8ca2-3deb-432c-9451-90c1d7024283 tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.241537 Oct 28 09:55:04.103455 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 540/1100] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:04.113025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.114062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:04.122642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.123542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.124310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.125648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.126479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.127217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.292411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.301926 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da1532e6-49b8-4bff-adb4-4c457a9d52e3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1468 microversion: 2.1 time: 0.196495 Oct 28 09:55:04.302628 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 541/1101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:04 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1468 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:04.308292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ddbffff-be17-4776-a117-89f7694def08 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.337935 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ddbffff-be17-4776-a117-89f7694def08 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1901161865" status: 202 len: 0 microversion: 2.1 time: 0.033685 Oct 28 09:55:04.338573 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 542/1102] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:04 2022] DELETE /compute/v2.1/flavors/1901161865 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:04.344284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.345225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:04.353923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.355254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.356008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.357014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.357484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.357945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.429315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.439724 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0bcea75f-3370-4af6-b4a0-9f9bf9d6f8d7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1264 microversion: 2.1 time: 0.099552 Oct 28 09:55:04.440299 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 543/1103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:04 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1264 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:04.461727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.461727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:04.461727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.461727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.462309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.462309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.462597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.463535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.552240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.566968 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-457da990-1fde-46b7-888f-a6c5fcd753ec tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1320 microversion: 2.1 time: 0.880175 Oct 28 09:55:04.581326 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 561/1104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:03 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1320 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:04.587809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-43224631"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:04.590664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:04.600951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.600951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.600951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.600951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.601454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.601454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.645404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:04.664330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a005fd5d-9b06-448a-9ac4-fdd0654e7d4b tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 2031 microversion: 2.25 time: 0.222654 Oct 28 09:55:04.665020 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 544/1105] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:04 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 2031 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:04.690918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a399f18-1654-4464-bb16-5b7922db772b tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.712174 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a399f18-1654-4464-bb16-5b7922db772b tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033893 Oct 28 09:55:04.712766 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 545/1106] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:04.730229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-442821043", "imageRef": "0dc25223-3def-4261-b048-8c8f2644a635", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4d3e3046-6bc5-4224-b3bf-e6492c858ddf"}], "security_groups": [{"name": "tempest-securitygroup--1223564731"}], "key_name": "tempest-keypair-1471561052", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:04.863628 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e856ff0a-0eb8-4d95-8982-e3669f332ee9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "POST /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a/action" status: 202 len: 0 microversion: 2.1 time: 0.280904 Oct 28 09:55:04.864874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 562/1107] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:55:04 2022] POST /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 09:55:04.872039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:04.873024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:04.880681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.881205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.881642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.882351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:04.882805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:04.883230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:04.923150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] validate_networks() for [('4d3e3046-6bc5-4224-b3bf-e6492c858ddf', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:55:04.972376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:04.991005 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bdb913c6-e9ad-4ce8-9a8e-8f2c9058fa15 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1275 microversion: 2.1 time: 0.124125 Oct 28 09:55:04.992807 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 563/1108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:04 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1275 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:05.000790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:05.001806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:05.011304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:05.012029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:05.012472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:05.013440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:05.013924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:05.014345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:05.267080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:05.289054 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2428606a-6c32-4d6d-be9d-7eca62a1dfc0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1359 microversion: 2.1 time: 0.294607 Oct 28 09:55:05.289649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 564/1109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:04 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:05.296879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-zed-1", "block_migration": "auto"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:05.299928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:05.306978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:05.308048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:05.308841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:05.309853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:05.310309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:05.310742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:05.341648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'flavor' on Instance uuid 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:05.361046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Going to try to live migrate instance to n-h1-zed-1 {{(pid=128747) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:55:05.589914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:55:05.590631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:55:05.591290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:55:05.591905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:55:05.593089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:55:05.613830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:05.614526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:05.615346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:05.616426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:05.616938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:05.617369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:05.663201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Getting quotas for project 70725194c6a84c4a991a8acc16a8bf68. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:05.665818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=5,nova_api:DELETE=9 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:05.674249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Getting quotas for user a0a8b4be16e0439dbacf9d3c6cfeb527 and project 70725194c6a84c4a991a8acc16a8bf68. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:05.704555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:55:05.709053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0dc25223-3def-4261-b048-8c8f2644a635',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:55:05.821384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a13a7a4d-451d-485d-9219-145cc4298dc5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.101571 Oct 28 09:55:05.829037 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 546/1110] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:55:05.834675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e78e4017-7616-4e83-bafc-e5c10dfadfc7 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1488376754", "id": 1231142364, "os-flavor-access:is_public": "False"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:05.885621 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e78e4017-7616-4e83-bafc-e5c10dfadfc7 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.054351 Oct 28 09:55:05.887085 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 547/1111] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:05 2022] POST /compute/v2.1/flavors => generated 430 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:05.892271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-972aeaed-2219-4b67-8c0e-eceafaab9f08 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3383a820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:06.005327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-972aeaed-2219-4b67-8c0e-eceafaab9f08 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.116945 Oct 28 09:55:06.005986 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 548/1112] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:05 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:06.020738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:06.021631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:06.033895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:06.034709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:06.035323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:06.036218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:06.036864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:06.037486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:06.428106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:06.440640 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab5e442b-54c0-446e-a517-06139533172d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.431897 Oct 28 09:55:06.442607 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 549/1113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:06 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:06.450490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:06.451702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:06.490761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:06.491259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:06.491703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:06.492467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:06.492936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:06.500605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:06.845082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:06.858327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47d25c3f-7bb8-4d6a-927c-644f2b133816 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1511 microversion: 2.1 time: 0.413901 Oct 28 09:55:06.859350 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 550/1114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:06 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:06.874715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:06.876835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:06.892843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:06.897732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:06.899404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:06.902326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:06.903877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:06.904568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.005730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:07.024690 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-604df178-11d0-4348-9306-5e0054c990f8 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1249 microversion: 2.1 time: 0.161959 Oct 28 09:55:07.026656 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 551/1115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:06 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1249 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:07.034340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0545ce29-6af6-4c5c-a3de-f0c64d11e71c tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "1231142364"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:07.048207 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-0545ce29-6af6-4c5c-a3de-f0c64d11e71c tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] HTTP exception thrown: Flavor 1231142364 could not be found. Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0545ce29-6af6-4c5c-a3de-f0c64d11e71c tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] Request method failure captured: Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 107 Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6bxnzTnaTKhyVnMBBvjI4PbSv8NqgXWxHla5x1vOpolgINQBcqvzOuqPQ0VSaqI_HMrft4DdBGchJ6N0pzj67wIbKldYFLl5NjpLUYKeYFjJ4D0Lz53gif_thAEwZSluL9Q307tRFFI3nf4H951Y_XIWY5mk_EPTokFdFGTLqogmQM Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd2c6115cdf2430fa42def1053e4b3e0 Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FlavorsAdminTestJSON-2139198491 Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:55:07.059083 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd2c6115cdf2430fa42def1053e4b3e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd2c6115cdf2430fa42def1053e4b3e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd2c6115cdf2430fa42def1053e4b3e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd2c6115cdf2430fa42def1053e4b3e0"}]}] Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FlavorsAdminTestJSON-2139198491 Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd2c6115cdf2430fa42def1053e4b3e0 Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-2139198491 Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FlavorsAdminTestJSON-2139198491-project Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f16c5123d4c441c4af00413afd47d1c1 Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FlavorsAdminTestJSON-2139198491-project Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "test", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "1231142364"}} Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:55:07.060691 n-d-zed-1 devstack@n-api.service[128748]: exception: Flavor 1231142364 could not be found. Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '1231142364'}}} Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1231142364 could not be found. Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:07.061648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1231142364 could not be found. Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:07.063060 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1231142364 could not be found. Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0545ce29-6af6-4c5c-a3de-f0c64d11e71c tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] Returning 400 to user: Flavor 1231142364 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0545ce29-6af6-4c5c-a3de-f0c64d11e71c tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.032339 Oct 28 09:55:07.064501 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 552/1116] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:07 2022] POST /compute/v2.1/servers => generated 81 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 09:55:07.069636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.069636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:07.075995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.076488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.077580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.078724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.079196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.079632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.091789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:07.329950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:07.350068 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca93ffdf-8a59-48be-907a-941408d7706b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.285496 Oct 28 09:55:07.368183 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 553/1117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:07 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:07.368183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.368663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:07.382270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.383436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.383885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.385233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.386510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.387159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.550594 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cbb4f3a3-0ab5-4a98-b111-b05b42cc010f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4/action" status: 202 len: 0 microversion: 2.25 time: 2.259670 Oct 28 09:55:07.551516 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 565/1118] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:55:05 2022] POST /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4/action => generated 0 bytes in 2261 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:07.559754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.560454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:07.568336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.568947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.569478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.570184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.570729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.571150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.641509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:07.650691 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-557b9f28-5b48-41b0-a353-c5b2048c1bd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1542 microversion: 2.1 time: 0.292442 Oct 28 09:55:07.658593 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 554/1119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:07 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1542 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:07.666463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c74526ed-f532-4609-92fc-856d53a329c6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33860310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.795289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c74526ed-f532-4609-92fc-856d53a329c6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.135215 Oct 28 09:55:07.799491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 555/1120] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:07 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:07.812426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5eabd9fa-375f-4bab-9ced-e1c0e871bd6c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.852766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5eabd9fa-375f-4bab-9ced-e1c0e871bd6c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1231142364" status: 202 len: 0 microversion: 2.1 time: 0.051054 Oct 28 09:55:07.858560 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 556/1121] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:07 2022] DELETE /compute/v2.1/flavors/1231142364 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:07.874046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-15d5d0a3-9b93-464d-818f-d1702ebf4268 req-702b757c-aca0-4278-a505-9ed776b9e378 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f4eab3e-5428-452b-9a92-47468a9cce9e", "tag": "d4186ca8-dc8b-4fda-a547-01f8c26c2e1b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:07.902780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-15d5d0a3-9b93-464d-818f-d1702ebf4268 req-702b757c-aca0-4278-a505-9ed776b9e378 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.903408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-15d5d0a3-9b93-464d-818f-d1702ebf4268 req-702b757c-aca0-4278-a505-9ed776b9e378 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.903945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-15d5d0a3-9b93-464d-818f-d1702ebf4268 req-702b757c-aca0-4278-a505-9ed776b9e378 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.924108 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-15d5d0a3-9b93-464d-818f-d1702ebf4268 req-702b757c-aca0-4278-a505-9ed776b9e378 service nova] Creating event network-changed:d4186ca8-dc8b-4fda-a547-01f8c26c2e1b for instance 9f4eab3e-5428-452b-9a92-47468a9cce9e on n-h1-zed-1 Oct 28 09:55:07.939116 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-15d5d0a3-9b93-464d-818f-d1702ebf4268 req-702b757c-aca0-4278-a505-9ed776b9e378 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075567 Oct 28 09:55:07.943162 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 557/1122] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:07.958003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:07.959679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:07.974524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.978815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.982338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:07.986747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:07.987567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:07.992604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.089377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.125273 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd3260bc-afa1-49ee-98f8-1519d95cc1c0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1513 microversion: 2.1 time: 0.572173 Oct 28 09:55:08.126035 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 566/1123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:07 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1513 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:08.145463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.146490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:08.154992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.155493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.155939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.156654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.157148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.157784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.243668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.255047 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c366f32-9617-4e66-8434-1085c36ddbe0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.310285 Oct 28 09:55:08.258452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 558/1124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:07 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:08.272293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.277441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:08.287863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.288480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.289058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.289801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.290266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.290698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.387851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62352435-91b1-404d-b8a3-9fa3849e8c9b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127325 Oct 28 09:55:08.388472 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 559/1125] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:08.395722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce67369c-ce20-4a72-ac09-8e1a09e0cf9a tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.433616 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce67369c-ce20-4a72-ac09-8e1a09e0cf9a tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040326 Oct 28 09:55:08.434596 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 560/1126] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:08.441026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4ea703f9-297b-4ced-9580-cfb60f84eff2 req-34551c70-d307-4a53-80a0-8f9d83ab714c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:08.455780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4ea703f9-297b-4ced-9580-cfb60f84eff2 req-34551c70-d307-4a53-80a0-8f9d83ab714c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.456763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4ea703f9-297b-4ced-9580-cfb60f84eff2 req-34551c70-d307-4a53-80a0-8f9d83ab714c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.457627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4ea703f9-297b-4ced-9580-cfb60f84eff2 req-34551c70-d307-4a53-80a0-8f9d83ab714c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.478429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4ea703f9-297b-4ced-9580-cfb60f84eff2 req-34551c70-d307-4a53-80a0-8f9d83ab714c service nova] Creating event network-changed:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h2-zed-1 Oct 28 09:55:08.489812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4ea703f9-297b-4ced-9580-cfb60f84eff2 req-34551c70-d307-4a53-80a0-8f9d83ab714c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053110 Oct 28 09:55:08.490984 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 561/1127] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:08.497814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.498916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:08.508292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.509220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.510045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.511037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.511993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.512858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.513627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.523359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.534288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.536075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-648e90e6-126e-42e7-80de-0347fadce409 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.401700 Oct 28 09:55:08.536637 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 567/1128] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:08.542668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.556076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:08.560403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.560980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.561376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.562090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.562557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.562979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.678679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.692637 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-03319fec-f727-4bcd-af1d-9ae2fc695f46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1297 microversion: 2.1 time: 0.200162 Oct 28 09:55:08.693816 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 562/1129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1297 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:08.698717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.702510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:08.716719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.719242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.719477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.721764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.726646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.729934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.803084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.814659 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b9bd19b2-e994-46e2-bb0f-c79f85abfb01 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1511 microversion: 2.1 time: 0.276585 Oct 28 09:55:08.815110 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 568/1130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:08.819951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45fcb7ab-4616-460b-aeb0-b67b04bb249c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-46459451", "id": 1918964804, "os-flavor-access:is_public": "False"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:08.843610 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45fcb7ab-4616-460b-aeb0-b67b04bb249c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.027122 Oct 28 09:55:08.844730 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 569/1131] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:08 2022] POST /compute/v2.1/flavors => generated 413 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:08.850297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37f2eca9-71d4-490c-bb42-113d52d919da tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca335c6b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.917406 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37f2eca9-71d4-490c-bb42-113d52d919da tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.070594 Oct 28 09:55:08.918653 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 570/1132] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:08.924307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:08.933502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:08.935153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:08.954731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.955410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.956020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:08.956967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:08.957952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:08.959852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:09.079367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:09.155784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:09.163209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:09.163800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:09.164441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:09.359687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-477230d6-78b0-43f5-aa39-db0ae8d88364 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1514 microversion: 2.1 time: 0.439680 Oct 28 09:55:09.360549 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 571/1133] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1514 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:09.367672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe313973-a891-401d-83e4-4a5cfa8e5fb6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1810245860", "id": 1758835994, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:09.399466 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe313973-a891-401d-83e4-4a5cfa8e5fb6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.036820 Oct 28 09:55:09.400803 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 572/1134] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:09 2022] POST /compute/v2.1/flavors => generated 414 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:09.409454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-61cd4974-76d3-4d45-b950-1aab802e28a8 req-80d28db4-7e86-4044-ae06-598738ac76d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd254e-662a-4020-9421-b76fb300937d", "name": "network-vif-unplugged", "status": "completed", "tag": "a53f8536-805c-4547-b056-8cc4428c8aba"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:09.421914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-61cd4974-76d3-4d45-b950-1aab802e28a8 req-80d28db4-7e86-4044-ae06-598738ac76d7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:09.422827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-61cd4974-76d3-4d45-b950-1aab802e28a8 req-80d28db4-7e86-4044-ae06-598738ac76d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:09.423478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-61cd4974-76d3-4d45-b950-1aab802e28a8 req-80d28db4-7e86-4044-ae06-598738ac76d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:09.439334 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-61cd4974-76d3-4d45-b950-1aab802e28a8 req-80d28db4-7e86-4044-ae06-598738ac76d7 service nova] Creating event network-vif-unplugged:a53f8536-805c-4547-b056-8cc4428c8aba for instance a8fd254e-662a-4020-9421-b76fb300937d on n-h2-zed-1 Oct 28 09:55:09.445039 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-61cd4974-76d3-4d45-b950-1aab802e28a8 req-80d28db4-7e86-4044-ae06-598738ac76d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041635 Oct 28 09:55:09.446234 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 573/1135] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:09.582108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:09.603469 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-440fb4eb-a688-4233-a430-9b1fb6509a86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.908222 Oct 28 09:55:09.605806 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 563/1136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:08 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:09.613897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:09.627485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:09.628379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:09.635143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:09.636303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1279397735', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:09.640727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:09.643640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:09.644706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:09.647132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:09.648430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:09.649150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:09.650324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:09.651255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:09.654882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:09.656123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:09.656949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:09.657555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:09.844896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:09.963344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:09.974955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:09.975841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:09.978554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.018919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:10.021964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:10.033887 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d76d0c1-fc41-4412-b176-e855a3062e10 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.586087 Oct 28 09:55:10.049393 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 574/1137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:09 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:10.057523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fc1bb330-eded-4d35-997d-ed293a7bc7c7 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.111194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fc1bb330-eded-4d35-997d-ed293a7bc7c7 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 416 microversion: 2.1 time: 0.059994 Oct 28 09:55:10.118501 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 575/1138] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 416 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:10.138827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.143949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:10.164672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.168880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.171200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.174522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.175668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.176836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.291919 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fff3288f-4acd-4bc0-bfce-4f2728afd085 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1279397735" status: 200 len: 1516 microversion: 2.1 time: 0.684588 Oct 28 09:55:10.292475 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 564/1139] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:55:09 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1279397735 => generated 1516 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:10.297128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.298010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:10.313983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.314476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.314922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.316241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.316241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.316537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.435728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:10.436652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:10.445060 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fc8b14f9-add8-4d9d-b40a-c57bbe63aa47 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1303 microversion: 2.1 time: 0.151380 Oct 28 09:55:10.445757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 565/1140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1303 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:10.451008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:10.452953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:10.454360 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fca901fa-43c0-4454-ad29-045828a702c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.325502 Oct 28 09:55:10.455159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 576/1141] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:10.459755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5276de31-7b39-45fe-919a-4c7a55b52441 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.470731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5276de31-7b39-45fe-919a-4c7a55b52441 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 416 microversion: 2.1 time: 0.014329 Oct 28 09:55:10.471580 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 577/1142] 10.222.0.16 () {58 vars in 1177 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 416 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:10.474118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e21a9fcd-e5dc-4425-b847-a62f1c682a67 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33e13700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.485388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.496556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:10.499195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:10.520945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.521439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.521877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.522601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.523060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.523480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.571736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e21a9fcd-e5dc-4425-b847-a62f1c682a67 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.123058 Oct 28 09:55:10.579385 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 566/1143] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:10.585386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-afce8bb7-6957-4859-902b-e4eaecbfbdba tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.606449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-afce8bb7-6957-4859-902b-e4eaecbfbdba tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 416 microversion: 2.1 time: 0.025864 Oct 28 09:55:10.616448 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 567/1144] 10.222.0.16 () {58 vars in 1171 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 416 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:10.622479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ae1e5d0-4207-484c-9a12-bd468980ecd6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.639209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ae1e5d0-4207-484c-9a12-bd468980ecd6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 416 microversion: 2.1 time: 0.021511 Oct 28 09:55:10.643971 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 568/1145] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 416 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:10.658564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:10.659136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:10.665451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.665939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.666376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.667116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.668238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.668743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:10.727891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:10.813392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:10.824492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:10.824492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:10.824492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:11.334979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:11.358860 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39adc8fe-1eb1-4ac9-b417-4c7c46d03c4c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.704010 Oct 28 09:55:11.365442 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2a238063-7945-4184-82f3-128ba5c745de tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4518 microversion: 2.1 time: 0.892595 Oct 28 09:55:11.376928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 569/1146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:11.377706 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 578/1147] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 09:55:10 2022] GET /compute/v2.1/servers/detail?status=active => generated 4518 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:11.389549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8719a02e-0b22-4b58-9766-820a10ffb617 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:11.394097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:11.394955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:11.414436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:11.421659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:11.422386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:11.423581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:11.424209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:11.424809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:11.450366 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8719a02e-0b22-4b58-9766-820a10ffb617 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.079019 Oct 28 09:55:11.459099 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 570/1148] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 09:55:11 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:11.469341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:11.474859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:11.481677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.servers [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Removing options 'limit' from query {{(pid=128748) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 09:55:11.483021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:11.491909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:11.499203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:11.499906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:11.501108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:11.501732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:11.502389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:11.645006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:11.655906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:11.659047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:11.659681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.268519 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-78c829ab-a814-4f32-90b5-6ee23c5d6be0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1660 microversion: 2.1 time: 0.807984 Oct 28 09:55:12.269136 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 571/1149] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:11 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1660 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:12.288376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:12.288376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:12.303474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:12.303977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:12.304431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.305636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:12.305636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:12.306031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.351029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:12.382861 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-571f2cef-ecd5-4636-b7de-23d60773e9ea tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 1.002098 Oct 28 09:55:12.388690 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 579/1150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:11 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:12.397713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:12.399385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:12.416162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:12.417390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:12.418096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.419020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:12.420527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:12.421325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.650174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:12.660594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:12.667323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:12.674765 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eac1a936-d404-44e4-8968-d5a890e3ea61 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.283305 Oct 28 09:55:12.676938 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 580/1151] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:12 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:12.690126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ac98bb7-346d-4da8-a1a9-ad0711a3bf17 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:12.740091 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ac98bb7-346d-4da8-a1a9-ad0711a3bf17 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.061169 Oct 28 09:55:12.745792 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 581/1152] 10.222.0.16 () {58 vars in 1175 bytes} [Fri Oct 28 09:55:12 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:12.756424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f63d413-4541-4d6b-b14f-d9fa3b71db40 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3367d8b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:12.834113 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f63d413-4541-4d6b-b14f-d9fa3b71db40 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.086848 Oct 28 09:55:12.844208 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 582/1153] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:12 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:12.850219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:12.856802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:12.858679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:12.864598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:12.865265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:12.865796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.866628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:12.867200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:12.867727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.952763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:12.966995 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e8b34bce-bf41-4fd3-9c65-e23fe5bea8bc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.696758 Oct 28 09:55:12.968142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 572/1154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:12 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:12.975631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:12.976526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:12.991512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:12.994217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:12.996801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:12.999722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.004684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.005439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:13.009413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.135410 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-048fd8bc-9fa0-4e9c-ac49-bf29cc0f1add tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?status=active" status: 200 len: 1010 microversion: 2.1 time: 0.287138 Oct 28 09:55:13.141323 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 583/1155] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 09:55:12 2022] GET /compute/v2.1/servers?status=active => generated 1010 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:13.147782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7246175-4c29-4e1d-b013-52ea348de492 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.209215 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7246175-4c29-4e1d-b013-52ea348de492 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.065230 Oct 28 09:55:13.210742 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 584/1156] 10.222.0.16 () {58 vars in 1173 bytes} [Fri Oct 28 09:55:13 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:13.238035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.245928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:13.247156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.servers [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Removing options 'limit' from query {{(pid=128747) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 09:55:13.249467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:13.258375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.258977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.259539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.261110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.262051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.262834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.320941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:13.369528 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14357f2e-1ed2-48ae-b6e5-6d74b855d6e1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1010 microversion: 2.1 time: 0.136884 Oct 28 09:55:13.379992 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 585/1157] 10.222.0.16 () {58 vars in 1150 bytes} [Fri Oct 28 09:55:13 2022] GET /compute/v2.1/servers?limit=100000 => generated 1010 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:13.386551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cc6283f-2f05-4181-9283-4d76b4601b28 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.423873 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cc6283f-2f05-4181-9283-4d76b4601b28 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.041319 Oct 28 09:55:13.446336 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 586/1158] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 09:55:13 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:13.458916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e8110fe4-b82b-4ae3-a317-d0e51529eed8 req-7102c5c2-1431-44f0-8c9f-c25fb304aed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc7662d-f778-4cd9-8b6f-4f29a6954ce4", "name": "network-vif-unplugged", "status": "completed", "tag": "8cb76f58-dfbc-420d-b4ac-b6ed3360ea99"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:13.511308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e8110fe4-b82b-4ae3-a317-d0e51529eed8 req-7102c5c2-1431-44f0-8c9f-c25fb304aed3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.514190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:13.515451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e8110fe4-b82b-4ae3-a317-d0e51529eed8 req-7102c5c2-1431-44f0-8c9f-c25fb304aed3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.520976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e8110fe4-b82b-4ae3-a317-d0e51529eed8 req-7102c5c2-1431-44f0-8c9f-c25fb304aed3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.534014 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e7cadc6c-e684-49aa-be31-160f4fbb81ba tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.563655 Oct 28 09:55:13.555047 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 573/1159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:12 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:13.562256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.563069 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e8110fe4-b82b-4ae3-a317-d0e51529eed8 req-7102c5c2-1431-44f0-8c9f-c25fb304aed3 service nova] Creating event network-vif-unplugged:8cb76f58-dfbc-420d-b4ac-b6ed3360ea99 for instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 on n-h2-zed-1 Oct 28 09:55:13.572691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:13.574249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:13.587422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e8110fe4-b82b-4ae3-a317-d0e51529eed8 req-7102c5c2-1431-44f0-8c9f-c25fb304aed3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138899 Oct 28 09:55:13.601725 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 587/1160] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:13.605072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.605806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.606423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.607475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.608183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.609907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.624962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7c26e61c-4956-4b1a-a489-f56a7f55b609 req-c5b2fed5-429b-458f-86a6-0a5232d635a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73f7b43e-9af7-48b0-b0fc-ad060328abbf", "tag": "5a5bee98-bf90-4c92-b3a5-a7436e5ffedb"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:13.663879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7c26e61c-4956-4b1a-a489-f56a7f55b609 req-c5b2fed5-429b-458f-86a6-0a5232d635a6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.664551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7c26e61c-4956-4b1a-a489-f56a7f55b609 req-c5b2fed5-429b-458f-86a6-0a5232d635a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.670493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7c26e61c-4956-4b1a-a489-f56a7f55b609 req-c5b2fed5-429b-458f-86a6-0a5232d635a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.704836 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7c26e61c-4956-4b1a-a489-f56a7f55b609 req-c5b2fed5-429b-458f-86a6-0a5232d635a6 service nova] Creating event network-changed:5a5bee98-bf90-4c92-b3a5-a7436e5ffedb for instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf on n-h1-zed-1 Oct 28 09:55:13.717084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7c26e61c-4956-4b1a-a489-f56a7f55b609 req-c5b2fed5-429b-458f-86a6-0a5232d635a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113055 Oct 28 09:55:13.720840 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 588/1161] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:13.730963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.736881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:13.752179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:13.761039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.761945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.764337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.765342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.767156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.770306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.902864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06c7da1e-01cd-4a75-90eb-da4a0d558397 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1010 microversion: 2.1 time: 0.321737 Oct 28 09:55:13.905470 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 574/1162] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 09:55:13 2022] GET /compute/v2.1/servers => generated 1010 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:13.924597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f17a586-5c59-4fe8-84f9-11f38aa3194f tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.972614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f17a586-5c59-4fe8-84f9-11f38aa3194f tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1758835994" status: 202 len: 0 microversion: 2.1 time: 0.063163 Oct 28 09:55:13.975228 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 575/1163] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:13 2022] DELETE /compute/v2.1/flavors/1758835994 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:13.987214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:13.988164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:13.996472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.997203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.997646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:13.998390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:13.998839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:13.999272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.276218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.286106 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d683bcd6-fc9a-46de-8b75-a1b8f7306fc1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.562834 Oct 28 09:55:14.297461 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 589/1164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:13 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:14.308577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96b5c0c6-171f-48f4-b1f8-1fc6d0803107 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca335b2af0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.371439 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96b5c0c6-171f-48f4-b1f8-1fc6d0803107 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.072557 Oct 28 09:55:14.380431 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 590/1165] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:14 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:14.383751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.389019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.389831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:14.404777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.405315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.405760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.406504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.406964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.407404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.511256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:14.596897 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3ff1a1ca-d147-4346-8331-4f013c457537 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 345 microversion: 2.1 time: 0.221242 Oct 28 09:55:14.596897 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 591/1166] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:14 2022] GET /compute/v2.1/servers?flavor=451 => generated 345 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:14.605054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-145c5eac-81ba-467a-8bfd-1847c355d0e6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.626057 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-145c5eac-81ba-467a-8bfd-1847c355d0e6 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028320 Oct 28 09:55:14.626670 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 592/1167] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:14.631770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.632550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:14.639440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.639945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.640386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.641431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.641892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.642322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.825492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.830448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.840687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.842431 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d338aea6-d1a9-4043-84f5-2dd910d0924f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.214689 Oct 28 09:55:14.842844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.844529 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67bed292-327c-4ed4-a62d-995371977d06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.867784 Oct 28 09:55:14.845388 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 576/1168] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:13 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:14.854817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-66a63732-6f3b-49dd-a077-560cee208aa2 req-0f5e21c3-bcd6-44e9-ac19-87288510bfdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ac7f33-0abb-4958-8a4b-42eaec67578a", "name": "network-vif-plugged", "status": "completed", "tag": "e54700aa-52ee-4f0a-b07e-8955746bd325"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:14.855185 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 593/1169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:14 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:14.865265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.866553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:14.872633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66a63732-6f3b-49dd-a077-560cee208aa2 req-0f5e21c3-bcd6-44e9-ac19-87288510bfdc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.873559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66a63732-6f3b-49dd-a077-560cee208aa2 req-0f5e21c3-bcd6-44e9-ac19-87288510bfdc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.874174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66a63732-6f3b-49dd-a077-560cee208aa2 req-0f5e21c3-bcd6-44e9-ac19-87288510bfdc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.874480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.874987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.875959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.876696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.877195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.878114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.888478 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-66a63732-6f3b-49dd-a077-560cee208aa2 req-0f5e21c3-bcd6-44e9-ac19-87288510bfdc service nova] Creating event network-vif-plugged:e54700aa-52ee-4f0a-b07e-8955746bd325 for instance 54ac7f33-0abb-4958-8a4b-42eaec67578a on n-h2-zed-1 Oct 28 09:55:14.894498 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-66a63732-6f3b-49dd-a077-560cee208aa2 req-0f5e21c3-bcd6-44e9-ac19-87288510bfdc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043143 Oct 28 09:55:14.895602 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 577/1170] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:14.902809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.909397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.910070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.servers [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Removing options 'limit' from query {{(pid=128748) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 09:55:14.911387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:14.917543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.918248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.918879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.919935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:14.920556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:14.921387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:14.952122 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4f29aed6-e76c-4902-998a-3420f2da3186 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=1" status: 200 len: 484 microversion: 2.1 time: 0.054260 Oct 28 09:55:14.953333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 578/1171] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 09:55:14 2022] GET /compute/v2.1/servers?limit=1 => generated 484 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:14.958050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd3683c7-5c88-4850-a2e3-1096762559db tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.979149 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd3683c7-5c88-4850-a2e3-1096762559db tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1918964804" status: 202 len: 0 microversion: 2.1 time: 0.024356 Oct 28 09:55:14.981288 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 579/1172] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 09:55:14 2022] DELETE /compute/v2.1/flavors/1918964804 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:14.987838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:14.994154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:14.995341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1279397735', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:15.001665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.002409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.003164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.004388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.005387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.006178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.074156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:15.082983 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dbb603e0-6233-4c01-91fe-7edeb3f8deff tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.226471 Oct 28 09:55:15.084498 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 594/1173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:14 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.090596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-284c1ce9-6092-4096-ab40-bcee4cff101e tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.112893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-284c1ce9-6092-4096-ab40-bcee4cff101e tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026411 Oct 28 09:55:15.127379 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 595/1174] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.129515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:15.140778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ccb2f80-4fea-4361-9cda-d9a3b85b179c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-990596765", "id": 551622535, "os-flavor-access:is_public": "False"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:15.165655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=6,nova_api:INSERT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:15.171748 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ccb2f80-4fea-4361-9cda-d9a3b85b179c tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.036802 Oct 28 09:55:15.185076 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 596/1175] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:15 2022] POST /compute/v2.1/flavors => generated 411 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:15.192424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-76865cc7-22f2-45d9-8ccc-0e1e628c16f3 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.202581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:15.206192 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01456805-b440-4f19-8c90-70908ef71ce0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1279397735" status: 200 len: 346 microversion: 2.1 time: 0.223417 Oct 28 09:55:15.207046 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 580/1176] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 09:55:14 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1279397735 => generated 346 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:15.219615 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-76865cc7-22f2-45d9-8ccc-0e1e628c16f3 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033605 Oct 28 09:55:15.220043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-092a5033-2ea1-4c85-a262-209290476c96 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:15.221523 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 597/1177] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.234818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-092a5033-2ea1-4c85-a262-209290476c96 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.234818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-092a5033-2ea1-4c85-a262-209290476c96 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.234818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-092a5033-2ea1-4c85-a262-209290476c96 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.247135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e0d0085a-a7b9-4260-a77e-eef91b18232c tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.280422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e0d0085a-a7b9-4260-a77e-eef91b18232c tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.040681 Oct 28 09:55:15.295857 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 598/1178] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:15.303494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29bae32f-415b-473a-a346-476c96b1be6e tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.315660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-092a5033-2ea1-4c85-a262-209290476c96 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Going to try to stop instance {{(pid=128748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 09:55:15.332484 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29bae32f-415b-473a-a346-476c96b1be6e tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/551622535" status: 202 len: 0 microversion: 2.1 time: 0.032644 Oct 28 09:55:15.336279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 599/1179] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:55:15 2022] DELETE /compute/v2.1/flavors/551622535 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:55:15.342105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.342780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:15.354359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.355125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.355723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.357206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.358022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.360518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.391818 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-092a5033-2ea1-4c85-a262-209290476c96 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "POST /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e/action" status: 202 len: 0 microversion: 2.1 time: 0.175319 Oct 28 09:55:15.396301 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 581/1180] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:55:15 2022] POST /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:55:15.422067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d75c745-bb0f-488d-9cd4-4b048195366a tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.450892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d75c745-bb0f-488d-9cd4-4b048195366a tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037061 Oct 28 09:55:15.451644 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 582/1181] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.475965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a54ca9c5-1dc4-48ed-bc2c-3fe3257e05ed tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33603700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.529955 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a54ca9c5-1dc4-48ed-bc2c-3fe3257e05ed tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.067499 Oct 28 09:55:15.532112 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 583/1182] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.543828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.545110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:15.555379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.557110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:15.558254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.561559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.562532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.564400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.567765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.570600 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-47f9f644-cb4c-4b4e-9c5e-6ffe89832957 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.235402 Oct 28 09:55:15.572320 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 600/1183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.578710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d0fd9a4-6347-46b5-be94-fd5fb4989387 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1614342322", "id": 652053236, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:15.617173 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d0fd9a4-6347-46b5-be94-fd5fb4989387 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.043241 Oct 28 09:55:15.618246 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 601/1184] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:15 2022] POST /compute/v2.1/flavors => generated 411 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:15.638193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-057f2ccf-f07b-48b9-b861-0ec69eb02a99 tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.666481 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-057f2ccf-f07b-48b9-b861-0ec69eb02a99 tempest-FlavorsAdminTestJSON-2139198491 tempest-FlavorsAdminTestJSON-2139198491-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5392 microversion: 2.1 time: 0.033637 Oct 28 09:55:15.668078 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 602/1185] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/flavors/detail => generated 5392 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.690504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c8021ca-4448-43e0-8f79-901aecf2c39b tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.714341 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c8021ca-4448-43e0-8f79-901aecf2c39b tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/652053236" status: 202 len: 0 microversion: 2.1 time: 0.028448 Oct 28 09:55:15.714926 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 603/1186] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:55:15 2022] DELETE /compute/v2.1/flavors/652053236 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:55:15.722744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d9c7b40c-9c6d-41df-8c99-1b099c2539b2 req-32cd0f3d-6391-47dd-90e8-99bf8ac559a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc7662d-f778-4cd9-8b6f-4f29a6954ce4", "tag": "8cb76f58-dfbc-420d-b4ac-b6ed3360ea99"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:15.738965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d9c7b40c-9c6d-41df-8c99-1b099c2539b2 req-32cd0f3d-6391-47dd-90e8-99bf8ac559a0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.739450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d9c7b40c-9c6d-41df-8c99-1b099c2539b2 req-32cd0f3d-6391-47dd-90e8-99bf8ac559a0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.740034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d9c7b40c-9c6d-41df-8c99-1b099c2539b2 req-32cd0f3d-6391-47dd-90e8-99bf8ac559a0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.752340 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d9c7b40c-9c6d-41df-8c99-1b099c2539b2 req-32cd0f3d-6391-47dd-90e8-99bf8ac559a0 service nova] Creating event network-changed:8cb76f58-dfbc-420d-b4ac-b6ed3360ea99 for instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 on n-h2-zed-1 Oct 28 09:55:15.757627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d9c7b40c-9c6d-41df-8c99-1b099c2539b2 req-32cd0f3d-6391-47dd-90e8-99bf8ac559a0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038639 Oct 28 09:55:15.758434 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 604/1187] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:15.768328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e0b55ae7-bf9e-4316-ab21-ad018f1740b3 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.792075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e0b55ae7-bf9e-4316-ab21-ad018f1740b3 tempest-FlavorsAdminTestJSON-1032864658 tempest-FlavorsAdminTestJSON-1032864658-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028479 Oct 28 09:55:15.797187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 605/1188] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.797559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:15.802097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-54773c97-34cc-4cc1-a499-ae03136f8cc8 req-eb9a341b-2b75-476e-b584-55d86b170aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd40166-156e-4d19-aa39-44ce7e03bbaf", "tag": "e4a0cf05-4ead-4e65-9732-3f4849c44d52"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:15.811849 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e03899bf-426a-4498-9f6f-b5b9e2ab50d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.278469 Oct 28 09:55:15.812455 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 584/1189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:15.815395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-54773c97-34cc-4cc1-a499-ae03136f8cc8 req-eb9a341b-2b75-476e-b584-55d86b170aff service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.816131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-54773c97-34cc-4cc1-a499-ae03136f8cc8 req-eb9a341b-2b75-476e-b584-55d86b170aff service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.816732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-54773c97-34cc-4cc1-a499-ae03136f8cc8 req-eb9a341b-2b75-476e-b584-55d86b170aff service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.829327 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-54773c97-34cc-4cc1-a499-ae03136f8cc8 req-eb9a341b-2b75-476e-b584-55d86b170aff service nova] Creating event network-changed:e4a0cf05-4ead-4e65-9732-3f4849c44d52 for instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf on n-h2-zed-1 Oct 28 09:55:15.834379 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-54773c97-34cc-4cc1-a499-ae03136f8cc8 req-eb9a341b-2b75-476e-b584-55d86b170aff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040320 Oct 28 09:55:15.835238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 606/1190] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:15.868310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.869173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:15.872941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:15.873735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:15.876636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=4,nova_api:DELETE=9 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:15.879086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.879642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.880743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.881734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.882314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.882854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.884992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.885656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.886100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:15.886943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:15.887409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:15.887837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:16.059496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.064967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.073842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.075567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.076027 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96c3d00e-9859-4eff-8389-0a3b73b13a46 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.213476 Oct 28 09:55:16.076892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-274888e7-3089-4775-969f-a73575b228f8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.208653 Oct 28 09:55:16.077304 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 585/1191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:16.077858 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 607/1192] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:15 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:16.116541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.117199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:16.123839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:16.124589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:16.125262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:16.126255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:16.126726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:16.127162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:16.272114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.280482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2575979c-cce3-4a4b-9d3f-9bf421459bb6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.168355 Oct 28 09:55:16.281088 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 586/1193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:16 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:16.547148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee74a908-d41e-4af0-93e6-be525a57c813 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3329e1f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.601999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.602618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:16.610677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:16.612184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:16.612639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:16.613403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:16.613865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:16.614296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:16.622123 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee74a908-d41e-4af0-93e6-be525a57c813 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.078308 Oct 28 09:55:16.628963 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 608/1194] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:16 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:16.761735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:16.769665 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e603d6a1-2dbe-424a-ab5f-f09b04b8c01e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.171780 Oct 28 09:55:16.770560 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 587/1195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:16 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:16.838724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:16.839345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:16.845556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:16.846046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:16.846689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:16.847402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:16.847862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:16.848296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.100021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:17.100800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:17.109167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.109816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.110357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.111199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.111930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.112471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.292635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.315127 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4b33fd71-282d-4628-9efa-e69ec08d5869 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.480632 Oct 28 09:55:17.328931 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 609/1196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:16 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:17.328931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:17.328931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:17.331169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.336259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.337041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.337487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.338208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.339238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.339674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.340896 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1162b680-9054-4ab8-a089-7212b37f79ce tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.245002 Oct 28 09:55:17.357144 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 588/1197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:17 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:17.357144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:17.357144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:17.357144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.357869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.357869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.357869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.357869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.358470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.363730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:17.537381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.547154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.547442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.549077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.550500 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64322543-2fe8-40a3-91d4-f6c9821d6073 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.233167 Oct 28 09:55:17.551621 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 610/1198] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:17 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:17.556378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-77eb4217-b5af-4bb3-9648-f531820a6c0d req-ef123a35-825e-458a-a231-445b96d60f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4eab3e-5428-452b-9a92-47468a9cce9e", "name": "network-vif-plugged", "status": "completed", "tag": "d4186ca8-dc8b-4fda-a547-01f8c26c2e1b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:17.558058 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07d1c223-3ce2-406a-a6f9-16712b779191 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.214804 Oct 28 09:55:17.568928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 589/1199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:17 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:17.569152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-77eb4217-b5af-4bb3-9648-f531820a6c0d req-ef123a35-825e-458a-a231-445b96d60f86 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.569152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-77eb4217-b5af-4bb3-9648-f531820a6c0d req-ef123a35-825e-458a-a231-445b96d60f86 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.569152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-77eb4217-b5af-4bb3-9648-f531820a6c0d req-ef123a35-825e-458a-a231-445b96d60f86 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.579465 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-77eb4217-b5af-4bb3-9648-f531820a6c0d req-ef123a35-825e-458a-a231-445b96d60f86 service nova] Creating event network-vif-plugged:d4186ca8-dc8b-4fda-a547-01f8c26c2e1b for instance 9f4eab3e-5428-452b-9a92-47468a9cce9e on n-h1-zed-1 Oct 28 09:55:17.587848 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-77eb4217-b5af-4bb3-9648-f531820a6c0d req-ef123a35-825e-458a-a231-445b96d60f86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034808 Oct 28 09:55:17.589149 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 611/1200] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:17.638743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe4350de-5cb1-4067-b05f-2df56731c872 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33603430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:17.700946 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe4350de-5cb1-4067-b05f-2df56731c872 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.066042 Oct 28 09:55:17.701780 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 590/1201] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:17 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:17.794662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:17.796588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:17.804205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.804952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.805646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.806371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:17.806839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:17.807347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:17.949599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:17.957517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b17c7eea-5917-4ea1-9b46-bcc3bd70d8e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.167675 Oct 28 09:55:17.968004 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 612/1202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:17 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:18.341061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:18.341883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:18.351793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.357439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.357714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.358500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.358964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.359395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.384454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:18.385805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:18.394952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.399580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.400026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.400830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.402005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.402428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.564203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.575320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76979428-1164-4fd1-be81-9e20a4f59551 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.239548 Oct 28 09:55:18.595834 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 591/1203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:18 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:18.631728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:18.638313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.642167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:18.647321 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45a437d7-3d35-466b-9dab-b8b37a1369a6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.267198 Oct 28 09:55:18.649556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 613/1204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:18 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:18.656094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.659407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.660053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.661011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.661774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:18.662933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.663739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:18.664513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.679938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.680432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.680868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.681612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:18.682064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:18.682533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:18.864145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.870167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.883897 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7e29afef-ed3a-4452-8ebf-5cfa4e1e4842 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.233006 Oct 28 09:55:18.889920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.891496 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 614/1205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:18 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:18.893279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:18.894504 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b2586cd5-1a95-4cd0-a956-4830e90c878d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.276115 Oct 28 09:55:18.895049 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 592/1206] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:18 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:18.918216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf940994-3584-4976-8d4b-5a66e82a7327 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca332af040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:18.982685 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf940994-3584-4976-8d4b-5a66e82a7327 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.086297 Oct 28 09:55:18.983959 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 615/1207] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:18 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:18.996805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.007987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:19.015639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.016518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.017235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.028786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.029335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.029788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.119298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7d1221c-8a5a-41a4-8f7a-bcdc15ad4ede tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1194607142", "id": 1854830283, "os-flavor-access:is_public": "True"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:19.148203 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7d1221c-8a5a-41a4-8f7a-bcdc15ad4ede tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.246816 Oct 28 09:55:19.149592 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 593/1208] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:55:18 2022] POST /compute/v2.1/flavors => generated 468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:19.237125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:19.246627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83543ddb-1e06-4fa0-802a-252c5e3b24ee tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.261230 Oct 28 09:55:19.249289 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 616/1209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:18 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:19.322247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9a83a00c-fb7c-4caf-9c3e-25816e863a6d tempest-FlavorsV261TestJSON-1664093308 tempest-FlavorsV261TestJSON-1664093308-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.335187 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9a83a00c-fb7c-4caf-9c3e-25816e863a6d tempest-FlavorsV261TestJSON-1664093308 tempest-FlavorsV261TestJSON-1664093308-project] 10.222.0.16 "GET /compute/v2.1/flavors/1854830283" status: 200 len: 468 microversion: 2.61 time: 0.175470 Oct 28 09:55:19.335742 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 594/1210] 10.222.0.16 () {60 vars in 1199 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/flavors/1854830283 => generated 468 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:19.349040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5af14590-073f-428e-a532-31628a362d07 tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:19.379544 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5af14590-073f-428e-a532-31628a362d07 tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] 10.222.0.16 "PUT /compute/v2.1/flavors/1854830283" status: 200 len: 469 microversion: 2.61 time: 0.034370 Oct 28 09:55:19.380578 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 617/1211] 10.222.0.16 () {62 vars in 1219 bytes} [Fri Oct 28 09:55:19 2022] PUT /compute/v2.1/flavors/1854830283 => generated 469 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:19.394270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-538897f9-b9c1-4cbb-9f2a-d804e3a8e726 tempest-FlavorsV261TestJSON-1664093308 tempest-FlavorsV261TestJSON-1664093308-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.421709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-538897f9-b9c1-4cbb-9f2a-d804e3a8e726 tempest-FlavorsV261TestJSON-1664093308 tempest-FlavorsV261TestJSON-1664093308-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.031954 Oct 28 09:55:19.422296 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 595/1212] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:19.444918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85f68175-82f2-4e95-9864-6cea3ec5398c tempest-FlavorsV261TestJSON-1664093308 tempest-FlavorsV261TestJSON-1664093308-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.466266 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85f68175-82f2-4e95-9864-6cea3ec5398c tempest-FlavorsV261TestJSON-1664093308 tempest-FlavorsV261TestJSON-1664093308-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.025009 Oct 28 09:55:19.466862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 618/1213] 10.222.0.16 () {60 vars in 1166 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:19.483403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16ee9776-3d05-4d95-a802-9b77350efcce tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.503341 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16ee9776-3d05-4d95-a802-9b77350efcce tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1854830283" status: 202 len: 0 microversion: 2.61 time: 0.023781 Oct 28 09:55:19.503933 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 596/1214] 10.222.0.16 () {60 vars in 1202 bytes} [Fri Oct 28 09:55:19 2022] DELETE /compute/v2.1/flavors/1854830283 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:19.512572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e0ed13a5-517c-4c7d-95c2-62aad9fcd1ff tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.535510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e0ed13a5-517c-4c7d-95c2-62aad9fcd1ff tempest-FlavorsV261TestJSON-1492455066 tempest-FlavorsV261TestJSON-1492455066-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.027056 Oct 28 09:55:19.536192 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 619/1215] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:19.607214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.608132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:19.628037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.628947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.629721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.631043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.631912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.632680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.688977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.690200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:19.698611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.699425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.700162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.701108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.702402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.703139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.835685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:19.848725 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2926436f-604f-48f6-89ca-9a8b50ed0980 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.246240 Oct 28 09:55:19.850169 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 597/1216] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:19.920701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:19.926195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.927206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:19.930147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c494dc4b-82ae-41fd-a761-c80ee9893a14 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.256314 Oct 28 09:55:19.934671 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 620/1217] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:19.952533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:19.953412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:19.956066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.957288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.958772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.960227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.962453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.963937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.984105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.984609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:19.990459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:19.991364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:19.991917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:20.001383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:20.239736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.248714 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f07060f1-ceeb-44cd-b916-3f10ebf153df tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.334403 Oct 28 09:55:20.250071 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 598/1218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:20.255290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-48acf60d-7ec1-4e40-af57-1f69d70b74f8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3349b3a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:20.334726 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-48acf60d-7ec1-4e40-af57-1f69d70b74f8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.083350 Oct 28 09:55:20.335310 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 599/1219] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:20 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:20.340791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:20.341448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:20.348491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:20.349597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:20.350064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:20.350902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:20.351450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:20.352160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:20.388844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.409500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.410988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.416280 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2a0f804d-697c-412c-a46e-f8f825d7cdfb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.480249 Oct 28 09:55:20.416928 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 621/1220] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:19 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:20.534341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:20.543318 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7df99e9-4ddc-4e14-a965-54c0760eec8d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.206652 Oct 28 09:55:20.548396 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 600/1221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:20 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:20.877137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:20.878610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:20.883193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=18 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:20.888937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:20.889712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:20.890191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:20.891077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:20.891703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:20.892078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:20.957396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:20.958382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:20.967766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:20.968524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:20.969357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:20.970344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:20.971075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:20.972094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:21.103325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.116678 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-614764e6-a8af-4653-af26-1f8f2d930351 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.244441 Oct 28 09:55:21.121740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 622/1222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:20 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:21.259958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.273730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:21.274502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:21.284143 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c76fc53c-e598-4b00-8b2c-64562313b5f5 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.330714 Oct 28 09:55:21.287284 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 601/1223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:20 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:21.287705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:21.288444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:21.289170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:21.290108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:21.290762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:21.291632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:21.351169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca2d7d61-1b45-499c-ab80-b6f7071710a2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3349b820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:21.433679 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca2d7d61-1b45-499c-ab80-b6f7071710a2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.086924 Oct 28 09:55:21.435122 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 602/1224] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:21 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:21.462531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:21.463081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:21.475015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:21.475515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:21.475987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:21.476682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:21.477169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:21.477600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:21.568461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.577555 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b0051ff-d3d3-4187-a6d4-492a428b741e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.307824 Oct 28 09:55:21.579095 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 623/1225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:21 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:21.584116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:21.585252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:21.592331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:21.601714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:21.603922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:21.615616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:21.616502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:21.617182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:21.642990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=14 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:21.759167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.777097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.780370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.785435 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9112d65a-ca15-439b-8296-40fc27b7cfed tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.332886 Oct 28 09:55:21.803924 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 603/1226] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:21 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:21.967575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:21.982781 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ad8a684-c71f-49e8-864c-b6a44b35fbf3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.402327 Oct 28 09:55:21.984075 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 624/1227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:21 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:22.148161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:22.149153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:22.158219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.158985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.175769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.176718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.177255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.177730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.251558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7bebcaba-4f34-4489-b069-c732fd4976a1 req-3a059276-edd8-4045-8378-ff35ddd41941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "name": "network-vif-plugged", "status": "completed", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:22.284874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7bebcaba-4f34-4489-b069-c732fd4976a1 req-3a059276-edd8-4045-8378-ff35ddd41941 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.285453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7bebcaba-4f34-4489-b069-c732fd4976a1 req-3a059276-edd8-4045-8378-ff35ddd41941 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.285893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7bebcaba-4f34-4489-b069-c732fd4976a1 req-3a059276-edd8-4045-8378-ff35ddd41941 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.325874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7bebcaba-4f34-4489-b069-c732fd4976a1 req-3a059276-edd8-4045-8378-ff35ddd41941 service nova] Creating event network-vif-plugged:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h2-zed-1 Oct 28 09:55:22.335650 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7bebcaba-4f34-4489-b069-c732fd4976a1 req-3a059276-edd8-4045-8378-ff35ddd41941 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095161 Oct 28 09:55:22.337579 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 625/1228] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:22.345584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:22.346917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:22.354854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.355683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.356366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.357572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.358232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.358833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.454793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:22.464569 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b26143c4-3401-4463-8acb-f3053a6e9554 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.321925 Oct 28 09:55:22.476640 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 604/1229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:22 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:22.490614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de581a0b-e31f-46ba-94db-1ea2f47d221c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca337d8e50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:22.568663 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de581a0b-e31f-46ba-94db-1ea2f47d221c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.081688 Oct 28 09:55:22.574000 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 605/1230] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:22 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:22.608926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:22.610521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:22.617616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.618404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.619022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.620442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.621268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.621973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.630496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:22.639226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:22.640827 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50b62688-85cb-4fc3-9ca4-2940cad490dd tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.301024 Oct 28 09:55:22.641620 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 626/1231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:22 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:22.799127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:22.808504 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-428e6f92-33ae-468c-a3b7-2efb5519d9ce tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.208688 Oct 28 09:55:22.821674 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 606/1232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:22 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:22.827236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:22.827894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:22.834956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.835449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.836046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:22.836965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:22.837421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:22.838422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.006703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:23.007499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:23.017171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.018858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.025393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.026670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.027251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.027918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.062895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:23.080496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:23.082302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:23.087302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2bba9d44-3995-4dcb-b8a8-768ae1ba5d16 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.264189 Oct 28 09:55:23.101805 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 627/1233] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:22 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:23.241785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:23.253453 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2bdf8e38-f2dd-4368-bce0-1c9d6c547c05 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.247939 Oct 28 09:55:23.254803 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 607/1234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:23 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:23.490759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:23.491579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:23.501309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.502170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.502825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.503558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.504052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.504487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.589114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a9eb1d4-4031-4702-a4c0-421c5d791d0c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca334b23a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:23.661128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a9eb1d4-4031-4702-a4c0-421c5d791d0c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.076774 Oct 28 09:55:23.662074 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 608/1235] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:23 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:23.669303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:23.670216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:23.677648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.678309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.679037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.679998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.680537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.681078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.730409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:23.738552 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee741cca-4b13-49ae-bab1-45aa97bc2214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.251927 Oct 28 09:55:23.739447 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 628/1236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:23 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:23.832798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:23.842587 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0153221-2958-4fc7-9d34-ee99e8a586c9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.178475 Oct 28 09:55:23.843196 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 609/1237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:23 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:23.848070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:23.848694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:23.855121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.855621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.856064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.856798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:23.857386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:23.857838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:23.998049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Calling method '.version_select at 0x7fca3324d160>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.002216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.003110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.004246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.031863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.033299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.034128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.040491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.049582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.050375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.050982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.058012 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da427e5f-68ff-4712-84b8-16a3c17a2eb9 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.263471 Oct 28 09:55:24.058869 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 629/1238] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:23 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:24.061237 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fc064989-134d-4087-9097-37d644e26696 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.216393 Oct 28 09:55:24.061840 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 610/1239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:23 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:24.116601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.117577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:24.127155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.127810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.128355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.129227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.130406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.130916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.201608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b783065-7815-4b88-a853-6b045a9425ba tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Calling method '.version_select at 0x7fca3324d700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.203349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1b783065-7815-4b88-a853-6b045a9425ba tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f13e3b839db9487899daf9bc5c4de493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bbd559abee4c0ebf98c18efad2303d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b783065-7815-4b88-a853-6b045a9425ba tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Request method failure captured: Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hypervisors/n-h1-zed-1/search HTTP/1.1 Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6cKLy0aeSGskeytuNdGdHQddIi2MzHU3zK9jdtA6T1vqKlQc6HMQzX0iaHmy069ew5Q_fhuKBdWY1nkk71-PMuWYL-OSebNER3-pizWc97qiDmkPPyD7jElp_dfbhsMsNAajM4frOFhwx8KrZEQMSm20ZqyqsZ4D7RWlH-y32XZkpI Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 15bbd559abee4c0ebf98c18efad2303d Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-244996764 Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:55:24.205056 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15bbd559abee4c0ebf98c18efad2303d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15bbd559abee4c0ebf98c18efad2303d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15bbd559abee4c0ebf98c18efad2303d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15bbd559abee4c0ebf98c18efad2303d"}]}] Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-244996764 Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 15bbd559abee4c0ebf98c18efad2303d Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-244996764 Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-244996764-project Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f13e3b839db9487899daf9bc5c4de493 Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-244996764-project Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 09:55:24.207101 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'n-h1-zed-1'} Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:55:24.208195 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 28 09:55:24.210792 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.213563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b783065-7815-4b88-a853-6b045a9425ba tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:24.213563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1b783065-7815-4b88-a853-6b045a9425ba tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/n-h1-zed-1/search" status: 403 len: 117 microversion: 2.1 time: 0.140015 Oct 28 09:55:24.213563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 630/1240] 10.222.0.16 () {58 vars in 1200 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/os-hypervisors/n-h1-zed-1/search => generated 117 bytes in 147 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:24.218166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Calling method '.version_select at 0x7fca33366940>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.219884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.220374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.220812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.228701 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Request method failure captured: Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6cL45SQTiW0ZbOHQR2If58BoBK16iXVZeOHh3wbczGPbfILROmE2vqM1YsUJZ2nYw0Oh5OPCV0Jw1FJ5K5yONb29LiL9oz2xvn06lha5PgA3JwEr8k5ZBNRYLUV5VzUUQWZgi35xC39Yl_9RZEiEgne8oIQwt64zQcWqtMnz2RwnXg Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: e18825598b2344c194fa88dd58c1bfe6 Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-438470840 Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:55:24.230508 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e18825598b2344c194fa88dd58c1bfe6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e18825598b2344c194fa88dd58c1bfe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e18825598b2344c194fa88dd58c1bfe6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e18825598b2344c194fa88dd58c1bfe6"}]}] Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-438470840 Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: e18825598b2344c194fa88dd58c1bfe6 Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-438470840 Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1b1ee166d69a4280a0787e34e81c1ae3 Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 09:55:24.231960 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.232799 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-51156268-c6fd-41ac-8ab0-d43c77497763 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.017802 Oct 28 09:55:24.234106 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 631/1241] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:24.248186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Calling method '.version_select at 0x7fca333660d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.252298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.253366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.254287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.282180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.283154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.284045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.303738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.304536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.304708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.305372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.315181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.317773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.318311 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ab1f0c41-590c-4e37-b37b-5915855aa40f tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.079478 Oct 28 09:55:24.319252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 632/1242] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:24.319801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2bffae71-3b99-4c93-b71e-86ffb2342287 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.207424 Oct 28 09:55:24.320806 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 611/1243] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:24.330132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.330745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:24.337529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.338010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.338495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.339202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.339650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.340074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.345337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f752d02b-867a-48f2-877e-3b5721d4e9ca tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Calling method '.version_select at 0x7fca33408e50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.347592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f752d02b-867a-48f2-877e-3b5721d4e9ca tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f13e3b839db9487899daf9bc5c4de493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bbd559abee4c0ebf98c18efad2303d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f752d02b-867a-48f2-877e-3b5721d4e9ca tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Request method failure captured: Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6cKLy0aeSGskeytuNdGdHQddIi2MzHU3zK9jdtA6T1vqKlQc6HMQzX0iaHmy069ew5Q_fhuKBdWY1nkk71-PMuWYL-OSebNER3-pizWc97qiDmkPPyD7jElp_dfbhsMsNAajM4frOFhwx8KrZEQMSm20ZqyqsZ4D7RWlH-y32XZkpI Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 15bbd559abee4c0ebf98c18efad2303d Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-244996764 Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:55:24.349467 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15bbd559abee4c0ebf98c18efad2303d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/15bbd559abee4c0ebf98c18efad2303d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_15bbd559abee4c0ebf98c18efad2303d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/15bbd559abee4c0ebf98c18efad2303d"}]}] Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-244996764 Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 15bbd559abee4c0ebf98c18efad2303d Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-244996764 Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-244996764-project Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f13e3b839db9487899daf9bc5c4de493 Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-244996764-project Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 09:55:24.351131 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1'} Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:55:24.352091 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 28 09:55:24.353706 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.355105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f752d02b-867a-48f2-877e-3b5721d4e9ca tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:24.355657 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f752d02b-867a-48f2-877e-3b5721d4e9ca tempest-HypervisorAdminNegativeUnderV252Test-244996764 tempest-HypervisorAdminNegativeUnderV252Test-244996764-project] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.019569 Oct 28 09:55:24.356313 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 612/1244] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:24.367780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Calling method '.version_select at 0x7fca3349b820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.370435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.371040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.371581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.379155 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] HTTP exception thrown: No hypervisor matching '6563029a-ab13-4528-8ee8-1a85b404f0c6' could be found. Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Request method failure captured: Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-hypervisors/6563029a-ab13-4528-8ee8-1a85b404f0c6/servers HTTP/1.1 Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6cL45SQTiW0ZbOHQR2If58BoBK16iXVZeOHh3wbczGPbfILROmE2vqM1YsUJZ2nYw0Oh5OPCV0Jw1FJ5K5yONb29LiL9oz2xvn06lha5PgA3JwEr8k5ZBNRYLUV5VzUUQWZgi35xC39Yl_9RZEiEgne8oIQwt64zQcWqtMnz2RwnXg Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e18825598b2344c194fa88dd58c1bfe6 Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-438470840 Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:55:24.380690 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e18825598b2344c194fa88dd58c1bfe6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e18825598b2344c194fa88dd58c1bfe6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e18825598b2344c194fa88dd58c1bfe6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e18825598b2344c194fa88dd58c1bfe6"}]}] Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-438470840 Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e18825598b2344c194fa88dd58c1bfe6 Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-438470840 Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1b1ee166d69a4280a0787e34e81c1ae3 Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: exception: No hypervisor matching '6563029a-ab13-4528-8ee8-1a85b404f0c6' could be found. Oct 28 09:55:24.382351 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '6563029a-ab13-4528-8ee8-1a85b404f0c6'} Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '6563029a-ab13-4528-8ee8-1a85b404f0c6' could be found. Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.383206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '6563029a-ab13-4528-8ee8-1a85b404f0c6' could be found. Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] Returning 404 to user: No hypervisor matching '6563029a-ab13-4528-8ee8-1a85b404f0c6' could be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-434d58e2-07ea-4366-9336-3a9f31e249f1 tempest-HypervisorAdminNegativeUnderV252Test-438470840 tempest-HypervisorAdminNegativeUnderV252Test-438470840-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors/6563029a-ab13-4528-8ee8-1a85b404f0c6/servers" status: 404 len: 123 microversion: 2.1 time: 0.018442 Oct 28 09:55:24.384922 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 613/1245] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/os-hypervisors/6563029a-ab13-4528-8ee8-1a85b404f0c6/servers => generated 123 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:24.449642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=16 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:24.503488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.512984 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c46d59f7-216e-4d7e-9380-cece3706f16f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.187829 Oct 28 09:55:24.513578 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 633/1246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:24.677858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90310912-0ef0-4723-8659-29a6c97f59d3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33eb0280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.732569 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90310912-0ef0-4723-8659-29a6c97f59d3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.058869 Oct 28 09:55:24.733293 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 614/1247] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:24.762974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.763660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:24.770898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.771641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.772387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.773343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.774036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.774548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.784115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:24.891822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:24.893829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:24.901881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.902712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.903385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.904380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:24.905077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:24.906012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:24.940684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:24.949444 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ade3dd97-2806-4920-92f1-445a4dc69865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.190914 Oct 28 09:55:24.950128 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 634/1248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:25.066309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:25.082877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.087571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.089218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:25.094522 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-993e2de0-fba6-44a4-a74e-4ccda97e1baf tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.208392 Oct 28 09:55:25.095274 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 615/1249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:24 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:25.095873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.096379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.096823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:25.097755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.098262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.098702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:25.267512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.275823 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4b3be75-d2c7-4232-82ad-8fad3ce6a2d8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.192958 Oct 28 09:55:25.284164 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 635/1250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:25 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:25.351336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.352091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:25.360042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.360887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.361481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:25.363513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.364304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.364957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:25.525263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.537659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.539464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.540287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.541353 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b8bfa88-198d-458d-915d-6fbd9aa98e86 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.195441 Oct 28 09:55:25.541930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:25.542563 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 616/1251] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:25 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:25.552504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.554005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.554934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:25.556472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.557554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.558698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:25.751233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd793433-bfc7-424c-a33e-c3d8932b2b63 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3340d040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.798837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:25.811307 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d14aa74-5286-470e-babb-1a31ba7bccb2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.278184 Oct 28 09:55:25.813189 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 636/1252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:25 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:25.820411 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd793433-bfc7-424c-a33e-c3d8932b2b63 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.076500 Oct 28 09:55:25.821026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 617/1253] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:25 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:25.974455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:25.975191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:25.982880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.983387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.983856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:25.984570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:25.985063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:25.985500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.126911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:26.127533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:26.133962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.134456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.135076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.136075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.136543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.137008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.155420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.171097 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6a597f5-769a-45b7-a110-78bd28b69930 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.201251 Oct 28 09:55:26.178316 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 637/1254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:25 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:26.303737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:26.304508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:26.305678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.315283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.315914 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52cd7581-5242-496a-bc66-5eb89a852eb3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.193620 Oct 28 09:55:26.316177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.317000 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 618/1255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:26 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:26.317527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.319238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.320369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.321468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.484644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.493290 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-afe4be45-4490-4726-8538-ffbe3c1394b7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.193731 Oct 28 09:55:26.493798 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 638/1256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:26 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:26.568381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:26.569038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:26.576290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.576798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.577264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.578016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.578476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.578914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.744405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.753364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.755181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:26.756936 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5785b692-3ae1-477f-ab2e-3b1b9fc3713b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.192576 Oct 28 09:55:26.768031 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 619/1257] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:26 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:26.837816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3dd5ad6c-da88-4eb5-9921-f46c50902ac4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3329e790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:26.838428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:26.839355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:26.847442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.847442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.847874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.848507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:26.849293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:26.849887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:26.901842 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3dd5ad6c-da88-4eb5-9921-f46c50902ac4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.066796 Oct 28 09:55:26.903560 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 639/1258] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:26 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:26.996470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.005711 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63960410-b51e-47f1-aae3-1798165228be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.171422 Oct 28 09:55:27.006303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 620/1259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:26 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:27.198618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.199240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:27.202417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=6,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:27.207155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.207657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.208100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.208825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.209330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.209775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.340343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.341020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:27.347772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.348291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.348777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.349653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.350041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.350562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.364579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.373877 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70f82b50-48e6-45c7-aa1b-e5650889ec21 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.180262 Oct 28 09:55:27.374541 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 640/1260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:27 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:27.497531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.506808 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-992b7f22-fd08-4a06-8150-99f7a3d71bec tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.170936 Oct 28 09:55:27.507416 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 621/1261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:27 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:27.515187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.515870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:27.522146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.522868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.523565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.524385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.525021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.525448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.529185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-453e137e-cac6-4f87-9d60-55a7f45c0b4f tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] Calling method '.version_select at 0x7fca3358f820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.543615 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-453e137e-cac6-4f87-9d60-55a7f45c0b4f tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.149165 Oct 28 09:55:27.544215 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 641/1262] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 09:55:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:27.556949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2921d6f2-705b-4592-90d6-2cd35f586a0f tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] Action: 'update', calling method: .version_select at 0x7fca33295940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:27.674461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.683880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29a32381-ad54-4e4b-b756-75dff36aa655 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.172176 Oct 28 09:55:27.684666 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 622/1263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:27 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:27.783125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.783696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:27.790201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.790690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.791188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.792324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:27.792777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:27.793221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:27.841008 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2921d6f2-705b-4592-90d6-2cd35f586a0f tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.287662 Oct 28 09:55:27.841707 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 642/1264] 10.222.0.16 () {60 vars in 1206 bytes} [Fri Oct 28 09:55:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:27.852570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7ee514f-22ce-43e8-9596-b4ba88ea506b tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] Calling method '.version_select at 0x7fca33ad81f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.863488 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7ee514f-22ce-43e8-9596-b4ba88ea506b tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.014409 Oct 28 09:55:27.864046 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 643/1265] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 09:55:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:27.875786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a5357a7-ca07-4084-90a0-33f27248e191 tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] Action: 'update', calling method: .version_select at 0x7fca3324da60>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:27.929533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.939291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.941112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:27.942540 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e22f3f93-4d8c-4707-8ccc-2c49975fa4f7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.163317 Oct 28 09:55:27.943195 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 623/1266] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:27 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:27.949080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba736475-89c4-40a4-8713-889f8b6055a2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3340d700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:27.987983 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a5357a7-ca07-4084-90a0-33f27248e191 tempest-QuotaClassesAdminTestJSON-825896596 tempest-QuotaClassesAdminTestJSON-825896596-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.115915 Oct 28 09:55:27.988712 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 644/1267] 10.222.0.16 () {60 vars in 1206 bytes} [Fri Oct 28 09:55:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:27.995963 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba736475-89c4-40a4-8713-889f8b6055a2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.051626 Oct 28 09:55:27.996541 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 624/1268] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:27 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:28.030754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:28.031455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:28.039883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.040631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.041406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.043107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.043892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.044669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.203968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:28.211624 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-59b435da-b32f-4082-aff9-8e6a9a7eccc4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.184686 Oct 28 09:55:28.212187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 645/1269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:28 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:28.398299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:28.399081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:28.406573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.407119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.407897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.409411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.410142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.410520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.534236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:28.534856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:28.541004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.541502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.542194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.542892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.543359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.543794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.625695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:28.633557 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dbf4d21a-28a0-4b79-828e-c1268227f214 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.239161 Oct 28 09:55:28.641273 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 625/1270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:28 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:28.706550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:28.707673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:28.714233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.714739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.715334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.715922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.716414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.716874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.741674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:28.750980 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d0c991a-596b-4c36-8baf-06c893d66174 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.221266 Oct 28 09:55:28.765629 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 646/1271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:28 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:28.867311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:28.876336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c92591d2-3bab-447d-972c-82a5d470d412 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.173606 Oct 28 09:55:28.883808 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 626/1272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:28 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:28.969235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:28.970108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:28.977034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.977700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.978082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:28.978798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:28.979914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:28.980348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.011401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09766bf5-e535-46c5-9d84-910f7863a394 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3349b430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:29.062853 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09766bf5-e535-46c5-9d84-910f7863a394 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.055057 Oct 28 09:55:29.063434 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 627/1273] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:29 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:29.131441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:29.140152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:29.141764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:29.143022 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b48db318-4839-4105-8a84-b081a81d656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.177863 Oct 28 09:55:29.143820 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 647/1274] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:28 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:29.236448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:29.237098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:29.243155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.243650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.244083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.245454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.245893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.246317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.401720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:29.410116 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-afe3ef5a-ba65-4651-b152-05d59bd3396d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.177738 Oct 28 09:55:29.410687 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 628/1275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:29 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:29.658633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:29.659248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:29.665222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=24,nova_api:INSERT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:29.667958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.668457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.668897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.669645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.670108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.670535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.775948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:29.777326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:29.785409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.786119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.786755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.787813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.788467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.789184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.828584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:29.853824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:29.863062 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c282bcea-a706-4663-b67c-c2e5dbcfc07e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.208210 Oct 28 09:55:29.864737 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 648/1276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:29 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:29.899758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:29.900373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:29.914513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.915015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.915457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:29.917065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:29.917527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:29.917950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:30.078648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.089082 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b768ba5b-620f-4a36-8604-21482870c581 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.317541 Oct 28 09:55:30.106682 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 629/1277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:29 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:30.112036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4654645d-276c-486a-a941-bcd99094647c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33408ca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:30.143265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.155365 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3bc94059-cfdc-4f3f-87ca-f98d64bd1251 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1317 microversion: 2.1 time: 0.258977 Oct 28 09:55:30.169604 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 649/1278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:29 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:30.177772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:30.178896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:30.179762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4654645d-276c-486a-a941-bcd99094647c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.071800 Oct 28 09:55:30.180437 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 630/1279] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:30 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:30.194888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:30.195799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:30.196423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:30.197234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:30.197745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:30.198719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:30.437194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:30.438745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:30.447486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:30.450106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:30.450814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:30.451609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:30.452646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:30.453265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:30.480435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.495356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.498193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.500662 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd5bc9f6-cbd5-4ed8-96b7-73498f801187 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.329800 Oct 28 09:55:30.502005 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 650/1280] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:30 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:30.837593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:30.846414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2c00f360-43cf-4f00-bf1e-247d9c3e54a1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.414517 Oct 28 09:55:30.847276 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 631/1281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:30 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:30.887529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:30.888151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:30.894593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:30.895082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:30.895820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:30.896533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:30.897029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:30.897451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.040298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.049006 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af3a088d-b52d-4eaf-9d1b-14113ab62716 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1523 microversion: 2.1 time: 0.165349 Oct 28 09:55:31.049579 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 651/1282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:30 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:31.121506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.122472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:31.129532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.130228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.130676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.131392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.131851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.132286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.189573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.190487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:31.197158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.197662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.198131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.198862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.199308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.199734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.307292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.315581 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f196769f-12d9-4063-a1f5-a54a1d7b4672 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.198349 Oct 28 09:55:31.316265 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 632/1283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:31 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:31.327163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84f38f9e-0026-498b-836d-b275f35d76a0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3343f820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.358906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.368305 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aea1a79f-dccd-4516-ba39-77c91b62a049 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1466 microversion: 2.1 time: 0.182333 Oct 28 09:55:31.369139 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 652/1284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:31 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1466 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:31.378822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84f38f9e-0026-498b-836d-b275f35d76a0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.061195 Oct 28 09:55:31.379587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 633/1285] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:31 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:31.391715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.392624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:31.399305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.399805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.400244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.401575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.402042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.402474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.586414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Action: 'update', calling method: .version_select at 0x7fca336723a0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:31.654441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.654930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.655369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.656098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.656557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.657014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.708597 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e8610fb2-7998-4f63-a3ce-7737817d4c1f tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0" status: 200 len: 148 microversion: 2.57 time: 0.282851 Oct 28 09:55:31.709249 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 634/1286] 10.222.0.16 () {62 vars in 1303 bytes} [Fri Oct 28 09:55:31 2022] PUT /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0 => generated 148 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:55:31.718056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.718764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:31.725123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.725625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.726075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.726779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.727238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.727669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.746782 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c519eaa7-a898-423c-804c-edad0a06fcd4 tempest-ServersOnMultiNodesTest-1005692945 tempest-ServersOnMultiNodesTest-1005692945-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1611 microversion: 2.1 time: 0.359071 Oct 28 09:55:31.747744 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 653/1287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:31 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1611 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:31.765993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Calling method '.version_select at 0x7fca3329e5e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.834632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.835119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.835556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.836452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.836741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.837253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.856305 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-255bf964-113f-4f29-9730-c29aba23948d tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0/detail" status: 200 len: 463 microversion: 2.57 time: 0.094070 Oct 28 09:55:31.856950 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 654/1288] 10.222.0.16 () {60 vars in 1304 bytes} [Fri Oct 28 09:55:31 2022] GET /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0/detail => generated 463 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:31.865716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.865716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:31.870430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.870649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.870923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.871357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.872110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.872600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.872943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.879638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.881076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:31.882504 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-204cd572-61db-44fd-8171-5aeb72a48755 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.168489 Oct 28 09:55:31.883076 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 635/1289] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:31 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:31.888367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:31.889205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:31.897277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.897771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.898210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.898942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:31.899398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:31.899858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:31.908814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:31.937143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:32.020318 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec463e64-e3d1-4f50-8365-6e2a04bc76c1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 204 len: 0 microversion: 2.1 time: 0.160391 Oct 28 09:55:32.021219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 655/1290] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:31 2022] DELETE /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:32.027968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Action: 'update', calling method: .version_select at 0x7fca33413b80>, body: {"quota_set": {"ram": "2048"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:32.056229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.065531 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6993253b-1723-4429-8b9d-3e3661497979 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.181371 Oct 28 09:55:32.066385 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 636/1291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:31 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:32.087106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.088138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:32.094448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.094945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.095385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.096089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.096547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.097003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.101146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.101728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.102243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.103047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.103587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.104640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.138412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.138924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.139453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.140304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.140841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.141297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.205082 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1fd6601e-be9c-4396-8d7b-9f4606a56bae tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0?user_id=574939b9f36e4a3aaa4622c69df3ad7b" status: 200 len: 148 microversion: 2.57 time: 0.181250 Oct 28 09:55:32.211532 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 656/1292] 10.222.0.16 () {62 vars in 1384 bytes} [Fri Oct 28 09:55:32 2022] PUT /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0?user_id=574939b9f36e4a3aaa4622c69df3ad7b => generated 148 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:32.211532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.212075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:32.218508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.219008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.219450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.220160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.220617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.221076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.243234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.251966 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d315e69f-d359-48f3-b8fc-d26b19bc9630 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1472 microversion: 2.1 time: 0.173635 Oct 28 09:55:32.252746 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 637/1293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:32.258301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c3f49ea3-4991-423c-b77a-b53be63ef0b5 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] Calling method '.version_select at 0x7fca3340d040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.325838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:32.341300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c3f49ea3-4991-423c-b77a-b53be63ef0b5 tempest-QuotasAdminTestV257-1565785912 tempest-QuotasAdminTestV257-1565785912-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0?user_id=574939b9f36e4a3aaa4622c69df3ad7b" status: 200 len: 190 microversion: 2.57 time: 0.087052 Oct 28 09:55:32.341889 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 638/1294] 10.222.0.16 () {60 vars in 1364 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/os-quota-sets/95f79b33c5a74aa39aa4ed45e52586b0?user_id=574939b9f36e4a3aaa4622c69df3ad7b => generated 190 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:55:32.346703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.347490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:32.356159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.356613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.357430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.358493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.359137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.359742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.378160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.386987 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85966114-346d-43b3-a340-9af3266673a2 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1500 microversion: 2.1 time: 0.179449 Oct 28 09:55:32.395626 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 657/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1500 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:32.404418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b0524ad-c44b-4f13-9a8e-584825aecb7f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3323c5e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.458639 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b0524ad-c44b-4f13-9a8e-584825aecb7f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.061526 Oct 28 09:55:32.461690 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 658/1296] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:32.469834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.476632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.478068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:32.485816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.486625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.487225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.488137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.488589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.489053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.547043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:32.558274 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c881639b-a7b5-4379-99bc-aa90a4aac84a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.214913 Oct 28 09:55:32.558880 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 639/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:32.736547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:32.766166 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b88a50a2-9e7a-46b7-8af9-f675c866b97b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.300283 Oct 28 09:55:32.766783 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 659/1298] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:32.779371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9237e9fa-9358-4f2f-b40f-7ed008c2eeb3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:32.786473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9237e9fa-9358-4f2f-b40f-7ed008c2eeb3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.786958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9237e9fa-9358-4f2f-b40f-7ed008c2eeb3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.787392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9237e9fa-9358-4f2f-b40f-7ed008c2eeb3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.810175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9237e9fa-9358-4f2f-b40f-7ed008c2eeb3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Going to try to start instance {{(pid=128748) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 09:55:32.855631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9237e9fa-9358-4f2f-b40f-7ed008c2eeb3 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "POST /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e/action" status: 202 len: 0 microversion: 2.1 time: 0.080672 Oct 28 09:55:32.856404 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 640/1299] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:55:32 2022] POST /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:55:32.864588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.865252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:32.871442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.871932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.872373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.873143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.873608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.874066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.910806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:32.911649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:32.917812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.918573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.919007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:32.919707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:32.920158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:32.920714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:33.020993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.030128 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5693d47b-1e77-42d4-a4d5-716895e91e05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1509 microversion: 2.1 time: 0.169493 Oct 28 09:55:33.030720 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 660/1300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:33.077808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.086340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.087774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.089732 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aeea150a-c74a-4fb4-a620-aa3afab12847 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.184982 Oct 28 09:55:33.095143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:33.096198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:33.105190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 641/1301] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:32 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:33.106660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:33.107383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:33.108148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:33.109134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:33.109614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:33.110218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:33.277741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:33.278409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.279004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:33.285334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:33.286323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:33.286993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:33.287140 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-484fcecb-41d9-4356-94fc-2ad267de8abc tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.199482 Oct 28 09:55:33.288024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:33.288822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:33.289546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:33.294426 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 661/1302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:33 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:33.433102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.441265 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c164549-d284-4b6d-bd9e-7e29a0cc2c7e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1472 microversion: 2.1 time: 0.167479 Oct 28 09:55:33.441853 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 642/1303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:33 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1472 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:33.474638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6194d76c-9755-4c8f-8065-bc0ab70c95a1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33264700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:33.520158 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6194d76c-9755-4c8f-8065-bc0ab70c95a1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.049403 Oct 28 09:55:33.520771 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 662/1304] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:33 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:33.583040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:33.583977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:33.590782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:33.591279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:33.591726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:33.592437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:33.593270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:33.593890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:33.764979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:33.773768 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5987283-23d0-4b1c-b208-47e3b6586413 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.195383 Oct 28 09:55:33.774361 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 643/1305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:33 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:34.054349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:34.060329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:34.070089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.071216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.073007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.073827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.075278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.076640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.116866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:34.118312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:34.128860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.129641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.130248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.131125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.131742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.132404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.321889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.335232 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f48e8681-01a0-40e8-96e9-087ce710d478 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1509 microversion: 2.1 time: 0.285166 Oct 28 09:55:34.345180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 663/1306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:34 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:34.345180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:34.345180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:34.351040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.352026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.353528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.354451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.354822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.355302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.441445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.450503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.452432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.453952 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90b018b4-5ac6-4e19-8f76-9d8f98f4b9e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.342480 Oct 28 09:55:34.470466 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 644/1307] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:34 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:34.480726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:34.481863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:34.491025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.492105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.492887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.493647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.494105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.494557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.589969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.603322 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4b50034e-6e40-43af-9857-89c57c3689ab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.266720 Oct 28 09:55:34.603946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 664/1308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:34 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:34.624340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b41e09c5-0ce2-4bd5-8286-77e7b019a4cf tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca334131f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:34.676114 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b41e09c5-0ce2-4bd5-8286-77e7b019a4cf tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.057813 Oct 28 09:55:34.677020 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 665/1309] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:34 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:34.798829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:34.799660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:34.814467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.814979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.815447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.816305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.816795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.817256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.833147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:34.862556 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0829d175-e65e-45c3-a997-b06de531de38 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1472 microversion: 2.1 time: 0.389848 Oct 28 09:55:34.865023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 645/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:34 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:34.882382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7d065f45-5024-448c-8726-84fb3540a712 req-c195a7f6-a1dc-4e42-9bcf-0a607ee7bd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f4eab3e-5428-452b-9a92-47468a9cce9e", "name": "network-vif-deleted", "tag": "d4186ca8-dc8b-4fda-a547-01f8c26c2e1b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:34.910987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7d065f45-5024-448c-8726-84fb3540a712 req-c195a7f6-a1dc-4e42-9bcf-0a607ee7bd55 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:34.914566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7d065f45-5024-448c-8726-84fb3540a712 req-c195a7f6-a1dc-4e42-9bcf-0a607ee7bd55 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:34.916586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7d065f45-5024-448c-8726-84fb3540a712 req-c195a7f6-a1dc-4e42-9bcf-0a607ee7bd55 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:34.976386 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7d065f45-5024-448c-8726-84fb3540a712 req-c195a7f6-a1dc-4e42-9bcf-0a607ee7bd55 service nova] Creating event network-vif-deleted:d4186ca8-dc8b-4fda-a547-01f8c26c2e1b for instance 9f4eab3e-5428-452b-9a92-47468a9cce9e on n-h1-zed-1 Oct 28 09:55:34.993258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7d065f45-5024-448c-8726-84fb3540a712 req-c195a7f6-a1dc-4e42-9bcf-0a607ee7bd55 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124881 Oct 28 09:55:34.994204 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 646/1311] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:35.356354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.364227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:35.369529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:35.379822 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f37a9bac-b8f0-45e5-947e-e9e142347a2e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.587622 Oct 28 09:55:35.383027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.383845 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 666/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:34 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:35.384545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.385199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.386085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.386693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.387284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.483647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:35.484988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:35.492766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.493574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.494236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.496081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.497037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.497948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.561215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.574167 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d52308b-d51a-45d3-bd11-76d6dc5b6935 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1509 microversion: 2.1 time: 0.215617 Oct 28 09:55:35.577026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 647/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:35 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:35.649573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:35.652626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:35.678762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.684879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.685391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.686162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.688826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.688826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.710336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.747068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.751946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.754935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a7dab5e-df19-4db5-a3c6-8be68014d6dc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.275778 Oct 28 09:55:35.758538 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 667/1314] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:35 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:55:35.795610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37c69e56-f97b-4000-9568-0a983d67263f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33264b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:35.881231 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37c69e56-f97b-4000-9568-0a983d67263f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.121278 Oct 28 09:55:35.882041 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 668/1315] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:35 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:35.887572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:35.888186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:35.894560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.895057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.895503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.895764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:35.896206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.896664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.897141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.905317 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ede05850-4bb5-4b66-a4d7-8acb2014fdc2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.279393 Oct 28 09:55:35.906263 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 648/1316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:35 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:35.946400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:35.946896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:35.947342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:35.948347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid 9f4eab3e-5428-452b-9a92-47468a9cce9e {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:35.992320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:36.000264 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c0a061f-980e-40ee-9511-a1cfc1d97e67 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 200 len: 1307 microversion: 2.1 time: 0.117229 Oct 28 09:55:36.000856 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 669/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:35 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 1307 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:36.403399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:36.404239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:36.411300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.411848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.412618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.413583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.414037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.414615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.438591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:36.560239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:36.568923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b24600b-c704-451f-91b0-32e9617c28d2 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.169795 Oct 28 09:55:36.569701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 649/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:36 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:36.604533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:36.605255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:36.611848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.612250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.612797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.613597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.614121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.614619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.617254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1365191628", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:36.670101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:55:36.746796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:36.755464 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbc02a70-355e-49ba-bc1d-d6fe9f8c798d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1513 microversion: 2.1 time: 0.155376 Oct 28 09:55:36.756054 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 650/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:36 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:36.781591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:36.786531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:36.786984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.servers [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Removing options 'limit' from query {{(pid=128748) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 09:55:36.787750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:36.788883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.789393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.789834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.790562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.791024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.792041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.793930 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ae5d738-b79d-451e-8de2-97ecd9a0ea8e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.015985 Oct 28 09:55:36.794640 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 651/1320] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 09:55:36 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 09:55:36.802138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:36.802804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:36.812501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.813049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.813492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.814228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.816255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.816255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.871490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:55:36.871916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:55:36.872390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:55:36.872800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:55:36.873248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:55:36.882110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.882596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.883039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.883768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.884422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.884852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.903624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Getting quotas for project 7d2636214d0b430d929ef27e9592488d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:36.908540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Getting quotas for user feb7e91603d6463e9428e71c31efb6b3 and project 7d2636214d0b430d929ef27e9592488d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:36.923405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:55:36.925934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:55:36.953612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:36.961988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:36.963949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:36.965189 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cdf955d3-fc8e-4fec-b81d-b07779bacaf6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.167281 Oct 28 09:55:36.965750 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 652/1321] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:36 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:36.970115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:36.972460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:36.973983 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3277797d-b3f7-4e7d-851a-f2ca32c42a45 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.480295 Oct 28 09:55:36.975379 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 670/1322] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:55:36.977190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.978269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.978716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.979976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:36.980441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:36.980875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:36.981005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fcf212ad-473f-47f7-8cfa-dbb46510600d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca332094c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.046301 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fcf212ad-473f-47f7-8cfa-dbb46510600d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.069517 Oct 28 09:55:37.046917 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 671/1323] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:36 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:37.051956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.052513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:37.059365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.059860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.060345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.061084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.061541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.061964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.147634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:37.159005 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ebeb6cda-ba21-48e2-8b26-23ae5e831b80 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1513 microversion: 2.1 time: 0.192201 Oct 28 09:55:37.159600 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 653/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:36 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1513 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:37.164825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.165620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 9f4eab3e-5428-452b-9a92-47468a9cce9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:37.172939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.173912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.174520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.175636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.177119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.177836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.194308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance 9f4eab3e-5428-452b-9a92-47468a9cce9e could not be found. Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e HTTP/1.1 Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:55:37.195980 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 9f4eab3e-5428-452b-9a92-47468a9cce9e could not be found. Oct 28 09:55:37.198380 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '9f4eab3e-5428-452b-9a92-47468a9cce9e'} Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f4eab3e-5428-452b-9a92-47468a9cce9e could not be found. Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:37.199774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f4eab3e-5428-452b-9a92-47468a9cce9e could not be found. Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f4eab3e-5428-452b-9a92-47468a9cce9e could not be found. Oct 28 09:55:37.203562 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:37.207591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance 9f4eab3e-5428-452b-9a92-47468a9cce9e could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:37.207591 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9ef346b-ba09-49ef-bc69-90a24008e105 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e" status: 404 len: 111 microversion: 2.1 time: 0.036717 Oct 28 09:55:37.207591 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 654/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:37 2022] GET /compute/v2.1/servers/9f4eab3e-5428-452b-9a92-47468a9cce9e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:37.207940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-694154502", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:37.262329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:37.267979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:55:37.271310 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfe47b61-0c27-4579-a609-ab003bf4f0fb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.223154 Oct 28 09:55:37.271903 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 672/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:37 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:37.286918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.287828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:37.294417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.294994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.295510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.296315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.297339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.298049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.443774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:37.453083 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf7832d0-8daa-4a8f-931a-51f2d8bdd187 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1511 microversion: 2.1 time: 0.170483 Oct 28 09:55:37.454064 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 673/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:37 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1511 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:37.459237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.460178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:37.467491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.468656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.469328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.470288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.470981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.471615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.507590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:37.585047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:37.620457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fcbca751-6dcf-4baf-ab4c-4d6be620bf23 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 204 len: 0 microversion: 2.1 time: 0.163978 Oct 28 09:55:37.625206 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 674/1328] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:37 2022] DELETE /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:37.630781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.631472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:37.639365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.640153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.640966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.642330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.643215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.643808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.781352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:55:37.781879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:55:37.782228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:55:37.782638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:55:37.783047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:55:37.793215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.794023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.794631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.795277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.795889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.796550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.804768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:37.815282 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b2e39467-a2d7-43ee-8d80-da721513ff49 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1511 microversion: 2.1 time: 0.188691 Oct 28 09:55:37.816189 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 675/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:37 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1511 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:37.817302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Getting quotas for project 7d2636214d0b430d929ef27e9592488d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:37.821412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.822028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:37.829553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.830265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.830903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.831288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Getting quotas for user feb7e91603d6463e9428e71c31efb6b3 and project 7d2636214d0b430d929ef27e9592488d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:37.831953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.832935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.833537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.848053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:55:37.850510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:55:37.901834 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bb659cee-cc4a-4392-9660-79ce1a27d1b6 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699085 Oct 28 09:55:37.902489 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 655/1330] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:55:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:55:37.913773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:37.914393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:37.920931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.921425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.921857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:37.922753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:37.923647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:37.924073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.000126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.011966 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b3f64f0-7515-4280-8fd5-2e016207d62a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.193359 Oct 28 09:55:38.024935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 676/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:37 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:38.024935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.028550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.029706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'ip': '172.20.0.12', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:38.101165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.111522 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-027ec745-19e8-489e-939b-8d50fe08e2a0 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1472 microversion: 2.1 time: 0.207913 Oct 28 09:55:38.125884 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 656/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:37 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1472 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:38.130986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-694d542b-2631-4a41-ba83-7a37e5dde79a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.131699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-694d542b-2631-4a41-ba83-7a37e5dde79a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:38.168050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.168567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.169152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.170265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.170733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.171167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.203426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-694d542b-2631-4a41-ba83-7a37e5dde79a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.212170 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-694d542b-2631-4a41-ba83-7a37e5dde79a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1213 microversion: 2.1 time: 0.085056 Oct 28 09:55:38.213449 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 657/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:38.232334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.233374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:38.240723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.241539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.242284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.243153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.244186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.245474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.270395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:38.345110 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-59c62eca-3983-4b78-a88a-486ec970c471 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0.12" status: 200 len: 346 microversion: 2.1 time: 0.328646 Oct 28 09:55:38.350369 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 677/1334] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/servers?ip=172.20.0.12 => generated 346 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:38.359945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f839144-1d05-458f-a3e9-ad8d09883a4d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca335b2280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.427900 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2f839144-1d05-458f-a3e9-ad8d09883a4d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.079576 Oct 28 09:55:38.433469 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 678/1335] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:38.443262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.444503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:38.448277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.454788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:38.457085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.457790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.458730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.459798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.460181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.461116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.461455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.462393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.464165 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-896560e5-876b-43d0-8ecd-82955f14c0a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.248882 Oct 28 09:55:38.464745 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 658/1336] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:38.470006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.470647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:38.482485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.483404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.483959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.484826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.485944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.486537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.619288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.627925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-767080e0-7b5c-4285-add9-ada9f5d67546 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.192591 Oct 28 09:55:38.629478 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 679/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:38.666376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.674960 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf789780-069f-40f8-965d-92e92f574865 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1513 microversion: 2.1 time: 0.209205 Oct 28 09:55:38.675535 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 659/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:38.696239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.696850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:38.702820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.703336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.703806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.704497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.704981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.705408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.842367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:38.850164 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14ca42d5-f3b8-4987-a084-3680be48ab05 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1511 microversion: 2.1 time: 0.157721 Oct 28 09:55:38.850731 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 680/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:38.872022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:38.872621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:38.879010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.879507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.879949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:38.880660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:38.881142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:38.881788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.039293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.039997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:39.047965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.049107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.050194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.050959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.051430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.052021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.075615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.087805 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dec10128-26c5-47ba-b7f9-9dff0d491e58 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1511 microversion: 2.1 time: 0.219797 Oct 28 09:55:39.098965 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 660/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:38 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:39.113315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.130176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.132790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:39.147644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.148141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.148579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.149349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.149806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.150242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.202587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:39.224399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.232738 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e619b47c-86b1-4c24-80c4-d254e1740489 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.198692 Oct 28 09:55:39.233365 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 681/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:39.238194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.239275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:39.246050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.246458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.246903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.247619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.248350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.248822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.277035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.284310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.284953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.285296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.412856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.421840 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6025f813-e43f-4345-ad46-d7f86a751be6 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1472 microversion: 2.1 time: 0.187096 Oct 28 09:55:39.422314 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 682/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1472 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:39.446746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.447369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:39.454656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.455159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.455602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.456335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.456950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.457382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.519514 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56b046d4-1801-441b-89b2-554936aca2f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 4518 microversion: 2.1 time: 0.411172 Oct 28 09:55:39.520130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 661/1343] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/servers/detail => generated 4518 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:39.525132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e843751-b2ca-47c8-938a-ed3dd766afa0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3baebee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.562240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.575712 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7bd03bf3-65d1-4990-ab4b-73eddca4afae tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1265 microversion: 2.1 time: 0.136815 Oct 28 09:55:39.588045 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e843751-b2ca-47c8-938a-ed3dd766afa0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.066662 Oct 28 09:55:39.590669 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 683/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:39.594209 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 662/1345] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:39.596380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.597181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:39.606845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.610434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.611067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.612267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.613159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.614013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.614508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.614697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.616370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:39.768069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.779187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.780796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.782643 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65a183ca-9862-4141-854f-a952e51d0425 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.190655 Oct 28 09:55:39.783314 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 684/1346] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:39.788467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:39.789574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:39.799532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.800353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.801342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.802206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:39.802834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:39.803346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:39.953521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:39.961816 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-defc0d85-108a-40c7-ab30-630ae3943da1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1312 microversion: 2.1 time: 0.176995 Oct 28 09:55:39.963778 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 685/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:40.006648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.007306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.007774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.008547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.009055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.010019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.099736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:40.211372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-031bb513-4076-47f1-907d-0f8e95432755 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1010 microversion: 2.1 time: 0.615805 Oct 28 09:55:40.212097 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 663/1348] 10.222.0.16 () {58 vars in 1150 bytes} [Fri Oct 28 09:55:39 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1010 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:40.226939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:40.253726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:40.255048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:40.273298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:40.274054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:40.276511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.278072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.281506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.282589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.283283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.283947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.286798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.287676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.289802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.292033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.292770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.294328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.465046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:40.550153 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6d96900-5f0a-461b-a74f-faf1458fa7b5 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1010 microversion: 2.1 time: 0.326803 Oct 28 09:55:40.557957 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 686/1349] 10.222.0.16 () {58 vars in 1212 bytes} [Fri Oct 28 09:55:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1010 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:40.561146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:40.561868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:40.574943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.576029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.576527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.578063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.578633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.579334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.685326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:40.694134 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9122fc2c-9449-46cb-aec2-7a0cecf1cd59 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.424788 Oct 28 09:55:40.697069 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 664/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:40 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:40.704753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:40.710913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:40.711867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:40.718208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.718959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.719572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.720544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.721215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.721835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.816700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:40.892459 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b21358b-29c4-4c43-9073-5c055cca6b76 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1010 microversion: 2.1 time: 0.195700 Oct 28 09:55:40.893239 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 665/1351] 10.222.0.16 () {58 vars in 1196 bytes} [Fri Oct 28 09:55:40 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1010 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:40.897842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:40.898562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:40.904868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.905478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.906094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.906878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:40.907497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:40.908002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:40.914272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:40.928551 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-444468e2-0612-4940-8050-0236253c8226 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1472 microversion: 2.1 time: 0.375668 Oct 28 09:55:40.931201 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 687/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:40 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1472 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:40.938436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-79ff7b91-1569-4cd1-b3d2-f7fff45ebd2d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca335c69d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:40.991743 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-79ff7b91-1569-4cd1-b3d2-f7fff45ebd2d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.058564 Oct 28 09:55:40.992332 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 688/1353] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:40 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:41.005616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:41.006226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:41.012872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.013418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.013855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.014568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.015030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.015462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.057128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.073518 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07180608-f92f-4306-b7cb-57d50d4d61cb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1271 microversion: 2.1 time: 0.179122 Oct 28 09:55:41.076224 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 666/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:40 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:41.081653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:41.086669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.087743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'name': '1279397735', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:41.093366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.093864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.094308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.095063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.095526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.095960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.181014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:41.214446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.227146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.230803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.232868 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f35423ee-089e-496d-bdbe-a3af2374a2aa tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1569 microversion: 2.25 time: 0.231103 Oct 28 09:55:41.233883 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 689/1355] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:41 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1569 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:41.240235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:41.240534 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c792e08-f435-437b-baef-63d76cb6dac8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?name=1279397735" status: 200 len: 346 microversion: 2.1 time: 0.162911 Oct 28 09:55:41.241320 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 667/1356] 10.222.0.16 () {58 vars in 1156 bytes} [Fri Oct 28 09:55:41 2022] GET /compute/v2.1/servers?name=1279397735 => generated 346 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:41.242181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:41.252332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.253159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.253896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.254910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.255555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.256169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.263695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:41.268726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.269493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:41.274942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.275430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.275870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.276594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.277074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.277514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.377520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:41.393208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:41.447681 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f296549-908e-421f-b841-3e84eb7668df tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1010 microversion: 2.1 time: 0.187726 Oct 28 09:55:41.448874 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 668/1357] 10.222.0.16 () {58 vars in 1154 bytes} [Fri Oct 28 09:55:41 2022] GET /compute/v2.1/servers?name=-instance => generated 1010 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:41.469666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:41.478183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.479760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-127939773', 'deleted': False, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:55:41.485735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.486285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.486805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.488005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.488646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.489320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.523717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:41.533255 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-388a6704-f044-47d0-8d15-f15adee98fb8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1462 microversion: 2.1 time: 0.298088 Oct 28 09:55:41.550849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 690/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:41 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1462 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:41.569545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:41.571570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:41.586975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.587485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.588751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.589210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.589678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.590675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.606233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:55:41.728052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b63e67ea-3c9b-4265-a405-ffcabfcde474 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-127939773" status: 200 len: 346 microversion: 2.1 time: 0.267021 Oct 28 09:55:41.729802 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 669/1359] 10.222.0.16 () {58 vars in 1228 bytes} [Fri Oct 28 09:55:41 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-127939773 => generated 346 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:41.734937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:41.737133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:41.745678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.746345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.746965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:41.747819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:41.748425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:41.749047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.014404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f99b7e3d-04f9-4ecd-8206-9f2d925f971d tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1607 microversion: 2.1 time: 0.455172 Oct 28 09:55:42.031883 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 691/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:41 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1607 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:42.031883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:42.031883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:42.031883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.032437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.032437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.033663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.034316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.034859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.064000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:42.067353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:42.096941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:42.110492 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f19d743c-1d1d-4b28-a64e-16f6ff87b88f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.379128 Oct 28 09:55:42.115619 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 670/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:41 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:42.147724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:42.148382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:42.162555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.163060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.163509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.164254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.164717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.165184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.215537 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9201a97a-d6bb-4022-bfb4-908ef319fdc4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 204 len: 0 microversion: 2.1 time: 0.197830 Oct 28 09:55:42.216363 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 692/1362] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:42 2022] DELETE /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:42.224647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7759b8c8-1ffe-4d6a-96d9-8f7b6729fd61 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3362b700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:42.301625 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7759b8c8-1ffe-4d6a-96d9-8f7b6729fd61 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.082015 Oct 28 09:55:42.303996 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 693/1363] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:42 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:42.312737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:42.313937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:42.323916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.324560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.325116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.326138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.326731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.328676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.375253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8f6e3fb8d6584717b71970da75f27541', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0844f17c02294217954ad90f41b9e2fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:42.375941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] flavor_id is None. Assuming migration. {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 09:55:42.376383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 09:55:42.577718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:42.590335 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16a15f72-1348-44c3-8c18-594ddab8571b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1472 microversion: 2.1 time: 0.473274 Oct 28 09:55:42.592379 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 671/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:42 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1472 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:42.611456 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e57136e2-7d27-4e5f-9fef-b2818ca6de74 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc/action" status: 202 len: 0 microversion: 2.1 time: 0.306021 Oct 28 09:55:42.612806 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 694/1365] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:55:42 2022] POST /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:55:42.618910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:42.619638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:42.619796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:42.620695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:42.633296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.635884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.636718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.637860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.638484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.639068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.644595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.645415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.649501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.652320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:42.656758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:42.657261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:42.936660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:42.962163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-26d05e33-6f10-46d8-a5e7-b43212deda40 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.332250 Oct 28 09:55:42.975282 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 672/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:42 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:42.988281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:42.989050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:43.012583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.013170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.013708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.014482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.014950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.015996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.097955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:43.112029 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3055c03f-1eaf-4b07-bd69-5f617b8739ee tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1517 microversion: 2.1 time: 0.497730 Oct 28 09:55:43.116399 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 695/1367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:42 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1517 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:43.236920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b4f7a84c-f44c-471b-92c2-229a885eff37 req-180fb8da-047d-4836-aaf4-7c623bcb3ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caca59f2-508b-4f81-b2c9-73857a7e7cbb", "tag": "5df6dcc3-c245-46be-ace9-9232b18e4b70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:43.251377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b4f7a84c-f44c-471b-92c2-229a885eff37 req-180fb8da-047d-4836-aaf4-7c623bcb3ad5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.252261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b4f7a84c-f44c-471b-92c2-229a885eff37 req-180fb8da-047d-4836-aaf4-7c623bcb3ad5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.253002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b4f7a84c-f44c-471b-92c2-229a885eff37 req-180fb8da-047d-4836-aaf4-7c623bcb3ad5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.285446 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b4f7a84c-f44c-471b-92c2-229a885eff37 req-180fb8da-047d-4836-aaf4-7c623bcb3ad5 service nova] Creating event network-changed:5df6dcc3-c245-46be-ace9-9232b18e4b70 for instance caca59f2-508b-4f81-b2c9-73857a7e7cbb on n-h1-zed-1 Oct 28 09:55:43.293502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b4f7a84c-f44c-471b-92c2-229a885eff37 req-180fb8da-047d-4836-aaf4-7c623bcb3ad5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174867 Oct 28 09:55:43.294887 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 696/1368] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:43.304057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:43.305230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:43.306464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:43.317824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.318124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:43.318398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.318852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.319575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.320042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.320526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.320665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:43.322226 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85d8a01c-76f9-40d1-a7dd-438e7d465cbe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1544 microversion: 2.25 time: 0.345860 Oct 28 09:55:43.323050 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 673/1369] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:42 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1544 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:43.328834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:43.329998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:43.336744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.337734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.338466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.339408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.340085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.340732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.599621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:43.613410 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15b8286a-3e04-4b88-8bab-8ab5f4408259 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.288913 Oct 28 09:55:43.615025 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 674/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:43 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:43.622777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c489995-2991-437b-9971-c99e804ab7d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca334b23a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:43.683380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c489995-2991-437b-9971-c99e804ab7d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.064742 Oct 28 09:55:43.685208 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 675/1371] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:43 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:43.698113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5a5a4a2-6ec4-4060-9f46-923005ce6a14 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '.version_select at 0x7fca33603820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:43.703798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5a5a4a2-6ec4-4060-9f46-923005ce6a14 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.704249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5a5a4a2-6ec4-4060-9f46-923005ce6a14 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.704692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5a5a4a2-6ec4-4060-9f46-923005ce6a14 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.734044 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5a5a4a2-6ec4-4060-9f46-923005ce6a14 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3241 microversion: 2.25 time: 0.043938 Oct 28 09:55:43.735137 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 676/1372] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 09:55:43 2022] GET /compute/v2.1/os-migrations => generated 3241 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:43.759178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:43.774565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d2b9afe0-ed47-4cff-9d27-38c4bb811565 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1471 microversion: 2.1 time: 0.478208 Oct 28 09:55:43.778156 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 697/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:43 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1471 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:43.788482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:43.789725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:43.806234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.807644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.812302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.813183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.813754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.814271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.881063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-17ceb69a-c3ae-47f3-98a3-b6e5d664ccd7 req-a1f51be6-b083-4e6d-abf0-5f5d3d9c907a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "102f91db-dd8e-4eba-bdbf-ca1b780a43c3", "tag": "b3e43631-e765-4de2-a277-d17477fcacf1"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:43.907735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-17ceb69a-c3ae-47f3-98a3-b6e5d664ccd7 req-a1f51be6-b083-4e6d-abf0-5f5d3d9c907a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.910818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-17ceb69a-c3ae-47f3-98a3-b6e5d664ccd7 req-a1f51be6-b083-4e6d-abf0-5f5d3d9c907a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.911823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-17ceb69a-c3ae-47f3-98a3-b6e5d664ccd7 req-a1f51be6-b083-4e6d-abf0-5f5d3d9c907a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.927036 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-17ceb69a-c3ae-47f3-98a3-b6e5d664ccd7 req-a1f51be6-b083-4e6d-abf0-5f5d3d9c907a service nova] Creating event network-changed:b3e43631-e765-4de2-a277-d17477fcacf1 for instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 on n-h1-zed-1 Oct 28 09:55:43.934740 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-17ceb69a-c3ae-47f3-98a3-b6e5d664ccd7 req-a1f51be6-b083-4e6d-abf0-5f5d3d9c907a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198113 Oct 28 09:55:43.935747 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 677/1374] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:43.941557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:43.942469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:43.950746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.951517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.952112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:43.953125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:43.953873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:43.957161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:44.112490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:44.132615 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3bb7383c-6db9-437a-849c-84fcc16f12aa tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1472 microversion: 2.1 time: 0.352751 Oct 28 09:55:44.143493 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 698/1375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:43 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1472 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:44.160257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:44.160981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:44.182185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:44.183501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:44.184176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:44.184719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:44.186137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:44.186704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:44.187717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:44.211213 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-020f4f47-0c9f-4119-a79e-b88416f087d7 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 2031 microversion: 2.25 time: 0.273871 Oct 28 09:55:44.213356 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 678/1376] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:43 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 2031 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:44.229538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:44.232630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:44.246860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:44.254874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:44.256427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:44.257551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:44.258322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:44.259049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:44.938346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:44.952155 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f716d7cc-f82a-4b42-8aae-e5387f0701ae tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1517 microversion: 2.1 time: 0.736908 Oct 28 09:55:44.970355 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 679/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:44 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1517 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:44.978720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7b2ae6f-936e-4344-88f8-34f1a4eac1c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Action: 'create', calling method: .version_select at 0x7fca336729d0>, body: {"keypair": {"name": "tempest-keypair-393075797", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHrvzUqW20HS7urRMRbxoOgJ3JWo6o7H5HdJb5u/ZK+zJGw8+MT2+B9JBR1ItIbjBOBC2TF6uUbk1MHoTgzfGH8//EeOE5Imw6DeiOwRHxsjxGNolWIgirKonjDorenYWQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:45.002912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f7b2ae6f-936e-4344-88f8-34f1a4eac1c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for project a563769bd6e84594b3837db9d0fdafd4. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:45.009945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f7b2ae6f-936e-4344-88f8-34f1a4eac1c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for user 52e08cff441e4fb0b01886d81a7b5ad6 and project a563769bd6e84594b3837db9d0fdafd4. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:45.015410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:45.050766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7b2ae6f-936e-4344-88f8-34f1a4eac1c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.079057 Oct 28 09:55:45.052469 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 680/1378] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 09:55:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 81 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 09:55:45.062621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:45.063637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:45.071549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:45.073182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:45.073868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:45.074889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:45.075612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:45.076262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:45.271756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:45.280997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-09104397-a486-4ad2-841a-5bf27a7b5694 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 1.132086 Oct 28 09:55:45.301937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 699/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:44 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:45.315392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a57db5f-f08c-4313-aba0-8a405e6f07d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3364d9d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:45.469948 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a57db5f-f08c-4313-aba0-8a405e6f07d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.167402 Oct 28 09:55:45.478864 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 700/1380] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:45 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:45.501565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:45.505586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:45.543023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:45.546616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:45.548235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:45.549711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:45.552838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:45.559157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:45.903413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:45.941278 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-365b3fcc-d612-46a5-a9e4-06158e53430b tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.884685 Oct 28 09:55:45.942973 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 681/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:45 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:45.957583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:45.960651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:45.973055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:45.973794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:45.974459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:45.975727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:45.976626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:45.977573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.165660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:46.183168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d83369c-1d85-439c-84a3-2ded31083ef4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1471 microversion: 2.1 time: 0.699294 Oct 28 09:55:46.203921 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 701/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:45 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1471 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:46.210468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.211086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.226214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:46.242483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.245207 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73c67f5e-f9bf-4bc7-87f2-4d1d929c4c1c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1430 microversion: 2.1 time: 0.297873 Oct 28 09:55:46.245652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.247248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.263091 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 682/1383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:45 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1430 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:46.264464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.273563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.275307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.279326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b60ac171-cdd9-4e85-afa6-c1494a0af9da req-a7802353-f7da-4e8b-94ca-ce034aaf9dab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e8eb614-33b5-4970-a2bf-5e520088cfbc", "name": "network-vif-deleted", "tag": "86643eab-f01a-464c-b28c-1c96c81ce94d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:46.310708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b60ac171-cdd9-4e85-afa6-c1494a0af9da req-a7802353-f7da-4e8b-94ca-ce034aaf9dab service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.311192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b60ac171-cdd9-4e85-afa6-c1494a0af9da req-a7802353-f7da-4e8b-94ca-ce034aaf9dab service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.311625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b60ac171-cdd9-4e85-afa6-c1494a0af9da req-a7802353-f7da-4e8b-94ca-ce034aaf9dab service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.333697 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b60ac171-cdd9-4e85-afa6-c1494a0af9da req-a7802353-f7da-4e8b-94ca-ce034aaf9dab service nova] Creating event network-vif-deleted:86643eab-f01a-464c-b28c-1c96c81ce94d for instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc on n-h2-zed-1 Oct 28 09:55:46.347049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b60ac171-cdd9-4e85-afa6-c1494a0af9da req-a7802353-f7da-4e8b-94ca-ce034aaf9dab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081075 Oct 28 09:55:46.347970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 683/1384] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:46.361715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.362451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.378835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.379338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.379781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.389580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.390131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.390552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:46.390687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.401772 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-054bae2b-abeb-44ef-b519-3b7126f4cba6 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1475 microversion: 2.1 time: 0.196146 Oct 28 09:55:46.405958 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 702/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:46 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1475 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:46.485034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4818dc9-a2eb-4755-b6aa-f2d65f40c5cf tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca335b2820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.587475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4818dc9-a2eb-4755-b6aa-f2d65f40c5cf tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.105991 Oct 28 09:55:46.589165 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 703/1386] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:46 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:46.604646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a721903b-2be1-494a-b150-59f0d0915b23 req-35aca11c-04fe-4708-9a7d-83bd5e0a1d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad29dfd-d75a-4f22-bc12-f8e238bb961a", "name": "network-vif-deleted", "tag": "40fad97c-a7e4-4ac3-ac01-8c3014ae5be8"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:46.628175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a721903b-2be1-494a-b150-59f0d0915b23 req-35aca11c-04fe-4708-9a7d-83bd5e0a1d39 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:46.630091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a721903b-2be1-494a-b150-59f0d0915b23 req-35aca11c-04fe-4708-9a7d-83bd5e0a1d39 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:46.632560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a721903b-2be1-494a-b150-59f0d0915b23 req-35aca11c-04fe-4708-9a7d-83bd5e0a1d39 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:46.659908 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a721903b-2be1-494a-b150-59f0d0915b23 req-35aca11c-04fe-4708-9a7d-83bd5e0a1d39 service nova] Creating event network-vif-deleted:40fad97c-a7e4-4ac3-ac01-8c3014ae5be8 for instance aad29dfd-d75a-4f22-bc12-f8e238bb961a on n-h2-zed-1 Oct 28 09:55:46.671318 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a721903b-2be1-494a-b150-59f0d0915b23 req-35aca11c-04fe-4708-9a7d-83bd5e0a1d39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077322 Oct 28 09:55:46.672605 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 704/1387] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:46.906809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:46.915851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31b22d20-cb65-401d-9baa-8ad14336cd19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.566580 Oct 28 09:55:46.917025 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 684/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:46 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:46.985680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:46.986858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:46.997837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=64,nova_cell0:UPDATE=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:47.001088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.001807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.002415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.003317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.003936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.004521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.211886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:47.213891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:47.233756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.234646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.235287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.236368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.236828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.244319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.371530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:47.380230 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cc4ac66-328e-4c5d-a759-8d5c8d37d7c1 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.414446 Oct 28 09:55:47.386106 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 705/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:46 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:47.391230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:47.398807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:47.407434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.407975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.417188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.418165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.418663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.419141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.470167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:47.484017 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f1747a2-1e72-4e4a-979c-2767005a72c3 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1471 microversion: 2.1 time: 0.277382 Oct 28 09:55:47.497331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 685/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:47 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:47.511382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:47.512208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:47.512338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:47.521808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.522678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.523287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.524171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:47.524788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:47.525691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40ddbd10-21bc-4db4-8d57-6ef3ff7b1196 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1430 microversion: 2.1 time: 0.137410 Oct 28 09:55:47.526328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:47.527356 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 706/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:47 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1430 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:47.611965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1f2bd9e-1b83-4682-bece-db2b9619a070 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3362bf70>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:47.643650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:47.664875 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2c7c0b14-ffca-4f4b-b12d-83c960fbfc5a tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1475 microversion: 2.1 time: 0.164189 Oct 28 09:55:47.683602 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 686/1392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:47 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1475 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:47.689654 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1f2bd9e-1b83-4682-bece-db2b9619a070 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.086389 Oct 28 09:55:47.693348 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 707/1393] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:47 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:47.941228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:47.942592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:47.992614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.006822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.007401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.008190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.008675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.009146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.407794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-be3af524-f2af-4a4e-be58-597cb42f699e req-6fb00d07-bd4c-40a3-a247-ca3061a449af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fc7662d-f778-4cd9-8b6f-4f29a6954ce4", "tag": "8cb76f58-dfbc-420d-b4ac-b6ed3360ea99"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:48.439541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be3af524-f2af-4a4e-be58-597cb42f699e req-6fb00d07-bd4c-40a3-a247-ca3061a449af service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.440846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be3af524-f2af-4a4e-be58-597cb42f699e req-6fb00d07-bd4c-40a3-a247-ca3061a449af service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.444461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be3af524-f2af-4a4e-be58-597cb42f699e req-6fb00d07-bd4c-40a3-a247-ca3061a449af service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.462514 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-be3af524-f2af-4a4e-be58-597cb42f699e req-6fb00d07-bd4c-40a3-a247-ca3061a449af service nova] Creating event network-changed:8cb76f58-dfbc-420d-b4ac-b6ed3360ea99 for instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 on n-h2-zed-1 Oct 28 09:55:48.470067 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-be3af524-f2af-4a4e-be58-597cb42f699e req-6fb00d07-bd4c-40a3-a247-ca3061a449af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067746 Oct 28 09:55:48.471879 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 708/1394] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:55:48.478216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:48.479884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:48.489991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.490504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.491140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.491864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.492329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.492763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.896314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:48.921899 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52de50eb-a118-4c7c-b6b4-456faf09d77b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.985928 Oct 28 09:55:48.922520 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 687/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:47 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:48.933980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:48.934593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:48.955737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.956225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.956669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:48.959863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:48.960346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:48.960780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.020328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:49.191048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:49.205798 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6bcc3ada-3141-4e61-915e-80beb382e550 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1471 microversion: 2.1 time: 0.281178 Oct 28 09:55:49.206051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:49.217698 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 688/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:48 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:49.222202 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-db407de9-c69f-47fc-98e5-40c06afcf7d7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.748869 Oct 28 09:55:49.222792 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 709/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:48 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:49.227284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:49.227907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:49.233885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:49.234515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:49.241586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.242346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.242502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.242875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.243279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.243415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.244037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.244559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.244732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.245023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.245538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.246135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.287220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.287676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.288076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.288789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid aad29dfd-d75a-4f22-bc12-f8e238bb961a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:49.316383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.317078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.317790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.318395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid 8e8eb614-33b5-4970-a2bf-5e520088cfbc {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:49.484032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:49.502146 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9211080b-f819-41df-a6a1-71f499efbb25 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 200 len: 1307 microversion: 2.1 time: 0.283245 Oct 28 09:55:49.503523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 689/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:49 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:49.508413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93e1a8ce-0e26-4a5f-b078-569602510e37 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33794dc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:49.610248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93e1a8ce-0e26-4a5f-b078-569602510e37 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.105387 Oct 28 09:55:49.610838 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 690/1399] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:49 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:49.803224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:49.815421 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c2a1aadc-d806-4e8d-a4d0-40ee5cfbc166 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 200 len: 1310 microversion: 2.1 time: 0.591565 Oct 28 09:55:49.816021 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 710/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:49 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 1310 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:49.949821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:49.951329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:49.960182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.961751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.962371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:49.964005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:49.964629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:49.965252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.105281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1249335340", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7035122b-a147-4d22-80a1-0879f4691bf4"}], "security_groups": [{"name": "tempest-securitygroup--666599505"}], "key_name": "tempest-keypair-393075797", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:50.183268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:50.207891 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af72f7bc-b156-4955-8e31-e1680342db50 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.263309 Oct 28 09:55:50.208913 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 691/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:49 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:50.239319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:50.242718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:50.258614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.259267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.259832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.261406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.261986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.264777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.352656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=15 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:50.365098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] validate_networks() for [('7035122b-a147-4d22-80a1-0879f4691bf4', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:55:50.553574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:50.567677 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1262dc9-a50d-4b66-8355-6dbe4a567ce0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1471 microversion: 2.1 time: 0.336450 Oct 28 09:55:50.569601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 692/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:50 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1471 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:50.577950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:50.578581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:50.587014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.587504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.587935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.588674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.589250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.589675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.832334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:50.845440 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffef26e7-150d-4ff5-8f81-619623a969b3 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.274706 Oct 28 09:55:50.864295 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 693/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:50 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:50.876729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:50.880755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 8e8eb614-33b5-4970-a2bf-5e520088cfbc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:50.894141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.895076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.895695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.896834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:50.897560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:50.898166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:50.915246 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc could not be found. Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc HTTP/1.1 Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:55:50.918135 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc could not be found. Oct 28 09:55:50.919848 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '8e8eb614-33b5-4970-a2bf-5e520088cfbc'} Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc could not be found. Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:50.920821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc could not be found. Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc could not be found. Oct 28 09:55:50.922441 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:50.925340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance 8e8eb614-33b5-4970-a2bf-5e520088cfbc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:50.926544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a684a422-e0b1-4986-adaf-76358276608e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc" status: 404 len: 111 microversion: 2.1 time: 0.057788 Oct 28 09:55:50.927841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 694/1404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:50 2022] GET /compute/v2.1/servers/8e8eb614-33b5-4970-a2bf-5e520088cfbc => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:50.933353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e9610cd-cff2-4901-b6e0-95600048b806 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33791ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:50.992401 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1e9610cd-cff2-4901-b6e0-95600048b806 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.063228 Oct 28 09:55:51.004444 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 695/1405] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:50 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:51.014807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.015438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: aad29dfd-d75a-4f22-bc12-f8e238bb961a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.022557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.023066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.023514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.024391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.024863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.025347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.041634 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] HTTP exception thrown: Instance aad29dfd-d75a-4f22-bc12-f8e238bb961a could not be found. Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Request method failure captured: Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a HTTP/1.1 Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6bBmHD-7ae0iEh2O1VwzhqMmU4hAb3dpSfFSS5gMYpnVmW7hytHTH5X2Ej3KZpuxffJfbjmLhadb0V4qoQDRrSQ64xsklm7WMey81JZ3jEdGHvovdvqLWK0hyNzEXHHpaMyZ1g1qWFsuLggzUBrNM7ggpsbeWCCbGA76CrAkiPI3io Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 57eeba8f69124206b8e6a8c8eb875c6f Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:55:51.043257 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57eeba8f69124206b8e6a8c8eb875c6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57eeba8f69124206b8e6a8c8eb875c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57eeba8f69124206b8e6a8c8eb875c6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57eeba8f69124206b8e6a8c8eb875c6f"}]}] Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 57eeba8f69124206b8e6a8c8eb875c6f Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ListServerFiltersTestJSON-1288892638-project Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a21c5e160ca7460d892ce593d4644240 Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ListServerFiltersTestJSON-1288892638-project Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance aad29dfd-d75a-4f22-bc12-f8e238bb961a could not be found. Oct 28 09:55:51.044896 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'aad29dfd-d75a-4f22-bc12-f8e238bb961a'} Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad29dfd-d75a-4f22-bc12-f8e238bb961a could not be found. Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:51.045887 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad29dfd-d75a-4f22-bc12-f8e238bb961a could not be found. Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad29dfd-d75a-4f22-bc12-f8e238bb961a could not be found. Oct 28 09:55:51.047454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:51.049239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Returning 404 to user: Instance aad29dfd-d75a-4f22-bc12-f8e238bb961a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:51.049239 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99c80444-da7c-4149-9abc-e77c61b29927 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a" status: 404 len: 111 microversion: 2.1 time: 0.039301 Oct 28 09:55:51.049468 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 696/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:51 2022] GET /compute/v2.1/servers/aad29dfd-d75a-4f22-bc12-f8e238bb961a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:51.054421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.054936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.061777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.062354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.062818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.063528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.063992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.064553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.094746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:51.126824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:55:51.127294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:55:51.127769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:55:51.128510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:55:51.129288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:55:51.147624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.152783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.153299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.154100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.154571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.155213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.200038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:55:51.216182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for user 52e08cff441e4fb0b01886d81a7b5ad6 and project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:55:51.228473 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63bd8f70-0a6c-4c38-a323-1c2580e1015d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 204 len: 0 microversion: 2.1 time: 0.176505 Oct 28 09:55:51.230261 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 697/1407] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:51 2022] DELETE /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:51.245304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.246278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.252740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:55:51.259823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.260835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.261312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.262544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:55:51.268694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.269268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.269772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.325158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:51.369032 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3795cf5e-9b06-4a18-a256-0d626f306108 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 1.273015 Oct 28 09:55:51.372571 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 711/1408] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:55:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:55:51.386998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.398376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.408604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.409237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.410095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.411051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.411744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.412394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.452206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:51.488412 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3fe673d3-fb80-4ac9-a002-18092eed16d4 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 204 len: 0 microversion: 2.1 time: 0.255777 Oct 28 09:55:51.493141 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 698/1409] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:51 2022] DELETE /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:51.500867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.501748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.510338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.510844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.511293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.512199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.513138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.513818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.523267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:51.729771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:51.740604 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b710e674-cf1e-48d4-ae32-8df22cf939a7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1472 microversion: 2.1 time: 0.244711 Oct 28 09:55:51.741747 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 699/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:51 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:51.746834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:51.748536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4784c226-3906-4e44-8fd4-3547a6b4a45f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.749805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4784c226-3906-4e44-8fd4-3547a6b4a45f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.758544 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-103811fb-0df3-49db-8e03-c862d4de8b7e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.381665 Oct 28 09:55:51.759674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 712/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:51 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:51.765132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.766570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.773656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.774601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.775236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.776719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.777441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.778040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.835435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4784c226-3906-4e44-8fd4-3547a6b4a45f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:51.861590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4784c226-3906-4e44-8fd4-3547a6b4a45f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:51.864321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4784c226-3906-4e44-8fd4-3547a6b4a45f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:51.866131 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4784c226-3906-4e44-8fd4-3547a6b4a45f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1285 microversion: 2.25 time: 0.123166 Oct 28 09:55:51.868018 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 700/1412] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:51 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:51.873227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:51.874614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:51.881623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.882476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.883157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:51.884117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:51.884821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:51.885642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.027228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:52.038501 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fa8eb0f7-5284-4740-a3d1-aa3ee53dbcdf tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1517 microversion: 2.1 time: 0.277204 Oct 28 09:55:52.043009 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 713/1413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:51 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1517 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:52.091363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:52.105467 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0724d62-077c-4073-aec4-4b1996e67e38 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.236156 Oct 28 09:55:52.106073 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 701/1414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:51 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:52.114359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:52.114980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:52.121497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.121995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.122437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.123162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.123654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.124028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.158599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-48d1ed0b-2d64-4790-8f8a-908f6f31f184 req-13087200-a8eb-40af-822b-4d635a61dfec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caca59f2-508b-4f81-b2c9-73857a7e7cbb", "name": "network-vif-plugged", "status": "completed", "tag": "5df6dcc3-c245-46be-ace9-9232b18e4b70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:52.171746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48d1ed0b-2d64-4790-8f8a-908f6f31f184 req-13087200-a8eb-40af-822b-4d635a61dfec service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.172245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48d1ed0b-2d64-4790-8f8a-908f6f31f184 req-13087200-a8eb-40af-822b-4d635a61dfec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.172684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48d1ed0b-2d64-4790-8f8a-908f6f31f184 req-13087200-a8eb-40af-822b-4d635a61dfec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.189845 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-48d1ed0b-2d64-4790-8f8a-908f6f31f184 req-13087200-a8eb-40af-822b-4d635a61dfec service nova] Creating event network-vif-plugged:5df6dcc3-c245-46be-ace9-9232b18e4b70 for instance caca59f2-508b-4f81-b2c9-73857a7e7cbb on n-h1-zed-1 Oct 28 09:55:52.194973 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-48d1ed0b-2d64-4790-8f8a-908f6f31f184 req-13087200-a8eb-40af-822b-4d635a61dfec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150480 Oct 28 09:55:52.195969 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 714/1415] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:52.202707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7eb5e6ed-f1a3-4d00-b40a-56f9100c7d86 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33603040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:52.268587 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7eb5e6ed-f1a3-4d00-b40a-56f9100c7d86 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.071486 Oct 28 09:55:52.280695 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 715/1416] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:52 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:52.293087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:52.301748 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b839d418-c645-4f63-bf22-bf948944d931 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.194674 Oct 28 09:55:52.302319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 702/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:52 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:52.783481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:52.784532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:52.787951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:52.788581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:52.791604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.792088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.792584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.800106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.800349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.800614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.800805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.801179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.801431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.802160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:52.802854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:52.803498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:52.959822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:52.968788 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3d5e452-7288-492d-9b52-3539d88b83ac tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1472 microversion: 2.1 time: 0.190187 Oct 28 09:55:52.996777 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 716/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:52 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1472 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:53.005662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:53.006695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:53.017803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.018847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.019783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.021098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.022087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.023251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.043068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.055941 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4cc2b4ad-037b-4d5c-8204-76c464c629c8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.271852 Oct 28 09:55:53.058782 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 703/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:52 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:53.075152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:53.075865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:53.086790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.087367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.087867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.089513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.091190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.091190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.121586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.133509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.136415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.137367 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14a9fed8-0461-4d56-af17-e77825924e44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1337 microversion: 2.25 time: 0.138705 Oct 28 09:55:53.149965 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 717/1420] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:52 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1337 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:53.161158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:53.161913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:53.169488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.170299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.171072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.172005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.173082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.173957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.314205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.324517 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb1ee3af-21e0-42cf-865b-b15c3ec447dc tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1517 microversion: 2.1 time: 0.253843 Oct 28 09:55:53.326868 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 704/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:53 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1517 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:53.331952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f52b6238-88c9-43dd-a68b-34e6e5bc2a9b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33782f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:53.423344 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f52b6238-88c9-43dd-a68b-34e6e5bc2a9b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.093035 Oct 28 09:55:53.423344 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 705/1422] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:53 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:53.427925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:53.429504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:53.437267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.439252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.439719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.440454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:53.441138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:53.441578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:53.661817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.667649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:53.671238 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d78227d3-ffaa-4d31-95ae-2005aef7252d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.246944 Oct 28 09:55:53.672196 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 706/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:53 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:53.763032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:53.784474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f61e2ab-5e08-46df-b195-80eb17068f53 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.632660 Oct 28 09:55:53.813470 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 718/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:53 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:54.008351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:54.009008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:54.038283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.038784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.039239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.039959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.040429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.040849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.085443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:54.086843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:54.102958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.108244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.111928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.112942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.117590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.118312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.538167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.540811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.554084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3e7a5ee-92bf-45ba-8bcb-b151a23f1ef4 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.472435 Oct 28 09:55:54.555065 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 719/1425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:54 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:54.556166 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9fb2f2c9-f3e4-43a4-a1b2-b659aed9de9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1472 microversion: 2.1 time: 0.555852 Oct 28 09:55:54.565933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:54.570265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:54.582003 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 707/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:53 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1472 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:54.611948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.611948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.616788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b714d4e2-1732-45b8-8f9f-c26d4f719838 req-d40850f2-e10c-445e-a6b8-84c342e04c86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102f91db-dd8e-4eba-bdbf-ca1b780a43c3", "name": "network-vif-plugged", "status": "completed", "tag": "b3e43631-e765-4de2-a277-d17477fcacf1"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:54.617630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.619325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.625838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.628347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.646710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b714d4e2-1732-45b8-8f9f-c26d4f719838 req-d40850f2-e10c-445e-a6b8-84c342e04c86 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.647556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b714d4e2-1732-45b8-8f9f-c26d4f719838 req-d40850f2-e10c-445e-a6b8-84c342e04c86 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.648320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b714d4e2-1732-45b8-8f9f-c26d4f719838 req-d40850f2-e10c-445e-a6b8-84c342e04c86 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.682461 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b714d4e2-1732-45b8-8f9f-c26d4f719838 req-d40850f2-e10c-445e-a6b8-84c342e04c86 service nova] Creating event network-vif-plugged:b3e43631-e765-4de2-a277-d17477fcacf1 for instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 on n-h1-zed-1 Oct 28 09:55:54.706650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b714d4e2-1732-45b8-8f9f-c26d4f719838 req-d40850f2-e10c-445e-a6b8-84c342e04c86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122597 Oct 28 09:55:54.707661 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 708/1427] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:54.719493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:54.720451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:54.727378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.727871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.728352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.729139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.729602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.730711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.788380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:54.789188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:54.790094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:54.791074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid d4b413ab-c900-43bb-8658-18beccaeb37a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:54.846843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.872086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.875384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.880307 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b388cbca-13a7-40d4-90a1-b5c1c5166eb3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1343 microversion: 2.25 time: 0.322534 Oct 28 09:55:54.881991 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 720/1428] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:54 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1343 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:54.920623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1cbf0647-21e4-4612-b305-aac58d0abd5d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3385af70>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:54.974516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:54.983088 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75cdd9c3-6d00-4a9e-92ca-8e26c5ae3249 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1310 microversion: 2.1 time: 0.274181 Oct 28 09:55:54.998886 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 709/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:54 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1310 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.036966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1bcbd639-5c21-4bce-8088-b1e7160a90ed req-bebc7dd3-fb6b-4fdc-aed0-ac07b95d2798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b413ab-c900-43bb-8658-18beccaeb37a", "name": "network-vif-deleted", "tag": "a4c5de3a-f9d1-4336-8f45-16778a9df2de"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:55.064739 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1cbf0647-21e4-4612-b305-aac58d0abd5d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.181155 Oct 28 09:55:55.067699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 721/1430] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:54 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.073605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1bcbd639-5c21-4bce-8088-b1e7160a90ed req-bebc7dd3-fb6b-4fdc-aed0-ac07b95d2798 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.074101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1bcbd639-5c21-4bce-8088-b1e7160a90ed req-bebc7dd3-fb6b-4fdc-aed0-ac07b95d2798 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.075026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1bcbd639-5c21-4bce-8088-b1e7160a90ed req-bebc7dd3-fb6b-4fdc-aed0-ac07b95d2798 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.088681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:55.096439 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1bcbd639-5c21-4bce-8088-b1e7160a90ed req-bebc7dd3-fb6b-4fdc-aed0-ac07b95d2798 service nova] Creating event network-vif-deleted:a4c5de3a-f9d1-4336-8f45-16778a9df2de for instance d4b413ab-c900-43bb-8658-18beccaeb37a on n-h1-zed-1 Oct 28 09:55:55.102050 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1bcbd639-5c21-4bce-8088-b1e7160a90ed req-bebc7dd3-fb6b-4fdc-aed0-ac07b95d2798 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098627 Oct 28 09:55:55.104264 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 710/1431] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:55.109344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:55.111335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:55.112609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:55.126639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.127576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.128191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.129127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.129758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.130355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.139486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.140294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.142039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.143643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.144944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.146537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.431580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:55.441555 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-caea3914-71f1-4a52-9cdd-fbc648169ac0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.335760 Oct 28 09:55:55.446254 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 711/1432] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:55 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.586096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:55.586714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:55.595962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.596468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.596939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.597654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.598114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.611293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.672411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:55.683516 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1822ea5-627b-45d7-9585-ec962540ac93 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.605765 Oct 28 09:55:55.699770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 722/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:55 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.707937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:55.708557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:55.714460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:55.722195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.723060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.723582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.724380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.724946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.725462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.769374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.770141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.770792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.771582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid a2aae186-313a-4f4d-8751-52c9df62b486 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:55.847693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:55.850863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:55.862035 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c635018d-1556-4abe-ae40-80911c59bb74 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 200 len: 1306 microversion: 2.1 time: 0.157104 Oct 28 09:55:55.868678 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 723/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:55 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 1306 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.887338 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3d784389-b7e9-43f8-a6f8-900c301210f9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.302619 Oct 28 09:55:55.902092 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 712/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:55 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:55.911843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:55.912468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:55.926017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.931590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.932624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:55.936234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:55.936818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:55.939689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.010653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.011381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:56.053144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.053657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.070817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.076034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.076559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.077040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.181659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.191175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.191735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.192218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid d4b413ab-c900-43bb-8658-18beccaeb37a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:56.295118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:56.303458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:56.305652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:56.306937 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-134d3a59-86f9-4c8e-862d-8e120f128bef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.399178 Oct 28 09:55:56.308358 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 724/1436] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:55 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:56.313029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c2c06d98-ec41-4a66-8472-06854afffd15 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3385a940>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.321237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:56.330666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-13a6cfb2-6bb9-4a0f-91e3-4e8d9631bb3e tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1310 microversion: 2.1 time: 0.328355 Oct 28 09:55:56.345022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 713/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1310 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:56.345022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.345022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:56.345022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.345022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.345606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.345606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.345994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.346429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.403978 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c2c06d98-ec41-4a66-8472-06854afffd15 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.094408 Oct 28 09:55:56.404816 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 725/1438] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:56.471262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.471892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:56.490053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.491611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.492556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.495064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.495745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.496724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.729962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:56.739403 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfa1258e-4141-47dd-9da5-622284b0a734 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.272293 Oct 28 09:55:56.740012 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 726/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:56.745219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.746034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:56.757392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.757900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.758352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.761174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.764139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.764597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.773968 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab197490-12ec-4aea-9864-75aa9671f9e2 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1806 microversion: 2.1 time: 0.441191 Oct 28 09:55:56.778155 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 714/1440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1806 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:56.785147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a1084c6d-0918-4b7b-8eba-9ddbe9824f87 req-2bf8ccf3-f4a7-47a0-85b2-efdaa2470fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd40166-156e-4d19-aa39-44ce7e03bbaf", "name": "network-vif-plugged", "status": "completed", "tag": "e4a0cf05-4ead-4e65-9732-3f4849c44d52"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:56.806059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a1084c6d-0918-4b7b-8eba-9ddbe9824f87 req-2bf8ccf3-f4a7-47a0-85b2-efdaa2470fa4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.809178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a1084c6d-0918-4b7b-8eba-9ddbe9824f87 req-2bf8ccf3-f4a7-47a0-85b2-efdaa2470fa4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.815665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a1084c6d-0918-4b7b-8eba-9ddbe9824f87 req-2bf8ccf3-f4a7-47a0-85b2-efdaa2470fa4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.834079 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a1084c6d-0918-4b7b-8eba-9ddbe9824f87 req-2bf8ccf3-f4a7-47a0-85b2-efdaa2470fa4 service nova] Creating event network-vif-plugged:e4a0cf05-4ead-4e65-9732-3f4849c44d52 for instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf on n-h2-zed-1 Oct 28 09:55:56.847286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a1084c6d-0918-4b7b-8eba-9ddbe9824f87 req-2bf8ccf3-f4a7-47a0-85b2-efdaa2470fa4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065970 Oct 28 09:55:56.854860 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 715/1441] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:56.861885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.866346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.866851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.867924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.869154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.869673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.870114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.908508 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28437003-13af-4be7-a261-6f526ea695ce tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 0.052267 Oct 28 09:55:56.911382 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 716/1442] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:56.928743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:56.929842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: a2aae186-313a-4f4d-8751-52c9df62b486] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:56.942658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.946745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.947420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:56.950822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:56.951505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:56.952166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.000718 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance a2aae186-313a-4f4d-8751-52c9df62b486 could not be found. Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 HTTP/1.1 Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:55:57.004852 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance a2aae186-313a-4f4d-8751-52c9df62b486 could not be found. Oct 28 09:55:57.006625 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'a2aae186-313a-4f4d-8751-52c9df62b486'} Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2aae186-313a-4f4d-8751-52c9df62b486 could not be found. Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:55:57.007569 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2aae186-313a-4f4d-8751-52c9df62b486 could not be found. Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2aae186-313a-4f4d-8751-52c9df62b486 could not be found. Oct 28 09:55:57.009199 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:55:57.013045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance a2aae186-313a-4f4d-8751-52c9df62b486 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:55:57.014254 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41f19db7-7570-4ff2-b7ed-865686d9d9e3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486" status: 404 len: 111 microversion: 2.1 time: 0.101744 Oct 28 09:55:57.019783 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 717/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/servers/a2aae186-313a-4f4d-8751-52c9df62b486 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:55:57.028079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.028996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.036103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.036881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.037558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.038513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.039138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.039734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.095121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.120928 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02d38f77-830d-4257-9085-8e57061e2cf6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.376441 Oct 28 09:55:57.122803 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 727/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:56 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:57.138036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.147528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.167028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.169059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.171487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.174490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.177009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.178782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.230868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:57.311242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.319969 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-55eb2e72-132d-4a6f-aa60-4fe516c84d3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.297207 Oct 28 09:55:57.326631 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 718/1445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:57 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:57.333349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fec6091c-fea9-41a2-9747-5b1174a93eee req-25c7ea5c-488d-41a2-bf0f-65e226a455b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2aae186-313a-4f4d-8751-52c9df62b486", "name": "network-vif-deleted", "tag": "8803f705-6e47-4629-ad45-8006f013267d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:57.356033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fec6091c-fea9-41a2-9747-5b1174a93eee req-25c7ea5c-488d-41a2-bf0f-65e226a455b8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.356527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fec6091c-fea9-41a2-9747-5b1174a93eee req-25c7ea5c-488d-41a2-bf0f-65e226a455b8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.359180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fec6091c-fea9-41a2-9747-5b1174a93eee req-25c7ea5c-488d-41a2-bf0f-65e226a455b8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.386247 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fec6091c-fea9-41a2-9747-5b1174a93eee req-25c7ea5c-488d-41a2-bf0f-65e226a455b8 service nova] Creating event network-vif-deleted:8803f705-6e47-4629-ad45-8006f013267d for instance a2aae186-313a-4f4d-8751-52c9df62b486 on n-h2-zed-1 Oct 28 09:55:57.396227 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fec6091c-fea9-41a2-9747-5b1174a93eee req-25c7ea5c-488d-41a2-bf0f-65e226a455b8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068623 Oct 28 09:55:57.400008 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 719/1446] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:57.407100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3be7878f-a8f1-46c9-9591-ecaaf963f106 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 204 len: 0 microversion: 2.1 time: 0.282059 Oct 28 09:55:57.407789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.408500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.409352 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 728/1447] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:57 2022] DELETE /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:57.416969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.418082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.420433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:57.427191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.428413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.429268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.430700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.431154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.431674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.432017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.432226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.432934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.433325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.438193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.438531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.481875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.482768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.483446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.484122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid d4b413ab-c900-43bb-8658-18beccaeb37a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:57.550343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.568863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-927c6cd0-5222-4957-91f7-41c1d8127d2d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1310 microversion: 2.1 time: 0.157913 Oct 28 09:55:57.593857 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 729/1448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:57 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:57.606459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.606957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.613445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.613935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.614375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.615083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.615536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.615959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.639804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:57.655710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:55:57.771707 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92a79e51-359a-483d-b766-d4c36b8d999e tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 204 len: 0 microversion: 2.1 time: 0.168833 Oct 28 09:55:57.775643 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 730/1449] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:55:57 2022] DELETE /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:55:57.781398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1af810bc-eb9f-4d7d-b06d-5942b6212dca tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca332954c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.817430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.830970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.832955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:57.834420 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-200543a7-cef0-4d20-9ab8-7cb84521e6d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.431187 Oct 28 09:55:57.853318 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 720/1450] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:57 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:57.878263 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1af810bc-eb9f-4d7d-b06d-5942b6212dca tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.101267 Oct 28 09:55:57.882227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.886984 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 731/1451] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:57 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:57.889432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.892078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-531931a4-c910-4ecf-869c-2d41b5dc8df9 req-b6c84d2d-78af-4d9c-bdcd-9e32ff4ee08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6255ec55-f11e-457b-b949-b17da3834864", "tag": "dedd9f55-4ec9-4fd5-bc71-af4596ace404"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:55:57.907494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-531931a4-c910-4ecf-869c-2d41b5dc8df9 req-b6c84d2d-78af-4d9c-bdcd-9e32ff4ee08b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.908100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.908624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.908974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-531931a4-c910-4ecf-869c-2d41b5dc8df9 req-b6c84d2d-78af-4d9c-bdcd-9e32ff4ee08b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.909661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-531931a4-c910-4ecf-869c-2d41b5dc8df9 req-b6c84d2d-78af-4d9c-bdcd-9e32ff4ee08b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.910008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.910742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.911209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.911645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.926154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-531931a4-c910-4ecf-869c-2d41b5dc8df9 req-b6c84d2d-78af-4d9c-bdcd-9e32ff4ee08b service nova] Creating event network-changed:dedd9f55-4ec9-4fd5-bc71-af4596ace404 for instance 6255ec55-f11e-457b-b949-b17da3834864 on n-h2-zed-1 Oct 28 09:55:57.932490 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-531931a4-c910-4ecf-869c-2d41b5dc8df9 req-b6c84d2d-78af-4d9c-bdcd-9e32ff4ee08b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043755 Oct 28 09:55:57.933863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 732/1452] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:55:57.941057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:57.942158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:57.949903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.950767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.951652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:57.952480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:57.953150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:57.953642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.113683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:58.123209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a47c182d-edf6-40fa-86d9-8ece3caf7ba8 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.267966 Oct 28 09:55:58.138807 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 721/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:57 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:58.151978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:58.153466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:58.162858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.164425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.165431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.167369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.168453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.169786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.195600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:58.206239 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-835ba4e4-0057-4505-a72d-f10b419368cc tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1474 microversion: 2.1 time: 0.270847 Oct 28 09:55:58.221724 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 733/1454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:57 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1474 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:58.344583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:58.345418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:58.356143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.358060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.358805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.362564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.362564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.363066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.441449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:58.453205 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63097f1b-6810-4240-99b2-0e3132b6dda6 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.306395 Oct 28 09:55:58.453742 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 722/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:58 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:58.593848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:58.594741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:58.621590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.621590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.621590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.621590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.622193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.622193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.622370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:58.622370 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a09effec-7cb8-405c-84de-c53fd99dd49a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.279186 Oct 28 09:55:58.622370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 734/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:58 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:58.681291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.682711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.683165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.683622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid d4b413ab-c900-43bb-8658-18beccaeb37a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:58.754331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:58.770819 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07aaf8d2-7a7e-4d5e-8c84-c4de5ece5a94 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1310 microversion: 2.1 time: 0.182833 Oct 28 09:55:58.771773 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 723/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:58 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1310 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:58.862547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:58.864767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:58.873721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.874776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.875466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.876431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:58.877156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:58.877815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:58.894135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99d021ab-e9f4-4db2-989b-0ada99c43e04 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33782f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:58.980483 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99d021ab-e9f4-4db2-989b-0ada99c43e04 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1453 microversion: 2.1 time: 0.089496 Oct 28 09:55:58.982027 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 724/1458] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:58 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:59.060101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.071649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.074164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.075488 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31db3e39-b8c7-43ea-87b3-5d95bc999343 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.216969 Oct 28 09:55:59.076460 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 735/1459] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:55:58 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:55:59.151680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:59.152656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:59.160304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.160790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.161254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.161965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.162442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.162863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.232003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:59.233035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:59.239816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.241692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.242352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.243326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.244700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.245350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.365149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.377812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-66a4ea49-4a88-4a47-bd1d-dd17b1ba3a35 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.233396 Oct 28 09:55:59.382288 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 725/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:59 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:55:59.472512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.481003 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96bdb49a-1318-4c75-a4d3-08a8753e46f9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1474 microversion: 2.1 time: 0.253129 Oct 28 09:55:59.482036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 736/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:59 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1474 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:59.483546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:59.484168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:59.492306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.492801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.493267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.493973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.494937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.495368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.638671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.646972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:59.647678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:59.648540 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e296fab6-c7a2-452c-a98a-cf7fec26b51f tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1371 microversion: 2.1 time: 0.168687 Oct 28 09:55:59.649512 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 726/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:59 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:59.661455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.663647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.663647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.663647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.663647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.664187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.804613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:55:59.806411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:55:59.811062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.820033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.820597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.822562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.823304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.823768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.824197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.829259 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-67d34640-7796-4f5d-9b1e-29764ea50ccd tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.186098 Oct 28 09:55:59.829866 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 737/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:59 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:59.865494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:55:59.883285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:55:59.883773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:55:59.884209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:55:59.884656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid d4b413ab-c900-43bb-8658-18beccaeb37a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:55:59.926348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:55:59.936409 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a30bf81-22d4-4049-9a93-54f379c43282 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1310 microversion: 2.1 time: 0.145429 Oct 28 09:55:59.937016 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 727/1464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:55:59 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1310 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:55:59.998623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7300cce8-43d8-4fea-a268-1044992f165d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3367da60>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.048944 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7300cce8-43d8-4fea-a268-1044992f165d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1462 microversion: 2.1 time: 0.056444 Oct 28 09:56:00.049723 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 738/1465] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:55:59 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1462 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:00.064547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8080ad02-5886-4038-af4c-ed60aaaa24af tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca338601f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.104626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.105450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.112173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.113271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.113662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.114288 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8080ad02-5886-4038-af4c-ed60aaaa24af tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 200 len: 1462 microversion: 2.1 time: 0.053496 Oct 28 09:56:00.114643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.115026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 728/1466] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 1462 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:00.115497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.116007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.129378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.130274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.136820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.137385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.137823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.138523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.138976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.139464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.264102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.272723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.274595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.275351 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95b8368e-29b5-4bfe-84a4-24f512066ffb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.176225 Oct 28 09:56:00.276483 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 739/1467] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:00.281144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a35b77d3-2490-4376-9fc2-7b6c20a184b6", "device": "/dev/xvdb"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:00.285127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.292837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.293444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.294450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.295157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.295607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.296027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.335091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.344731 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47c8358f-a4f9-4bbe-95b1-60fb27dac2d8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1481 microversion: 2.1 time: 0.219378 Oct 28 09:56:00.345343 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 729/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1481 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:00.404463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.405102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.412313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.412821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.413275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.414006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.414455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.414873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.581100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.589845 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5191bdc5-e944-4b0d-8cda-c26ed3c73e7c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.189764 Oct 28 09:56:00.590399 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 730/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:00.594872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.595483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.601376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.601939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.602378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.603070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.603524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.603943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.741576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:00.749630 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0e2e997-761e-4b8b-91ae-d62f095adbee tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1474 microversion: 2.1 time: 0.158237 Oct 28 09:56:00.750213 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 731/1470] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1474 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:00.754685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:00.755301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:00.762190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.763072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.763523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.764229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:00.764687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:00.765143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:00.978692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.006510 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7394d6d2-1e4d-4548-93ce-cafa31932a74 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1556 microversion: 2.1 time: 0.255204 Oct 28 09:56:01.011152 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 732/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:00 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1556 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:01.023110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.023755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.032932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.033786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.034415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.036211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.037319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.037761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.173887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:01.185403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.195785 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f1f10d7-98a8-4c38-b861-5a3e8b79d719 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.183190 Oct 28 09:56:01.196693 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 733/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:01.202772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.203811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.210161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.210930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.211873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.212815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.213621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.214110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.239943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:01.249968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.250595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.251163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.251618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid d4b413ab-c900-43bb-8658-18beccaeb37a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:01.296959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.305147 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e60e5ac-cfc2-442b-8454-9beb9f124f46 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1310 microversion: 2.1 time: 0.107056 Oct 28 09:56:01.305721 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 734/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1310 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:01.311021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.311528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.317273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.317763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.318206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.318912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.319368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.319800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.396843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6dd6c666-2526-4cf6-99d0-5b7e3e2a30e9 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090031 Oct 28 09:56:01.397592 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 735/1474] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:01.402790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-299d8c07-3911-43a0-abfc-57571e598376 req-1d1f4a5a-bf82-402b-acac-ad2464b8620d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e618b41c-1036-4406-8bdd-152212526ef2", "name": "network-vif-deleted", "tag": "422b35b6-0138-4c3e-82f4-6f0638f98c6e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:01.414151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-299d8c07-3911-43a0-abfc-57571e598376 req-1d1f4a5a-bf82-402b-acac-ad2464b8620d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.414772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-299d8c07-3911-43a0-abfc-57571e598376 req-1d1f4a5a-bf82-402b-acac-ad2464b8620d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.415308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-299d8c07-3911-43a0-abfc-57571e598376 req-1d1f4a5a-bf82-402b-acac-ad2464b8620d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.428723 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-299d8c07-3911-43a0-abfc-57571e598376 req-1d1f4a5a-bf82-402b-acac-ad2464b8620d service nova] Creating event network-vif-deleted:422b35b6-0138-4c3e-82f4-6f0638f98c6e for instance e618b41c-1036-4406-8bdd-152212526ef2 on n-h2-zed-1 Oct 28 09:56:01.434517 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-299d8c07-3911-43a0-abfc-57571e598376 req-1d1f4a5a-bf82-402b-acac-ad2464b8620d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035627 Oct 28 09:56:01.435296 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 736/1475] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:01.441228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.441943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.449135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.449940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.450388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.451135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.451594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.452022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.634034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.646390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.648813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.650201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75549a68-1092-4ca9-bd98-e26337afd60e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.213725 Oct 28 09:56:01.655666 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 737/1476] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:01.665989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.667002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.674561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.675189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.675705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.676639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.677055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.677577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.814775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.822580 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d8da072-134f-4d71-8570-05ff51f9f86c tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1468 microversion: 2.1 time: 0.164283 Oct 28 09:56:01.823658 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 738/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1468 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:01.828333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.829000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.834735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.835580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.835704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.836340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.836792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.837665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.842148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=28 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:01.974171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:01.982723 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3327a671-db9a-48a4-8fc5-0e2f1e927c83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.158081 Oct 28 09:56:01.983458 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 739/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:01.988178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:01.988469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:01.994164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.995236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.995676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:01.996389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:01.996846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:01.997374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.131922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:02.145689 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-98bbe623-362d-44ee-bbed-4563fb2f205c tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1474 microversion: 2.1 time: 0.161135 Oct 28 09:56:02.146652 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 740/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:01 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1474 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:02.151713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1790381377"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:02.154212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:02.160536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.161414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.161560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.162200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.162668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.163098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.378737 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5268aad0-fb9d-4152-8994-5adbb9c0bad1 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "POST /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d/action" status: 202 len: 0 microversion: 2.1 time: 0.230470 Oct 28 09:56:02.385082 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 741/1480] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:02 2022] POST /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 09:56:02.387216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:02.387949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:02.394945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.395779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.396217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.396943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.397404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.397829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.558857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:02.569219 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41d1e08a-92ea-4586-afd5-5f94f17ca877 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1313 microversion: 2.1 time: 0.188072 Oct 28 09:56:02.576330 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 742/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:02 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:02.582733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:02.583624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:02.591985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.615327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.623085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.624128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.626474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.627109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.706428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.706969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.709705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.710335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid d4b413ab-c900-43bb-8658-18beccaeb37a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:02.771380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:02.774918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:02.781338 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f12787e3-d647-471f-9810-ac3473b7b4f1 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 200 len: 1310 microversion: 2.1 time: 0.203282 Oct 28 09:56:02.782108 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 743/1482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:02 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 1310 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:02.787115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d755c763-0b98-47ef-b15c-5893602050bb tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33672b80>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:02.845980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d755c763-0b98-47ef-b15c-5893602050bb tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.063008 Oct 28 09:56:02.854704 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 744/1483] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:02 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:02.859636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:02.860498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:02.862532 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d5f96588-3831-4527-b7c5-8760d94c1c12 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "POST /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.584682 Oct 28 09:56:02.865412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 740/1484] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 09:56:00 2022] POST /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 194 bytes in 2588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:02.867787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.868536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.869197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:02.870112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:02.870565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:02.870988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.014003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.014830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.023904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.024737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.025443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.027035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.027739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.028489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.059270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:03.080165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:03.081645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:03.082996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4464658a-0c2d-41e9-a5ea-52a2565db7fc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.227261 Oct 28 09:56:03.083747 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 745/1485] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:02 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:03.169624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.170542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.177085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.177966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.178581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.179318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.179934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.180369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.264653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:03.274990 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b017e5e5-9bfa-4bed-bfc6-0e27cfdc5164 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1432 microversion: 2.1 time: 0.108770 Oct 28 09:56:03.277070 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 746/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1432 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:03.467414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-92e8cad3-84e9-4f6e-998f-54e24f86f916 req-b706cefb-19a4-48b7-a860-9545dbf893dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dd40166-156e-4d19-aa39-44ce7e03bbaf", "tag": "e4a0cf05-4ead-4e65-9732-3f4849c44d52"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:03.480115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-92e8cad3-84e9-4f6e-998f-54e24f86f916 req-b706cefb-19a4-48b7-a860-9545dbf893dd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.481116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-92e8cad3-84e9-4f6e-998f-54e24f86f916 req-b706cefb-19a4-48b7-a860-9545dbf893dd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.482071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-92e8cad3-84e9-4f6e-998f-54e24f86f916 req-b706cefb-19a4-48b7-a860-9545dbf893dd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.503350 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-92e8cad3-84e9-4f6e-998f-54e24f86f916 req-b706cefb-19a4-48b7-a860-9545dbf893dd service nova] Creating event network-changed:e4a0cf05-4ead-4e65-9732-3f4849c44d52 for instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf on n-h2-zed-1 Oct 28 09:56:03.519828 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-92e8cad3-84e9-4f6e-998f-54e24f86f916 req-b706cefb-19a4-48b7-a860-9545dbf893dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047574 Oct 28 09:56:03.529199 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 747/1487] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:03.599496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.602681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.612641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:03.614152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.614838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.616635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.618492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.621552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.623860 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1b2c71d0-5b6e-4059-87ae-9fcc9ffc48c6 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.620014 Oct 28 09:56:03.624615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.625661 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 741/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:03.811062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.812025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: d4b413ab-c900-43bb-8658-18beccaeb37a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.823369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.827466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.829070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.830126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.830869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.831650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.859451 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] HTTP exception thrown: Instance d4b413ab-c900-43bb-8658-18beccaeb37a could not be found. Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Request method failure captured: Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a HTTP/1.1 Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6bBmHD-7ae0iEh2O1VwzhqMmU4hAb3dpSfFSS5gMYpnVmW7hytHTH5X2Ej3KZpuxffJfbjmLhadb0V4qoQDRrSQ64xsklm7WMey81JZ3jEdGHvovdvqLWK0hyNzEXHHpaMyZ1g1qWFsuLggzUBrNM7ggpsbeWCCbGA76CrAkiPI3io Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 57eeba8f69124206b8e6a8c8eb875c6f Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:56:03.861635 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57eeba8f69124206b8e6a8c8eb875c6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57eeba8f69124206b8e6a8c8eb875c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57eeba8f69124206b8e6a8c8eb875c6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57eeba8f69124206b8e6a8c8eb875c6f"}]}] Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 57eeba8f69124206b8e6a8c8eb875c6f Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListServerFiltersTestJSON-1288892638-project Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a21c5e160ca7460d892ce593d4644240 Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListServerFiltersTestJSON-1288892638-project Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance d4b413ab-c900-43bb-8658-18beccaeb37a could not be found. Oct 28 09:56:03.863826 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd4b413ab-c900-43bb-8658-18beccaeb37a'} Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b413ab-c900-43bb-8658-18beccaeb37a could not be found. Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:03.864771 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b413ab-c900-43bb-8658-18beccaeb37a could not be found. Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b413ab-c900-43bb-8658-18beccaeb37a could not be found. Oct 28 09:56:03.866550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:03.869477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Returning 404 to user: Instance d4b413ab-c900-43bb-8658-18beccaeb37a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:03.870553 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a9f6594-485d-40a0-806b-7d18fbc4cd69 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a" status: 404 len: 111 microversion: 2.1 time: 0.068139 Oct 28 09:56:03.871301 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 742/1489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/servers/d4b413ab-c900-43bb-8658-18beccaeb37a => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:56:03.876768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-18abe4bc-f53d-44dc-875d-d8e0d013bac7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330dcc10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.877505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:03.887692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14566786-2c4c-4fe5-b8a7-1fa5b7880e61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1463 microversion: 2.1 time: 0.290794 Oct 28 09:56:03.888591 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 748/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1463 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:03.894982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.895717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.903393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.904163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.904802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.905719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.906366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.906983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.946951 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-18abe4bc-f53d-44dc-875d-d8e0d013bac7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.074287 Oct 28 09:56:03.949329 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 743/1491] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:03.964035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:03.964516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:03.967157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:03.972568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.973101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.973780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:03.974758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:03.975386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:03.976044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.177079 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90b0c882-01c0-48f8-a27c-535923fe95a9 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 204 len: 0 microversion: 2.1 time: 0.284739 Oct 28 09:56:04.186051 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 749/1492] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:03 2022] DELETE /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:04.193900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:04.195193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:04.208027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.209968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.210752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.212658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.227344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.228038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.313220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:04.324162 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-315e5cfa-bb88-44c3-9291-fe6eab755d8b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1464 microversion: 2.1 time: 0.368294 Oct 28 09:56:04.324754 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 744/1493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:03 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:04.330539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:04.331457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:04.344620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.345542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.346318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.347314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.347948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.348569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.632051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:04.647702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:04.649529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:04.650859 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c19d02c-7426-495b-964b-0407649dcb4f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.463416 Oct 28 09:56:04.651552 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 750/1494] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:04 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:04.661530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:04.662890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:04.669202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.669533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.669973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.670650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.671105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.671525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.679073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:04.694623 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4ae7540-6623-4356-a066-e18578ab454b tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1519 microversion: 2.1 time: 0.367872 Oct 28 09:56:04.695537 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 745/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:04 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1519 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:04.700728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1832565679", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "caca59f2-508b-4f81-b2c9-73857a7e7cbb"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:04.732174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.732885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.733509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.734176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid 3d45eb16-2631-4068-bd85-d26fb3f25d98 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:04.781658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:56:04.877818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:04.889483 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-290658fc-0200-4fae-9d2a-77f271345f43 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1309 microversion: 2.1 time: 0.235335 Oct 28 09:56:04.890068 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 751/1496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:04 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1309 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:04.902803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:04.905599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:04.921627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.922128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.922571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:04.923285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:04.923993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:04.924628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.138407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:05.139007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:05.139299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:05.139769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:05.140184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:05.152606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.153061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.153509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.154293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.154756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.155236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.159524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:05.174305 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d3ebc180-2f24-46d5-8b6d-7f8072951467 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.279326 Oct 28 09:56:05.175289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 752/1497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:04 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:05.180177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9160748-0b05-41ad-8cee-bf22b200ca23 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3349b1f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.182501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Getting quotas for project 7d2636214d0b430d929ef27e9592488d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:56:05.194178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Getting quotas for user feb7e91603d6463e9428e71c31efb6b3 and project 7d2636214d0b430d929ef27e9592488d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:56:05.209155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:56:05.211597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:56:05.242854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9160748-0b05-41ad-8cee-bf22b200ca23 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.066330 Oct 28 09:56:05.243749 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 753/1498] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:05.276765 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ceac803a-feb2-4a82-b5ec-6fc82e9f3e3e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580146 Oct 28 09:56:05.278288 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 746/1499] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:56:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:56:05.289189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0934727c-4bea-4bb1-9c4f-76b331458b34 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.290172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0934727c-4bea-4bb1-9c4f-76b331458b34 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.388797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0934727c-4bea-4bb1-9c4f-76b331458b34 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:05.402561 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0934727c-4bea-4bb1-9c4f-76b331458b34 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1214 microversion: 2.1 time: 0.117541 Oct 28 09:56:05.409066 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 754/1500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:05.554468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e0033a99-35fd-46e1-bdd3-e60ad9612a8e req-ad3cec7c-23d0-4f47-b5b3-61a872064d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d45eb16-2631-4068-bd85-d26fb3f25d98", "name": "network-vif-deleted", "tag": "87606c16-1569-4633-b64b-9a7a85b0c2d6"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:05.567881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e0033a99-35fd-46e1-bdd3-e60ad9612a8e req-ad3cec7c-23d0-4f47-b5b3-61a872064d96 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.569030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e0033a99-35fd-46e1-bdd3-e60ad9612a8e req-ad3cec7c-23d0-4f47-b5b3-61a872064d96 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.569779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e0033a99-35fd-46e1-bdd3-e60ad9612a8e req-ad3cec7c-23d0-4f47-b5b3-61a872064d96 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.584661 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e0033a99-35fd-46e1-bdd3-e60ad9612a8e req-ad3cec7c-23d0-4f47-b5b3-61a872064d96 service nova] Creating event network-vif-deleted:87606c16-1569-4633-b64b-9a7a85b0c2d6 for instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 on n-h1-zed-1 Oct 28 09:56:05.592426 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e0033a99-35fd-46e1-bdd3-e60ad9612a8e req-ad3cec7c-23d0-4f47-b5b3-61a872064d96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041983 Oct 28 09:56:05.594384 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 747/1501] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:05.680257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.680871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.688319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.688892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.689369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.690055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.690507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.690930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.719910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.721060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.727984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.728548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.729648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.730532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.731212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.731971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.886905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:05.900127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:05.902917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:05.904476 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1e64841-c2ea-4667-8fa7-063c593c030c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.229533 Oct 28 09:56:05.920143 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 755/1502] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:05.920366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:05.920535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:05.920535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:05.920695 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cd5892ad-05d8-42f6-b261-ed18e9392467 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1519 microversion: 2.1 time: 0.203078 Oct 28 09:56:05.920845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.921566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.922224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.923222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.924114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.924543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.929500 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 748/1503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:05.960541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:05.961043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:05.961483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:05.962000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid 3d45eb16-2631-4068-bd85-d26fb3f25d98 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:06.003109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:06.011479 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75c27243-7609-4b88-9972-7e57195cd350 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 200 len: 1309 microversion: 2.1 time: 0.103143 Oct 28 09:56:06.012058 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 756/1504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:05 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:06.204604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:06.206002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:06.217352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.221532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.222343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.236767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.238291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.239786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.261761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5595b01-c79d-4266-87b3-3ef3a36116c7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3399c0d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:06.335714 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5595b01-c79d-4266-87b3-3ef3a36116c7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.079588 Oct 28 09:56:06.337805 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 757/1505] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:06 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:06.348290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-157b2e76-df65-43b5-bbbb-85cd35512ed9 req-6b7cddfb-4b2f-4d0f-bb97-1844f64e367c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ac7f33-0abb-4958-8a4b-42eaec67578a", "name": "network-vif-unplugged", "status": "completed", "tag": "e54700aa-52ee-4f0a-b07e-8955746bd325"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:06.375800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-157b2e76-df65-43b5-bbbb-85cd35512ed9 req-6b7cddfb-4b2f-4d0f-bb97-1844f64e367c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.377811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-157b2e76-df65-43b5-bbbb-85cd35512ed9 req-6b7cddfb-4b2f-4d0f-bb97-1844f64e367c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.380256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-157b2e76-df65-43b5-bbbb-85cd35512ed9 req-6b7cddfb-4b2f-4d0f-bb97-1844f64e367c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.406603 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-157b2e76-df65-43b5-bbbb-85cd35512ed9 req-6b7cddfb-4b2f-4d0f-bb97-1844f64e367c service nova] Creating event network-vif-unplugged:e54700aa-52ee-4f0a-b07e-8955746bd325 for instance 54ac7f33-0abb-4958-8a4b-42eaec67578a on n-h2-zed-1 Oct 28 09:56:06.420456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-157b2e76-df65-43b5-bbbb-85cd35512ed9 req-6b7cddfb-4b2f-4d0f-bb97-1844f64e367c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079395 Oct 28 09:56:06.423437 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 758/1506] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:06.438332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:06.441440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:06.460630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.461403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.463819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.464729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.477749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.480670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.603721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:06.613860 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-267524af-e45c-4aa8-a1c5-e37c11805998 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1266 microversion: 2.1 time: 0.186548 Oct 28 09:56:06.614728 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 759/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:06 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:06.700740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:06.705638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:06.712025 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-259b7342-23af-4d63-b2f6-bc3196665e5b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.512572 Oct 28 09:56:06.729076 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 749/1508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:06 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:06.931284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:06.932427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:06.942239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:06.942859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:06.948249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:06.951133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.955260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.956577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.957306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.958268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.958926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.959561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.960152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.960784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:06.961745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:06.968242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:06.968963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.092134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.111061 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a9878a33-9d29-46e7-816a-8d7e24878896 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1477 microversion: 2.1 time: 0.171826 Oct 28 09:56:07.113141 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 750/1509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:06 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1477 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:07.120259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.121965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 3d45eb16-2631-4068-bd85-d26fb3f25d98] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.131487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.132391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.134055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.134821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.135449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.135894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.153327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.157171 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 could not be found. Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 HTTP/1.1 Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:56:07.158825 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 could not be found. Oct 28 09:56:07.160473 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '3d45eb16-2631-4068-bd85-d26fb3f25d98'} Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 could not be found. Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:07.161439 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 could not be found. Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 could not be found. Oct 28 09:56:07.162967 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.164366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance 3d45eb16-2631-4068-bd85-d26fb3f25d98 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:07.164366 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6f288ed1-9bf1-4a83-a84d-5b53da31e7e1 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98" status: 404 len: 111 microversion: 2.1 time: 0.045459 Oct 28 09:56:07.164366 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 751/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/servers/3d45eb16-2631-4068-bd85-d26fb3f25d98 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:07.170318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.170566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.171071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: e618b41c-1036-4406-8bdd-152212526ef2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.172151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.173516 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d2c03f7-28e3-495a-bbca-a271f811fe81 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.246061 Oct 28 09:56:07.174505 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 760/1511] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:06 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:07.183965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.184456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.185403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.186303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.186926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.187522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.204274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance e618b41c-1036-4406-8bdd-152212526ef2 could not be found. Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 HTTP/1.1 Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:56:07.205987 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e618b41c-1036-4406-8bdd-152212526ef2 could not be found. Oct 28 09:56:07.208225 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e618b41c-1036-4406-8bdd-152212526ef2'} Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e618b41c-1036-4406-8bdd-152212526ef2 could not be found. Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:07.209290 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e618b41c-1036-4406-8bdd-152212526ef2 could not be found. Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e618b41c-1036-4406-8bdd-152212526ef2 could not be found. Oct 28 09:56:07.211340 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:07.213013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance e618b41c-1036-4406-8bdd-152212526ef2 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:07.213013 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31122839-dca6-4eef-9b30-de0437c2ca86 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2" status: 404 len: 111 microversion: 2.1 time: 0.042571 Oct 28 09:56:07.213013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 752/1512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/servers/e618b41c-1036-4406-8bdd-152212526ef2 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:07.215886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d343626-1470-476f-8257-3f3e47fbe80d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.248800 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d343626-1470-476f-8257-3f3e47fbe80d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/23fbb2c7-2d21-406b-a5af-6d99cb136ba8" status: 204 len: 0 microversion: 2.1 time: 0.036535 Oct 28 09:56:07.249719 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 761/1513] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 09:56:07 2022] DELETE /compute/v2.1/os-server-groups/23fbb2c7-2d21-406b-a5af-6d99cb136ba8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:07.257973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.259079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.266337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.266994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.267501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.268512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.269138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.269757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.298481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:07.357773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29333dfc-bd43-466b-90f7-769469ef4725 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca338ecca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.413955 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-603b5e7f-81f3-4c16-a3a2-d972ccedaf1b tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 204 len: 0 microversion: 2.1 time: 0.159632 Oct 28 09:56:07.417820 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 753/1514] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:07 2022] DELETE /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:07.423432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.424354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.431228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.431721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.432878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.435218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.436025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.436571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.461331 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29333dfc-bd43-466b-90f7-769469ef4725 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.110899 Oct 28 09:56:07.461847 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 762/1515] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:07.469023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:07.590673 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3e471e8-30b1-47bf-850d-10f126282b6a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 204 len: 0 microversion: 2.1 time: 0.171312 Oct 28 09:56:07.591512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 754/1516] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:07 2022] DELETE /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:07.600127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.600862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.602980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:07.609767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.610463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.611025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.611994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.612683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.613381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.614923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-90832585-2501-4e65-ae3e-12b8d0d9dfd7 req-280013f2-0250-4888-9f10-5bc7722a7f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8bca161-a586-4715-a853-495bacc34c9e", "name": "network-vif-deleted", "tag": "a70c91bc-a9ad-4fbe-905f-84d7e6f0ad55"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:07.626572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-90832585-2501-4e65-ae3e-12b8d0d9dfd7 req-280013f2-0250-4888-9f10-5bc7722a7f07 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.627217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-90832585-2501-4e65-ae3e-12b8d0d9dfd7 req-280013f2-0250-4888-9f10-5bc7722a7f07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.627666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-90832585-2501-4e65-ae3e-12b8d0d9dfd7 req-280013f2-0250-4888-9f10-5bc7722a7f07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.641808 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-90832585-2501-4e65-ae3e-12b8d0d9dfd7 req-280013f2-0250-4888-9f10-5bc7722a7f07 service nova] Creating event network-vif-deleted:a70c91bc-a9ad-4fbe-905f-84d7e6f0ad55 for instance a8bca161-a586-4715-a853-495bacc34c9e on n-h1-zed-1 Oct 28 09:56:07.647309 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-90832585-2501-4e65-ae3e-12b8d0d9dfd7 req-280013f2-0250-4888-9f10-5bc7722a7f07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037231 Oct 28 09:56:07.648524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 755/1517] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:07.654465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.655160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.658396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:07.664144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.664631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.665117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.665827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.666312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.666737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.734471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.742655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e64faff-5032-4838-bf4a-7b265ebcda2a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1274 microversion: 2.1 time: 0.092155 Oct 28 09:56:07.743408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 756/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:07.761941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:07.762664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:07.764929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.769762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.770397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.770954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.771775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:07.772336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:07.772888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:07.773351 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e658d6a1-ae02-41a3-9502-476388c9fd50 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1475 microversion: 2.1 time: 0.177421 Oct 28 09:56:07.774187 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 763/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1475 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:07.914067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:07.922837 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0f00ec4-0165-49ca-8ec8-757c1abd7649 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.178197 Oct 28 09:56:07.923435 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 757/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:07 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.134497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.135062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.142339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.143069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.143693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.144633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.145285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.146013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.181197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.182947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.183581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.184144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid a8bca161-a586-4715-a853-495bacc34c9e {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:08.198934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.199545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.206869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.207529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.207797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.208511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.208989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.211835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.240525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.249938 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f60aa0c6-33df-4753-a45b-1a3e5c359ca8 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1311 microversion: 2.1 time: 0.119369 Oct 28 09:56:08.251326 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 764/1521] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1311 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.380494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.389885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.391601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.392859 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e294cf75-009a-4da4-9a35-ee1fd46b9205 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.197769 Oct 28 09:56:08.404950 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 758/1522] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:56:08.476633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea80b9d5-ca8e-4835-97c4-f004a11e248d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33eb0c10>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.522712 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea80b9d5-ca8e-4835-97c4-f004a11e248d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.049811 Oct 28 09:56:08.523291 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 765/1523] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.769962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.770988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.781294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.781953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.782734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.783604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.784262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.785040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.799410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.801737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.809974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.810611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.811108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.811901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.812496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.813041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.821044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:08.851985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.861452 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-26b21217-d1c9-4098-a95b-d5b314f63076 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1274 microversion: 2.1 time: 0.097833 Oct 28 09:56:08.862470 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 759/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:08.955257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:08.956457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:08.964409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.965451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.966365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.966755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:08.967084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:08.967711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:08.968463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:08.976332 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b327c37b-892e-4934-b8a3-cc0546b4cdc7 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1475 microversion: 2.1 time: 0.182213 Oct 28 09:56:08.989911 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 766/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1475 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:09.115920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7e117985-2b0a-40f0-b622-874303877dfc req-49be8616-ae83-4d74-8b9c-2141a14d7b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6255ec55-f11e-457b-b949-b17da3834864", "name": "network-vif-plugged", "status": "completed", "tag": "dedd9f55-4ec9-4fd5-bc71-af4596ace404"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:09.122603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.129554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7e117985-2b0a-40f0-b622-874303877dfc req-49be8616-ae83-4d74-8b9c-2141a14d7b91 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.130032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7e117985-2b0a-40f0-b622-874303877dfc req-49be8616-ae83-4d74-8b9c-2141a14d7b91 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.130707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7e117985-2b0a-40f0-b622-874303877dfc req-49be8616-ae83-4d74-8b9c-2141a14d7b91 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.132124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8207eaee-26fa-4f52-abf5-061ec5243563 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.181289 Oct 28 09:56:09.133632 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 760/1526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:08 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:09.153854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7e117985-2b0a-40f0-b622-874303877dfc req-49be8616-ae83-4d74-8b9c-2141a14d7b91 service nova] Creating event network-vif-plugged:dedd9f55-4ec9-4fd5-bc71-af4596ace404 for instance 6255ec55-f11e-457b-b949-b17da3834864 on n-h2-zed-1 Oct 28 09:56:09.159700 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7e117985-2b0a-40f0-b622-874303877dfc req-49be8616-ae83-4d74-8b9c-2141a14d7b91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049804 Oct 28 09:56:09.160439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 767/1527] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:09.276030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:09.277310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:09.283916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.284558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.285029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.285746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.286203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.286630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.321408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.321907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.322358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.323649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid a8bca161-a586-4715-a853-495bacc34c9e {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:09.368576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.377400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb877c1c-1de9-4c97-aea1-62d59af2134d tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1311 microversion: 2.1 time: 0.105317 Oct 28 09:56:09.378001 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 761/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:09 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:09.417911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:09.418623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:09.425393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.425870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.426323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.427022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.427478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.427905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.538225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7c807c06-6445-4685-8945-b11071eb1b90 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3313ab80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:09.570675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.589815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.591976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.593362 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dbe92282-d592-4f58-8d14-63ff32b5d2d2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.179766 Oct 28 09:56:09.595797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 768/1529] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:09 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:09.624821 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7c807c06-6445-4685-8945-b11071eb1b90 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.090917 Oct 28 09:56:09.625458 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 762/1530] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:09 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:09.884724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:09.885254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:09.891304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.891775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.892223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.892925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:09.893380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:09.893805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:09.954314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:09.962153 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ddb59c0-0d21-470b-beb8-858060653a19 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1274 microversion: 2.1 time: 0.081485 Oct 28 09:56:09.962882 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 769/1531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:09 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1274 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:09.999664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.000414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:10.007471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.008158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.008836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.009647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.010179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.010694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.153018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:10.156580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.157449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:10.161341 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-baef4dbb-27ea-4d27-88c6-5352edf06ff9 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1475 microversion: 2.1 time: 0.165595 Oct 28 09:56:10.161935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 763/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:09 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1475 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:10.164340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.164829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.165307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.166005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.167022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.167455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.300860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:10.308859 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d60af641-a57c-41d4-a245-22f5e93e1638 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.156189 Oct 28 09:56:10.309475 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 770/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:10 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:10.401658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.402176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:10.409027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.409516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.409957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.410652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.411107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.411543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.442049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.442531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.442975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.443427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid a8bca161-a586-4715-a853-495bacc34c9e {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:10.532102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:10.540869 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-947f92f1-76fa-43ea-9452-b858a563af59 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1311 microversion: 2.1 time: 0.143401 Oct 28 09:56:10.553377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 764/1534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:10 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1311 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:10.628695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.629880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:10.637099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.639505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.639505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.639505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:10.643258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c203a979-503c-4d2d-814a-9dbe569bcb11 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330b0940>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.651126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:10.652730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:10.694827 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c203a979-503c-4d2d-814a-9dbe569bcb11 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.056628 Oct 28 09:56:10.695409 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 765/1535] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:10 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:10.986126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:10.986743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:11.001076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.001575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.002010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.002735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.003184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.003610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.023786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:11.097370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:11.110914 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-426838b2-2bb4-4ffe-9394-e3669e524d80 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1272 microversion: 2.1 time: 0.127806 Oct 28 09:56:11.124931 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 766/1536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:10 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:11.190808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:11.193025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:11.203545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.204581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.205729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.206885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.207771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.209360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.260767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:11.269860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:11.271678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:11.272803 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2df634bd-8146-4557-b42d-9069d04eb0ff tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1410 microversion: 2.25 time: 0.648859 Oct 28 09:56:11.273567 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 771/1537] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:10 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1410 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:56:11.334079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:11.335188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:11.343463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.344320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.345048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.345977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.346691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.347349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.527318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:11.544342 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c39e0bb0-9981-4e06-aa25-c54cdec0e1af tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1475 microversion: 2.1 time: 0.362420 Oct 28 09:56:11.589069 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 767/1538] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:11 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1475 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:11.605338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:11.606011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:11.626470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.627123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.627581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.628330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.631414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.633327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.637388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:11.668430 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbffd45e-a270-4765-9d2b-d5630233f37e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.335426 Oct 28 09:56:11.670626 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 772/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:11 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:11.690237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d5ff6838-3aec-4561-a8ba-496fd3617f20 req-4acde786-a47c-41cc-96bc-9d17e7b982fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e3a96bd-336e-4033-b37e-ccaa89b078b1", "name": "network-vif-deleted", "tag": "f5462778-8f5b-453c-9384-f7173f4d6944"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:11.699971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.700462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.700922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.701389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lazy-loading 'fault' on Instance uuid a8bca161-a586-4715-a853-495bacc34c9e {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:11.726455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5ff6838-3aec-4561-a8ba-496fd3617f20 req-4acde786-a47c-41cc-96bc-9d17e7b982fd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.726959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5ff6838-3aec-4561-a8ba-496fd3617f20 req-4acde786-a47c-41cc-96bc-9d17e7b982fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.727399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5ff6838-3aec-4561-a8ba-496fd3617f20 req-4acde786-a47c-41cc-96bc-9d17e7b982fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.757918 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d5ff6838-3aec-4561-a8ba-496fd3617f20 req-4acde786-a47c-41cc-96bc-9d17e7b982fd service nova] Creating event network-vif-deleted:f5462778-8f5b-453c-9384-f7173f4d6944 for instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 on n-h1-zed-1 Oct 28 09:56:11.775444 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d5ff6838-3aec-4561-a8ba-496fd3617f20 req-4acde786-a47c-41cc-96bc-9d17e7b982fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099172 Oct 28 09:56:11.776623 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 773/1540] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:11.790253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a21c5e160ca7460d892ce593d4644240', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57eeba8f69124206b8e6a8c8eb875c6f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:11.800658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2495efd-f66a-4966-8f20-95ba3d4bb067 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33eb08b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:11.802618 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d3f2662-4c2f-49d3-b6d4-67f02427df71 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 200 len: 1311 microversion: 2.1 time: 0.212310 Oct 28 09:56:11.804234 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 768/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:11 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 1311 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:11.817927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b03726d7-eb80-4c07-97b5-1c8aea14310f req-08c680fa-2e4a-4e0a-b67e-e048ca86becd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d797eca4-cd96-4170-8c7d-c0cb62f84495", "name": "network-vif-deleted", "tag": "b13047c4-d5fd-42f3-91c6-1bc7f76b3f4b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:11.838583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b03726d7-eb80-4c07-97b5-1c8aea14310f req-08c680fa-2e4a-4e0a-b67e-e048ca86becd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:11.842954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b03726d7-eb80-4c07-97b5-1c8aea14310f req-08c680fa-2e4a-4e0a-b67e-e048ca86becd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:11.843686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b03726d7-eb80-4c07-97b5-1c8aea14310f req-08c680fa-2e4a-4e0a-b67e-e048ca86becd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:11.863926 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2495efd-f66a-4966-8f20-95ba3d4bb067 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.085685 Oct 28 09:56:11.872508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b03726d7-eb80-4c07-97b5-1c8aea14310f req-08c680fa-2e4a-4e0a-b67e-e048ca86becd service nova] Creating event network-vif-deleted:b13047c4-d5fd-42f3-91c6-1bc7f76b3f4b for instance d797eca4-cd96-4170-8c7d-c0cb62f84495 on n-h1-zed-1 Oct 28 09:56:11.874246 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 774/1542] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:11 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:11.878322 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b03726d7-eb80-4c07-97b5-1c8aea14310f req-08c680fa-2e4a-4e0a-b67e-e048ca86becd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071595 Oct 28 09:56:11.879534 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 769/1543] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:12.136707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:12.137916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:12.154035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.154832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.155598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.156621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.157276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.157895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.299739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:12.300420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:12.310726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.311529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.312147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.313149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.313800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.314398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.329004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:12.351660 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-243ce48c-e097-4452-9617-9d189e6f842a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.218194 Oct 28 09:56:12.354508 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 775/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:12 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:12.590123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:12.609810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:12.611581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:12.611755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:12.612294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:12.612833 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fadfcd34-759d-4a92-9c7d-351f880854fe tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1606 microversion: 2.25 time: 0.317641 Oct 28 09:56:12.613436 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 770/1545] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:56:12 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1606 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:56:12.619361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.621190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.622331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.626506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.627353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.630389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.638193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:12.638702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:12.644895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.645666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.646305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.647225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.647853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.648462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.674538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.675176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.675763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.676236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid d797eca4-cd96-4170-8c7d-c0cb62f84495 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:12.720665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:12.729523 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-64a65f69-22d8-45b8-b676-d4c4ca84c55d tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1309 microversion: 2.1 time: 0.122481 Oct 28 09:56:12.730115 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 776/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:12 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:12.735510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:12.736473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:12.742896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.743273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.743906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.745112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.745769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.746316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.795554 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d29f306-2058-438c-bed9-e3a08d88656c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.160906 Oct 28 09:56:12.798500 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 771/1547] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 09:56:12 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:56:12.837225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:12.838142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] [instance: a8bca161-a586-4715-a853-495bacc34c9e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:12.857416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.857997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.858448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.859184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:12.859648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:12.860097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:12.908936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] HTTP exception thrown: Instance a8bca161-a586-4715-a853-495bacc34c9e could not be found. Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Request method failure captured: Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e HTTP/1.1 Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6bBmHD-7ae0iEh2O1VwzhqMmU4hAb3dpSfFSS5gMYpnVmW7hytHTH5X2Ej3KZpuxffJfbjmLhadb0V4qoQDRrSQ64xsklm7WMey81JZ3jEdGHvovdvqLWK0hyNzEXHHpaMyZ1g1qWFsuLggzUBrNM7ggpsbeWCCbGA76CrAkiPI3io Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 57eeba8f69124206b8e6a8c8eb875c6f Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:56:12.913242 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57eeba8f69124206b8e6a8c8eb875c6f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/57eeba8f69124206b8e6a8c8eb875c6f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_57eeba8f69124206b8e6a8c8eb875c6f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/57eeba8f69124206b8e6a8c8eb875c6f"}]}] Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 57eeba8f69124206b8e6a8c8eb875c6f Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1288892638 Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListServerFiltersTestJSON-1288892638-project Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a21c5e160ca7460d892ce593d4644240 Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListServerFiltersTestJSON-1288892638-project Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a8bca161-a586-4715-a853-495bacc34c9e could not be found. Oct 28 09:56:12.914962 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a8bca161-a586-4715-a853-495bacc34c9e'} Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8bca161-a586-4715-a853-495bacc34c9e could not be found. Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:12.915909 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8bca161-a586-4715-a853-495bacc34c9e could not be found. Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8bca161-a586-4715-a853-495bacc34c9e could not be found. Oct 28 09:56:12.917574 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:12.924149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] Returning 404 to user: Instance a8bca161-a586-4715-a853-495bacc34c9e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:12.925337 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-809f6f5a-1344-4cb7-bd6a-8ac1c29748e0 tempest-ListServerFiltersTestJSON-1288892638 tempest-ListServerFiltersTestJSON-1288892638-project] 10.222.0.16 "GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e" status: 404 len: 111 microversion: 2.1 time: 0.097730 Oct 28 09:56:12.926539 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 772/1548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:12 2022] GET /compute/v2.1/servers/a8bca161-a586-4715-a853-495bacc34c9e => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:12.933158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f5e8364-43ba-4922-b475-ff217d31e9a5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330dc3a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:13.014999 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f5e8364-43ba-4922-b475-ff217d31e9a5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.086914 Oct 28 09:56:13.017544 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 773/1549] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:12 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:13.048180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:13.089606 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-605094ee-7c5b-4105-b923-be91bec13b90 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1476 microversion: 2.1 time: 0.357747 Oct 28 09:56:13.105313 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 777/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:12 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:13.376817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:13.377514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:13.392264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.392811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.395168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d2c28991-f65a-4b5a-a545-6dc7323f4284 req-b8440287-9eb6-4bb6-9578-1430b628585f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd254e-662a-4020-9421-b76fb300937d", "name": "network-vif-plugged", "status": "completed", "tag": "a53f8536-805c-4547-b056-8cc4428c8aba"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:13.398323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.401916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.402615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.405119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.413472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d2c28991-f65a-4b5a-a545-6dc7323f4284 req-b8440287-9eb6-4bb6-9578-1430b628585f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.418724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d2c28991-f65a-4b5a-a545-6dc7323f4284 req-b8440287-9eb6-4bb6-9578-1430b628585f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.420568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d2c28991-f65a-4b5a-a545-6dc7323f4284 req-b8440287-9eb6-4bb6-9578-1430b628585f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.448709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d2c28991-f65a-4b5a-a545-6dc7323f4284 req-b8440287-9eb6-4bb6-9578-1430b628585f service nova] Creating event network-vif-plugged:a53f8536-805c-4547-b056-8cc4428c8aba for instance a8fd254e-662a-4020-9421-b76fb300937d on n-h2-zed-1 Oct 28 09:56:13.460115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d2c28991-f65a-4b5a-a545-6dc7323f4284 req-b8440287-9eb6-4bb6-9578-1430b628585f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069562 Oct 28 09:56:13.463535 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 778/1551] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:13.754281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:13.754904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:13.762109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.762610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.763045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.763984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.764439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.765129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.799811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:13.800555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:13.801009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:13.801629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid d797eca4-cd96-4170-8c7d-c0cb62f84495 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:13.843449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:13.851290 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ca630c7-d254-46b7-8756-078fb30d68c8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 200 len: 1309 microversion: 2.1 time: 0.101372 Oct 28 09:56:13.851879 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 779/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:13 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:13.976279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:13.985894 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1d953dc-bac4-466b-80aa-508a8f9842ac tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.613232 Oct 28 09:56:13.986584 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 774/1553] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:13 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:14.033574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c386ded0-681a-42bf-bbf6-1eeb1be3db6d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33eb0820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:14.092249 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c386ded0-681a-42bf-bbf6-1eeb1be3db6d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.062042 Oct 28 09:56:14.094116 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 780/1554] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:14 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:14.115812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:14.116451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:14.125452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.126243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.127798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.128996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.130367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.131115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.389022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d9e82fd2-3ee5-403d-9474-205f91c63d22 req-45c9bbd6-5e06-43c3-9d2e-525c530a8f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e12c5461-6640-443e-be0e-23f058fcb802", "tag": "dc6ef171-5858-4a02-842a-2f96b84923c4"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:14.402556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d9e82fd2-3ee5-403d-9474-205f91c63d22 req-45c9bbd6-5e06-43c3-9d2e-525c530a8f5e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.403283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d9e82fd2-3ee5-403d-9474-205f91c63d22 req-45c9bbd6-5e06-43c3-9d2e-525c530a8f5e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.404427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d9e82fd2-3ee5-403d-9474-205f91c63d22 req-45c9bbd6-5e06-43c3-9d2e-525c530a8f5e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.421085 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d9e82fd2-3ee5-403d-9474-205f91c63d22 req-45c9bbd6-5e06-43c3-9d2e-525c530a8f5e service nova] Creating event network-changed:dc6ef171-5858-4a02-842a-2f96b84923c4 for instance e12c5461-6640-443e-be0e-23f058fcb802 on n-h1-zed-1 Oct 28 09:56:14.429213 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d9e82fd2-3ee5-403d-9474-205f91c63d22 req-45c9bbd6-5e06-43c3-9d2e-525c530a8f5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044097 Oct 28 09:56:14.431024 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 781/1555] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:14.761525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:14.777493 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ac248dcc-a928-4a9e-98f1-ed161bf49bfb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1475 microversion: 2.1 time: 0.665539 Oct 28 09:56:14.794141 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 775/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:14 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1475 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:14.877033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:14.878181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: d797eca4-cd96-4170-8c7d-c0cb62f84495] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:14.888130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.889089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.889729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.890810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.892421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.892983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.910219 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance d797eca4-cd96-4170-8c7d-c0cb62f84495 could not be found. Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 HTTP/1.1 Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:56:14.912142 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance d797eca4-cd96-4170-8c7d-c0cb62f84495 could not be found. Oct 28 09:56:14.913993 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'd797eca4-cd96-4170-8c7d-c0cb62f84495'} Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d797eca4-cd96-4170-8c7d-c0cb62f84495 could not be found. Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:14.914935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d797eca4-cd96-4170-8c7d-c0cb62f84495 could not be found. Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d797eca4-cd96-4170-8c7d-c0cb62f84495 could not be found. Oct 28 09:56:14.917038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:14.920084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance d797eca4-cd96-4170-8c7d-c0cb62f84495 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:14.921199 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b38e86d3-966e-4265-869a-d43a8ccd3fc3 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495" status: 404 len: 111 microversion: 2.1 time: 0.048852 Oct 28 09:56:14.925367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 782/1557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:14 2022] GET /compute/v2.1/servers/d797eca4-cd96-4170-8c7d-c0cb62f84495 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:14.930473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:14.931350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:14.939265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.940240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.940737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.941709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.942430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.943071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.978048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:14.980744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:14.982436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:14.983439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid 7e3a96bd-336e-4033-b37e-ccaa89b078b1 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:15.012830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:15.013624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:15.038617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:15.039417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:15.040019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:15.040935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:15.042236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:15.042888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:15.112691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:15.121113 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfe45841-93a1-4d80-9949-3e0b4265db9f tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 200 len: 1309 microversion: 2.1 time: 0.194331 Oct 28 09:56:15.121696 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 776/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:14 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 1309 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:15.129914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-facdce34-07b9-4b12-8b50-7d6b38112df0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330595e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:15.170559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:15.184164 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-facdce34-07b9-4b12-8b50-7d6b38112df0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.057936 Oct 28 09:56:15.185258 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 777/1559] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:15 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:15.375104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:15.389714 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-27e152fc-aa96-4a01-8f27-1061348f8415 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.380044 Oct 28 09:56:15.391152 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 783/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:15 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:15.801890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:15.807870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:15.808505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:15.817995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:15.818407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:15.819028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:15.819729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:15.820361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:15.820785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.151829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.152648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 7e3a96bd-336e-4033-b37e-ccaa89b078b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:16.154841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:16.161638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.162246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.162769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.163574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.164122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.164625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.184481 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 could not be found. Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 HTTP/1.1 Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:56:16.186478 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 could not be found. Oct 28 09:56:16.188202 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '7e3a96bd-336e-4033-b37e-ccaa89b078b1'} Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 could not be found. Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:16.189083 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 could not be found. Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 could not be found. Oct 28 09:56:16.190457 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:16.194321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance 7e3a96bd-336e-4033-b37e-ccaa89b078b1 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:16.195446 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d748c5f-c94e-409a-bfe6-eac2cd1950b5 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1" status: 404 len: 111 microversion: 2.1 time: 0.047601 Oct 28 09:56:16.196107 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 784/1561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:16 2022] GET /compute/v2.1/servers/7e3a96bd-336e-4033-b37e-ccaa89b078b1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:56:16.203087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46b1495c-3741-4ab3-b1db-ec2d5ac8283d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33e798b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.276102 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46b1495c-3741-4ab3-b1db-ec2d5ac8283d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.078365 Oct 28 09:56:16.276875 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 785/1562] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:16 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:16.288242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fba3d1a-652c-47a7-bbd2-fb1c9aecde87 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.325996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4fba3d1a-652c-47a7-bbd2-fb1c9aecde87 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/727288b3-d308-4dea-be42-b1e59c4250d1" status: 204 len: 0 microversion: 2.1 time: 0.043078 Oct 28 09:56:16.327262 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 786/1563] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 09:56:16 2022] DELETE /compute/v2.1/os-server-groups/727288b3-d308-4dea-be42-b1e59c4250d1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:16.336648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.337269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:16.354346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.355006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.355939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.357242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.358189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.360402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.403778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:16.531061 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22277188-cdb1-4a75-b050-b8811d840231 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "DELETE /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 204 len: 0 microversion: 2.1 time: 0.198878 Oct 28 09:56:16.532712 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 787/1564] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:16 2022] DELETE /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:56:16.546931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.547869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:16.559074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:16.571524 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-68c3066c-6b1f-4407-83f4-280241896e51 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1475 microversion: 2.1 time: 0.770012 Oct 28 09:56:16.573571 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 778/1565] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:15 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1475 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:16.586561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.586561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.586561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.586561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.587024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.587024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.599949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "name": "network-vif-unplugged", "status": "completed", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}, {"name": "network-changed", "server_uuid": "6255ec55-f11e-457b-b949-b17da3834864", "tag": "dedd9f55-4ec9-4fd5-bc71-af4596ace404"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:16.628838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.629369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.629811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.651401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:16.673439 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] Creating event network-vif-unplugged:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h1-zed-1 Oct 28 09:56:16.674251 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] Creating event network-changed:dedd9f55-4ec9-4fd5-bc71-af4596ace404 for instance 6255ec55-f11e-457b-b949-b17da3834864 on n-h2-zed-1 Oct 28 09:56:16.686874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:56:16.710194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f74d4cbf-fe26-4c79-bd3c-b26c9fc289b9 req-79cf9ddc-b35a-4230-8c0a-b9be4675ec5b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.134933 Oct 28 09:56:16.711274 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 779/1566] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:16.722208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:16.723162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:16.731988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.732490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.733018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.733761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:16.734217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:16.734911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:16.912326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:16.932813 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e7eb2b0-6769-4774-879f-7e8687029b61 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.396400 Oct 28 09:56:16.934680 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 788/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:16 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:17.066034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:17.077661 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-962c745d-ff85-422c-947c-5610986eeacd tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1472 microversion: 2.1 time: 0.364841 Oct 28 09:56:17.097362 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 780/1568] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:16 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1472 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:17.299948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90fac88a-5b7d-4b35-85df-c119f5941616 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33e89ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:17.398063 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90fac88a-5b7d-4b35-85df-c119f5941616 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.105783 Oct 28 09:56:17.405392 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 789/1569] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:17 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:17.599776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:17.601045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:17.605482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:17.606871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:17.608252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.608980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:17.609618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.611997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.613876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:17.614510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.617817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.618346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:17.618800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.620067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.620528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:17.626861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.860430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:17.871994 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25c9dcbc-abe8-4367-8d53-5dce58b1b489 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1475 microversion: 2.1 time: 0.271678 Oct 28 09:56:17.885410 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 790/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:17 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1475 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:17.970731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:17.971518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:17.987810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.988397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:17.988867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:17.999484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:17.999987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.000432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.121737 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-986e78fb-d916-4b80-9343-52cfb6bb4211 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1852 microversion: 2.1 time: 0.527115 Oct 28 09:56:18.123734 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 781/1571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:17 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1852 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:18.132466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:18.133391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:18.140459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.141376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.142001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.142960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.143585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.144183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.350484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:18.359440 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d4af309-09a7-46e8-98db-6a146a061f41 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1472 microversion: 2.1 time: 0.233772 Oct 28 09:56:18.360535 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 782/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:18 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1472 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:18.368393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-zed-1", "block_migration": true, "disk_over_commit": false}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:18.373414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:18.381695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.382609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.383258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.384333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.385617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.386317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.450322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lazy-loading 'flavor' on Instance uuid 73f7b43e-9af7-48b0-b0fc-ad060328abbf {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:18.466491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Going to try to live migrate instance to n-h2-zed-1 {{(pid=128747) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:56:18.487864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:18.497180 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6651d66b-3081-48aa-9901-ef572b0f0ae3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.540433 Oct 28 09:56:18.519523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 791/1573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:17 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:18.525615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c442f7f-8736-4feb-81e8-b3661dc249f0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33b52700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:18.601887 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c442f7f-8736-4feb-81e8-b3661dc249f0 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.071838 Oct 28 09:56:18.602941 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 792/1574] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:18 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:18.771324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f4f44722-d6c0-4d88-ad46-bc6e2b811cb3 req-efc9d584-3c8b-4d1c-944f-3607b9e59d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:18.793876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f4f44722-d6c0-4d88-ad46-bc6e2b811cb3 req-efc9d584-3c8b-4d1c-944f-3607b9e59d68 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.795557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f4f44722-d6c0-4d88-ad46-bc6e2b811cb3 req-efc9d584-3c8b-4d1c-944f-3607b9e59d68 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.798025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f4f44722-d6c0-4d88-ad46-bc6e2b811cb3 req-efc9d584-3c8b-4d1c-944f-3607b9e59d68 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.829910 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f4f44722-d6c0-4d88-ad46-bc6e2b811cb3 req-efc9d584-3c8b-4d1c-944f-3607b9e59d68 service nova] Creating event network-changed:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h1-zed-1 Oct 28 09:56:18.848491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-f4f44722-d6c0-4d88-ad46-bc6e2b811cb3 req-efc9d584-3c8b-4d1c-944f-3607b9e59d68 service nova] Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:56:18.878809 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f4f44722-d6c0-4d88-ad46-bc6e2b811cb3 req-efc9d584-3c8b-4d1c-944f-3607b9e59d68 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114804 Oct 28 09:56:18.879943 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 793/1575] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:18.901637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:18.902741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:18.909495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.910331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.911032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:18.912108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:18.912780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:18.913462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:19.253874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:19.265863 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae5730ed-b21c-40f2-9ee9-66043e56e91b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1475 microversion: 2.1 time: 0.369673 Oct 28 09:56:19.266459 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 794/1576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:18 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1475 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:19.383657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:19.385480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:19.399791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:19.401242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:19.401888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:19.405297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:19.405967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:19.406609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:19.906550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:19.918909 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b2b2d6eb-1640-446d-9e15-f60c47c31bc8 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1472 microversion: 2.1 time: 0.539077 Oct 28 09:56:19.919540 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 795/1577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:19 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1472 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:19.929121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:19.930863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:19.948814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:19.949460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:19.950010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:19.950728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:19.953303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:19.953784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:20.176795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:20.185768 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a8d0312-8c73-4108-9cf5-6ee8dcf31fef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.260477 Oct 28 09:56:20.191283 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 796/1578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:19 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:20.196302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae35e5c5-1895-4d15-ab24-37d0b56cab8e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca336035e0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:20.311258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae35e5c5-1895-4d15-ab24-37d0b56cab8e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.118542 Oct 28 09:56:20.312216 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 797/1579] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:20 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:20.335726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:20.336542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:20.353491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:20.357281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:20.357998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:20.361247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:20.362586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:20.365955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:21.141564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:21.155071 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d876f875-c548-478b-9477-d472310a04fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1475 microversion: 2.1 time: 0.839231 Oct 28 09:56:21.158511 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 798/1580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:20 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1475 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:21.178599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:21.182956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:21.191456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:21.192332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:21.193900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:21.194835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:21.195450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:21.196039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:21.815121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:21.831143 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-087a2bb5-b3f2-436f-ba91-d2ff63a522fe tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1472 microversion: 2.1 time: 0.671252 Oct 28 09:56:21.834182 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 799/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:21 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1472 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:21.846752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:21.847694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:21.859362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:21.863747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:21.864448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:21.865826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:21.868767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:21.870000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.166247 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-59ee585f-ab9b-43f8-9304-8e73a3a08ed1 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/action" status: 202 len: 0 microversion: 2.1 time: 3.804285 Oct 28 09:56:22.166863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 783/1582] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:18 2022] POST /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/action => generated 0 bytes in 3806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:56:22.189639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d22eb78-41dd-40b5-9b04-1e1729468fe9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330659d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:22.313647 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d22eb78-41dd-40b5-9b04-1e1729468fe9 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.142309 Oct 28 09:56:22.314631 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 784/1583] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:22 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:22.325462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-062c29d1-9301-4ccc-9ef4-0ccf2957148f req-0bfc8919-f534-49d6-8fad-ae81c66dc086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12c5461-6640-443e-be0e-23f058fcb802", "name": "network-vif-plugged", "status": "completed", "tag": "dc6ef171-5858-4a02-842a-2f96b84923c4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:22.360202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-062c29d1-9301-4ccc-9ef4-0ccf2957148f req-0bfc8919-f534-49d6-8fad-ae81c66dc086 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.361111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-062c29d1-9301-4ccc-9ef4-0ccf2957148f req-0bfc8919-f534-49d6-8fad-ae81c66dc086 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.361827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-062c29d1-9301-4ccc-9ef4-0ccf2957148f req-0bfc8919-f534-49d6-8fad-ae81c66dc086 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.387592 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-062c29d1-9301-4ccc-9ef4-0ccf2957148f req-0bfc8919-f534-49d6-8fad-ae81c66dc086 service nova] Creating event network-vif-plugged:dc6ef171-5858-4a02-842a-2f96b84923c4 for instance e12c5461-6640-443e-be0e-23f058fcb802 on n-h1-zed-1 Oct 28 09:56:22.405244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-062c29d1-9301-4ccc-9ef4-0ccf2957148f req-0bfc8919-f534-49d6-8fad-ae81c66dc086 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085108 Oct 28 09:56:22.407620 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 785/1584] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:22.417181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:22.418345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:22.426851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.427869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.428554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.429670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.432214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.433084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.465394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:22.717685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:22.726873 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-17359f7a-862f-4430-af57-2ba5657ade88 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.317628 Oct 28 09:56:22.737928 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 786/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:22 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:22.755200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:22.777011 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-194a438b-94db-4d54-a2c7-49aefe1d838f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.941450 Oct 28 09:56:22.781863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:22.782827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:22.790592 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 800/1586] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:21 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:22.797712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.801018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.803113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.804139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.804833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.805535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.849236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e09ef781-7c5a-4b91-abdd-bae6a3037649 req-19c86c04-653d-43f7-af3b-3ccea09e4f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05112b40-6767-428e-8884-474dd5e18ae9", "name": "network-vif-deleted", "tag": "194f7ac8-0af3-4fcc-b9e5-c4d135f440be"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:22.865798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e09ef781-7c5a-4b91-abdd-bae6a3037649 req-19c86c04-653d-43f7-af3b-3ccea09e4f76 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.866673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e09ef781-7c5a-4b91-abdd-bae6a3037649 req-19c86c04-653d-43f7-af3b-3ccea09e4f76 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.867375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e09ef781-7c5a-4b91-abdd-bae6a3037649 req-19c86c04-653d-43f7-af3b-3ccea09e4f76 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.890334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e09ef781-7c5a-4b91-abdd-bae6a3037649 req-19c86c04-653d-43f7-af3b-3ccea09e4f76 service nova] Creating event network-vif-deleted:194f7ac8-0af3-4fcc-b9e5-c4d135f440be for instance 05112b40-6767-428e-8884-474dd5e18ae9 on n-h1-zed-1 Oct 28 09:56:22.898266 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e09ef781-7c5a-4b91-abdd-bae6a3037649 req-19c86c04-653d-43f7-af3b-3ccea09e4f76 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052389 Oct 28 09:56:22.899063 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 801/1587] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:22.905192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:22.905881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:22.913203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.914555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.915193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:22.916284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:22.916952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:22.917787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:23.018407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:23.032697 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7fed146a-fd29-4145-8093-a9c3a2bd3057 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1430 microversion: 2.1 time: 0.132224 Oct 28 09:56:23.035353 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 802/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:22 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1430 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:23.159028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:23.180261 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb0806ab-e0ed-4c7a-a8ff-18c879e345fe tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1473 microversion: 2.1 time: 0.440541 Oct 28 09:56:23.180853 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 787/1589] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:22 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1473 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:23.349699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba06c927-9ee9-4f82-9f0f-9f018346075f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33e79b80>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:23.450406 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba06c927-9ee9-4f82-9f0f-9f018346075f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.104519 Oct 28 09:56:23.451822 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 803/1590] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:23 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:23.753206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:23.754172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:23.776877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:23.780339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:23.781416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:23.783159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:23.786523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:23.789639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:23.815706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:23.816466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:23.839192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:23.840000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:23.840448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:23.841350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:23.841734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:23.842163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.377748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:24.389449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5116c93c-17bf-4ff4-91ff-e4bd62280c30 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.579282 Oct 28 09:56:24.390407 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 804/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:23 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:24.399692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:24.402326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:24.421838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:24.428165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:24.431448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:24.432930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.436843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:24.439104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:24.441285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.443475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3403c6dd-c84d-4d47-b14e-4f18985cc736 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.695162 Oct 28 09:56:24.449960 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 788/1592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:23 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:24.454887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:24.469740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:24.488428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:24.488953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:24.493707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.495517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:24.499499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:24.500255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.533592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:24.535788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:24.536243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:24.536654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid 05112b40-6767-428e-8884-474dd5e18ae9 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:24.725386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:24.739933 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c762a934-d0bd-43ca-b24a-a5a2b5a02f57 tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1306 microversion: 2.1 time: 0.343090 Oct 28 09:56:24.742769 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 805/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:24 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1306 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:24.758764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-48846d48-4f18-471b-8867-2bd0d61ded43 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33a65310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:24.854404 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-48846d48-4f18-471b-8867-2bd0d61ded43 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.110512 Oct 28 09:56:24.856060 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 806/1594] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:24 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:25.067140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:25.081284 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aac30f3d-cf4c-44bf-83b2-43fd5572a26e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1470 microversion: 2.1 time: 0.629483 Oct 28 09:56:25.107286 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 789/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:24 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1470 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:25.107645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:25.108202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:25.115718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.116497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.117241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:25.118155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.118945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.120114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:25.309749 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f442ab5-e7ba-4e19-8b3d-3ed4d0a76f83 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "POST /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc/action" status: 202 len: 0 microversion: 2.1 time: 0.208946 Oct 28 09:56:25.318948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 807/1596] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:25 2022] POST /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:56:25.319201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:25.319827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:25.332816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.333426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.333880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:25.334613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.338943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.339543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:25.412170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:25.413432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:25.443646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.444173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.444635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:25.445466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:25.445932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:25.446360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.054331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:26.072590 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc9fb336-1e84-4962-b7a6-3682b810af7f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.757722 Oct 28 09:56:26.086852 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 790/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:25 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:26.102382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:26.102382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:26.117792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.118283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.118726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.120010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.124400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.124744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.257954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:26.267379 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-764442dc-2f27-45ea-8de6-75547dd7bf1c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1314 microversion: 2.1 time: 0.859370 Oct 28 09:56:26.269086 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 808/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:25 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1314 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:26.274952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:26.276137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:26.283294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.284031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.284696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.285604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.286225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.286816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.353121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:26.373548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:26.383086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:26.383981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:26.384667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:26.385444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lazy-loading 'fault' on Instance uuid 05112b40-6767-428e-8884-474dd5e18ae9 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:26.504325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '863b399a02b24f68acfbf4575cc3d257', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2480a829d442c8b55476ffa5d3ba3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:26.529391 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bed6f6ac-9a9b-46a2-9c0c-059fe3ae92ca tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 200 len: 1306 microversion: 2.1 time: 0.258302 Oct 28 09:56:26.551224 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 809/1599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:26 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 1306 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:26.584980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82317f6b-0dbd-4669-9ace-46fd9fe90d5d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33e795e0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:26.684758 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82317f6b-0dbd-4669-9ace-46fd9fe90d5d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.121353 Oct 28 09:56:26.688788 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 810/1600] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:26 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:26.800957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:26.812686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b737eae-75f3-4fd2-8496-1a56b5f433bd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.733702 Oct 28 09:56:26.813929 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 791/1601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:26 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:27.117071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:27.118095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:27.128151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.133502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.134578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.135986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.137025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.139894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.290842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:27.292891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:27.303599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.310571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.312631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.318067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.318928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.319644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.590123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:27.604187 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ef370bf-1d8d-4fc5-b899-dac1b583f599 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.497768 Oct 28 09:56:27.611993 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 811/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:27 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:27.631559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:27.632586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] [instance: 05112b40-6767-428e-8884-474dd5e18ae9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:27.668262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.669938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.670518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.682720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.683358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.683907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.686047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:27.695594 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b3bfe16-bfcb-4109-8dd1-7103d99ba02c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1464 microversion: 2.1 time: 0.408545 Oct 28 09:56:27.724801 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 792/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:27 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1464 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] HTTP exception thrown: Instance 05112b40-6767-428e-8884-474dd5e18ae9 could not be found. Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Request method failure captured: Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 HTTP/1.1 Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6Y4zs606xs4TqWUegJw5_xPjQXOsbyP-FvkZpcHRgM88i4pzng6yr0BozDoBAwT24f7g8847XPsrJS9V1AU0k1LHMcAEJv0tXsT1QaEHESDOmDX0JYIxmeDi29wB4QA-5mSkH-7hwohQevSzZyKwFZYVYktUPgkSleaX0htfcjgA6I Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:56:27.725289 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2480a829d442c8b55476ffa5d3ba3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2480a829d442c8b55476ffa5d3ba3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2480a829d442c8b55476ffa5d3ba3"}]}] Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2480a829d442c8b55476ffa5d3ba3 Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-1607455930 Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 863b399a02b24f68acfbf4575cc3d257 Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersOnMultiNodesTest-1607455930-project Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 05112b40-6767-428e-8884-474dd5e18ae9 could not be found. Oct 28 09:56:27.726849 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '05112b40-6767-428e-8884-474dd5e18ae9'} Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05112b40-6767-428e-8884-474dd5e18ae9 could not be found. Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:27.728214 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05112b40-6767-428e-8884-474dd5e18ae9 could not be found. Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05112b40-6767-428e-8884-474dd5e18ae9 could not be found. Oct 28 09:56:27.731535 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:27.733883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] Returning 404 to user: Instance 05112b40-6767-428e-8884-474dd5e18ae9 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:27.733883 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9462c864-0946-463d-9fd8-8de64ce6e15a tempest-ServersOnMultiNodesTest-1607455930 tempest-ServersOnMultiNodesTest-1607455930-project] 10.222.0.16 "GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9" status: 404 len: 111 microversion: 2.1 time: 0.101207 Oct 28 09:56:27.733883 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 812/1604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:27 2022] GET /compute/v2.1/servers/05112b40-6767-428e-8884-474dd5e18ae9 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:27.734818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-872c9278-8f9c-4f46-8c7c-0f57873edb7e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330b0280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:27.839056 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-872c9278-8f9c-4f46-8c7c-0f57873edb7e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.126591 Oct 28 09:56:27.840094 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 793/1605] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:27 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:27.847753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:27.856106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:27.873142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.876038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.878005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.880606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.882930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.883940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.969414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:27.979077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Searching by: {'deleted': False, 'project_id': '310e5f4299b44b4bae3fc3886133251d'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:27.995432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.997378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.997909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:27.998680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:27.999146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:27.999573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:28.129961 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-db84e33f-88e5-4b4c-b68f-78ffd0a47b41 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.402336 Oct 28 09:56:28.131062 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 813/1606] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:56:27 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:56:28.160895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:28.170862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Searching by: {'deleted': False} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:28.190164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:28.190723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:28.191167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:28.195748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:28.196290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:28.196739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:28.206229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:28.216335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-914f974c-1f93-49dd-b0c8-901cd2789b79 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.374377 Oct 28 09:56:28.220454 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 794/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:27 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:28.450879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Listed batch of 16 results from cell out of 1000 limit. Returned 16 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:56:28.611956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:28.613282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:28.614075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:28.639481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:28.640885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:28.656978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:28.657853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:28.658972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:28.670202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:28.672207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:28.673821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:29.101322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:29.116186 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb0a2fef-ea54-4fe1-9674-9ccbca5105be tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.485087 Oct 28 09:56:29.116813 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 795/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:28 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:29.483556 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73080ffa-fca7-47d5-ab98-e787fa59c4fe tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 26513 microversion: 2.1 time: 1.327860 Oct 28 09:56:29.484186 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 814/1609] 10.222.0.16 () {58 vars in 1171 bytes} [Fri Oct 28 09:56:28 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 26513 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:56:29.490226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0b023ce-a46f-4f30-8f77-8542af0358e4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33d9f0d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:29.621182 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0b023ce-a46f-4f30-8f77-8542af0358e4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.135526 Oct 28 09:56:29.622875 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 815/1610] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:29 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:29.631243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d5f9367c-da81-4f26-bcf5-c430309eb43e req-2913c82e-d179-4cd8-a33d-7b66633b977d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "name": "network-vif-plugged", "status": "completed", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:29.653959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5f9367c-da81-4f26-bcf5-c430309eb43e req-2913c82e-d179-4cd8-a33d-7b66633b977d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:29.655738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5f9367c-da81-4f26-bcf5-c430309eb43e req-2913c82e-d179-4cd8-a33d-7b66633b977d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:29.656233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5f9367c-da81-4f26-bcf5-c430309eb43e req-2913c82e-d179-4cd8-a33d-7b66633b977d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:29.679069 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d5f9367c-da81-4f26-bcf5-c430309eb43e req-2913c82e-d179-4cd8-a33d-7b66633b977d service nova] Creating event network-vif-plugged:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h1-zed-1 Oct 28 09:56:29.695597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-d5f9367c-da81-4f26-bcf5-c430309eb43e req-2913c82e-d179-4cd8-a33d-7b66633b977d service nova] Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:56:29.723783 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d5f9367c-da81-4f26-bcf5-c430309eb43e req-2913c82e-d179-4cd8-a33d-7b66633b977d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099399 Oct 28 09:56:29.727216 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 816/1611] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:29.741025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:29.745513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:29.756278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:29.757297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:29.757906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:29.758812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:29.761236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:29.761899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1358913594", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "ed5e2a6e-3c15-4d9e-addc-feb9144a1099"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:29.763047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:29.879029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] validate_networks() for [('ed5e2a6e-3c15-4d9e-addc-feb9144a1099', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:56:29.995185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:30.009475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ebae201-1404-4ea2-9022-fc8a97473368 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.280166 Oct 28 09:56:30.010766 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 817/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:29 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:30.034343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:30.048075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Searching by: {'deleted': False, 'project_id': '310e5f4299b44b4bae3fc3886133251d'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:30.053714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:30.054284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:30.054788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:30.055756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:30.056288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:30.057826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:30.089008 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-79baa8ea-0df7-44eb-aafa-24c03924677a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?tenant_id=7d2636214d0b430d929ef27e9592488d" status: 200 len: 15 microversion: 2.1 time: 0.063447 Oct 28 09:56:30.089723 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 818/1613] 10.222.0.16 () {58 vars in 1231 bytes} [Fri Oct 28 09:56:30 2022] GET /compute/v2.1/servers/detail?tenant_id=7d2636214d0b430d929ef27e9592488d => generated 15 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:56:30.118863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:30.131573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Searching by: {'tenant_id': '7d2636214d0b430d929ef27e9592488d', 'deleted': False} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:30.144896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:30.148054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:30.148814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:30.150363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:30.155799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:30.156504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:30.195829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:56:30.250722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:30.251325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:30.251918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:30.561484 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad932a18-cc0d-42e7-a23b-8b10885539d3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7d2636214d0b430d929ef27e9592488d" status: 200 len: 4809 microversion: 2.1 time: 0.449941 Oct 28 09:56:30.563054 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 819/1614] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 09:56:30 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=7d2636214d0b430d929ef27e9592488d => generated 4809 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:30.569054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:30.569865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:30.577992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:30.578865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:30.579557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:30.580714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:30.581646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:30.582379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.024805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:31.025377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:31.025783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:31.026200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:31.026649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:31.053114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.053701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.054170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.054979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.060726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:31.063166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.064422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.074257 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a6a4130-ea44-412d-900b-d0048e850f3e tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.510044 Oct 28 09:56:31.077229 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 820/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:30 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:31.089522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:31.107194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Getting quotas for project dea2fc789d4f4d47a08d92bfe8660de4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:56:31.116412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Getting quotas for user aa6e855b62b646e7b7545432aa62afc8 and project dea2fc789d4f4d47a08d92bfe8660de4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:56:31.116659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Searching by: {'tenant_id': '310e5f4299b44b4bae3fc3886133251d', 'deleted': False} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:31.124232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.124985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.125606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.127187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.127814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.128412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.144840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:56:31.147251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:56:31.184396 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb36902d-87b7-4fc4-aba2-b76347ec3509 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=310e5f4299b44b4bae3fc3886133251d" status: 200 len: 15 microversion: 2.1 time: 0.105756 Oct 28 09:56:31.188512 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 821/1616] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 09:56:31 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=310e5f4299b44b4bae3fc3886133251d => generated 15 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:56:31.193430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4af16b1d-9573-41a8-ba82-09409be63d18 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33e8a280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:31.306750 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dca75482-339d-41bf-a357-f9ada3788bc4 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.181408 Oct 28 09:56:31.310059 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 796/1617] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:56:31.314143 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4af16b1d-9573-41a8-ba82-09409be63d18 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.118055 Oct 28 09:56:31.322565 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 822/1618] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:31 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:31.327209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7b041eb-7ed2-4571-bcb9-75f8f06e8410 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:31.357968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:31.360472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:31.362144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7b041eb-7ed2-4571-bcb9-75f8f06e8410 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.045563 Oct 28 09:56:31.365031 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 823/1619] 10.222.0.16 () {58 vars in 1189 bytes} [Fri Oct 28 09:56:31 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:56:31.371071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d361b458-6685-4fd6-8605-58e85bf0a72e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:31.371895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d361b458-6685-4fd6-8605-58e85bf0a72e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:31.401647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.402498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.404341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.406876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.407382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.407826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.437185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d361b458-6685-4fd6-8605-58e85bf0a72e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:31.446631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d361b458-6685-4fd6-8605-58e85bf0a72e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1216 microversion: 2.1 time: 0.078690 Oct 28 09:56:31.448392 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 824/1620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:31 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1216 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:31.466256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:31.471085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:31.486209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.486971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.489353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.492179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.495445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.497165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.768518 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-178277b9-9262-454e-8712-5b58247d6fc2 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.318760 Oct 28 09:56:31.770694 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 825/1621] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:31 2022] POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:56:31.782868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:31.798067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:31.800730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '7d2636214d0b430d929ef27e9592488d'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:31.838532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.840135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.841554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.847165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:31.857204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:31.857743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:31.885297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:31.906909 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b941c3f8-313a-4979-89e4-2f1d66b80a6c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.593519 Oct 28 09:56:31.908307 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 797/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:31 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:32.104493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:32.105249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:32.122844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:32.129408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:32.129869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:32.137097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:32.137688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:32.138139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:32.413519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:56:32.624268 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6cb291e8-b808-4096-8b01-a6023941d514 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.848608 Oct 28 09:56:32.626772 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 826/1623] 10.222.0.16 () {58 vars in 1150 bytes} [Fri Oct 28 09:56:31 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:32.658479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9273b6c0-0c5a-468f-a294-22bad37087e4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33dfc820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:32.736201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9273b6c0-0c5a-468f-a294-22bad37087e4 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.082881 Oct 28 09:56:32.750594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 827/1624] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:32 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:32.765883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:32.766859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:32.775227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:32.776083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:32.776759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:32.777717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:32.778344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:32.779693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:32.957944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:32.970565 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-add8562c-381c-41cd-8be2-0accff4ea906 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1212 microversion: 2.1 time: 0.222302 Oct 28 09:56:32.984965 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 828/1625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:32 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1212 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:32.984965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:32.993642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:33.014593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:33.015320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:33.016325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:33.017255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:33.017822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:33.019416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:33.106677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:33.115684 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddaafd5c-92c4-4ea6-87d5-afdbe8e10f15 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 1.017791 Oct 28 09:56:33.126666 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 798/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:32 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:33.144132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:33.152022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:33.179801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:33.182820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:33.187056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:33.189290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:33.193134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:33.194817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:33.299726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:33.360141 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a78b9bf3-7d80-4f87-a9d7-1d15aced0669 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.382690 Oct 28 09:56:33.362032 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 829/1627] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:32 2022] POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:56:33.383998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:33.390211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:33.416890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:33.418637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:33.419704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:33.420983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:33.421729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:33.422578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:33.859163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5aef8368-d593-415f-aa7c-c31a113788bb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1609 microversion: 2.1 time: 0.492775 Oct 28 09:56:33.863627 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 830/1628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:33 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1609 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:33.872920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-346af45c-ca41-4bbe-82af-82ba5a40feb5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca38709550>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:33.938233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:33.967072 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee730475-78bb-43cf-98fd-82d9c741daeb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.836427 Oct 28 09:56:33.969909 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 799/1629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:33 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:33.986952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:33.991416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:33.998442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:34.000142 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-346af45c-ca41-4bbe-82af-82ba5a40feb5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.135038 Oct 28 09:56:34.000828 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 831/1630] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:33 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:34.010603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:34.015806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:34.027575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.028152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.028608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.029390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.029857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.030300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.032198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.032923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.035751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.036754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.037449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.040838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.224316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:34.235899 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8001e186-103f-4eab-bd72-3f71ed8b82ff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1268 microversion: 2.1 time: 0.233624 Oct 28 09:56:34.250944 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 832/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:34 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1268 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:34.264113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:34.274036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:34.306286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.307333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.307780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.308501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.308993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.309428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.635401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f10de72d-5511-4ecb-9eb9-1a4bea2df4f3 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1609 microversion: 2.1 time: 0.661728 Oct 28 09:56:34.639932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 800/1632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:33 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1609 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:34.645007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-354e8b2a-dedc-43e2-a5ee-0ac24d2a458f req-1fb716ab-e019-4e8b-94b4-53d8e1777ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "name": "network-vif-unplugged", "status": "completed", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:34.676319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-354e8b2a-dedc-43e2-a5ee-0ac24d2a458f req-1fb716ab-e019-4e8b-94b4-53d8e1777ba5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.677246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-354e8b2a-dedc-43e2-a5ee-0ac24d2a458f req-1fb716ab-e019-4e8b-94b4-53d8e1777ba5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.679281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-354e8b2a-dedc-43e2-a5ee-0ac24d2a458f req-1fb716ab-e019-4e8b-94b4-53d8e1777ba5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.680335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:34.694379 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9e08b7dd-a6eb-4417-aea2-47b60bf6f5b7 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.436722 Oct 28 09:56:34.696243 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 833/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:34 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:34.706582 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-354e8b2a-dedc-43e2-a5ee-0ac24d2a458f req-1fb716ab-e019-4e8b-94b4-53d8e1777ba5 service nova] Creating event network-vif-unplugged:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h2-zed-1 Oct 28 09:56:34.708030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:34.720185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Searching by: {'host': 'n-h1-zed-1', 'deleted': False} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:34.723237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-354e8b2a-dedc-43e2-a5ee-0ac24d2a458f req-1fb716ab-e019-4e8b-94b4-53d8e1777ba5 service nova] Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:56:34.741955 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-354e8b2a-dedc-43e2-a5ee-0ac24d2a458f req-1fb716ab-e019-4e8b-94b4-53d8e1777ba5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100102 Oct 28 09:56:34.744164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.749507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.749970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.750973 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 801/1634] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:34.753731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:34.756472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:34.758477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:34.936709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:56:34.998366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:35.000142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:35.011963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.019057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.019780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.020641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.021364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.022046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.114483 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-60a7a238-731d-4147-b7dd-c8911a082fe6 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=n-h1-zed-1&all_tenants=1" status: 200 len: 2944 microversion: 2.1 time: 0.415428 Oct 28 09:56:35.115642 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 834/1635] 10.222.0.16 () {58 vars in 1184 bytes} [Fri Oct 28 09:56:34 2022] GET /compute/v2.1/servers?host=n-h1-zed-1&all_tenants=1 => generated 2944 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:35.126756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-512e3c58-335d-44fc-abc1-574e839662ac tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33b01e50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:35.225494 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-512e3c58-335d-44fc-abc1-574e839662ac tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.106649 Oct 28 09:56:35.234115 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 835/1636] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:35 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:35.239167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:35.245374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:56:35.272693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.277148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.277740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.286124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.292132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.292881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.346808 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-231dc064-ae3b-465f-892a-fb7f9267c1fc tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.119093 Oct 28 09:56:35.357606 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 836/1637] 10.222.0.16 () {58 vars in 1196 bytes} [Fri Oct 28 09:56:35 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:56:35.372013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:35.373573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:35.383359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.393973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.395028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.405090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.405892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.407009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.531731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:35.554313 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0f35562-a696-4241-adc8-7b5b9b8d284f tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1274 microversion: 2.1 time: 0.192865 Oct 28 09:56:35.557043 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 837/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:35 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:35.576321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:35.580122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:35.590467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.591297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.591935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.593341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.613141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:35.621196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.623364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.631340 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-28db3376-d6ec-459f-b6c1-6e64c536910e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.638426 Oct 28 09:56:35.642021 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 802/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:34 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:35.723562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:35.724175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:35.738789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.739288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.739726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.740438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.740892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.750474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.821308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12d0a225-86cb-4cc1-b5b0-cf6939e3ec7a tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.244501 Oct 28 09:56:35.822947 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 838/1640] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:35 2022] POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:56:35.830717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:35.833919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:35.851730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.852251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.852703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:35.853531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:35.854004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:35.854444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:36.090863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:36.094241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:36.097641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:36.098269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:36.098934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:36.220607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:36.229147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:36.231628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:36.233782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:36.237621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:36.238899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:36.240750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:36.300892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b3773e7-a013-43ee-98d3-3f550235f215 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action" status: 202 len: 1068 microversion: 2.1 time: 0.472541 Oct 28 09:56:36.303495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 839/1641] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:35 2022] POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action => generated 1068 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 28 09:56:36.311829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da3a3c69-3a98-4df8-bf63-876ad2b975b3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca38113ca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:36.413682 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da3a3c69-3a98-4df8-bf63-876ad2b975b3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.108820 Oct 28 09:56:36.422360 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 840/1642] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:36 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:36.422360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:36.422360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:36.447254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:36.448026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:36.453854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:36.454825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:36.455414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:36.455963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:36.503255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:36.533373 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d05b5ecf-911b-46f3-8a81-81bf16222b99 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.813344 Oct 28 09:56:36.551131 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 803/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:35 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:36.579078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:36.581380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:36.595634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:36.598019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:36.598746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:36.613972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:36.615811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:36.619347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:37.052746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:37.065132 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-37343170-938b-4d57-9800-41497819b7a9 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.648856 Oct 28 09:56:37.072431 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 841/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:36 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:37.079735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:37.082903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:37.100272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:37.100778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:37.101258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:37.101985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:37.102446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:37.102873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:37.399772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:37.410144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee54e3f1-a3af-4b98-ba92-a885f995cd8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.336242 Oct 28 09:56:37.414141 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 842/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:37 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:37.427818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-cf334494-d196-4e8c-ae80-34ac344a6d2a req-d62fc8a7-1580-4483-8240-d246319993ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:37.451179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-cf334494-d196-4e8c-ae80-34ac344a6d2a req-d62fc8a7-1580-4483-8240-d246319993ad service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:37.456310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-cf334494-d196-4e8c-ae80-34ac344a6d2a req-d62fc8a7-1580-4483-8240-d246319993ad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:37.457014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-cf334494-d196-4e8c-ae80-34ac344a6d2a req-d62fc8a7-1580-4483-8240-d246319993ad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:37.487986 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-cf334494-d196-4e8c-ae80-34ac344a6d2a req-d62fc8a7-1580-4483-8240-d246319993ad service nova] Creating event network-changed:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h2-zed-1 Oct 28 09:56:37.504367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-cf334494-d196-4e8c-ae80-34ac344a6d2a req-d62fc8a7-1580-4483-8240-d246319993ad service nova] Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 09:56:37.529192 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-cf334494-d196-4e8c-ae80-34ac344a6d2a req-d62fc8a7-1580-4483-8240-d246319993ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111640 Oct 28 09:56:37.536234 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 843/1646] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:37.542598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5299e623-845c-45c1-9710-238baae760fd tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3398fb80>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:37.562972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:37.567551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:37.577883 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-db1234af-045e-4c3a-9d97-e49bc60e892d tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 1.001500 Oct 28 09:56:37.578992 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 804/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:36 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:37.602779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:37.614144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:37.641227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:37.641912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:37.642545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:37.643399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:37.647765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:37.650256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:37.668497 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5299e623-845c-45c1-9710-238baae760fd tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.130620 Oct 28 09:56:37.676995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 844/1648] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:37 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:38.101843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:38.111277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:38.128390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:38.129287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:38.129935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:38.131076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:38.145049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:38.145849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:38.640949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:38.652218 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-87a5a03b-d2a5-4009-98e1-6e69fa7e24fd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 1.071826 Oct 28 09:56:38.660988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:38.670025 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d02caa5-32a5-487c-ae00-02fd217ef020 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.582822 Oct 28 09:56:38.670334 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 805/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:37 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:38.672639 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 845/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:38 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:38.683206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3a9a64a9-892c-42c3-841f-3232db890181 req-70feee6b-4509-46e6-94e4-560c06ba0a48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc44a47e-3db8-4aaa-874f-56186e3092d1", "tag": "411ddc74-252d-4abf-a433-41fe9c5e8125"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:38.684921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:38.685731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:38.702314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:38.703090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:38.703685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:38.704576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:38.705218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:38.705801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:38.710072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3a9a64a9-892c-42c3-841f-3232db890181 req-70feee6b-4509-46e6-94e4-560c06ba0a48 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:38.710564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3a9a64a9-892c-42c3-841f-3232db890181 req-70feee6b-4509-46e6-94e4-560c06ba0a48 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:38.711660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3a9a64a9-892c-42c3-841f-3232db890181 req-70feee6b-4509-46e6-94e4-560c06ba0a48 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:38.743632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3a9a64a9-892c-42c3-841f-3232db890181 req-70feee6b-4509-46e6-94e4-560c06ba0a48 service nova] Creating event network-changed:411ddc74-252d-4abf-a433-41fe9c5e8125 for instance cc44a47e-3db8-4aaa-874f-56186e3092d1 on n-h2-zed-1 Oct 28 09:56:38.755539 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3a9a64a9-892c-42c3-841f-3232db890181 req-70feee6b-4509-46e6-94e4-560c06ba0a48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083641 Oct 28 09:56:38.758401 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 806/1651] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:38.764322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:38.777540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:38.784704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:38.785295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:38.785739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:38.786458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:38.786915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:38.797299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:39.108384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:39.117985 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8343438a-fc84-4a64-a6d1-6f8ad329adae tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.441276 Oct 28 09:56:39.128440 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 846/1652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:38 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:39.134726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7222f74-5c00-43f9-ac0b-08c3fe0e758d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3387d0d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:39.226626 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7222f74-5c00-43f9-ac0b-08c3fe0e758d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.095544 Oct 28 09:56:39.227221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 847/1653] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:39 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:39.276811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:39.290227 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a4d76ab-8f4e-4e3e-93d2-72e346342a43 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.529086 Oct 28 09:56:39.293787 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 807/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:38 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:39.682887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:39.683901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:39.694274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:39.697105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:39.697761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:39.699149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:39.700609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:39.701625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:39.702269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:39.702878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:39.717625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:39.718290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:39.718872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:39.721402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:39.722382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:39.725101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:39.763542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:39.973074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:39.993875 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-45a85d5e-3310-4712-b285-ec53eb5ff446 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.311390 Oct 28 09:56:40.004937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 848/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:39 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:40.065120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:40.080404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c843546-401e-4762-911b-1453c706684e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.387188 Oct 28 09:56:40.085911 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 808/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:39 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:40.159065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:40.160127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:40.168968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:40.170208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:40.170838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:40.171728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:40.172355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:40.173110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:40.243422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3dee6ea7-1741-4fea-a7fe-4f119cdacbd8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3307c940>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:40.313041 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3dee6ea7-1741-4fea-a7fe-4f119cdacbd8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.073351 Oct 28 09:56:40.320954 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 809/1657] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:40 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:40.324798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:40.335384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:40.346667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:40.347176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:40.347630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:40.356988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:40.357644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:40.358113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:40.447813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:40.476363 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6a7d472-9ec7-4e1d-9de4-2f2c7218f00c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.320822 Oct 28 09:56:40.477787 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 849/1658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:40 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:40.628405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:40.641686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d297cd6a-81aa-40e8-acd0-d4ee262fec5e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.321386 Oct 28 09:56:40.647876 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 810/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:40 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:41.022560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:41.023178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:41.035718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.037677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.037846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.038574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.039033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.039545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.111727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:41.113047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:41.116494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:41.134348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.137672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.145087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.147989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.148508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.152288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.153906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:41.296387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:41.306003 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-094116e6-9010-4610-ac28-e23293cc384d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.286788 Oct 28 09:56:41.308385 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 850/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:41 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:41.334956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b84ef246-a1ac-44ea-bc38-563d526639df tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33b3a160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:41.402023 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b84ef246-a1ac-44ea-bc38-563d526639df tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1455 microversion: 2.1 time: 0.073849 Oct 28 09:56:41.413733 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 851/1661] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:41 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1455 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:41.442646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:41.457594 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dccbc780-f1f6-4701-bc43-fee4c510a88c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.349749 Oct 28 09:56:41.458793 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 811/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:41 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:41.500434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:41.506239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:41.507141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:41.524826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.526901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.527372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.528126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.541323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.541323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.667128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:41.668083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:41.678519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.679208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.680119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.681201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:41.681942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:41.682476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:41.789454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:41.807862 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4ec2377b-8bb5-41d5-b4bb-c73e72fb18f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.308012 Oct 28 09:56:41.814945 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 852/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:41 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:42.024351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:42.040302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2fbb2ee-0224-4e4e-8f56-f40cb827e4f8 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.378416 Oct 28 09:56:42.041590 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 812/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:41 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:42.336126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:42.337387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:42.346018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.346771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.347386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.348322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.348988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.349586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.418210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a8df276f-b5c7-4069-8022-8dbea3ef5632 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330659d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:42.518517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a8df276f-b5c7-4069-8022-8dbea3ef5632 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1464 microversion: 2.1 time: 0.104395 Oct 28 09:56:42.528267 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 813/1665] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:42 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1464 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:42.536240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:42.536881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:42.542105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:42.546337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.546842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.547290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.548302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.549296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.550025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.553507 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e4b6854-e1e1-4d7e-a2e6-198abb8cb1ed tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.224450 Oct 28 09:56:42.568932 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 853/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:42 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:42.574294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1589e594-8ba8-4969-84be-978ec3c1cfaf tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33be2e50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:42.629009 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1589e594-8ba8-4969-84be-978ec3c1cfaf tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 200 len: 1464 microversion: 2.1 time: 0.070316 Oct 28 09:56:42.629970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 854/1667] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:42 2022] GET /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 1464 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:42.643989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:42.644826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:42.651555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.652560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.653056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.653790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.654241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.654676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.802313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:42.810563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ac3670f-07fd-420e-9800-1503a048cb31 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1481 microversion: 2.1 time: 0.170533 Oct 28 09:56:42.811823 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 855/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:42 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1481 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:42.840234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:42.840863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:42.847523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.848022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.848463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.849212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:42.849696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:42.850318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:42.851806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:42.861332 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf92beb8-4dca-4414-b5e8-18053cdef4da tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.335828 Oct 28 09:56:42.863026 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 814/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:42 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:43.051493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:43.063805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:43.064659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:43.065675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c46b8220-b2ef-4b1f-bd4b-4e4b5cb2ebe9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.229781 Oct 28 09:56:43.067603 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 856/1670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:42 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:43.084088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.084727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.085501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:43.086555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.087224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.088484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:43.327312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:43.339386 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c260dd81-0f5b-442b-a1a0-c47c2459a988 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.278041 Oct 28 09:56:43.340007 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 815/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:43 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:43.578038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:43.578758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:43.586135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.586635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.587129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:43.588451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.588956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.589381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:43.766702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:43.775356 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ece2575-0d13-44c2-9819-408a2f6eea0b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.200769 Oct 28 09:56:43.776441 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 857/1672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:43 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:43.835473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:43.836097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:43.843939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.844439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.844881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:43.845619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.846078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.846510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:43.886251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:43.886901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:43.893392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.894105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.894549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:43.895252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:43.895709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:43.896139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:44.028010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:44.040826 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e5d5ed4-f0d0-434e-b3cc-c0be72bf9a10 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1481 microversion: 2.1 time: 0.210266 Oct 28 09:56:44.042174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 816/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:43 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1481 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:44.043308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:44.051827 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-60806b8e-5b18-4a13-b30a-e0fae550d74e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.170718 Oct 28 09:56:44.052554 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 858/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:43 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:44.091339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:44.092173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:44.098479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:44.099231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:44.099840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:44.100736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:44.101235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:44.101669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:44.312196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:44.329289 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2a4ccb8-d7c9-45f1-9884-e7eb5843deee tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.241822 Oct 28 09:56:44.329881 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 817/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:44 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:44.362939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:44.370994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:44.377712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:44.378684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:44.379341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:44.380657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:44.381995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:44.381995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:44.585639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:44.600056 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96a2a933-27c0-4387-ba8e-99be25c68f9e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.240850 Oct 28 09:56:44.613628 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 859/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:44 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:44.800544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:44.801099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:44.809859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:44.812604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:44.813966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:44.815130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:44.816491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:44.817217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:44.999281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:45.021284 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf947a75-4d2a-40c6-b43a-0e38459b596c tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1469 microversion: 2.1 time: 0.225108 Oct 28 09:56:45.023941 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 818/1677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:44 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1469 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:45.078591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:45.079556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:45.098752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:45.100736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:45.102338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.106400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.106855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:45.107592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.108050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.111924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.112761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.113683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:45.114723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:45.115927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.116687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.117388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:45.304814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:45.483260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:45.498948 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99d8ab0d-9990-4b49-9aaf-810440e485ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.427126 Oct 28 09:56:45.501350 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 819/1678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:45 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:45.511877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:45.512824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:45.513747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:45.521907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e6a734a4-8495-4b2b-b700-7ea584bc1ef6 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1481 microversion: 2.1 time: 0.455520 Oct 28 09:56:45.526903 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 860/1679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:45 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1481 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:45.546008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.546962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.547654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:45.549170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.550238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.551102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:45.624709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:45.626036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:45.641294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.641785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.642214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:45.643125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:45.643740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:45.644332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:46.151918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:46.178298 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af2f039d-0392-4165-bf63-0e702316a909 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.669302 Oct 28 09:56:46.193180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 820/1680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:45 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:46.193180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:46.193540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:46.203784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:46.204273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:46.204709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:46.210730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:46.211226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:46.211669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:46.437989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:46.448335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-34f6eda4-52ad-4676-8f75-f04b8a58d2b1 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1462 microversion: 2.1 time: 0.263467 Oct 28 09:56:46.453071 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 821/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:46 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1462 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:46.455012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-af1b8b8d-27ac-4592-a00a-2e6000f1941f req-805607c9-3494-4f4c-838b-3c0e7e698f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "name": "network-vif-plugged", "status": "completed", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:46.467770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-af1b8b8d-27ac-4592-a00a-2e6000f1941f req-805607c9-3494-4f4c-838b-3c0e7e698f7b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:46.468492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-af1b8b8d-27ac-4592-a00a-2e6000f1941f req-805607c9-3494-4f4c-838b-3c0e7e698f7b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:46.469258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-af1b8b8d-27ac-4592-a00a-2e6000f1941f req-805607c9-3494-4f4c-838b-3c0e7e698f7b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:46.474150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:46.482846 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ff84fa85-ecef-4648-bc4c-c4c9aca56997 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.862136 Oct 28 09:56:46.484026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 861/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:45 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:46.502019 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-af1b8b8d-27ac-4592-a00a-2e6000f1941f req-805607c9-3494-4f4c-838b-3c0e7e698f7b service nova] Creating event network-vif-plugged:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h2-zed-1 Oct 28 09:56:46.515104 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-af1b8b8d-27ac-4592-a00a-2e6000f1941f req-805607c9-3494-4f4c-838b-3c0e7e698f7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064350 Oct 28 09:56:46.516273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 822/1683] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:46.529754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:46.531651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:46.546594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:46.548440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:46.551886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:46.552745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:46.553328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:46.554190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:46.881731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:46.905628 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f653269d-9c1c-4f98-a2d5-707fadd86062 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.381710 Oct 28 09:56:46.906976 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 823/1684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:46 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:46.913512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:46.914572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:46.921958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:46.922684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:46.923302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:46.924436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:46.925438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:46.926024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.042710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.044362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:47.053231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.058348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.063136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.069509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.070053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.070506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.219926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:47.227945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:47.241368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-411be544-0e95-4add-830a-002f613bc801 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1468 microversion: 2.1 time: 0.332886 Oct 28 09:56:47.250788 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 824/1685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:46 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:47.255968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.256838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:47.264812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.265740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.266387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.267626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.268704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.269961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.435059 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a35e8918-0c9b-4cf5-ac58-3ecb426f3067 tempest-MigrationsAdminTest-1734037692 tempest-MigrationsAdminTest-1734037692-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1607 microversion: 2.1 time: 0.949786 Oct 28 09:56:47.435916 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 862/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:46 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1607 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:47.448302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3810ad8-bdbd-431c-84f3-3c7eb64ec903 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32b83700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.509446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:47.519642 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c639a1f-e63b-4ade-acc0-89b8e282dd6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.267223 Oct 28 09:56:47.520207 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 825/1687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:47 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:47.525969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.527515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:47.536088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.536827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.537768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.538668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.539291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.540119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.590193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:47.649071 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3810ad8-bdbd-431c-84f3-3c7eb64ec903 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?changes-since=2022-10-28T09%3A53%3A50Z" status: 200 len: 2800 microversion: 2.1 time: 0.211837 Oct 28 09:56:47.653996 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 863/1688] 10.222.0.16 () {58 vars in 1199 bytes} [Fri Oct 28 09:56:47 2022] GET /compute/v2.1/images?changes-since=2022-10-28T09%3A53%3A50Z => generated 2800 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:47.665791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.675225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:47.704708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:47.706975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.709836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.710564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.711615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.712478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.713287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.736306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78d55fa5-e556-4ec2-9609-69d1c3619075 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 204 len: 0 microversion: 2.1 time: 0.214349 Oct 28 09:56:47.737374 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 826/1689] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:47 2022] DELETE /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:47.743815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92d50222-90f9-433d-85d4-82ee1c6b9dd7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330b0d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.824757 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92d50222-90f9-433d-85d4-82ee1c6b9dd7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2015575855" status: 200 len: 485 microversion: 2.1 time: 0.086055 Oct 28 09:56:47.826015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 827/1690] 10.222.0.16 () {58 vars in 1231 bytes} [Fri Oct 28 09:56:47 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2015575855 => generated 485 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:47.830152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:47.831164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:47.839192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.839687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.840150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.840942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:47.841395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:47.841816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:47.959739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:47.970775 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a818eeb9-6666-4a10-88a1-0fdcec18fd2e tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.315293 Oct 28 09:56:47.975510 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 864/1691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:47 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:47.989900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-675fa249-c2f1-4a21-b22e-b08480b64e81 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32b8b940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.042234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:48.052955 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c1d1db83-01e8-4d7a-9938-3978568bda85 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1468 microversion: 2.1 time: 0.226429 Oct 28 09:56:48.054216 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 828/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:47 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1468 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:48.069881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.070943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:48.078206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:48.078823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:48.079347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:48.080146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:48.080684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:48.081234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:48.117012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-675fa249-c2f1-4a21-b22e-b08480b64e81 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?server=a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 957 microversion: 2.1 time: 0.139987 Oct 28 09:56:48.126847 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 865/1693] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 09:56:47 2022] GET /compute/v2.1/images?server=a8fd254e-662a-4020-9421-b76fb300937d => generated 957 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:48.132181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e289fac-07f9-4906-9958-77fac593e1ab tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32bab4c0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.198401 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e289fac-07f9-4906-9958-77fac593e1ab tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 483 microversion: 2.1 time: 0.069814 Oct 28 09:56:48.209506 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 866/1694] 10.222.0.16 () {58 vars in 1317 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 483 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:48.222291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-61ff98ca-66e7-4527-8531-abdcdadc3c58 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32b8b0d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.303382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-61ff98ca-66e7-4527-8531-abdcdadc3c58 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 483 microversion: 2.1 time: 0.092585 Oct 28 09:56:48.303983 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 867/1695] 10.222.0.16 () {58 vars in 1303 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 483 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:48.324458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fcefaf06-4302-4f21-9f94-96eeba77a23e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3387df70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.398839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:48.410145 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c8493e2b-3634-4650-8479-1f36ce829f47 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1472 microversion: 2.1 time: 0.354443 Oct 28 09:56:48.411141 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 829/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1472 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:48.555401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.556131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:48.568329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:48.568949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:48.569491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:48.572951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:48.574438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:48.576329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:48.591322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fcefaf06-4302-4f21-9f94-96eeba77a23e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3706 microversion: 2.1 time: 0.277093 Oct 28 09:56:48.597745 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 868/1697] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3706 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:48.602692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e16c8333-4d50-42ed-9409-e598cc18db89 req-dc640be7-b8b9-4120-8571-171bb9a4a4db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd254e-662a-4020-9421-b76fb300937d", "name": "network-vif-unplugged", "status": "completed", "tag": "a53f8536-805c-4547-b056-8cc4428c8aba"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:48.627958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e16c8333-4d50-42ed-9409-e598cc18db89 req-dc640be7-b8b9-4120-8571-171bb9a4a4db service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:48.628802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e16c8333-4d50-42ed-9409-e598cc18db89 req-dc640be7-b8b9-4120-8571-171bb9a4a4db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:48.629480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e16c8333-4d50-42ed-9409-e598cc18db89 req-dc640be7-b8b9-4120-8571-171bb9a4a4db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:48.642308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e16c8333-4d50-42ed-9409-e598cc18db89 req-dc640be7-b8b9-4120-8571-171bb9a4a4db service nova] Creating event network-vif-unplugged:a53f8536-805c-4547-b056-8cc4428c8aba for instance a8fd254e-662a-4020-9421-b76fb300937d on n-h2-zed-1 Oct 28 09:56:48.652302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e16c8333-4d50-42ed-9409-e598cc18db89 req-dc640be7-b8b9-4120-8571-171bb9a4a4db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052977 Oct 28 09:56:48.653613 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 869/1698] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:48.663506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97a1c7a9-960e-4d3f-97a4-096ded65766b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32bab5e0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.785058 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97a1c7a9-960e-4d3f-97a4-096ded65766b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.127930 Oct 28 09:56:48.786739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 870/1699] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:48.802822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-273df1d5-7de6-45e0-ba66-309ba502b484 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3398ff70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:48.838362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:48.847108 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7540b885-c95b-4821-835f-6e44cce052f6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.299361 Oct 28 09:56:48.847700 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 830/1700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:48.905162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-273df1d5-7de6-45e0-ba66-309ba502b484 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.108577 Oct 28 09:56:48.907314 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 871/1701] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:56:48.921654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c794574-c21b-40e4-ae2f-ec0da027b28b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3301adc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.003453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.004234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:49.012122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.013896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.014513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.015929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.016739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.017369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.065725 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c794574-c21b-40e4-ae2f-ec0da027b28b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/detail?changes-since=2022-10-28T09%3A53%3A46Z" status: 200 len: 7021 microversion: 2.1 time: 0.142944 Oct 28 09:56:49.081471 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 831/1702] 10.222.0.16 () {58 vars in 1220 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-28T09%3A53%3A46Z => generated 7021 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:49.090728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.092527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:49.101723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.102532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.102686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.103915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.104385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.104816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.300235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:49.311796 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c3f03fa8-8179-493f-a7d6-9c2e0c8faa22 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.317397 Oct 28 09:56:49.315458 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 872/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:48 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:49.324210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2fb5e50f-2128-42ba-8e51-8d94c708f43a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32b3f670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.362359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:49.370550 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-89f8e8d6-c03c-4ac4-9b27-a829e9e49b33 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1468 microversion: 2.1 time: 0.287575 Oct 28 09:56:49.372460 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 832/1704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1468 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:49.411598 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2fb5e50f-2128-42ba-8e51-8d94c708f43a tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2015575855" status: 200 len: 665 microversion: 2.1 time: 0.094744 Oct 28 09:56:49.412294 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 873/1705] 10.222.0.16 () {58 vars in 1252 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2015575855 => generated 665 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:49.431752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b4d2009-487a-4508-ad7d-41996b3cc72d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330b0820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.438100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.440728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:49.449226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.450091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.450707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.451655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.452373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.453046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.499300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b4d2009-487a-4508-ad7d-41996b3cc72d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1465 microversion: 2.1 time: 0.073589 Oct 28 09:56:49.500521 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 833/1706] 10.222.0.16 () {58 vars in 1338 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fv2.1%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1465 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:49.515513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-801cbdf9-bb17-44dc-92e0-00e1cac99f69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3313f670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.575854 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-801cbdf9-bb17-44dc-92e0-00e1cac99f69 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1465 microversion: 2.1 time: 0.063596 Oct 28 09:56:49.576095 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 834/1707] 10.222.0.16 () {58 vars in 1324 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.16%2Fcompute%2Fservers%2F54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1465 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:49.601811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb603d6d-e1ac-48ee-8a07-4f6466a31dd8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330b0310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.716654 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb603d6d-e1ac-48ee-8a07-4f6466a31dd8 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7796 microversion: 2.1 time: 0.127387 Oct 28 09:56:49.717401 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 835/1708] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7796 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:49.738453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10169ffd-347f-4215-9305-c51364ccdb5b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33072af0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.817699 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10169ffd-347f-4215-9305-c51364ccdb5b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4374 microversion: 2.1 time: 0.083354 Oct 28 09:56:49.830408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 836/1709] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4374 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:49.835785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:49.842030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-107bf557-1591-4cf0-87a7-3eaa65d90e16 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330300d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.852702 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffe02c89-e974-47f9-a75d-eeeca255e9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1478 microversion: 2.1 time: 0.419435 Oct 28 09:56:49.853975 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 874/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1478 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:49.870699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.876740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:49.886197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.887036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.887723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.888830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:49.889708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:49.891464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:49.914813 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-107bf557-1591-4cf0-87a7-3eaa65d90e16 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/c7ac23d6-0e32-4a44-9d15-3c8a5df377c1" status: 200 len: 784 microversion: 2.1 time: 0.082888 Oct 28 09:56:49.916351 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 837/1711] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/images/c7ac23d6-0e32-4a44-9d15-3c8a5df377c1 => generated 784 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:49.932171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d2419ad-f610-4cc9-a0c7-aa826f2cef73 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3313f8b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:49.987376 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d2419ad-f610-4cc9-a0c7-aa826f2cef73 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1611 microversion: 2.1 time: 0.059118 Oct 28 09:56:49.988079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 838/1712] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1611 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:50.005324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c02d35a3-bd39-43fd-a70a-fa1df355ddd3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca3301bca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:50.198116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:50.207612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:50.220742 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ddbc1634-a86f-4581-ad04-919d9625cbf2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.352557 Oct 28 09:56:50.222145 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 875/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:49 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:50.335171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:50.335797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:50.349101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:50.349626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:50.350748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:50.351509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:50.353997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:50.355454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:50.802422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:50.811901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c02d35a3-bd39-43fd-a70a-fa1df355ddd3 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760" status: 204 len: 0 microversion: 2.1 time: 0.811219 Oct 28 09:56:50.812491 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 839/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:49 2022] DELETE /compute/v2.1/images/c086d6ba-128a-41cd-8118-5e72b5a30760 => generated 0 bytes in 813 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:50.816490 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc169ba2-093b-4980-bfdd-3334e1437648 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.485128 Oct 28 09:56:50.820723 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 876/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:50 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:50.828781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4f79ed0c-dabb-4a69-8fdd-2c19e6947433 req-06e6d379-6274-44f7-857e-2bb04e4bfea5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc44a47e-3db8-4aaa-874f-56186e3092d1", "name": "network-vif-plugged", "status": "completed", "tag": "411ddc74-252d-4abf-a433-41fe9c5e8125"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:50.829983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:50.830642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:50.845203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4f79ed0c-dabb-4a69-8fdd-2c19e6947433 req-06e6d379-6274-44f7-857e-2bb04e4bfea5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:50.845695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4f79ed0c-dabb-4a69-8fdd-2c19e6947433 req-06e6d379-6274-44f7-857e-2bb04e4bfea5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:50.846253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4f79ed0c-dabb-4a69-8fdd-2c19e6947433 req-06e6d379-6274-44f7-857e-2bb04e4bfea5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:50.851710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:50.852489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:50.853230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:50.854753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:50.855216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:50.855647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:50.876384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4f79ed0c-dabb-4a69-8fdd-2c19e6947433 req-06e6d379-6274-44f7-857e-2bb04e4bfea5 service nova] Creating event network-vif-plugged:411ddc74-252d-4abf-a433-41fe9c5e8125 for instance cc44a47e-3db8-4aaa-874f-56186e3092d1 on n-h2-zed-1 Oct 28 09:56:50.885764 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4f79ed0c-dabb-4a69-8fdd-2c19e6947433 req-06e6d379-6274-44f7-857e-2bb04e4bfea5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063754 Oct 28 09:56:50.886553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 877/1716] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:50.911901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c6a1cb11-6885-49e6-b3a4-f177ea37d545 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32b3fdc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:50.944485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:50.976818 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44a33cb0-9c00-45af-af55-39cb5832c424 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1426 microversion: 2.1 time: 0.163215 Oct 28 09:56:50.979122 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 840/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:50 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1426 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:50.996019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-87fee75a-f40d-463e-a3bd-84a7f03f7f3e req-9627f9f4-b218-4eec-87f0-d5c4f408cbc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa2d1ca-547c-4542-a2ad-e599ea8954bc", "name": "network-vif-deleted", "tag": "db027e3d-41f4-4aff-acbb-df05dcdf12dd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:51.023739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-87fee75a-f40d-463e-a3bd-84a7f03f7f3e req-9627f9f4-b218-4eec-87f0-d5c4f408cbc7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:51.024236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-87fee75a-f40d-463e-a3bd-84a7f03f7f3e req-9627f9f4-b218-4eec-87f0-d5c4f408cbc7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:51.024674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-87fee75a-f40d-463e-a3bd-84a7f03f7f3e req-9627f9f4-b218-4eec-87f0-d5c4f408cbc7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:51.077447 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-87fee75a-f40d-463e-a3bd-84a7f03f7f3e req-9627f9f4-b218-4eec-87f0-d5c4f408cbc7 service nova] Creating event network-vif-deleted:db027e3d-41f4-4aff-acbb-df05dcdf12dd for instance afa2d1ca-547c-4542-a2ad-e599ea8954bc on n-h2-zed-1 Oct 28 09:56:51.091807 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-87fee75a-f40d-463e-a3bd-84a7f03f7f3e req-9627f9f4-b218-4eec-87f0-d5c4f408cbc7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108537 Oct 28 09:56:51.093635 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 841/1718] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:51.107677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:51.109934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:51.122515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:51.123252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:51.123870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:51.133859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:51.134544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:51.135694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:51.404417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:51.420472 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f09ef17-ad6c-4e52-9ba5-b09f2a39e89e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1478 microversion: 2.1 time: 0.324937 Oct 28 09:56:51.422553 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 842/1719] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:51 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1478 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:51.440011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:51.441262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:51.463981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:51.470278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:51.470849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:51.471779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:51.472349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:51.472882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:51.719681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:51.725395 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c6a1cb11-6885-49e6-b3a4-f177ea37d545 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc" status: 204 len: 0 microversion: 2.1 time: 0.832414 Oct 28 09:56:51.726064 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 878/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:50 2022] DELETE /compute/v2.1/images/676608cb-039d-41e7-affe-4ed842cfdcbc => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:51.734371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5e03d31-4060-4b1c-b193-6ccb2d072949 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32bfeca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:51.755178 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b4d454b-60dd-4d91-815d-9555c0e8715b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.328637 Oct 28 09:56:51.755809 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 843/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:51 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:51.843502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:51.844829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:51.852887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:51.858587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:51.859170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:51.860040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:51.860420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:51.860848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.130576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:52.140120 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74602cec-2322-42d6-8710-38c38bb376a7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.300578 Oct 28 09:56:52.140725 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 844/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:51 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:52.145992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:52.146608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:52.158620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.159329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.160040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.160936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.161553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.162082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.238548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:52.247651 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-56324aaf-9e41-479e-b4f6-821fa15d61e5 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 200 len: 1297 microversion: 2.1 time: 0.105876 Oct 28 09:56:52.248238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 845/1723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:52 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:52.393530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-834836ee-8781-4919-bc0f-39c3532b3b5f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Action: 'create', calling method: .version_select at 0x7fca33030310>, body: {"keypair": {"name": "tempest-keypair-1234078248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgORvIfN9npIn0rd9zFxDFo/jDyzlvmjvPEex3T9e4PJi8RJV3cJqK0d1Rr5/aiLAHSpMfi0aa4FYhs7FM93ESJfkwZnXFjnP+/p8XXOa+l2ildMZ90gIb6a3RLLyor0w=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:52.395493 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5e03d31-4060-4b1c-b193-6ccb2d072949 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4" status: 204 len: 0 microversion: 2.1 time: 0.665277 Oct 28 09:56:52.396241 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 879/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:51 2022] DELETE /compute/v2.1/images/75cd4dc2-15d0-4571-9581-7fac823af1b4 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:56:52.405232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:52.406004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:52.411272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-834836ee-8781-4919-bc0f-39c3532b3b5f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Getting quotas for project aa7146c7cb464ce99ad2f6593f0ebb0b. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:56:52.413936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.414771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.415299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.416246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-834836ee-8781-4919-bc0f-39c3532b3b5f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Getting quotas for user b2706dd9c4f24a41a1e990c0517b792e and project aa7146c7cb464ce99ad2f6593f0ebb0b. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:56:52.416484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.417112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.417758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.429951 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [None req-834836ee-8781-4919-bc0f-39c3532b3b5f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [2330d91e-2023-421e-b116-bc73d1f9a12b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 09:56:52.448225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:52.528539 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b992d753-1076-487a-8301-f95552f0d085 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 204 len: 0 microversion: 2.1 time: 0.127217 Oct 28 09:56:52.531998 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 880/1725] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:52 2022] DELETE /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:52.536765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:52.537741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:52.544028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.544531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.545001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.545873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.546338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.546769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.696128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:52.706538 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-481cb2c7-aa6f-450f-83b8-9edc2462ac6b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1478 microversion: 2.1 time: 0.176143 Oct 28 09:56:52.707142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 881/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:52 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1478 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:52.711633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:52.712246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:52.718132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.718623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.719057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.719753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.720204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.720630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.862535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:52.871164 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2667db33-fcff-4586-b039-70be4e2c33d2 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1474 microversion: 2.1 time: 0.163012 Oct 28 09:56:52.871736 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 882/1727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:52 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1474 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:52.876159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:52.876767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:52.882366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.882853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.883292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:52.883994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:52.884453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:52.884971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.017350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:53.027242 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa29e515-b8f8-4411-a129-b8104690e5d4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.154489 Oct 28 09:56:53.027829 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 883/1728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:52 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:53.032229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7be59fed-c444-4ecf-8ec4-74f0676cf2c6 req-fa5f834c-c671-4bf0-bf07-bf6d9ca229fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caca59f2-508b-4f81-b2c9-73857a7e7cbb", "name": "network-vif-unplugged", "status": "completed", "tag": "5df6dcc3-c245-46be-ace9-9232b18e4b70"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:53.044060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7be59fed-c444-4ecf-8ec4-74f0676cf2c6 req-fa5f834c-c671-4bf0-bf07-bf6d9ca229fd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.044734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7be59fed-c444-4ecf-8ec4-74f0676cf2c6 req-fa5f834c-c671-4bf0-bf07-bf6d9ca229fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.045190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7be59fed-c444-4ecf-8ec4-74f0676cf2c6 req-fa5f834c-c671-4bf0-bf07-bf6d9ca229fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.057078 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7be59fed-c444-4ecf-8ec4-74f0676cf2c6 req-fa5f834c-c671-4bf0-bf07-bf6d9ca229fd service nova] Creating event network-vif-unplugged:5df6dcc3-c245-46be-ace9-9232b18e4b70 for instance caca59f2-508b-4f81-b2c9-73857a7e7cbb on n-h1-zed-1 Oct 28 09:56:53.062112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7be59fed-c444-4ecf-8ec4-74f0676cf2c6 req-fa5f834c-c671-4bf0-bf07-bf6d9ca229fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033139 Oct 28 09:56:53.062719 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 884/1729] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:53.163599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:53.164410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:53.171518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.172023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.172474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.173200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.173661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.174093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.318536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:53.326524 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-26456d4b-2cad-40ee-bff6-4844c503c966 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.167504 Oct 28 09:56:53.327195 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 885/1730] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:53 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:53.331775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:53.332480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: afa2d1ca-547c-4542-a2ad-e599ea8954bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:53.340489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.341312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.341929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.343462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.343923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.344550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.363235 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] HTTP exception thrown: Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc could not be found. Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Request method failure captured: Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc HTTP/1.1 Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XMKmUsE7fw9VBuQiXIfRiplG14oVm1p18z2hYXrFwQeKxtf2Jx-KGcrdKSVgOgL3sNx0bXQ1HXg3VTGS40XSGiPp0oAZDb-up9SrMsFCuhetziMXW9ImJ-GqZJjKVHORludm4h7sN8NNA8o_-AHfwEEBXA8nW_BdWV6Rv_IsliNdk Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:56:53.364966 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_386a18c232b949b793bf7ec70ed3b6c9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/386a18c232b949b793bf7ec70ed3b6c9"}]}] Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-MigrationsAdminTest-825942653 Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-MigrationsAdminTest-825942653-project Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 9dc12014773b4f9fb34ff214c07d7f61 Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-MigrationsAdminTest-825942653-project Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc could not be found. Oct 28 09:56:53.366888 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'afa2d1ca-547c-4542-a2ad-e599ea8954bc'} Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc could not be found. Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:53.367913 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc could not be found. Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc could not be found. Oct 28 09:56:53.369651 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:56:53.372475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Returning 404 to user: Instance afa2d1ca-547c-4542-a2ad-e599ea8954bc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:53.372475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49d81642-23b4-4f19-91cb-90370ccb8eab tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc" status: 404 len: 111 microversion: 2.1 time: 0.038299 Oct 28 09:56:53.372475 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 886/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:53 2022] GET /compute/v2.1/servers/afa2d1ca-547c-4542-a2ad-e599ea8954bc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:56:53.376410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:53.377311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:53.382895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.383381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.383836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.384530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.385533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.386292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.414344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:53.439934 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [None req-834836ee-8781-4919-bc0f-39c3532b3b5f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [2330d91e-2023-421e-b116-bc73d1f9a12b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34662. Oct 28 09:56:53.459446 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-834836ee-8781-4919-bc0f-39c3532b3b5f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.210084 Oct 28 09:56:53.460692 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 846/1732] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 09:56:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:53.504469 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-100b2906-86e6-478e-8c6b-df9de338bf8b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 204 len: 0 microversion: 2.1 time: 0.131742 Oct 28 09:56:53.505075 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 887/1733] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:53 2022] DELETE /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:53.513921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:53.514686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:53.520750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.521272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.521711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.522414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.522868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.523294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.686669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:53.694905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3b15f74-c641-4fcc-9296-e393b4a83697 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1535 microversion: 2.1 time: 0.185419 Oct 28 09:56:53.695507 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 847/1734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:53 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1535 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:53.730274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:53.730839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:53.738874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.739632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.740060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.740781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.741496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.741913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.893324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:53.899436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:53.900722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:53.902931 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d2cee79e-efe1-4a04-adcb-90d4b710b2ec tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1478 microversion: 2.1 time: 0.177032 Oct 28 09:56:53.903583 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 888/1735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:53 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1478 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:53.914167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.917619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.919542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:53.921172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:53.927087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:53.927998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.053405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:54.055211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:54.062338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.062890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.063398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.064131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.064758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.065029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.106280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:54.116813 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d4c12d04-f3d6-4596-acd7-02d2e409b224 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1474 microversion: 2.1 time: 0.225687 Oct 28 09:56:54.120972 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 848/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:53 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1474 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:54.343313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:54.350114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:54.351014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:54.354269 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90121713-c458-437d-9136-830e48b1990f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.305588 Oct 28 09:56:54.368970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 889/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:54 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:54.374143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.375033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.375495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.376253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.376722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.377209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.527602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:54.537806 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1620eb21-1bf7-4a85-91a0-4a8ddea73aec tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1316 microversion: 2.1 time: 0.191496 Oct 28 09:56:54.539048 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 849/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:54 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:54.724016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:54.725182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:54.738923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.740229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.741308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.742848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.744457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.745520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.930489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:54.932307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:54.941704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.942450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.943257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.944127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:54.944698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:54.945267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:54.969396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:55.051627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:55.065770 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-58e5c832-e2f1-4f14-a3ce-d2d0c50fdd9b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1535 microversion: 2.1 time: 0.348951 Oct 28 09:56:55.086657 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 890/1739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:54 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1535 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:55.126372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-661926625", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "85535b7b-3d98-4509-9816-a4f492217981"}], "security_groups": [{"name": "tempest-securitygroup--864312068"}], "key_name": "tempest-keypair-1234078248", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:55.173229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:55.185417 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83c7e54f-9e19-4365-bd08-7e1456d5184c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1478 microversion: 2.1 time: 0.260962 Oct 28 09:56:55.200936 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 850/1740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:54 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1478 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:55.200936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:55.200936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:55.200936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:55.201448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:55.201448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:55.201986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:55.202833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:55.203651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:55.447437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:55.456620 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25390ecb-bf11-4cfc-923e-683615756289 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1474 microversion: 2.1 time: 0.268884 Oct 28 09:56:55.457265 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 851/1741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:55 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1474 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:55.463273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-887cec41-7ff2-434b-97e9-5fba87036c67 req-0b636ae7-90a0-40be-9c6b-371c18c5a036 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caca59f2-508b-4f81-b2c9-73857a7e7cbb", "name": "network-vif-plugged", "status": "completed", "tag": "5df6dcc3-c245-46be-ace9-9232b18e4b70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:55.474044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-887cec41-7ff2-434b-97e9-5fba87036c67 req-0b636ae7-90a0-40be-9c6b-371c18c5a036 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:55.475441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-887cec41-7ff2-434b-97e9-5fba87036c67 req-0b636ae7-90a0-40be-9c6b-371c18c5a036 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:55.475648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] validate_networks() for [('85535b7b-3d98-4509-9816-a4f492217981', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:56:55.475881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-887cec41-7ff2-434b-97e9-5fba87036c67 req-0b636ae7-90a0-40be-9c6b-371c18c5a036 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:55.491916 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-887cec41-7ff2-434b-97e9-5fba87036c67 req-0b636ae7-90a0-40be-9c6b-371c18c5a036 service nova] Creating event network-vif-plugged:5df6dcc3-c245-46be-ace9-9232b18e4b70 for instance caca59f2-508b-4f81-b2c9-73857a7e7cbb on n-h1-zed-1 Oct 28 09:56:55.500941 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-887cec41-7ff2-434b-97e9-5fba87036c67 req-0b636ae7-90a0-40be-9c6b-371c18c5a036 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041807 Oct 28 09:56:55.502264 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 852/1742] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:55.510409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:55.511118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:55.513210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:55.521224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:55.522245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:55.522746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:55.523491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:55.523982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:55.524596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:55.698816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:55.711285 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3fa94ea5-e9a8-4bd0-adfa-172c55e7cdbb tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.205640 Oct 28 09:56:55.712499 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 853/1743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:55 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:55.743147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:55.744275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:55.753152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:55.753669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:55.754126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:55.757323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:55.757590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:55.758307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.135209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:56.148827 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b320d8b-4724-43fb-b75d-a3a4b320bc1a tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1503 microversion: 2.1 time: 0.432200 Oct 28 09:56:56.150200 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 854/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:55 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1503 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:56.174863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:56.176233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:56.185957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.186810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.187535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.188365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.189006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.189551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.458839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:56.470295 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-edacc89b-0a3d-4ff4-b2ec-b822727c8c3b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1535 microversion: 2.1 time: 0.306857 Oct 28 09:56:56.486594 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 855/1745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:56 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1535 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:56.501737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:56.502362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:56.517008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.517876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.518599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.520062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.520852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.521641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.653042 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-320c38b7-b4cf-4c23-b09f-e16f25eb9de3 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.165043 Oct 28 09:56:56.658442 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 856/1746] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 09:56:56 2022] DELETE /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1/os-server-password => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:56.664178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:56.665182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:56.675878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.676700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.679375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.680440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.681273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.682462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.941258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:56.954408 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7252978b-e2fc-4c23-9f4f-fbce253a2653 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1478 microversion: 2.1 time: 0.294261 Oct 28 09:56:56.955593 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 857/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:56 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1478 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:56.961432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:56.962320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:56.970810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.972615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.974286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:56.975667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:56.977329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:56.977977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.115739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:57.128511 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-219ce6f3-9fdf-4a7b-a95a-d64873f49f6e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1303 microversion: 2.1 time: 0.171595 Oct 28 09:56:57.147061 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 858/1748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:56 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:57.161440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:57.161948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:57.182611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.183118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.183639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.184371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.184840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.185319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.223281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:57.223706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:57.224176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:57.224803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:57.225421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:57.247734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.248556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.249211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.250142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.250846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.251472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.270029 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19a9cbd9-5c0e-4157-b4ba-8cdb126f0fff tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.115256 Oct 28 09:56:57.277303 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 859/1749] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 09:56:57 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1/os-server-password => generated 16 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:56:57.282609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:57.283672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:57.286689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Getting quotas for project aa7146c7cb464ce99ad2f6593f0ebb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:56:57.294712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Getting quotas for user b2706dd9c4f24a41a1e990c0517b792e and project aa7146c7cb464ce99ad2f6593f0ebb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:56:57.297014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.297529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.297979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.298994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.299464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.300855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.310298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:56:57.313642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:56:57.380817 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0522cc83-e390-4f3e-a7c6-c009f305e761 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.258394 Oct 28 09:56:57.382873 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 891/1750] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:56:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 2261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:56:57.397153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-417715b2-3103-47f8-941d-b454a95cf6c6 req-1e58749f-ab53-4de0-8192-94ecc225dc33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09e54b5f-f267-485d-bdd9-30491a1c91f0", "name": "network-vif-deleted", "tag": "0de949ec-f797-4b55-890a-ca8b36655c8c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:57.411901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-417715b2-3103-47f8-941d-b454a95cf6c6 req-1e58749f-ab53-4de0-8192-94ecc225dc33 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.412885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-417715b2-3103-47f8-941d-b454a95cf6c6 req-1e58749f-ab53-4de0-8192-94ecc225dc33 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.413520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-417715b2-3103-47f8-941d-b454a95cf6c6 req-1e58749f-ab53-4de0-8192-94ecc225dc33 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.428765 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-417715b2-3103-47f8-941d-b454a95cf6c6 req-1e58749f-ab53-4de0-8192-94ecc225dc33 service nova] Creating event network-vif-deleted:0de949ec-f797-4b55-890a-ca8b36655c8c for instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 on n-h1-zed-1 Oct 28 09:56:57.434573 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-417715b2-3103-47f8-941d-b454a95cf6c6 req-1e58749f-ab53-4de0-8192-94ecc225dc33 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049757 Oct 28 09:56:57.435321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 892/1751] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:57.443619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7f79eb1e-ee00-4c6a-9892-45fa5f3f2925 req-49e7bf5a-627b-4dc8-91d0-fb3c69d04e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54ac7f33-0abb-4958-8a4b-42eaec67578a", "name": "network-vif-deleted", "tag": "e54700aa-52ee-4f0a-b07e-8955746bd325"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:57.456034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7f79eb1e-ee00-4c6a-9892-45fa5f3f2925 req-49e7bf5a-627b-4dc8-91d0-fb3c69d04e38 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.456983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7f79eb1e-ee00-4c6a-9892-45fa5f3f2925 req-49e7bf5a-627b-4dc8-91d0-fb3c69d04e38 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.457586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7f79eb1e-ee00-4c6a-9892-45fa5f3f2925 req-49e7bf5a-627b-4dc8-91d0-fb3c69d04e38 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.472572 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7f79eb1e-ee00-4c6a-9892-45fa5f3f2925 req-49e7bf5a-627b-4dc8-91d0-fb3c69d04e38 service nova] Creating event network-vif-deleted:e54700aa-52ee-4f0a-b07e-8955746bd325 for instance 54ac7f33-0abb-4958-8a4b-42eaec67578a on n-h2-zed-1 Oct 28 09:56:57.478965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7f79eb1e-ee00-4c6a-9892-45fa5f3f2925 req-49e7bf5a-627b-4dc8-91d0-fb3c69d04e38 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041842 Oct 28 09:56:57.480336 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 893/1752] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:57.487167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:57.488165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:57.499698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.500467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.501239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.503661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.504378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.507449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.574114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:56:57.614571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:57.713946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:57.723444 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-58242410-324e-4dd6-aa06-92b39c5cbd01 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.444738 Oct 28 09:56:57.727684 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 860/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:57 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:57.733407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-86b3cc34-8918-4593-838f-24b1c349095d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:57.734441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-86b3cc34-8918-4593-838f-24b1c349095d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:57.777163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8a0e490-03c9-4381-920a-34f697034bf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 204 len: 0 microversion: 2.1 time: 0.294881 Oct 28 09:56:57.780835 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 894/1754] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:56:57 2022] DELETE /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:56:57.799044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:57.799828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:57.819904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.820403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.820839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.821589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.822096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.823034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.828748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86b3cc34-8918-4593-838f-24b1c349095d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:57.837998 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-86b3cc34-8918-4593-838f-24b1c349095d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1241 microversion: 2.1 time: 0.108487 Oct 28 09:56:57.839575 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 861/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:57 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:57.848978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:57.855160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:57.882819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.884069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.885327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.886179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.886679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.891910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.972784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:57.973820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:57.976372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:57.976850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lazy-loading 'fault' on Instance uuid 09e54b5f-f267-485d-bdd9-30491a1c91f0 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:58.099650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:58.108196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:58.109440 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e091ce3-55cd-4180-a90f-7279517d7069 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 200 len: 1369 microversion: 2.1 time: 0.327169 Oct 28 09:56:58.112104 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 895/1756] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:57 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 1369 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:58.117318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:58.117984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.125570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.126328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.126954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.128006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.128637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.129259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.132261 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46e20859-e18c-4fef-948c-4fc052774577 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1509 microversion: 2.1 time: 0.291233 Oct 28 09:56:58.133033 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 862/1757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:57 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1509 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:58.159551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:58.160692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.169639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.170956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.171961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.173101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.174455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.175759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.238999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.239491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.239928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.240383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lazy-loading 'fault' on Instance uuid 54ac7f33-0abb-4958-8a4b-42eaec67578a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:58.315814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:58.319833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:58.324641 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-474be129-0005-4ca7-a376-b7718d7741be tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1464 microversion: 2.1 time: 0.211248 Oct 28 09:56:58.326425 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 896/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:58 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:58.330383 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b7e0b2b-49de-4cfe-97ea-809d4e54be76 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1308 microversion: 2.1 time: 0.174636 Oct 28 09:56:58.348567 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 863/1759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:58 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:58.354835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:58.355490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.362111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.362652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.363377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.364147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.365064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.365662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.527369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:58.536081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bdea8812-b086-4f54-8904-eee04ef97799 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1464 microversion: 2.1 time: 0.186243 Oct 28 09:56:58.536672 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 897/1760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:58 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1464 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:58.564934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:58.568296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.578804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.579698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.580593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.582482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.583522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.584215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.704075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:56:58.704983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:56:58.705748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:56:58.706164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:56:58.706579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:56:58.752159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:58.752928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.762842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.763335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.764097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.764827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.765309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.765915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.773437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.779908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.780408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.780850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.781592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.782226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.782828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.814011 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c82d363-9a42-4061-b4f4-5edc945e0476 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action" status: 202 len: 1068 microversion: 2.1 time: 0.256325 Oct 28 09:56:58.814966 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 864/1761] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:56:58 2022] POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action => generated 1068 bytes in 258 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 09:56:58.833390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:58.834006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.843440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.843937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.844436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.845450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.846089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.846807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.876737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:56:58.938501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:58.955644 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-df6e8988-14b4-4bee-8643-de3922561ad5 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.207981 Oct 28 09:56:58.958373 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 898/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:58 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:58.977006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:58.980708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:58.990378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.991180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.991631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:58.992428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:58.992891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:58.993363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.044352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:59.052801 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f9237283-51b8-4db3-bf30-4cc90da49b04 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.223395 Oct 28 09:56:59.053494 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 865/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:58 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:59.063588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:59.073848 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c9667dd-e75e-47e5-91bb-d381dc7298a4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1245 microversion: 2.1 time: 0.113254 Oct 28 09:56:59.074657 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 899/1764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:58 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1245 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:59.137043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:59.137661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 09e54b5f-f267-485d-bdd9-30491a1c91f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:59.143951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.144676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.145348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.146246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.146873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.147470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.159477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:59.160200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:59.163938 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] HTTP exception thrown: Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 could not be found. Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Request method failure captured: Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 HTTP/1.1 Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XMKmUsE7fw9VBuQiXIfRiplG14oVm1p18z2hYXrFwQeKxtf2Jx-KGcrdKSVgOgL3sNx0bXQ1HXg3VTGS40XSGiPp0oAZDb-up9SrMsFCuhetziMXW9ImJ-GqZJjKVHORludm4h7sN8NNA8o_-AHfwEEBXA8nW_BdWV6Rv_IsliNdk Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:56:59.167237 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_386a18c232b949b793bf7ec70ed3b6c9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/386a18c232b949b793bf7ec70ed3b6c9"}]}] Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-MigrationsAdminTest-825942653 Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-MigrationsAdminTest-825942653-project Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 9dc12014773b4f9fb34ff214c07d7f61 Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-MigrationsAdminTest-825942653-project Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 could not be found. Oct 28 09:56:59.168766 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '09e54b5f-f267-485d-bdd9-30491a1c91f0'} Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 could not be found. Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:56:59.169665 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 could not be found. Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 could not be found. Oct 28 09:56:59.171047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:56:59.172289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.172289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.172289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.172289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.172717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.173372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.174233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Returning 404 to user: Instance 09e54b5f-f267-485d-bdd9-30491a1c91f0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:56:59.175566 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6846d728-e33a-4b42-b3fe-998717a47436 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0" status: 404 len: 111 microversion: 2.1 time: 0.042367 Oct 28 09:56:59.176531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 866/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:59 2022] GET /compute/v2.1/servers/09e54b5f-f267-485d-bdd9-30491a1c91f0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:56:59.184661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-047a3b9f-a880-4ec8-b549-4e1351c1614f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '.version_select at 0x7fca33030280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:59.205937 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-047a3b9f-a880-4ec8-b549-4e1351c1614f tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871682523" status: 202 len: 0 microversion: 2.1 time: 0.025013 Oct 28 09:56:59.206581 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 867/1766] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 09:56:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871682523 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:56:59.357163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:59.357771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:59.364452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.364952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.365662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.366369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.366817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.367326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.401629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.402189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.402809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.403266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lazy-loading 'fault' on Instance uuid 54ac7f33-0abb-4958-8a4b-42eaec67578a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:56:59.417766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:59.435174 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f7a34dd-f6d3-4af2-89bd-a9c6b137116b tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1509 microversion: 2.1 time: 0.280164 Oct 28 09:56:59.441906 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 900/1767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:59 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1509 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:56:59.457031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e25e6284-0df7-4d1c-bb34-f574ed905bf9 req-062f9637-15a8-4db5-a434-cae1912e494d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f7b43e-9af7-48b0-b0fc-ad060328abbf", "name": "network-vif-unplugged", "status": "completed", "tag": "5a5bee98-bf90-4c92-b3a5-a7436e5ffedb"}, {"name": "network-changed", "server_uuid": "73f7b43e-9af7-48b0-b0fc-ad060328abbf", "tag": "5a5bee98-bf90-4c92-b3a5-a7436e5ffedb"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:56:59.474144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:56:59.481113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e25e6284-0df7-4d1c-bb34-f574ed905bf9 req-062f9637-15a8-4db5-a434-cae1912e494d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.481725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e25e6284-0df7-4d1c-bb34-f574ed905bf9 req-062f9637-15a8-4db5-a434-cae1912e494d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.482219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e25e6284-0df7-4d1c-bb34-f574ed905bf9 req-062f9637-15a8-4db5-a434-cae1912e494d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.489512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a655277-d800-425b-93fd-3997c686a52e tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 200 len: 1308 microversion: 2.1 time: 0.134126 Oct 28 09:56:59.491631 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 868/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:59 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 1308 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:56:59.529003 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e25e6284-0df7-4d1c-bb34-f574ed905bf9 req-062f9637-15a8-4db5-a434-cae1912e494d service nova] Creating event network-vif-unplugged:5a5bee98-bf90-4c92-b3a5-a7436e5ffedb for instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf on n-h1-zed-1 Oct 28 09:56:59.529552 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e25e6284-0df7-4d1c-bb34-f574ed905bf9 req-062f9637-15a8-4db5-a434-cae1912e494d service nova] Creating event network-changed:5a5bee98-bf90-4c92-b3a5-a7436e5ffedb for instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf on n-h1-zed-1 Oct 28 09:56:59.545437 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e25e6284-0df7-4d1c-bb34-f574ed905bf9 req-062f9637-15a8-4db5-a434-cae1912e494d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.092140 Oct 28 09:56:59.546607 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 901/1769] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:56:59.981619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:56:59.982016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:56:59.990890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.991599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.992240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:56:59.993205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:56:59.994421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:56:59.995072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.079224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.080554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.087428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.088401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.089122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.090137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.090965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.091660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.187783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:00.196268 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-73179074-5e73-44d9-9170-3d434ac002db tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.218706 Oct 28 09:57:00.197239 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 869/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:56:59 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:00.202055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.202913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.214383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.214891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.215406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.216150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.216608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.217156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.285972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:00.295244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e918bde-62aa-4e17-927f-10f3fc69c805 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1293 microversion: 2.1 time: 0.096645 Oct 28 09:57:00.309187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 870/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:00 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1293 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:00.309187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.309187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.309187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.309187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.309942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.310879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.312092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.312092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.342035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:00.405832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:00.415647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6d35d44b-51dc-4e02-8786-62adb4463a27 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.341676 Oct 28 09:57:00.433948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 902/1772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:00 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:00.440691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-efaa6943-04fa-4c72-911e-6f8fb4c0d45d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 204 len: 0 microversion: 2.1 time: 0.143379 Oct 28 09:57:00.441811 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 871/1773] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:00 2022] DELETE /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:00.452090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.452773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.460201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.460709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.461198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.461936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.462399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.462868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.490133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.491117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.498416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.499215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.499832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.501013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.501656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.502257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.641831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:00.657701 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f93e1c33-dcbb-4e7e-b3b4-cc922bd56e61 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1467 microversion: 2.1 time: 0.171567 Oct 28 09:57:00.658890 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 872/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:00 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1467 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:00.672921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.674039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: 54ac7f33-0abb-4958-8a4b-42eaec67578a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.683771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.684572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.685393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.686651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.687633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.688285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.717153 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] HTTP exception thrown: Instance 54ac7f33-0abb-4958-8a4b-42eaec67578a could not be found. Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Request method failure captured: Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a HTTP/1.1 Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ap9PO0RG7loV8upvIObPaehG4qi4QAsOAZNe5XJgOfa-xaoNXvpFVpnswVYhmiPsl75c2kxcF4T9P_Gw1WOds38Nf4mYjQcy4EBYOJq7KVnHrxHcJy50FKdz0_9z0-0TjgvNP3O-eMNx8s3R-fj-izKa4uZRmB3Yx4zSV6WnIIqEo Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: f80fef68c5b24dc8b5340141bc1f837d Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListImageFiltersTestJSON-1984425338 Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:57:00.719854 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f80fef68c5b24dc8b5340141bc1f837d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f80fef68c5b24dc8b5340141bc1f837d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f80fef68c5b24dc8b5340141bc1f837d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f80fef68c5b24dc8b5340141bc1f837d"}]}] Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListImageFiltersTestJSON-1984425338 Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: f80fef68c5b24dc8b5340141bc1f837d Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1984425338 Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListImageFiltersTestJSON-1984425338-project Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: dbd28dab6bef44c28e487a58cc99cb5c Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListImageFiltersTestJSON-1984425338-project Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 54ac7f33-0abb-4958-8a4b-42eaec67578a could not be found. Oct 28 09:57:00.721946 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '54ac7f33-0abb-4958-8a4b-42eaec67578a'} Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54ac7f33-0abb-4958-8a4b-42eaec67578a could not be found. Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:00.723013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54ac7f33-0abb-4958-8a4b-42eaec67578a could not be found. Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54ac7f33-0abb-4958-8a4b-42eaec67578a could not be found. Oct 28 09:57:00.724465 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:00.733052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Returning 404 to user: Instance 54ac7f33-0abb-4958-8a4b-42eaec67578a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:00.734231 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b3d6f84a-3bea-40fb-94e1-81cf431f859f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a" status: 404 len: 111 microversion: 2.1 time: 0.073836 Oct 28 09:57:00.737451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 873/1775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:00 2022] GET /compute/v2.1/servers/54ac7f33-0abb-4958-8a4b-42eaec67578a => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:00.744317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.744826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.756627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.757175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.757622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.758354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.758818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.759256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.779229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:00.787753 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09ee038c-554b-48cc-8701-8d28155d9a00 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1469 microversion: 2.1 time: 0.340899 Oct 28 09:57:00.789180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:00.792695 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 903/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:00 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:00.874707 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d786f130-d1a1-4da9-b882-c53d1d9dd92d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 204 len: 0 microversion: 2.1 time: 0.134961 Oct 28 09:57:00.875397 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 874/1777] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:00 2022] DELETE /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:57:00.883642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:00.884261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:00.904152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.904644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.905352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:00.906103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:00.906569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:00.906979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.058178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:01.066463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3f24c46-2ea3-42c4-b635-b5bbd9325a98 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1474 microversion: 2.1 time: 0.186858 Oct 28 09:57:01.067051 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 904/1778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:00 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1474 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:01.220917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:01.221645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:01.228306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.228825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.229365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.230073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.230536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.230966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.324284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:01.324983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:01.327889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:01.333836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.334331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.334768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.335484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.335943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.336373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.373226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:01.381866 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-255c824f-ddbc-4174-8b9e-e4bc1da03c6d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.165129 Oct 28 09:57:01.382482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 875/1779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:01 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:01.411406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:01.419349 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dddd0b44-f798-4d34-81b8-2c42ccda91c7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1299 microversion: 2.1 time: 0.099510 Oct 28 09:57:01.419930 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 905/1780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:01 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:01.442002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:01.442621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:01.449837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.450332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.450779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.451493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.451982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.452411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.569068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-2eb84ffd-2c39-4336-8ba1-4ad20d94b696 req-b240c7d4-0d82-4802-aa5b-d8b9b1a7a8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc44a47e-3db8-4aaa-874f-56186e3092d1", "name": "network-vif-deleted", "tag": "411ddc74-252d-4abf-a433-41fe9c5e8125"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:01.584423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2eb84ffd-2c39-4336-8ba1-4ad20d94b696 req-b240c7d4-0d82-4802-aa5b-d8b9b1a7a8be service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.584929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2eb84ffd-2c39-4336-8ba1-4ad20d94b696 req-b240c7d4-0d82-4802-aa5b-d8b9b1a7a8be service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.585358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2eb84ffd-2c39-4336-8ba1-4ad20d94b696 req-b240c7d4-0d82-4802-aa5b-d8b9b1a7a8be service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.599953 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-2eb84ffd-2c39-4336-8ba1-4ad20d94b696 req-b240c7d4-0d82-4802-aa5b-d8b9b1a7a8be service nova] Creating event network-vif-deleted:411ddc74-252d-4abf-a433-41fe9c5e8125 for instance cc44a47e-3db8-4aaa-874f-56186e3092d1 on n-h2-zed-1 Oct 28 09:57:01.600153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:01.605115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-2eb84ffd-2c39-4336-8ba1-4ad20d94b696 req-b240c7d4-0d82-4802-aa5b-d8b9b1a7a8be service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039710 Oct 28 09:57:01.605731 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 906/1781] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:01.609461 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-775b188c-2c19-49d1-9e0b-d6dc844e6ca8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.171317 Oct 28 09:57:01.610046 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 876/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:01 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:01.683298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:01.684014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:01.690741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.691245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.691687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.692414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.692871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.693330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.727663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.728145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.729154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.729618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lazy-loading 'fault' on Instance uuid cc44a47e-3db8-4aaa-874f-56186e3092d1 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:01.790524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:01.801632 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a17e26e8-d610-4e14-8139-2dba71199485 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1306 microversion: 2.1 time: 0.123449 Oct 28 09:57:01.802617 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 907/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:01 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1306 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:01.822998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:01.823622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:01.829739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.830232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.830675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.831382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:01.831844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:01.832276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:01.967423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:01.977368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-170c34c3-880a-404f-8946-5c33fc2610a0 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1469 microversion: 2.1 time: 0.158225 Oct 28 09:57:01.977958 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 877/1784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:01 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:02.094894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:02.095970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:02.107720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.108590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.109405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.110682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.111477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.112035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.376045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:02.385062 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dae72408-8a8a-439a-a62a-d0cd1b042062 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1474 microversion: 2.1 time: 0.297601 Oct 28 09:57:02.385674 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 908/1785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:02 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1474 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:02.406416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:02.407040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:02.414193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.414689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.415134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.415849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.416309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.416738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.444140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:02.444765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:02.451776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.452579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.453223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.454130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.454779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.455200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.534724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:02.543224 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-912924e6-81d8-4708-b50e-e1343ac8ce2f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1299 microversion: 2.1 time: 0.102958 Oct 28 09:57:02.544647 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 909/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:02 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:02.633849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:02.635553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:02.650895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.653655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.654395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.655602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.656698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:02.657488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.658371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.674587 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9e097c86-010a-4acf-b3df-f25efaaf553a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.271681 Oct 28 09:57:02.676063 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 878/1787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:02 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:02.828504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:02.829753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:02.854980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.854980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.855859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.857063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.857617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.858177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.898528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:02.899220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:02.899866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:02.900498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lazy-loading 'fault' on Instance uuid cc44a47e-3db8-4aaa-874f-56186e3092d1 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:02.972787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:02.978080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:02.986987 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f602b0e-ff75-44ca-b29f-52ef5aa78d18 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.357014 Oct 28 09:57:02.987619 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 910/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:02 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:02.997278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa6e855b62b646e7b7545432aa62afc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dea2fc789d4f4d47a08d92bfe8660de4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:03.002945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:03.003809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:03.011685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.012191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.012631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.013749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.014291 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-09720735-93e5-4dd6-bdf3-e110f30fa5d7 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 200 len: 1306 microversion: 2.1 time: 0.192213 Oct 28 09:57:03.014623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.015262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.015551 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 879/1789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:02 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 1306 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:03.052562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.053194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.053738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.054272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lazy-loading 'fault' on Instance uuid b43bf398-e1f4-4d70-a0f3-95206e038e24 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:03.113967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:03.125266 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfdc3bd1-8227-4a67-99f9-7a6f9223ba2b tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 200 len: 1303 microversion: 2.1 time: 0.128029 Oct 28 09:57:03.126583 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 911/1790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:02 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:03.421338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:03.433439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:03.447397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.448124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.448945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.450152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.451097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.453929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.489076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:03.567845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:03.568481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:03.591163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.592390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.593301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.601578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.602519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.603169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.782408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:03.802433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70f8acbf-fe21-44a4-bebe-a2cfac90688f tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1474 microversion: 2.1 time: 0.391860 Oct 28 09:57:03.818748 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 880/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:03 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1474 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:03.837143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:03.842760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-468ff4ac-8832-444b-8368-36d6c888302a req-5ded29b6-12e3-48a5-a6ba-899716fd2b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43bf398-e1f4-4d70-a0f3-95206e038e24", "name": "network-vif-deleted", "tag": "83e59ddf-79e4-4360-a974-08584405f59f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:03.859667 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b53dbc4-ff5f-4e67-8fc9-a7abf86f9eeb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.292699 Oct 28 09:57:03.861458 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 912/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:03 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:03.881845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:03.885881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:03.887565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-468ff4ac-8832-444b-8368-36d6c888302a req-5ded29b6-12e3-48a5-a6ba-899716fd2b48 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.890019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-468ff4ac-8832-444b-8368-36d6c888302a req-5ded29b6-12e3-48a5-a6ba-899716fd2b48 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.897701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-468ff4ac-8832-444b-8368-36d6c888302a req-5ded29b6-12e3-48a5-a6ba-899716fd2b48 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.908294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.908811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.912644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.913744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:03.916481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:03.917111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:03.961220 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-468ff4ac-8832-444b-8368-36d6c888302a req-5ded29b6-12e3-48a5-a6ba-899716fd2b48 service nova] Creating event network-vif-deleted:83e59ddf-79e4-4360-a974-08584405f59f for instance b43bf398-e1f4-4d70-a0f3-95206e038e24 on n-h1-zed-1 Oct 28 09:57:03.998151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-468ff4ac-8832-444b-8368-36d6c888302a req-5ded29b6-12e3-48a5-a6ba-899716fd2b48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176661 Oct 28 09:57:03.999283 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 881/1793] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:04.028113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.031867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:04.043938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.044756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.045419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.046525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.047620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.048260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.231249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:04.253401 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-55f4a0ff-4f7b-40ce-8051-da9b0136dfad tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.386634 Oct 28 09:57:04.269024 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 913/1794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:03 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:04.269024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.269024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] [instance: cc44a47e-3db8-4aaa-874f-56186e3092d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:04.279755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:04.281011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.281754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.282900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.284420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.284420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.284730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.288392 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4095a97e-5d26-4cf4-bdb0-5e2a90ca25ba tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.275151 Oct 28 09:57:04.292986 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 882/1795] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:04 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:04.294255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.294867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: b43bf398-e1f4-4d70-a0f3-95206e038e24] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:04.309952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.310935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.311581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.312376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.313119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.313723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.315118 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] HTTP exception thrown: Instance cc44a47e-3db8-4aaa-874f-56186e3092d1 could not be found. Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Request method failure captured: Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 HTTP/1.1 Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6dMjXoUKQnB1qL6dgJ-EEAljHIRN-6jMXDOZ5odPUOotEzdJlhFf_mExQ1YP0RfZuiuOVL9rRSntGviJezZ7QujPx7PhQGGKAqbVxcLDOr6JNkqNmjF1xlz1tP6UBEk5HCZ6Z7pWgWgjvogPHuWz5qsrJ2ZHmivSRBYhC3RdUfaHVM Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: dea2fc789d4f4d47a08d92bfe8660de4 Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerPasswordTestJSON-1648153410 Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:57:04.318714 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dea2fc789d4f4d47a08d92bfe8660de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dea2fc789d4f4d47a08d92bfe8660de4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dea2fc789d4f4d47a08d92bfe8660de4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dea2fc789d4f4d47a08d92bfe8660de4"}]}] Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerPasswordTestJSON-1648153410 Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: dea2fc789d4f4d47a08d92bfe8660de4 Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1648153410 Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerPasswordTestJSON-1648153410-project Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: aa6e855b62b646e7b7545432aa62afc8 Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerPasswordTestJSON-1648153410-project Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance cc44a47e-3db8-4aaa-874f-56186e3092d1 could not be found. Oct 28 09:57:04.320656 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'cc44a47e-3db8-4aaa-874f-56186e3092d1'} Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc44a47e-3db8-4aaa-874f-56186e3092d1 could not be found. Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:04.321768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc44a47e-3db8-4aaa-874f-56186e3092d1 could not be found. Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc44a47e-3db8-4aaa-874f-56186e3092d1 could not be found. Oct 28 09:57:04.324155 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.325809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] Returning 404 to user: Instance cc44a47e-3db8-4aaa-874f-56186e3092d1 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:04.325809 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f35ff8c7-c26a-4480-a286-a495ff18faf0 tempest-ServerPasswordTestJSON-1648153410 tempest-ServerPasswordTestJSON-1648153410-project] 10.222.0.16 "GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1" status: 404 len: 111 microversion: 2.1 time: 0.063048 Oct 28 09:57:04.340703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] HTTP exception thrown: Instance b43bf398-e1f4-4d70-a0f3-95206e038e24 could not be found. Oct 28 09:57:04.340999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 914/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:04 2022] GET /compute/v2.1/servers/cc44a47e-3db8-4aaa-874f-56186e3092d1 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Request method failure captured: Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 HTTP/1.1 Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6XMKmUsE7fw9VBuQiXIfRiplG14oVm1p18z2hYXrFwQeKxtf2Jx-KGcrdKSVgOgL3sNx0bXQ1HXg3VTGS40XSGiPp0oAZDb-up9SrMsFCuhetziMXW9ImJ-GqZJjKVHORludm4h7sN8NNA8o_-AHfwEEBXA8nW_BdWV6Rv_IsliNdk Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:57:04.343892 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_386a18c232b949b793bf7ec70ed3b6c9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/386a18c232b949b793bf7ec70ed3b6c9"}]}] Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-MigrationsAdminTest-825942653 Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-MigrationsAdminTest-825942653-project Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 9dc12014773b4f9fb34ff214c07d7f61 Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-MigrationsAdminTest-825942653-project Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance b43bf398-e1f4-4d70-a0f3-95206e038e24 could not be found. Oct 28 09:57:04.345813 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'b43bf398-e1f4-4d70-a0f3-95206e038e24'} Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43bf398-e1f4-4d70-a0f3-95206e038e24 could not be found. Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:04.346886 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43bf398-e1f4-4d70-a0f3-95206e038e24 could not be found. Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43bf398-e1f4-4d70-a0f3-95206e038e24 could not be found. Oct 28 09:57:04.348667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:04.350241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Returning 404 to user: Instance b43bf398-e1f4-4d70-a0f3-95206e038e24 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:04.350241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e767ce0-8688-497b-94fc-062de29e779d tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24" status: 404 len: 111 microversion: 2.1 time: 0.055683 Oct 28 09:57:04.351811 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 883/1797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:04 2022] GET /compute/v2.1/servers/b43bf398-e1f4-4d70-a0f3-95206e038e24 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:04.355415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.355991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:04.364612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.365534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.366117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.368103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.370399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.371148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.419031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:04.627269 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8617321-1ea0-4841-a829-666ec1af2bf2 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 204 len: 0 microversion: 2.1 time: 0.275577 Oct 28 09:57:04.628662 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 915/1798] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:04 2022] DELETE /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:04.639034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.640506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:04.647569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.648277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.648921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.649812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.651185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.651785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.776833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-509d27e0-fc94-49d0-979d-e9ea2ba75fc2 req-24a835b0-f194-49f6-8efc-e1ba68f26748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c22437-c39a-4889-bb0d-56bb97a135ea", "tag": "7e04bab9-b1e8-431c-b7c3-915d16d255fe"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:04.797153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-509d27e0-fc94-49d0-979d-e9ea2ba75fc2 req-24a835b0-f194-49f6-8efc-e1ba68f26748 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.797643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-509d27e0-fc94-49d0-979d-e9ea2ba75fc2 req-24a835b0-f194-49f6-8efc-e1ba68f26748 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.798917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-509d27e0-fc94-49d0-979d-e9ea2ba75fc2 req-24a835b0-f194-49f6-8efc-e1ba68f26748 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.812296 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-509d27e0-fc94-49d0-979d-e9ea2ba75fc2 req-24a835b0-f194-49f6-8efc-e1ba68f26748 service nova] Creating event network-changed:7e04bab9-b1e8-431c-b7c3-915d16d255fe for instance 40c22437-c39a-4889-bb0d-56bb97a135ea on n-h2-zed-1 Oct 28 09:57:04.817428 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-509d27e0-fc94-49d0-979d-e9ea2ba75fc2 req-24a835b0-f194-49f6-8efc-e1ba68f26748 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045021 Oct 28 09:57:04.818158 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 916/1799] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:04.852513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.853300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:04.860037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.860532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.861205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.862109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.862732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.863328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.871612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:04.880218 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6fbdbf52-1044-4fc1-8e6f-c2babf4ccebb tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1468 microversion: 2.1 time: 0.247306 Oct 28 09:57:04.881325 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 884/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:04 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1468 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:04.887282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:04.887888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:04.894502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.895293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.895914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.896825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.897470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.898080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.916995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:04.918038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:04.918727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:04.919408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lazy-loading 'fault' on Instance uuid a8fd254e-662a-4020-9421-b76fb300937d {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:05.014794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbd28dab6bef44c28e487a58cc99cb5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f80fef68c5b24dc8b5340141bc1f837d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:05.024130 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8efdb551-adce-4c23-aea1-3da5dc5d0c7d tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 200 len: 1308 microversion: 2.1 time: 0.175830 Oct 28 09:57:05.025284 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 917/1801] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:04 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 1308 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:05.059706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:05.070133 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-36cffad1-af91-481d-b49b-760fc76a0fec tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.187399 Oct 28 09:57:05.070729 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 885/1802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:04 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:05.281461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:05.282732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:05.294149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:05.295429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:05.296332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:05.297826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:05.298808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:05.299709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:05.314323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:05.315215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:05.322880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:05.323752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:05.324423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:05.325350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:05.325983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:05.326607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:05.537248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:05.547913 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e3825408-45c5-4e58-bc6c-5fa4b3eae9d8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.237605 Oct 28 09:57:05.548632 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 886/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:05 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:05.910319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-85f1b0ca-db4c-448c-a707-c87d7feaae0d req-61be7e69-e759-4a7d-9d09-0e602ed41481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b164-bda6-4231-a396-be286a5310eb", "name": "network-vif-unplugged", "status": "completed", "tag": "f6376f13-2a79-40aa-bfb5-de1526dc5507"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:05.931126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-85f1b0ca-db4c-448c-a707-c87d7feaae0d req-61be7e69-e759-4a7d-9d09-0e602ed41481 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:05.932169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-85f1b0ca-db4c-448c-a707-c87d7feaae0d req-61be7e69-e759-4a7d-9d09-0e602ed41481 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:05.933111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-85f1b0ca-db4c-448c-a707-c87d7feaae0d req-61be7e69-e759-4a7d-9d09-0e602ed41481 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:05.947235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:05.952775 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-85f1b0ca-db4c-448c-a707-c87d7feaae0d req-61be7e69-e759-4a7d-9d09-0e602ed41481 service nova] Creating event network-vif-unplugged:f6376f13-2a79-40aa-bfb5-de1526dc5507 for instance 1b81b164-bda6-4231-a396-be286a5310eb on n-h1-zed-1 Oct 28 09:57:05.959744 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a86f54c-93e9-4de0-a91a-657a23d9158c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.684666 Oct 28 09:57:05.960212 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-85f1b0ca-db4c-448c-a707-c87d7feaae0d req-61be7e69-e759-4a7d-9d09-0e602ed41481 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061836 Oct 28 09:57:05.960700 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 918/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:05 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:05.961546 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 887/1805] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:05.983509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:05.984473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:05.991157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:05.991951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:05.992577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:05.993644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:05.994307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:05.995056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:06.048018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:06.048716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] [instance: a8fd254e-662a-4020-9421-b76fb300937d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:06.056124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:06.057194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:06.057623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:06.058560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:06.059026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:06.059445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:06.075150 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] HTTP exception thrown: Instance a8fd254e-662a-4020-9421-b76fb300937d could not be found. Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Request method failure captured: Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d HTTP/1.1 Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ap9PO0RG7loV8upvIObPaehG4qi4QAsOAZNe5XJgOfa-xaoNXvpFVpnswVYhmiPsl75c2kxcF4T9P_Gw1WOds38Nf4mYjQcy4EBYOJq7KVnHrxHcJy50FKdz0_9z0-0TjgvNP3O-eMNx8s3R-fj-izKa4uZRmB3Yx4zSV6WnIIqEo Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: f80fef68c5b24dc8b5340141bc1f837d Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListImageFiltersTestJSON-1984425338 Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:57:06.076805 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f80fef68c5b24dc8b5340141bc1f837d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/f80fef68c5b24dc8b5340141bc1f837d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_f80fef68c5b24dc8b5340141bc1f837d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/f80fef68c5b24dc8b5340141bc1f837d"}]}] Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListImageFiltersTestJSON-1984425338 Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: f80fef68c5b24dc8b5340141bc1f837d Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1984425338 Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListImageFiltersTestJSON-1984425338-project Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: dbd28dab6bef44c28e487a58cc99cb5c Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListImageFiltersTestJSON-1984425338-project Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a8fd254e-662a-4020-9421-b76fb300937d could not be found. Oct 28 09:57:06.078705 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a8fd254e-662a-4020-9421-b76fb300937d'} Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8fd254e-662a-4020-9421-b76fb300937d could not be found. Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:06.079571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8fd254e-662a-4020-9421-b76fb300937d could not be found. Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8fd254e-662a-4020-9421-b76fb300937d could not be found. Oct 28 09:57:06.081225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:06.083314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Returning 404 to user: Instance a8fd254e-662a-4020-9421-b76fb300937d could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:06.083314 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-606c11bf-68d0-4490-bcd5-60ef3032385b tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d" status: 404 len: 111 microversion: 2.1 time: 0.034418 Oct 28 09:57:06.083314 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 888/1806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:06 2022] GET /compute/v2.1/servers/a8fd254e-662a-4020-9421-b76fb300937d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:57:06.085507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-72749eca-fd27-4bc4-80c7-0b64f2d6b6ff req-735e9d9e-baa9-4407-ad39-bdbe27f3a116 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8fd254e-662a-4020-9421-b76fb300937d", "name": "network-vif-deleted", "tag": "a53f8536-805c-4547-b056-8cc4428c8aba"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:06.094931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-72749eca-fd27-4bc4-80c7-0b64f2d6b6ff req-735e9d9e-baa9-4407-ad39-bdbe27f3a116 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:06.095408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-72749eca-fd27-4bc4-80c7-0b64f2d6b6ff req-735e9d9e-baa9-4407-ad39-bdbe27f3a116 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:06.095833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-72749eca-fd27-4bc4-80c7-0b64f2d6b6ff req-735e9d9e-baa9-4407-ad39-bdbe27f3a116 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:06.107715 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-72749eca-fd27-4bc4-80c7-0b64f2d6b6ff req-735e9d9e-baa9-4407-ad39-bdbe27f3a116 service nova] Creating event network-vif-deleted:a53f8536-805c-4547-b056-8cc4428c8aba for instance a8fd254e-662a-4020-9421-b76fb300937d on n-h2-zed-1 Oct 28 09:57:06.112555 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-72749eca-fd27-4bc4-80c7-0b64f2d6b6ff req-735e9d9e-baa9-4407-ad39-bdbe27f3a116 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030760 Oct 28 09:57:06.113191 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 889/1807] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:06.118207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4789bf85-8869-4cc5-814f-1d71c8f0adcc tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca32fd9dc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:06.390257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:06.399205 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b612b8a-879f-4af4-9086-675d5339c7cd tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1468 microversion: 2.1 time: 0.424881 Oct 28 09:57:06.399795 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 919/1808] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:05 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1468 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:06.405042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:06.405970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:06.412972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:06.413768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:06.414399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:06.415338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:06.416645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:06.417145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:06.459632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4789bf85-8869-4cc5-814f-1d71c8f0adcc tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/images/81e273d4-88a6-41a5-8177-4d7cbe124511" status: 204 len: 0 microversion: 2.1 time: 0.345216 Oct 28 09:57:06.460201 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 890/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:06 2022] DELETE /compute/v2.1/images/81e273d4-88a6-41a5-8177-4d7cbe124511 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:06.469358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45ffb48e-e422-40e3-a9c8-1dfb522fe6c7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca330b0310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:06.723304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:06.734923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f53a429-c9a1-43ce-81cc-7da230c49373 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.333724 Oct 28 09:57:06.735611 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 920/1810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:06 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:06.736314 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45ffb48e-e422-40e3-a9c8-1dfb522fe6c7 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/images/cfa1019c-3456-498f-a0d7-ecea518f879e" status: 204 len: 0 microversion: 2.1 time: 0.271406 Oct 28 09:57:06.737553 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 891/1811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:06 2022] DELETE /compute/v2.1/images/cfa1019c-3456-498f-a0d7-ecea518f879e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:57:06.744890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:06.745536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:06.747261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d59ac368-2ab0-4146-acea-1124d2461bd5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] Calling method '.version_select at 0x7fca33055310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:06.752302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:06.753195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:06.753811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:06.754748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:06.755215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:06.755648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.042193 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d59ac368-2ab0-4146-acea-1124d2461bd5 tempest-ListImageFiltersTestJSON-1984425338 tempest-ListImageFiltersTestJSON-1984425338-project] 10.222.0.16 "DELETE /compute/v2.1/images/ce50a6d2-1a90-4df0-bcc8-33f9774ba089" status: 204 len: 0 microversion: 2.1 time: 0.300160 Oct 28 09:57:07.042781 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 892/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:06 2022] DELETE /compute/v2.1/images/ce50a6d2-1a90-4df0-bcc8-33f9774ba089 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:57:07.054111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:07.054891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:07.070245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:07.072335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:07.072890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:07.073411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.074223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:07.074681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:07.075117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.111308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:07.120620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-141d2ab3-edee-44c7-8203-82ddaee1dc83 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.383641 Oct 28 09:57:07.121240 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 921/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:06 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:07.317706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:07.331653 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c70415b-940e-4028-9196-be9e861f21e2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.287704 Oct 28 09:57:07.333183 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 893/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:07 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:07.432318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:07.434703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:07.460532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:07.471241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:07.502555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:07.505616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:07.510850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.515484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:07.518586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:07.520542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.759405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:07.760684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:07.780233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:07.781153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:07.782243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.783793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:07.784964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:07.785993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.839633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:07.931500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:07.933147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:07.933778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:07.934500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lazy-loading 'fault' on Instance uuid 1b81b164-bda6-4231-a396-be286a5310eb {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:08.011276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9dc12014773b4f9fb34ff214c07d7f61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '386a18c232b949b793bf7ec70ed3b6c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:08.024270 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0dcda96e-2cdf-4592-a801-3e454152ecd4 tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 200 len: 1303 microversion: 2.1 time: 0.601792 Oct 28 09:57:08.038124 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 922/1815] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:07 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 1303 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:08.095979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:08.107527 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-deffddce-be9e-4d8c-b551-8e91c9666fcb tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.351725 Oct 28 09:57:08.108370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 894/1816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:07 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:08.152255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:08.153018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:08.167064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:08.168253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:08.169583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:08.171772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:08.173424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:08.173956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:08.193239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e9f100b8-1684-4063-9b8d-462a6ddddb6f req-b39860dd-e4f8-4d3e-99dc-ceb990a88624 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b81b164-bda6-4231-a396-be286a5310eb", "name": "network-vif-deleted", "tag": "f6376f13-2a79-40aa-bfb5-de1526dc5507"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:08.225024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9f100b8-1684-4063-9b8d-462a6ddddb6f req-b39860dd-e4f8-4d3e-99dc-ceb990a88624 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:08.226687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9f100b8-1684-4063-9b8d-462a6ddddb6f req-b39860dd-e4f8-4d3e-99dc-ceb990a88624 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:08.228453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9f100b8-1684-4063-9b8d-462a6ddddb6f req-b39860dd-e4f8-4d3e-99dc-ceb990a88624 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:08.251205 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e9f100b8-1684-4063-9b8d-462a6ddddb6f req-b39860dd-e4f8-4d3e-99dc-ceb990a88624 service nova] Creating event network-vif-deleted:f6376f13-2a79-40aa-bfb5-de1526dc5507 for instance 1b81b164-bda6-4231-a396-be286a5310eb on n-h1-zed-1 Oct 28 09:57:08.258698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e9f100b8-1684-4063-9b8d-462a6ddddb6f req-b39860dd-e4f8-4d3e-99dc-ceb990a88624 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083548 Oct 28 09:57:08.260669 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 895/1817] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:08.361657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:08.362685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:08.373331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:08.373825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:08.377365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:08.378159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:08.378647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:08.379089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:08.499490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:08.521967 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e52286f8-19b0-4ac6-890c-cbd19285999c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.375479 Oct 28 09:57:08.526160 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 923/1818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:08 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:08.592667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:08.605257 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc645bb6-046b-4134-aea6-8b2666abdb85 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.249113 Oct 28 09:57:08.607010 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 896/1819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:08 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:09.051933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:09.052947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] [instance: 1b81b164-bda6-4231-a396-be286a5310eb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:09.060539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:09.061334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:09.062031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:09.063167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:09.063861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:09.064847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:09.082448 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] HTTP exception thrown: Instance 1b81b164-bda6-4231-a396-be286a5310eb could not be found. Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Request method failure captured: Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb HTTP/1.1 Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6XMKmUsE7fw9VBuQiXIfRiplG14oVm1p18z2hYXrFwQeKxtf2Jx-KGcrdKSVgOgL3sNx0bXQ1HXg3VTGS40XSGiPp0oAZDb-up9SrMsFCuhetziMXW9ImJ-GqZJjKVHORludm4h7sN8NNA8o_-AHfwEEBXA8nW_BdWV6Rv_IsliNdk Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:57:09.084645 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/386a18c232b949b793bf7ec70ed3b6c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_386a18c232b949b793bf7ec70ed3b6c9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/386a18c232b949b793bf7ec70ed3b6c9"}]}] Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-MigrationsAdminTest-825942653 Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 386a18c232b949b793bf7ec70ed3b6c9 Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-MigrationsAdminTest-825942653 Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-MigrationsAdminTest-825942653-project Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 9dc12014773b4f9fb34ff214c07d7f61 Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-MigrationsAdminTest-825942653-project Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 1b81b164-bda6-4231-a396-be286a5310eb could not be found. Oct 28 09:57:09.086209 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1b81b164-bda6-4231-a396-be286a5310eb'} Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b81b164-bda6-4231-a396-be286a5310eb could not be found. Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:09.087061 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b81b164-bda6-4231-a396-be286a5310eb could not be found. Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b81b164-bda6-4231-a396-be286a5310eb could not be found. Oct 28 09:57:09.090038 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:57:09.093498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] Returning 404 to user: Instance 1b81b164-bda6-4231-a396-be286a5310eb could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:09.094604 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-076e6cfc-a3aa-43f0-8af7-d20d366026df tempest-MigrationsAdminTest-825942653 tempest-MigrationsAdminTest-825942653-project] 10.222.0.16 "GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb" status: 404 len: 111 microversion: 2.1 time: 0.046942 Oct 28 09:57:09.095702 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 924/1820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:09 2022] GET /compute/v2.1/servers/1b81b164-bda6-4231-a396-be286a5310eb => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:09.147630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:09.156817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:09.188543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:09.189078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:09.193361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:09.194751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:09.198832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:09.201484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:09.940005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29c6eee8-928b-475e-af7a-c687f5f08c49 tempest-ListImagesTestJSON-98898317 tempest-ListImagesTestJSON-98898317-project] Calling method '.version_select at 0x7fca32b93160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.014647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29c6eee8-928b-475e-af7a-c687f5f08c49 tempest-ListImagesTestJSON-98898317 tempest-ListImagesTestJSON-98898317-project] 10.222.0.16 "GET /compute/v2.1/images/c7ac23d6-0e32-4a44-9d15-3c8a5df377c1" status: 200 len: 784 microversion: 2.1 time: 0.579108 Oct 28 09:57:10.024838 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 925/1821] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:57:09 2022] GET /compute/v2.1/images/c7ac23d6-0e32-4a44-9d15-3c8a5df377c1 => generated 784 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:10.025287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:10.025426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.025426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:10.033541 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b1b739e-698d-4e94-96d0-ceeb56218d3f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.896873 Oct 28 09:57:10.041901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:10.042540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:10.043002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:10.043757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:10.044224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:10.044657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:10.047207 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 897/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:09 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:10.059768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.060527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:10.080811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:10.081353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:10.081782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:10.082508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:10.088614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:10.089254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:10.320118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:10.330358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-701f2540-9a27-4c81-a930-043faf6a696a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.313573 Oct 28 09:57:10.330871 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 926/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:10 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:10.347952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:10.363927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49bd3d2c-a2fd-4416-8c58-2dbfb6504dc6 tempest-ListImagesTestJSON-98898317 tempest-ListImagesTestJSON-98898317-project] Calling method '.version_select at 0x7fca32b931f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.370451 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d67f1d2-8434-42b7-bb15-9e6b61d8c0fd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.318351 Oct 28 09:57:10.381948 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 898/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:10 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:10.459771 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49bd3d2c-a2fd-4416-8c58-2dbfb6504dc6 tempest-ListImagesTestJSON-98898317 tempest-ListImagesTestJSON-98898317-project] 10.222.0.16 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.127619 Oct 28 09:57:10.460720 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 927/1825] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 09:57:10 2022] GET /compute/v2.1/images => generated 871 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:10.480061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a76d65a2-8686-47c3-b309-98dbe3e60083 tempest-ListImagesTestJSON-98898317 tempest-ListImagesTestJSON-98898317-project] Calling method '.version_select at 0x7fca33030670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:10.563379 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a76d65a2-8686-47c3-b309-98dbe3e60083 tempest-ListImagesTestJSON-98898317 tempest-ListImagesTestJSON-98898317-project] 10.222.0.16 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.087695 Oct 28 09:57:10.563988 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 899/1826] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:57:10 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:11.065485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:11.066106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:11.074538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:11.075038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:11.075484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:11.079823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:11.080323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:11.080927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:11.312256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:11.319396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:11.323538 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85ff1c80-17e3-46ab-9627-37693d8d3fed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.262055 Oct 28 09:57:11.325613 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 928/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:11 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:11.362161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:11.362876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:11.371595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:11.372509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:11.373223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:11.374105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:11.374838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:11.375465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:11.403192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:11.403192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:11.412140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:11.412637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:11.416445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:11.417498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:11.420300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:11.420737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:11.630005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:11.639077 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92886411-648e-425e-b75f-78c437635512 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.288330 Oct 28 09:57:11.639825 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 900/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:11 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:11.735085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:11.773172 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f24be9d-9c18-42aa-8564-c3d9a09fd325 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.375992 Oct 28 09:57:11.776072 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 929/1829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:11 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:12.331845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d690ca8f-4a0e-43f8-8954-b6fea74d829a req-4dec76a0-bdec-4fa3-947e-4f6b659136fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c22437-c39a-4889-bb0d-56bb97a135ea", "name": "network-vif-plugged", "status": "completed", "tag": "7e04bab9-b1e8-431c-b7c3-915d16d255fe"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:12.347761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:12.349268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:12.364259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d690ca8f-4a0e-43f8-8954-b6fea74d829a req-4dec76a0-bdec-4fa3-947e-4f6b659136fc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:12.367052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:12.367846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:12.368662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d690ca8f-4a0e-43f8-8954-b6fea74d829a req-4dec76a0-bdec-4fa3-947e-4f6b659136fc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:12.369927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:12.370589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d690ca8f-4a0e-43f8-8954-b6fea74d829a req-4dec76a0-bdec-4fa3-947e-4f6b659136fc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:12.374276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:12.374947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:12.376884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:12.404660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d690ca8f-4a0e-43f8-8954-b6fea74d829a req-4dec76a0-bdec-4fa3-947e-4f6b659136fc service nova] Creating event network-vif-plugged:7e04bab9-b1e8-431c-b7c3-915d16d255fe for instance 40c22437-c39a-4889-bb0d-56bb97a135ea on n-h2-zed-1 Oct 28 09:57:12.418891 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d690ca8f-4a0e-43f8-8954-b6fea74d829a req-4dec76a0-bdec-4fa3-947e-4f6b659136fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085526 Oct 28 09:57:12.419962 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 901/1830] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:12.639719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:12.659371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a0c6332-2104-4f7f-a6fe-59c65dc0b006 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.315565 Oct 28 09:57:12.662697 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 930/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:12 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:12.665266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:12.666818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:12.674644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:12.675544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:12.676133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:12.677187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:12.677747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:12.678385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:12.798771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:12.799761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:12.806265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:12.807025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:12.807468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:12.808179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:12.808817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:12.809273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:12.866491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:12.879559 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e3a0169-6a4c-4a96-8604-d82a9bf2305a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.218988 Oct 28 09:57:12.892986 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 902/1832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:12 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:12.963790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:12.974013 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b05ded4-7f4f-4b1d-96c5-0b7b39c32bb7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.179046 Oct 28 09:57:12.974591 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 931/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:12 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:13.570187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1312265378", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": "none"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:13.601464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28551261-3972-4383-9190-0767e5a97337 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca33877310>, body: {"keypair": {"name": "tempest-keypair-1671283601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLq7SEGo76YZ28dEOS+oIQKdO1/6+isGdUDKr9o2Mz6+/8/wvKfb6TAvBakJ9Uob3yNwy/0uNpIsjkSw6V3eeQbmUj2rGBS1mBmU2HhDEpOjA+nQDsfgEoBA3VEctpBs7A=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:13.618066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-28551261-3972-4383-9190-0767e5a97337 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:13.631050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-28551261-3972-4383-9190-0767e5a97337 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:13.631506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:13.632048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:13.632533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:13.633013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:13.633434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:13.644018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:13.644512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:13.644989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:13.645733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:13.646199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:13.646631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:13.658936 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28551261-3972-4383-9190-0767e5a97337 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.201888 Oct 28 09:57:13.659849 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 932/1834] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 09:57:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 203 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:57:13.664656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Getting quotas for project 0710c69d87dc4f7fa6999e314efc8022. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:13.670876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Getting quotas for user f9ad41b36abd4eb8945f3ec85ce8f5a5 and project 0710c69d87dc4f7fa6999e314efc8022. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:13.671931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8281d370-18d8-48d2-92fc-30df2d2379e6 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32b83820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:13.684128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8281d370-18d8-48d2-92fc-30df2d2379e6 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1671283601" status: 200 len: 513 microversion: 2.2 time: 0.016483 Oct 28 09:57:13.684784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:57:13.687349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:57:13.689038 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 933/1835] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Oct 28 09:57:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1671283601 => generated 513 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:13.694474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:13.695089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:13.701459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:13.701951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:13.702390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:13.703254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:13.703721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:13.704155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:13.737920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5728753e-4602-4f34-9f41-921bab0604e8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.288812 Oct 28 09:57:13.738695 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 903/1836] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:57:13.743704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bf618d3-9a72-4ee3-b357-d79d0773a34e tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32f9f9d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:13.768417 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bf618d3-9a72-4ee3-b357-d79d0773a34e tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671283601" status: 204 len: 0 microversion: 2.2 time: 0.028507 Oct 28 09:57:13.769752 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 904/1837] 10.222.0.16 () {60 vars in 1261 bytes} [Fri Oct 28 09:57:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671283601 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:13.785261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92178311-421a-41b1-9df4-2b7b86e30acc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:13.786516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92178311-421a-41b1-9df4-2b7b86e30acc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:13.914219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92178311-421a-41b1-9df4-2b7b86e30acc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:13.924431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92178311-421a-41b1-9df4-2b7b86e30acc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:13.933389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92178311-421a-41b1-9df4-2b7b86e30acc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:13.934787 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92178311-421a-41b1-9df4-2b7b86e30acc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67" status: 200 len: 1278 microversion: 2.47 time: 0.163898 Oct 28 09:57:13.935288 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 905/1838] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:13 2022] GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:13.940414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c14b94cc-ae66-4678-b564-708facedded3 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca32f980d0>, body: {"keypair": {"name": "tempest-keypair-1809085520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORIsirWuzPDi7n04N+k4iTKr6Lvv9RV44/6WnknMYY9vT/J3/hJ6kw3PYRAYUrkuZUyG2dmCyCj5f3kI+ArS6VVhPHS0GVKErmVYa+eiSkOskorsAt9uVgvLQs0ncCR/g=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:13.974252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c14b94cc-ae66-4678-b564-708facedded3 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:13.986011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:13.991042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c14b94cc-ae66-4678-b564-708facedded3 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:13.996345 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1353a61f-a1db-4297-9cdd-62cd304c9e31 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1366 microversion: 2.1 time: 0.306111 Oct 28 09:57:14.002848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 934/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:13 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:14.023743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:14.025013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:14.039339 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c14b94cc-ae66-4678-b564-708facedded3 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.102374 Oct 28 09:57:14.050109 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 906/1840] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 09:57:13 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:57:14.055680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:14.055890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:14.056722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:14.061053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:14.061707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:14.062470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:14.062937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:14.063361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:14.064210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:14.064891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:14.065561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:14.066532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:14.067174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:14.067616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:14.254597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:14.265220 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7b885d6-ee3e-4efe-93f9-74604a86116b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.213396 Oct 28 09:57:14.268105 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 907/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:14 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:14.274436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02809243-41a2-461d-8897-ff3481d58470 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32fb8e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:14.288994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:14.299175 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4990e77-7969-4b74-b56b-4c957fb1bbed tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.294264 Oct 28 09:57:14.300151 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 935/1842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:14 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:14.307509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02809243-41a2-461d-8897-ff3481d58470 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809085520" status: 204 len: 0 microversion: 2.2 time: 0.036682 Oct 28 09:57:14.308592 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 908/1843] 10.222.0.16 () {60 vars in 1261 bytes} [Fri Oct 28 09:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809085520 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:14.317914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1959296059", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": "none"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:14.407045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:14.407610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:14.408206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:14.409270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:14.409803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:14.420297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:14.421071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:14.421796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:14.422522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:14.423092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:14.423639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:14.449193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Getting quotas for project 0710c69d87dc4f7fa6999e314efc8022. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:14.460062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Getting quotas for user f9ad41b36abd4eb8945f3ec85ce8f5a5 and project 0710c69d87dc4f7fa6999e314efc8022. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:14.481183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4aca3438-8bbf-4e08-8ff6-0b737167ccb4 tempest-NetworksTest-111484930 tempest-NetworksTest-111484930-project-admin] Calling method '.version_select at 0x7fca32b93040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:14.491751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:57:14.494121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:57:14.542902 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40043518-18f7-495a-ae4e-eb32e5addee8 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.232898 Oct 28 09:57:14.543991 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 909/1844] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:57:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 234 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:57:14.549389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d81c58ac-c21a-40fb-bda4-acfc13b15533 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca32ffe670>, body: {"keypair": {"name": "tempest-keypair-1676067430", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:14.571543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-d81c58ac-c21a-40fb-bda4-acfc13b15533 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:14.587284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-d81c58ac-c21a-40fb-bda4-acfc13b15533 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:14.625453 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d81c58ac-c21a-40fb-bda4-acfc13b15533 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.079578 Oct 28 09:57:14.626285 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 910/1845] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 09:57:14 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:57:14.632052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72ad91a6-f958-403b-8024-f41fce29466c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:14.636569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72ad91a6-f958-403b-8024-f41fce29466c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:14.689190 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72ad91a6-f958-403b-8024-f41fce29466c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "PUT /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 992 microversion: 2.47 time: 0.060816 Oct 28 09:57:14.690457 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 911/1846] 10.222.0.16 () {62 vars in 1297 bytes} [Fri Oct 28 09:57:14 2022] PUT /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 992 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:57:14.695616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70cdb9c5-b175-4ae3-8ae7-d89a93ea9565 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32fb60d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:14.731735 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70cdb9c5-b175-4ae3-8ae7-d89a93ea9565 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676067430" status: 204 len: 0 microversion: 2.2 time: 0.039821 Oct 28 09:57:14.735147 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 912/1847] 10.222.0.16 () {60 vars in 1261 bytes} [Fri Oct 28 09:57:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1676067430 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:14.744801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57aab8d6-8936-4a03-b642-39bd2e6cf3ff tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:14.745531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-57aab8d6-8936-4a03-b642-39bd2e6cf3ff tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:14.747567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:14.900135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57aab8d6-8936-4a03-b642-39bd2e6cf3ff tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:14.910336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57aab8d6-8936-4a03-b642-39bd2e6cf3ff tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:14.920397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57aab8d6-8936-4a03-b642-39bd2e6cf3ff tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:14.925907 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57aab8d6-8936-4a03-b642-39bd2e6cf3ff tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1278 microversion: 2.47 time: 0.186567 Oct 28 09:57:14.926436 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 913/1848] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:14 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:14.951051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf83b248-7cf2-4e3e-a399-91d27fd9196b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca32f8cf70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-217507202", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGPicSYH9h8JUcKxS+4ZHa2mKq2+A93sLi6hRmVhPLARtPPQxV0nn5KxXUBQ340rp4StLqA8IenKpBpWGB1kccolu5658h5TzMOLvBmWHnkPOs65pbO89aplJ9K55oQJdw=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:14.999323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cf83b248-7cf2-4e3e-a399-91d27fd9196b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:15.008281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cf83b248-7cf2-4e3e-a399-91d27fd9196b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:15.047872 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf83b248-7cf2-4e3e-a399-91d27fd9196b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.112534 Oct 28 09:57:15.049219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 914/1849] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 09:57:14 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:57:15.063079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.064453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:15.082717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.083684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.084358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.085336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.086028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.086684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.216450 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4aca3438-8bbf-4e08-8ff6-0b737167ccb4 tempest-NetworksTest-111484930 tempest-NetworksTest-111484930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 7422 microversion: 2.1 time: 0.914763 Oct 28 09:57:15.220530 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 936/1850] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:57:14 2022] GET /compute/v2.1/os-networks => generated 7422 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:15.225375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1095021-8507-4dab-a99b-f002a6c51f52 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca32b78040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-659174031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7gh0/kkGWF/kDsCK/BrwUtnOAM4H4FAmqpHM6Mv5PvvhAYO5GrC0AgNTFu+5LE+1Mc9JGU4kgfWB8DIbTP2KnZAN9Emst7cCtnERkgmioejE+dVVseXSyS1+Mp342uQw=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:15.242906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e1095021-8507-4dab-a99b-f002a6c51f52 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:15.250946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e1095021-8507-4dab-a99b-f002a6c51f52 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:15.286784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:15.297069 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07cae254-35ec-4ef4-90af-5a1a5cc7543d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1557 microversion: 2.1 time: 0.246351 Oct 28 09:57:15.298515 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1095021-8507-4dab-a99b-f002a6c51f52 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.076434 Oct 28 09:57:15.300599 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 937/1851] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 09:57:15 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 79 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:57:15.307234 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 915/1852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1557 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:15.314866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc096546-4d5b-4faa-ad96-a079c6c50f98 tempest-NetworksTest-111484930 tempest-NetworksTest-111484930-project-admin] Calling method '.version_select at 0x7fca32bfe280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.320312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.321348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:15.334447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.335208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.335904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.337022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.337936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.338989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.365638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:15.485636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:15.495270 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a02879fe-3682-4006-991d-886a0186f555 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1717 microversion: 2.1 time: 0.186318 Oct 28 09:57:15.495872 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 916/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1717 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:15.500475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-766ab73d-d927-4357-a0ad-5d07ec35fb47 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca33055040>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1289827600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+kkl3YBIWT6dC7WlnucPCjGYnFz2rRThYXeuc1h6MOMETNo1U1CF9MtZWEJwavE3/JGAlm/uG46sBbgjxiyiYJVioCWjWgmCnMh3LZ1g7kRY5/LLH5ws9OO+yZgDN6OA=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:15.514193 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc096546-4d5b-4faa-ad96-a079c6c50f98 tempest-NetworksTest-111484930 tempest-NetworksTest-111484930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks/9db80090-5c04-405d-b3ea-0727931e1e52" status: 200 len: 652 microversion: 2.1 time: 0.212071 Oct 28 09:57:15.515272 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 938/1854] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/os-networks/9db80090-5c04-405d-b3ea-0727931e1e52 => generated 652 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:15.516925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-766ab73d-d927-4357-a0ad-5d07ec35fb47 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:15.520764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.521303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:15.523723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-766ab73d-d927-4357-a0ad-5d07ec35fb47 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:15.528570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.529145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.529895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.530786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.531243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.532006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.550905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-766ab73d-d927-4357-a0ad-5d07ec35fb47 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.053710 Oct 28 09:57:15.551643 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 917/1855] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 09:57:15 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:57:15.556805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.557466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:15.563731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.564223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.564660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.565387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.566024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.566455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.628531 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-64a15529-053c-4348-b60a-5e64789ed88d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111931 Oct 28 09:57:15.629225 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 939/1856] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-interface => generated 285 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:15.633980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2b74d05-a661-46c9-97a5-487ef02a14be tempest-NetworksTest-111484930 tempest-NetworksTest-111484930-project-admin] Calling method '.version_select at 0x7fca32b52700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.731668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:15.746562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6fbcfe75-6c48-438f-b887-ca00cdba81c3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.192219 Oct 28 09:57:15.747771 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 918/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:15.756718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b158958-24f8-48c1-8b56-dabc833e9af2 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca3301b160>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.763424 n-d-zed-1 devstack@n-api.service[128747]: WARNING oslo_db.sqlalchemy.utils [None req-8b158958-24f8-48c1-8b56-dabc833e9af2 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 09:57:15.772014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b158958-24f8-48c1-8b56-dabc833e9af2 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.021305 Oct 28 09:57:15.772749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 919/1858] 10.222.0.16 () {60 vars in 1177 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:15.785735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b33d79c-3e29-4877-91d3-35611a36d86b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32fb63a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.820696 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b33d79c-3e29-4877-91d3-35611a36d86b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1289827600" status: 204 len: 0 microversion: 2.2 time: 0.040062 Oct 28 09:57:15.821509 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 920/1859] 10.222.0.16 () {60 vars in 1321 bytes} [Fri Oct 28 09:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1289827600 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:15.829611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98acd1aa-27fe-484a-92ed-0d339a033f7c tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca33055280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.857574 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98acd1aa-27fe-484a-92ed-0d339a033f7c tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-659174031" status: 204 len: 0 microversion: 2.2 time: 0.031616 Oct 28 09:57:15.858537 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 921/1860] 10.222.0.16 () {60 vars in 1318 bytes} [Fri Oct 28 09:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-659174031 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:57:15.866828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea0336e7-ea3d-4da3-b7fa-65da449de22c tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32fb8700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.917105 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea0336e7-ea3d-4da3-b7fa-65da449de22c tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-217507202" status: 204 len: 0 microversion: 2.2 time: 0.054200 Oct 28 09:57:15.925134 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 922/1861] 10.222.0.16 () {60 vars in 1318 bytes} [Fri Oct 28 09:57:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-217507202 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:57:15.933900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a92eda82-d5c2-47a8-9ec9-16d30795380a tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca32f999d0>, body: {"keypair": {"name": "tempest-keypair-515386848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZwsGrOVQPns0HWfy9uKbGAyH5yzEi3zSdnNqXasoO3PQq2SM8Xz27jQeMtKKBLR3ZIZXouXPH4bznmY38PKq8LBIpqsU4yz4IDd7Zed6t7UAnChI776gVFn4k1gwqUEA=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:15.953092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a92eda82-d5c2-47a8-9ec9-16d30795380a tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:15.958193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a92eda82-d5c2-47a8-9ec9-16d30795380a tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:15.959355 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2b74d05-a661-46c9-97a5-487ef02a14be tempest-NetworksTest-111484930 tempest-NetworksTest-111484930-project-admin] 10.222.0.16 "GET /compute/v2.1/os-networks" status: 200 len: 7422 microversion: 2.1 time: 0.328797 Oct 28 09:57:15.960173 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 940/1862] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/os-networks => generated 7422 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:15.966632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:15.968450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:15.976444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.977872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.978833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.979640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:15.980478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:15.981043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:15.987197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a92eda82-d5c2-47a8-9ec9-16d30795380a tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.060058 Oct 28 09:57:15.988676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 923/1863] 10.222.0.16 () {62 vars in 1199 bytes} [Fri Oct 28 09:57:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 28 09:57:16.005048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3921602-c8a0-438e-83d0-d238e23ac471 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32fa8670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.039243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3921602-c8a0-438e-83d0-d238e23ac471 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-515386848" status: 200 len: 512 microversion: 2.2 time: 0.043327 Oct 28 09:57:16.048053 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 924/1864] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-515386848 => generated 512 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:16.053477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0de8446-56c8-494b-9d86-ff51293f1c6f tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32f99040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.057770 n-d-zed-1 devstack@n-api.service[128747]: WARNING oslo_db.sqlalchemy.utils [None req-f0de8446-56c8-494b-9d86-ff51293f1c6f tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 09:57:16.065510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0de8446-56c8-494b-9d86-ff51293f1c6f tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 369 microversion: 2.2 time: 0.015952 Oct 28 09:57:16.066297 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 925/1865] 10.222.0.16 () {60 vars in 1177 bytes} [Fri Oct 28 09:57:16 2022] GET /compute/v2.1/os-keypairs => generated 369 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:16.078496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d505b777-cc8f-4b34-bb5d-c12643bde636 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32f8c670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.119932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d505b777-cc8f-4b34-bb5d-c12643bde636 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-515386848" status: 204 len: 0 microversion: 2.2 time: 0.045257 Oct 28 09:57:16.121262 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 926/1866] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Oct 28 09:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-515386848 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:16.130685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Action: 'create', calling method: .version_select at 0x7fca32ffeb80>, body: {"keypair": {"name": "tempest-keypair-759337777", "type": "x509"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:16.149438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:16.155310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:16.172368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.processutils [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpb_2ohkto/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpb_2ohkto/temp.key -subj /CN=9011f5f137dc4e9184519490d1b86409 -extensions v3_req_client {{(pid=128747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 09:57:16.183561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:16.192696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:16.194532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:16.195924 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dca70a5e-d6b6-468d-a7c5-b1a8ecdc2a24 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1330 microversion: 2.47 time: 0.234515 Oct 28 09:57:16.196672 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 941/1867] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:15 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1330 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:16.335866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.processutils [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpb_2ohkto/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpb_2ohkto/temp.key -subj /CN=9011f5f137dc4e9184519490d1b86409 -extensions v3_req_client" returned: 0 in 0.163s {{(pid=128747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 09:57:16.336866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.processutils [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpb_2ohkto/temp.key -password pass: {{(pid=128747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 28 09:57:16.363162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.processutils [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpb_2ohkto/temp.key -password pass:" returned: 0 in 0.025s {{(pid=128747) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 28 09:57:16.413583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:16.419816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Getting quotas for user 9011f5f137dc4e9184519490d1b86409 and project a9d95de022cd4769bbfe3e5f48958c88. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:16.438322 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0bf9f5d-fd49-4c0f-a652-e4c07e07c788 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.311082 Oct 28 09:57:16.439429 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 927/1868] 10.222.0.16 () {62 vars in 1198 bytes} [Fri Oct 28 09:57:16 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 313 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:16.451860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28f2a8c3-e964-4ffe-b70f-6d48f282131b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32b78040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.461980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28f2a8c3-e964-4ffe-b70f-6d48f282131b tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-759337777" status: 200 len: 1533 microversion: 2.2 time: 0.016032 Oct 28 09:57:16.463924 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 942/1869] 10.222.0.16 () {60 vars in 1255 bytes} [Fri Oct 28 09:57:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-759337777 => generated 1533 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:16.478252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cc454fb-0765-4cc4-a2d4-45c00f8a2a09 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32f993a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.486061 n-d-zed-1 devstack@n-api.service[128747]: WARNING oslo_db.sqlalchemy.utils [None req-2cc454fb-0765-4cc4-a2d4-45c00f8a2a09 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 09:57:16.491426 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cc454fb-0765-4cc4-a2d4-45c00f8a2a09 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.019589 Oct 28 09:57:16.497831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 928/1870] 10.222.0.16 () {60 vars in 1177 bytes} [Fri Oct 28 09:57:16 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:16.502851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53ed194a-1918-4393-892b-2a690ace3ba9 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] Calling method '.version_select at 0x7fca32b83c10>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.511516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:16.519264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.519960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:16.535162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:16.535898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:16.536447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:16.537423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:16.538001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:16.539313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:16.540753 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53ed194a-1918-4393-892b-2a690ace3ba9 tempest-KeyPairsV22TestJSON-80011315 tempest-KeyPairsV22TestJSON-80011315-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-759337777" status: 204 len: 0 microversion: 2.2 time: 0.041388 Oct 28 09:57:16.542325 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 943/1871] 10.222.0.16 () {60 vars in 1258 bytes} [Fri Oct 28 09:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-759337777 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:57:16.778312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.779928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:16.795065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:16.810862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:16.811449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:16.811807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:16.814794 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ada5207-1818-4598-9aa3-9717b44d66c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1707 microversion: 2.1 time: 0.299126 Oct 28 09:57:16.815412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 929/1872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:16 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1707 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:16.815717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:16.816221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:16.817033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:16.837533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0729f23b-8e18-41d3-aee5-751f977d79c0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '.version_select at 0x7fca330b0820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.841301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0729f23b-8e18-41d3-aee5-751f977d79c0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:16.841796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0729f23b-8e18-41d3-aee5-751f977d79c0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:16.842239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0729f23b-8e18-41d3-aee5-751f977d79c0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:16.856703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0729f23b-8e18-41d3-aee5-751f977d79c0 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1871 microversion: 2.1 time: 0.022906 Oct 28 09:57:16.860955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 930/1873] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:57:16 2022] GET /compute/v2.1/os-migrations => generated 1871 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:16.875202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:16.875852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:16.887173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:16.887173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:16.887678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:16.888572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:16.889071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:16.889975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.105159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:17.126208 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-89568033-08b6-402e-9ec6-c98e532a6bef tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.355418 Oct 28 09:57:17.129806 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 944/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:16 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:17.137071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-35f1af63-5d63-48a7-8836-9d8228cc76d4 req-f937f8ea-026f-4afa-ac4f-706a807ae7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40c22437-c39a-4889-bb0d-56bb97a135ea", "tag": "7e04bab9-b1e8-431c-b7c3-915d16d255fe"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:17.149246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-35f1af63-5d63-48a7-8836-9d8228cc76d4 req-f937f8ea-026f-4afa-ac4f-706a807ae7f2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:17.149741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-35f1af63-5d63-48a7-8836-9d8228cc76d4 req-f937f8ea-026f-4afa-ac4f-706a807ae7f2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:17.150876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-35f1af63-5d63-48a7-8836-9d8228cc76d4 req-f937f8ea-026f-4afa-ac4f-706a807ae7f2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.183888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-35f1af63-5d63-48a7-8836-9d8228cc76d4 req-f937f8ea-026f-4afa-ac4f-706a807ae7f2 service nova] Creating event network-changed:7e04bab9-b1e8-431c-b7c3-915d16d255fe for instance 40c22437-c39a-4889-bb0d-56bb97a135ea on n-h2-zed-1 Oct 28 09:57:17.191777 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-430a9ab9-ab79-4af6-8175-cee096437701 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1852 microversion: 2.1 time: 0.320920 Oct 28 09:57:17.192852 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 931/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:16 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1852 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:17.200048 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-35f1af63-5d63-48a7-8836-9d8228cc76d4 req-f937f8ea-026f-4afa-ac4f-706a807ae7f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060113 Oct 28 09:57:17.202234 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 945/1876] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:17.222093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:17.222689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:17.229136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:17.229768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:17.237881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:17.238381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:17.238977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.239710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:17.240173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:17.245450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:17.245956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:17.246601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.252091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.253002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:17.253496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:17.253941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.462893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5f80ec62-655a-4914-98e8-239c73e68e4f tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1852 microversion: 2.1 time: 0.248726 Oct 28 09:57:17.476939 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 932/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:17 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1852 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:17.503709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:17.526456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:17.531655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:17.532865 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a9dece2c-6d7c-42a7-a535-aed5428ccf95 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1330 microversion: 2.47 time: 0.315387 Oct 28 09:57:17.533465 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 946/1878] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:17 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1330 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:17.579143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:17.580673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:17.593039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:17.593556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:17.594071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.594779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:17.595480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:17.595917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:17.804124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lazy-loading 'services' on Instance uuid 73f7b43e-9af7-48b0-b0fc-ad060328abbf {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:18.069591 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f49acca9-3ca4-485f-9a34-8cc5c530a685 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments/a35b77d3-2490-4376-9fc2-7b6c20a184b6" status: 202 len: 0 microversion: 2.1 time: 0.495968 Oct 28 09:57:18.074028 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 933/1879] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 09:57:17 2022] DELETE /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments/a35b77d3-2490-4376-9fc2-7b6c20a184b6 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:18.080870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:18.083141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:18.090685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:18.091624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:18.092124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:18.093541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:18.094413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:18.095172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:18.150355 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-723b8bdd-1a66-4c16-9962-b7e97f6c27f9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074353 Oct 28 09:57:18.151189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:18.152015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:18.155888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4,nova_api:DELETE=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:18.156783 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 947/1880] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:18 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:18.161011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:18.161722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:18.162378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:18.163554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:18.164305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:18.164937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:18.414162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:18.426289 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1fa83029-71ab-4c18-add4-61e03b9dac62 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.279553 Oct 28 09:57:18.441186 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 934/1881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:18 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:18.563934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:18.565158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:18.579130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:18.581299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:18.589061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:18.589061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:18.589061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:18.589061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:18.709808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:18.721727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:18.723627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:18.724831 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5e97c9f-7b97-4404-8c5d-901889e8ca3e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1338 microversion: 2.47 time: 0.166315 Oct 28 09:57:18.725453 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 948/1882] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:18 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1338 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:19.164656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:19.174349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:19.183830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.184560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.184852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.185581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.190933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.191966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.235546 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76d0edf2-85a4-40d1-81f5-266bb0cb19e8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074750 Oct 28 09:57:19.236485 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 949/1883] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:19 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:19.440000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:19.441629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.442119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.442560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.443300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.443891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.444334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.453279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:19.454296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:19.467187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.468356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.469127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.470269 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf40c0be-ff1a-4fa3-b370-fd13794da98a tempest-AZV2TestJSON-849158726 tempest-AZV2TestJSON-849158726-project] 10.222.0.16 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.344683 Oct 28 09:57:19.471208 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 935/1884] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 09:57:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:57:19.471526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.472308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.472774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.674854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:19.688128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-283c8f0a-360d-45be-9bbc-a07e6da878a1 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.240203 Oct 28 09:57:19.701569 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 950/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:19 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:19.754148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:19.755260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:19.764485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.765295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.765990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.766964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:19.767714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:19.769405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:19.909793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:19.922069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:19.924075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:19.925426 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a93a2653-e95e-461e-ae60-b8d85775521d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1336 microversion: 2.47 time: 0.175215 Oct 28 09:57:19.927036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 936/1886] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:19 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1336 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:20.248143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:20.250782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:20.266649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:20.267275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:20.267899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:20.268313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5967a53a-6846-4385-80dd-bc6955b2fbc6 tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] Calling method '.version_select at 0x7fca33df1790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:20.269534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:20.273360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:20.273913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:20.289997 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5967a53a-6846-4385-80dd-bc6955b2fbc6 tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.191563 Oct 28 09:57:20.291572 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 951/1887] 10.222.0.16 () {60 vars in 1226 bytes} [Fri Oct 28 09:57:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:57:20.308551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9bb59f0f-ee84-4b45-babc-3c675b516227 tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] Action: 'update', calling method: .version_select at 0x7fca32b93790>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:20.352096 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c05574ef-9e23-4b09-a947-b829ae668818 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107710 Oct 28 09:57:20.357057 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 937/1888] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:20 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:20.455101 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9bb59f0f-ee84-4b45-babc-3c675b516227 tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.155671 Oct 28 09:57:20.455882 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 952/1889] 10.222.0.16 () {62 vars in 1247 bytes} [Fri Oct 28 09:57:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:57:20.469924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96de96f7-c37d-4629-94bd-35866eb2b274 tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] Calling method '.version_select at 0x7fca32f8cb80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:20.485724 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96de96f7-c37d-4629-94bd-35866eb2b274 tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.019531 Oct 28 09:57:20.486948 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 938/1890] 10.222.0.16 () {60 vars in 1226 bytes} [Fri Oct 28 09:57:20 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:57:20.499403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a3e28419-54df-4e48-8089-f11dc349028e tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] Action: 'update', calling method: .version_select at 0x7fca32b93af0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:20.575429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a3e28419-54df-4e48-8089-f11dc349028e tempest-QuotaClassesAdmin257Test-472092468 tempest-QuotaClassesAdmin257Test-472092468-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.080012 Oct 28 09:57:20.584090 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 953/1891] 10.222.0.16 () {62 vars in 1247 bytes} [Fri Oct 28 09:57:20 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:57:20.711947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:20.713542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:20.719965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:20.720456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:20.721149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:20.722103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:20.722567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:20.722996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:20.902058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:20.910449 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b14180d-e3b8-40e8-b165-85317a19620e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.202542 Oct 28 09:57:20.924240 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 939/1892] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:20 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:20.953435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:20.954054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:20.960645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:20.961171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:20.961662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:20.963143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:20.967338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:20.967338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:21.044819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:21.054020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:21.066801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:21.068012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d96614f6-670b-4205-9637-94f7c98073ae tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1336 microversion: 2.47 time: 0.118907 Oct 28 09:57:21.068583 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 954/1893] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:20 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1336 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:21.366720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:21.369648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:21.388124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:21.388551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:21.389109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:21.389821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:21.390364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:21.391048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:21.430807 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddd59ba5-bfb9-45c3-a20c-5db92e27b096 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068536 Oct 28 09:57:21.432324 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 940/1894] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:21 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:21.936870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:21.937436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:21.950984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:21.950984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:21.951364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:21.952127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:21.953020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:21.953020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.101299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:22.104920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:22.116387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.117680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.118145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.118921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.119381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.119887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.222788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.238387 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22108c62-9758-420b-a7f1-ebfa40c2fac8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.304137 Oct 28 09:57:22.250494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.251259 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 955/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:21 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:22.261848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.264412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.266617 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dafd8e24-d1fe-4dae-971e-ad8997f1454f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1357 microversion: 2.47 time: 0.174425 Oct 28 09:57:22.279132 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 941/1896] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:22 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:22.295008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:22.298089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:22.305614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.306778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.307319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.308167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.308725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.309308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.425162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:22.426284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:22.427151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:22.428262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:22.428951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:22.447115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:22.450568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:22.464983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.466424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.467841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.470292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.471290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.471927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.480770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:22.548172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ae8528cc-3465-4b04-8c29-750e82a45907 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107988 Oct 28 09:57:22.557191 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 942/1897] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:22 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:22.602948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:22.626899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.627416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.627871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.628617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.629113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.629553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.678284 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6211ab1d-c76c-497e-af0c-c74429c072dd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "POST /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e/action" status: 202 len: 1079 microversion: 2.47 time: 0.388070 Oct 28 09:57:22.678914 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 956/1898] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:57:22 2022] POST /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e/action => generated 1079 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 09:57:22.699630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:22.700395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:22.713437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.713934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.714379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.715092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:22.715552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:22.716048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:22.845898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.862771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.864489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:22.868045 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-728743e6-5d41-4ed1-bf6d-97b91ce01b4b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.171082 Oct 28 09:57:22.874258 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 943/1899] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:22 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:23.279033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:23.280456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:23.298278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:23.298795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:23.299247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:23.299977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:23.300442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:23.305442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:23.566283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:23.571504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:23.607453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:23.608580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:23.610763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:23.612072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:23.613006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:23.615836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:23.658681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:23.669690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75d116e4-3194-46b6-8229-29b1ceeed290 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108621 Oct 28 09:57:23.673230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e30a0ff0-8230-4e5f-9d7c-5e84161b802d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.402331 Oct 28 09:57:23.684933 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 957/1900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:23 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:23.687352 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 944/1901] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:23 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:23.896413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:23.897335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:23.908418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:23.909199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:23.909842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:23.913808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:23.914505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:23.915152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:24.513154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:24.530324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:24.536289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:24.537598 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e270c43f-5468-4cf0-a527-6474eef0e195 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.645782 Oct 28 09:57:24.538179 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 958/1902] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:23 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:24.686854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:24.695482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:24.702158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:24.702784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:24.705781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:24.706547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:24.710591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:24.711229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:24.711557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:24.712285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:24.713303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:24.713761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:24.713940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:24.714825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:24.717222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:24.717776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:24.742447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:24.758999 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d6ce301-9594-4e03-b729-39e7e39036d7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075843 Oct 28 09:57:24.766480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 945/1903] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:24 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:57:24.989843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.003141 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e1e075a-d30d-4691-bdea-271cf852bd35 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.304891 Oct 28 09:57:25.004724 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 959/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:24 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:25.200437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1926170400", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": "none"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:25.311163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:25.311593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:25.312074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:25.312483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:25.312924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:25.340771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:25.341295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:25.341735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:25.345805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:25.347774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:25.352937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:25.392765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Getting quotas for project 7cc6c533cbae4341a2e0b678b75cf49c. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:25.411126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Getting quotas for user 2f86992e452c4ab9b95e9d8fe8126f87 and project 7cc6c533cbae4341a2e0b678b75cf49c. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:25.442996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:57:25.452678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:57:25.534894 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-484e9acb-f4c4-40ff-921d-29db979cac55 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.552315 Oct 28 09:57:25.536226 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 946/1905] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:57:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:57:25.548798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af51b725-f318-4fd3-b591-cd6146bd2018 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:25.552367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af51b725-f318-4fd3-b591-cd6146bd2018 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:25.566962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:25.567596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:25.591206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:25.591835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:25.592478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:25.593281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:25.593751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:25.594208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:25.726052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af51b725-f318-4fd3-b591-cd6146bd2018 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.736087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af51b725-f318-4fd3-b591-cd6146bd2018 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.737806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af51b725-f318-4fd3-b591-cd6146bd2018 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.751110 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af51b725-f318-4fd3-b591-cd6146bd2018 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "PUT /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1359 microversion: 2.75 time: 0.207273 Oct 28 09:57:25.752823 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 960/1906] 10.222.0.16 () {62 vars in 1297 bytes} [Fri Oct 28 09:57:25 2022] PUT /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1359 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:25.787124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6fa841d-cee9-4a13-9054-cac6703acee4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:25.788092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a6fa841d-cee9-4a13-9054-cac6703acee4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:25.949496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a6fa841d-cee9-4a13-9054-cac6703acee4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.974351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a6fa841d-cee9-4a13-9054-cac6703acee4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.976340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a6fa841d-cee9-4a13-9054-cac6703acee4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.977781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.996008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.997864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:25.998996 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d0ad653-8a65-4b9b-afc5-17cbd70660bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.437021 Oct 28 09:57:26.001190 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a6fa841d-cee9-4a13-9054-cac6703acee4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1359 microversion: 2.75 time: 0.217160 Oct 28 09:57:26.016930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 947/1907] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:25 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:26.017172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 961/1908] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:25 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:26.032673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:26.034878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:26.071218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:26.071648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:26.072669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:26.074499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:26.075048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:26.075686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:26.443227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:26.452864 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca56e22e-37c9-47bd-8885-bad68a5b3d4c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.423908 Oct 28 09:57:26.457910 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 948/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:26 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:27.034450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:27.035073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:27.036529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:27.041756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:27.059188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:27.063319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:27.064364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:27.066271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:27.067230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:27.069023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:27.069786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:27.071431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:27.072124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:27.079497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:27.080199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:27.080814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:27.266476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:27.285582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:27.287620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:27.289152 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a38eb59-66a0-407d-896d-2febb6389bcb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.264625 Oct 28 09:57:27.292110 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 962/1910] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:27 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:27.369378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:27.379565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:27.382485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:27.398460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a055b25-1c00-4405-bf25-49977fd4343d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1411 microversion: 2.75 time: 0.368647 Oct 28 09:57:27.401782 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 949/1911] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:27 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1411 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:27.483911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:27.484550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:27.507410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:27.511309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:27.511993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:27.513314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:27.513923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:27.514897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:27.753384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:27.779083 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81956087-6df8-457b-a7c1-a65de11a364b tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.299681 Oct 28 09:57:27.780753 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 963/1912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:27 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:28.319829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:28.320479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:28.330157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:28.331069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:28.331521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:28.332239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:28.332697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:28.333153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:28.439538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.450633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.453210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b29249c-4d88-4d4e-b972-0f1009bdb26b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Action: 'create', calling method: .version_select at 0x7fca33877f70>, body: {"keypair": {"name": "tempest-keypair-885268190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFEKUdQQ930t8sCaKSy+owXABcoxrXmo7V6mQc/ptFwDj62nzgv0BbesyXjmksJ42G2FInqKA2/n4TWKkqv8aaupIE/CWeU51YZelsoJoYkcpyzZ4aRo1wHLREtK7aCV6g=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:28.453774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.454720 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4739654c-2e32-464f-8a18-c623d9b14bc1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.138928 Oct 28 09:57:28.469859 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 950/1913] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:28 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:28.475082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:28.475921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:28.483706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:28.484676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:28.485549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:28.486644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:28.487176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:28.487529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:28.488061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2b29249c-4d88-4d4e-b972-0f1009bdb26b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Getting quotas for project 78fef6627ff6418c9b64f7f1535dfe75. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:28.494957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2b29249c-4d88-4d4e-b972-0f1009bdb26b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Getting quotas for user be43920925d44c94ae226ee021925d73 and project 78fef6627ff6418c9b64f7f1535dfe75. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:28.496870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=83,nova_api:DELETE=1,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:28.534711 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b29249c-4d88-4d4e-b972-0f1009bdb26b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170895 Oct 28 09:57:28.535316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 964/1914] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 09:57:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:28.576966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.581679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.583132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.589635 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b648deb0-8855-48ea-a0b7-0bb657320bff tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1417 microversion: 2.75 time: 0.118088 Oct 28 09:57:28.590115 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 951/1915] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:28 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1417 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:28.804297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:28.804928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:28.811957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:28.812689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:28.813446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:28.814514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:28.814968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:28.815562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:28.988608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:28.999965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3deb14ff-b73a-40e0-bf9d-819a0905f309 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.200056 Oct 28 09:57:29.001131 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 965/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:28 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:29.484450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:29.485193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:29.492467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.493000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.493579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.495005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.495465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.495877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.596701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.611539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.614606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.616404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-61607c9f-7d30-4c46-b506-cecf390acfdd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.136026 Oct 28 09:57:29.628933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:29.628933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:29.630554 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 952/1917] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:29 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:29.631255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.632741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.634095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.636289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:29.638582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:29.641056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:29.812828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.825657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.828156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:29.835122 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf1c4222-a82a-4fc2-b597-a8727b86640b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1417 microversion: 2.75 time: 0.220537 Oct 28 09:57:29.835719 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 966/1918] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:29 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1417 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:30.037868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:30.043044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:30.053191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.054880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.055574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.056598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.057759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.058527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.232670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-258498151", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "95a9c977-6771-4522-8d26-d4a75f0d98f8"}], "security_groups": [{"name": "tempest-securitygroup--694113558"}], "key_name": "tempest-keypair-885268190", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:30.242447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.252206 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b97b396c-09c5-4f01-9a30-212290c67c99 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.230494 Oct 28 09:57:30.253500 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 953/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:30 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:30.373913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] validate_networks() for [('95a9c977-6771-4522-8d26-d4a75f0d98f8', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:57:30.645678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:30.647887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:30.654589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.655449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.655974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.656934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.657624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.658141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.742081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.751767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.753582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.754984 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f4f0873-100d-47f1-ba12-cc3c2b3bee6c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.113418 Oct 28 09:57:30.765988 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 954/1920] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:30 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:30.826961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Getting quotas for project 78fef6627ff6418c9b64f7f1535dfe75. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:30.834243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Getting quotas for user be43920925d44c94ae226ee021925d73 and project 78fef6627ff6418c9b64f7f1535dfe75. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:30.854842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:30.855358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:30.856111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:30.856374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:30.856860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:30.865688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:30.866458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.866911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:30.867324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.867906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.869238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.869911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.870417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.875742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.876710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.877443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.878398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:30.879533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:30.880183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:30.894018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Getting quotas for project 78fef6627ff6418c9b64f7f1535dfe75. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:30.899802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Getting quotas for user be43920925d44c94ae226ee021925d73 and project 78fef6627ff6418c9b64f7f1535dfe75. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:30.926279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:57:30.933165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:57:30.950754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.960333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.962304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:30.967976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfbc7f19-39ce-4536-95da-f001e9d3ef7e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1417 microversion: 2.75 time: 0.108082 Oct 28 09:57:30.968847 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 955/1921] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:30 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1417 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:31.003973 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3143a062-a9e6-4137-b831-25bfb24574b7 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.776011 Oct 28 09:57:31.004775 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 967/1922] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:57:30 2022] POST /compute/v2.1/servers => generated 408 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 09:57:31.015781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-044e7343-67e8-4b30-8b66-69ae5dcc0a8a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:31.016691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-044e7343-67e8-4b30-8b66-69ae5dcc0a8a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:31.083791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-044e7343-67e8-4b30-8b66-69ae5dcc0a8a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:31.098100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-044e7343-67e8-4b30-8b66-69ae5dcc0a8a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1276 microversion: 2.1 time: 0.086058 Oct 28 09:57:31.102837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 956/1923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:31 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1276 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:31.285545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:31.286495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:31.295172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:31.295929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:31.297025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:31.298208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:31.299057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:31.303713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:31.519979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:31.530053 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70319477-c38d-44a2-8deb-06d2c01c6f73 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1473 microversion: 2.1 time: 0.257155 Oct 28 09:57:31.531045 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 968/1924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:31 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:31.782812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:31.784058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:31.792335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:31.792955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:31.793471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:31.794264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:31.797001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:31.797533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:31.875578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:31.885321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:31.886777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:31.888226 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9596eae9-d3d6-43f7-a9f1-8f2e6b4f69b1 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.109336 Oct 28 09:57:31.888850 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 957/1925] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:31 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:31.996703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:31.998145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:32.011641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.012870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.013350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.014087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.014551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.014984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.103606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:32.114896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:32.116373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:32.123921 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-33d415e7-6f20-4f92-b178-d067e292e092 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1417 microversion: 2.75 time: 0.131489 Oct 28 09:57:32.125315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:32.125737 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 969/1926] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:31 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1417 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:32.125933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:32.132530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.133061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.133500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.135147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.135605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.136025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.216762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:32.225454 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15373a45-de26-40b8-9528-296f61088a00 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1280 microversion: 2.1 time: 0.104960 Oct 28 09:57:32.226219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 958/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:32 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:32.555201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:32.556224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:32.563686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.565132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.566186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.567397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.568276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.568936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.729705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:32.737845 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-488e3ca2-2afc-43a1-8e28-5316bc9b49a7 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1479 microversion: 2.1 time: 0.187284 Oct 28 09:57:32.738948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 970/1928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:32 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1479 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:32.914310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:32.914933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:32.923812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.924405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.925016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.926066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:32.926596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:32.927098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:32.999106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.012362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.014967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.016433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8510a5ed-93a0-4b29-905b-8acc062a4cb3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.106037 Oct 28 09:57:33.017563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 959/1929] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:32 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:33.159648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:33.160968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:33.169735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.170303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.171083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.172535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.173100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.173874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.260704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:33.260704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:33.260704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.260704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.261158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.261158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.261158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.261403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.261524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.270378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.272007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.281532 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-24ce3297-9c6b-40f8-bd9d-fdf3c80ed524 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1438 microversion: 2.75 time: 0.127255 Oct 28 09:57:33.293855 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 971/1930] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:33 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1438 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:33.317213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:33.320667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:33.328019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.328839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.329563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.330634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.331297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.331971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.468352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:33.468795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:33.469328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:33.469731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:33.470396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:33.595050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:33.607093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.607644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.608274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.610896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.611779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.612409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.725691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.738777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.742000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.765286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-40c7c201-3540-4d34-8c9a-b6e2effe118e tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "POST /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a/action" status: 202 len: 1495 microversion: 2.75 time: 0.453576 Oct 28 09:57:33.768780 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 972/1931] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:57:33 2022] POST /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a/action => generated 1495 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 28 09:57:33.789815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:33.795243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:33.805437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.806878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.807451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.808839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.809546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.813819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.831977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.841298 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-acd5a6ad-9e02-4aa2-a401-53acdf471127 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1328 microversion: 2.1 time: 0.597502 Oct 28 09:57:33.842271 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 960/1932] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:33 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1328 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:33.846915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:33.847527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:33.853416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.853907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.854344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.855044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:33.855502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:33.855927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:33.862849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:33.953774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.971606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.976571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:33.983684 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-60dd7500-9527-4e7f-972d-081575f50897 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.140265 Oct 28 09:57:33.984836 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 961/1933] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:33 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:34.053749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:34.054863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:34.078725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:34.081205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:34.082772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:34.085148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:34.088607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:34.089423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:34.234929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:34.256225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:34.260730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:34.263462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10348eb0-3489-4a49-a844-29db8ec0a88d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.215310 Oct 28 09:57:34.269199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 962/1934] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:34 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:34.311060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:34.320457 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ed72c27f-2ab0-41ba-b274-091575fdffa3 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1479 microversion: 2.1 time: 0.550206 Oct 28 09:57:34.321400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 973/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:33 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1479 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:34.357951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4a8fd4c5-71c4-4da8-ba57-ce78366af92e req-529645d4-b8bf-425a-a58d-b011c7b57e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caca59f2-508b-4f81-b2c9-73857a7e7cbb", "name": "network-vif-unplugged", "status": "completed", "tag": "5df6dcc3-c245-46be-ace9-9232b18e4b70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:34.372537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4a8fd4c5-71c4-4da8-ba57-ce78366af92e req-529645d4-b8bf-425a-a58d-b011c7b57e75 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:34.373339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4a8fd4c5-71c4-4da8-ba57-ce78366af92e req-529645d4-b8bf-425a-a58d-b011c7b57e75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:34.374143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4a8fd4c5-71c4-4da8-ba57-ce78366af92e req-529645d4-b8bf-425a-a58d-b011c7b57e75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:34.389136 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4a8fd4c5-71c4-4da8-ba57-ce78366af92e req-529645d4-b8bf-425a-a58d-b011c7b57e75 service nova] Creating event network-vif-unplugged:5df6dcc3-c245-46be-ace9-9232b18e4b70 for instance caca59f2-508b-4f81-b2c9-73857a7e7cbb on n-h1-zed-1 Oct 28 09:57:34.396320 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4a8fd4c5-71c4-4da8-ba57-ce78366af92e req-529645d4-b8bf-425a-a58d-b011c7b57e75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043085 Oct 28 09:57:34.397684 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 963/1936] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:34.866254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:34.867252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:34.874671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:34.875613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:34.876741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:34.877748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:34.878439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:34.879449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:34.959395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:34.969785 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7d25ad5-9adf-48d0-a5be-17723a1b78e5 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1334 microversion: 2.1 time: 0.107574 Oct 28 09:57:34.970387 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 974/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:34 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:35.015670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:35.016374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:35.023064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.023561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.024045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.024819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.025919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.026619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.049510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:35.140218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.166770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.169333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.180060 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da0e5286-7e52-4b85-9a71-85b6a5f248ca tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.169218 Oct 28 09:57:35.181034 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 964/1938] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:35 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:35.292419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:35.293383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:35.308590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.309361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.309658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.310593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.311418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.312562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.344357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:35.345362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:35.353153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.359314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.360124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.364108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.364871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.365585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.366356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:35.419512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.435037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.439689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.441424 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-168db8f2-c2dd-4cf1-b01b-84fef8a219ee tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.153684 Oct 28 09:57:35.457701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 975/1939] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:35 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:35.568277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:35.581754 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5c25126-84c4-40d5-947d-6b7850344ac2 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1479 microversion: 2.1 time: 0.241478 Oct 28 09:57:35.599266 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 965/1940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:35 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1479 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:35.664624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "075cdde8-9d72-40e3-84e8-730b470336ab"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:35.667454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:35.673936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.674744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.675175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.676322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:35.676973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:35.677590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:35.995478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:35.996163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:36.007122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.007691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.008096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.009088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.010168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.010594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.055016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-11ed546d-91c2-4ddb-8e85-2f6ae5440360 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "POST /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395079 Oct 28 09:57:36.061368 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 976/1941] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 09:57:35 2022] POST /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments => generated 194 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:36.212266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.222236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:36.224469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:36.235366 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57dc3171-f55b-42eb-99df-7c85a306aeb4 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1401 microversion: 2.1 time: 0.245730 Oct 28 09:57:36.253236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 966/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:35 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1401 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:36.259473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.260061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.262461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.264124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.268365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-80c19050-a83a-428a-b0a6-c89d2e73bab8 req-a04bbaa4-c0e2-4e7b-a870-40f0f63da258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec4e013-e1ac-4e82-992a-ac0aba822538", "tag": "3ca1e8b5-523a-4d6a-b906-057b0c3b5737"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:36.268696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.269852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.283166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80c19050-a83a-428a-b0a6-c89d2e73bab8 req-a04bbaa4-c0e2-4e7b-a870-40f0f63da258 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.283962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80c19050-a83a-428a-b0a6-c89d2e73bab8 req-a04bbaa4-c0e2-4e7b-a870-40f0f63da258 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.284627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80c19050-a83a-428a-b0a6-c89d2e73bab8 req-a04bbaa4-c0e2-4e7b-a870-40f0f63da258 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.302651 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-80c19050-a83a-428a-b0a6-c89d2e73bab8 req-a04bbaa4-c0e2-4e7b-a870-40f0f63da258 service nova] Creating event network-changed:3ca1e8b5-523a-4d6a-b906-057b0c3b5737 for instance dec4e013-e1ac-4e82-992a-ac0aba822538 on n-h2-zed-1 Oct 28 09:57:36.309754 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-80c19050-a83a-428a-b0a6-c89d2e73bab8 req-a04bbaa4-c0e2-4e7b-a870-40f0f63da258 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054563 Oct 28 09:57:36.310513 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 967/1943] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:36.400988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.409856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.411542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.419109 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3d75fca3-3710-4345-926a-c43d208e058f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.212899 Oct 28 09:57:36.419690 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 977/1944] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:36 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:36.470399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:36.471147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:36.482580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.483357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.484366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.486279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.487658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.488648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.587357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.601298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.603848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.605402 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-704c317d-321c-4b0a-b3f5-6348be12bafd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.141443 Oct 28 09:57:36.610174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:36.611120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:36.620329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.621011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.621736 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 968/1945] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:36 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:36.627251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.628210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:36.628696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:36.629176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:36.870241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:36.880763 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d06df082-7e69-4268-a931-13029ac0e661 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1479 microversion: 2.1 time: 0.278009 Oct 28 09:57:36.883203 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 978/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:36 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1479 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:37.260158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:37.260872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:37.268451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.269057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.269561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.270223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.270690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.271160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.417927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.426731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2baa09f-bc8d-4230-8b8c-8c594699c09e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1401 microversion: 2.1 time: 0.170622 Oct 28 09:57:37.427639 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 969/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:37 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1401 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:37.451902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:37.452601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:37.459704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.460497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.461206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.461990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.462685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.463320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.537707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.546148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.547598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.554566 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e88b0ed3-429b-4137-a1e1-45efe800f9f1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.107054 Oct 28 09:57:37.555608 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 979/1948] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:37 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:37.631831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:37.632364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:37.635254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:37.644432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.644952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.645392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.646325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.646785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.647216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.717036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.727121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.729137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:37.730685 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ffcabbb-b3f7-472a-8e70-0dd5760bb99f tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.102805 Oct 28 09:57:37.731141 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 970/1949] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:37 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:37.904217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:37.906440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:37.914598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.916274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.917007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.918232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:37.918924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:37.919570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:37.993828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-de54c1b7-31b2-4c99-bce4-0193d499076b req-55cdb2ac-ef6a-472c-87e5-b169db535409 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caca59f2-508b-4f81-b2c9-73857a7e7cbb", "name": "network-vif-plugged", "status": "completed", "tag": "5df6dcc3-c245-46be-ace9-9232b18e4b70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:38.017281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de54c1b7-31b2-4c99-bce4-0193d499076b req-55cdb2ac-ef6a-472c-87e5-b169db535409 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.017789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de54c1b7-31b2-4c99-bce4-0193d499076b req-55cdb2ac-ef6a-472c-87e5-b169db535409 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.018211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de54c1b7-31b2-4c99-bce4-0193d499076b req-55cdb2ac-ef6a-472c-87e5-b169db535409 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.045579 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-de54c1b7-31b2-4c99-bce4-0193d499076b req-55cdb2ac-ef6a-472c-87e5-b169db535409 service nova] Creating event network-vif-plugged:5df6dcc3-c245-46be-ace9-9232b18e4b70 for instance caca59f2-508b-4f81-b2c9-73857a7e7cbb on n-h1-zed-1 Oct 28 09:57:38.051927 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-de54c1b7-31b2-4c99-bce4-0193d499076b req-55cdb2ac-ef6a-472c-87e5-b169db535409 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061314 Oct 28 09:57:38.053805 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 971/1950] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:38.139188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.152533 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf3e4252-eae3-44d9-846b-87a702f9b792 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1479 microversion: 2.1 time: 0.252253 Oct 28 09:57:38.153734 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 980/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:37 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1479 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:38.458643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:38.459362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:38.471929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.472700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.473634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.474749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.475213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.475659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.588167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:38.589971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:38.598002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.599012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.599762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.600674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.601342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.601942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.634894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.644582 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eefeddaa-3cfd-47f8-8973-d6215d87878b tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1401 microversion: 2.1 time: 0.192799 Oct 28 09:57:38.645747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 972/1952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:38 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1401 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:38.692368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.702371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.703859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.710348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b36d3666-ff71-487a-8be6-1eb768599423 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.130052 Oct 28 09:57:38.710866 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 981/1953] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:38 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:38.757253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:38.757975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:38.767893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.768850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.769784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.770693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:38.771618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:38.772253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:38.843370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.851735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.853783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:38.854972 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c06449a6-3691-4b80-aaf9-94b85d61b42a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.102391 Oct 28 09:57:38.855736 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 973/1954] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:38 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:39.190029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:39.190724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:39.208589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.209112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.209551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.210266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.210720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.211144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.370490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:39.379408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-24d51948-758c-46b6-baa2-3b6ae659f93a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1479 microversion: 2.1 time: 0.207618 Oct 28 09:57:39.380308 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 982/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:39 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1479 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:39.669558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:39.670238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:39.677889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.678382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.679065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.679783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.680254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.680679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.740370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:39.741770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:39.755906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.757900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.758828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.760837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.761673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.762756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.853325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:39.863823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:39.867978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:39.874870 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9c86e980-0f11-4e58-a757-f01dd66cdd18 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.138703 Oct 28 09:57:39.892447 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 983/1956] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:39 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:39.904375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:39.905385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:39.917555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.918417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.919118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.920068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:39.922719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:39.923421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:39.960194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:39.969467 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a157035-9b83-440e-b908-d44f8b2ffa33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1401 microversion: 2.1 time: 0.303922 Oct 28 09:57:39.981842 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 974/1957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:39 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1401 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:40.015520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:40.026179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:40.028029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:40.029293 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39ace3d9-e9a8-40b8-8a54-1cf6250638a5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.135316 Oct 28 09:57:40.030071 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 984/1958] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:39 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:40.405592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:40.406899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:40.421721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.422342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.422812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.423578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.424050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.424490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.627641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:40.638450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-53a1ff7a-a344-45ef-821f-ba0bbb04fe92 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1464 microversion: 2.1 time: 0.238203 Oct 28 09:57:40.654413 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 975/1959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:40 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1464 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:40.671728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:40.674301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:40.680981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.682847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.683400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.684198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.684734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.685258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.780387 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50b70722-f210-472c-9017-85fd5f03a6eb tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.112423 Oct 28 09:57:40.781360 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 985/1960] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:57:40 2022] POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:40.789053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:40.789676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:40.796812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.797342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.797790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.798501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.798966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.799402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.833397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.833892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.834325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.834789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lazy-loading 'fault' on Instance uuid caca59f2-508b-4f81-b2c9-73857a7e7cbb {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:40.907630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:40.909025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:40.913190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:40.914908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=38,nova_cell0:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:40.922606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.923158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.923712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.924522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.925111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.925627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.953180 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b268abf8-4b01-4a2f-9a73-32163f7b9cd5 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1592 microversion: 2.1 time: 0.167790 Oct 28 09:57:40.954054 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 976/1961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:40 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1592 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:40.979131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:40.981854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:40.994533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.995061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.995503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:40.996219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:40.997323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:40.997769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.023394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.038342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.039861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.045950 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4bee5d2f-6280-49bf-9a35-4f914d642d38 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.143126 Oct 28 09:57:41.062443 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 986/1962] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:40 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:41.075369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:41.075999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:41.082132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.082794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.083246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.083960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.084420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.084846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.091128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=54 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:41.102351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:41.180818 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-26139071-ee84-4ccc-846e-cc9e8309e44c tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action" status: 202 len: 0 microversion: 2.1 time: 0.204237 Oct 28 09:57:41.183691 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 977/1963] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:57:40 2022] POST /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:41.192456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:41.198205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:41.207408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.208213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.209042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.209965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.210771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.211389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.256201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.269666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22df6a80-834b-4230-b7c7-12f5b8d1b933 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1401 microversion: 2.1 time: 0.205731 Oct 28 09:57:41.271125 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 987/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:41 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1401 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:41.280772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:41.281759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:41.318384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.319788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.321154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.322536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.324446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.324869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.325485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.330292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.331733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.332936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d1cc25ca-a0ee-45c4-89d9-a8bce3b5690a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.147901 Oct 28 09:57:41.333521 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 978/1965] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:41 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:41.476668 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-970f3363-1386-4055-98d6-ff60042cc803 tempest-ServersAdminTestJSON-1870628647 tempest-ServersAdminTestJSON-1870628647-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1609 microversion: 2.1 time: 0.204229 Oct 28 09:57:41.477500 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 988/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:41 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1609 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:41.500894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:41.501470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:41.508667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.509190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.509667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.510382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.510843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.511325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.544045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:41.581703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=1,nova_cell1:UPDATE=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:41.633026 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d1f7a72-3357-4d37-99f1-7018c2c2d95c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 204 len: 0 microversion: 2.1 time: 0.135765 Oct 28 09:57:41.633653 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 979/1967] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:41 2022] DELETE /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:41.642644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:41.643757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:41.650313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:41.652365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.652861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.653329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.654039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:41.654498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:41.654931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:41.793832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:41.802063 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd30bcdf-0c74-4c9b-9144-4b8fc1c265f8 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1470 microversion: 2.1 time: 0.163370 Oct 28 09:57:41.802637 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 989/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:41 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:42.077885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:42.078586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:42.085402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.085898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.086344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.087055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.088065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.088509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.156609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.164947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.166375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.171419 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc007f02-3c2c-47cc-be21-1bac7b10ecf8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.097751 Oct 28 09:57:42.172028 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 980/1969] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:42 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:42.298572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:42.299517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:42.306377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.307005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.307289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.308020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.308477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.309129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.358606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:42.359222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:42.365780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.366276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.366722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.367432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.367880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.368315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.473380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.491701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.493369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.495361 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d5a27be0-a538-44b9-a009-03ee296116e5 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.140696 Oct 28 09:57:42.496382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 981/1970] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:42 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:42.499520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.501209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-86c20af8-89ef-413a-add2-c6c06ce7d80b req-55124aaa-55ad-40ae-af6c-434a56d2c63f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec4e013-e1ac-4e82-992a-ac0aba822538", "name": "network-vif-plugged", "status": "completed", "tag": "3ca1e8b5-523a-4d6a-b906-057b0c3b5737"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:42.511377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-86c20af8-89ef-413a-add2-c6c06ce7d80b req-55124aaa-55ad-40ae-af6c-434a56d2c63f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.512422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-86c20af8-89ef-413a-add2-c6c06ce7d80b req-55124aaa-55ad-40ae-af6c-434a56d2c63f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.512422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-86c20af8-89ef-413a-add2-c6c06ce7d80b req-55124aaa-55ad-40ae-af6c-434a56d2c63f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.517618 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e110ba82-585b-4c04-bbb7-37d1d4ae74c6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1401 microversion: 2.1 time: 0.224971 Oct 28 09:57:42.518430 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 990/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:42 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1401 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:42.525786 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-86c20af8-89ef-413a-add2-c6c06ce7d80b req-55124aaa-55ad-40ae-af6c-434a56d2c63f service nova] Creating event network-vif-plugged:3ca1e8b5-523a-4d6a-b906-057b0c3b5737 for instance dec4e013-e1ac-4e82-992a-ac0aba822538 on n-h2-zed-1 Oct 28 09:57:42.530976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-86c20af8-89ef-413a-add2-c6c06ce7d80b req-55124aaa-55ad-40ae-af6c-434a56d2c63f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033143 Oct 28 09:57:42.531821 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 982/1972] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:42.825517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:42.826238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:42.833425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.833920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.834364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.835070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:42.835531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:42.835966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:42.969949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:42.978903 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a8538613-cf20-4a6b-b0d0-a70445a86858 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1470 microversion: 2.1 time: 0.157314 Oct 28 09:57:42.979610 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 991/1973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:42 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:43.200611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:43.201344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:43.207716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.208206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.208642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:43.209385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.209842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.210287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:43.277260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.285814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.287265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.293388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3fe69ed-a5b8-43a5-897f-1f42854527ba tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.097840 Oct 28 09:57:43.294102 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 983/1974] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:43 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:43.523828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:43.524564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:43.531823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.532338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.532858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:43.533685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.534150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.534586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:43.542971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:43.543905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:43.553432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.554316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.554948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:43.555680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.556182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.556617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:43.656423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.688622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.693173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.695017 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-000764ba-9c2f-49f6-976b-662119f0776a tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.177503 Oct 28 09:57:43.699537 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 992/1975] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:43 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:43.761817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:43.772466 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48e2c54b-54cb-4b36-95d9-4c405d33a95a tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1401 microversion: 2.1 time: 0.234423 Oct 28 09:57:43.773099 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 984/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:43 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1401 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:43.865878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:43.867175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:43.877024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.877827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.878267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:43.878981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:43.879426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:43.880090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.003560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:44.004637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:44.012295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.013231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.013930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.014926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.015633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.016297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.100327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:44.109677 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d76aa09-8e08-4311-8ca2-b6bc3efe3851 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1428 microversion: 2.1 time: 0.109893 Oct 28 09:57:44.110660 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 985/1977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:43 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1428 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:44.322812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:44.323535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:44.334185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.334993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.335760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.336723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.337492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.338488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.433496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 6255ec55-f11e-457b-b949-b17da3834864 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:44.434833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:44.447230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d2b0191a-0594-40dd-8db9-59464444c261 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 2338 microversion: 2.25 time: 0.585043 Oct 28 09:57:44.447820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 993/1978] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:43 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 2338 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:44.453096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:44.454590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:44.459721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-534e69b1-0046-487c-8f14-63758789084e req-6260b16c-a32d-4fdb-b346-9fb09df2dcb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e12c5461-6640-443e-be0e-23f058fcb802", "name": "network-vif-deleted", "tag": "dc6ef171-5858-4a02-842a-2f96b84923c4"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:44.471877 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d8b9d0a5-4220-482c-aff0-b1803fc8bf25 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.154001 Oct 28 09:57:44.472555 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 986/1979] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:44 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:44.485170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:44.490670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-534e69b1-0046-487c-8f14-63758789084e req-6260b16c-a32d-4fdb-b346-9fb09df2dcb8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.491482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-534e69b1-0046-487c-8f14-63758789084e req-6260b16c-a32d-4fdb-b346-9fb09df2dcb8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.492136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-534e69b1-0046-487c-8f14-63758789084e req-6260b16c-a32d-4fdb-b346-9fb09df2dcb8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.495233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.498313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.499571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.501026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.501682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.502118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.513500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-534e69b1-0046-487c-8f14-63758789084e req-6260b16c-a32d-4fdb-b346-9fb09df2dcb8 service nova] Creating event network-vif-deleted:dc6ef171-5858-4a02-842a-2f96b84923c4 for instance e12c5461-6640-443e-be0e-23f058fcb802 on n-h1-zed-1 Oct 28 09:57:44.521489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-534e69b1-0046-487c-8f14-63758789084e req-6260b16c-a32d-4fdb-b346-9fb09df2dcb8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064782 Oct 28 09:57:44.522528 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 994/1980] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:44.529054 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5f828b8-2dad-4bb2-9f1d-0a04da052a56 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 418 microversion: 2.25 time: 0.054939 Oct 28 09:57:44.532968 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 987/1981] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 09:57:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 418 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:57:44.725553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:44.726593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:44.733081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.735785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.736248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.737079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.737550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.737986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.796886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:44.797618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:44.804644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.811319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.812031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.812836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:44.813371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:44.813802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:44.875442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:44.889187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:44.891925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:44.894843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-407c8fb5-fccc-41f0-ab02-1301de71d0e2 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.173239 Oct 28 09:57:44.906299 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 995/1982] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:44 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:45.022019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:45.031843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a818c05d-d9d3-42fd-b924-8ce5d0f0536e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1587 microversion: 2.1 time: 0.239499 Oct 28 09:57:45.032847 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 988/1983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:44 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1587 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:45.055874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:45.057353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:45.066749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.067729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.068703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.069680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.070545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.071071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.135302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:45.136267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:45.144971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.145784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.146407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.147387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.148068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.148711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.187050 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7218137-ee4a-42a9-975e-196f1aba5ce6 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.135595 Oct 28 09:57:45.188122 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 996/1984] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 09:57:45 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:45.194813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.195429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.196640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.196640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lazy-loading 'fault' on Instance uuid e12c5461-6640-443e-be0e-23f058fcb802 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:45.248349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:45.267674 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e21c96a2-7531-463b-8592-207def51d56c tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 200 len: 1304 microversion: 2.1 time: 0.136832 Oct 28 09:57:45.271014 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 989/1985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:45 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:45.511182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:45.512705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:45.533094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.534083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.534712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.535714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.539386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.540348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.739585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:45.753442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:45.757498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:45.764277 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-550e1a85-e92f-4329-8c70-5c23e2e99227 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.260456 Oct 28 09:57:45.765364 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 997/1986] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:45 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:45.924812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:45.927287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:45.935639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.936929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.937835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:45.938744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:45.941682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:45.942343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.042249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:46.051787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:46.053680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:46.055108 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-11f230e1-8f82-410f-8ea7-2a27bfd99933 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.134915 Oct 28 09:57:46.069996 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 990/1987] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:45 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:46.201866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35033aba-1e52-4038-adcc-f5b643a905c2", "device": "/dev/xvdb"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:46.205415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.213076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.213568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.213995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.214689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.215134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.215757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.296450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.309485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: e12c5461-6640-443e-be0e-23f058fcb802] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.325451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.326362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.326822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.327578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.328272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.328663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.346440 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] HTTP exception thrown: Instance e12c5461-6640-443e-be0e-23f058fcb802 could not be found. Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Request method failure captured: Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 HTTP/1.1 Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6cXFCD1L-UtKiluaGKDHhR3SyWKWt2AviPVbYzxwcKQr5GB23eDCGCb5AUA869xOKyxA235amCnvxMF6fiwnvRm4DyZwgMUmFMjBdpPjQ_-EuOfmO4l7zfWx5KTOVEnYkhftmVF-XLDyuAg3Z8eVQPXorQsJYZiQRzkNhZ9j7tfgak Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7d2636214d0b430d929ef27e9592488d Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:57:46.348115 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d2636214d0b430d929ef27e9592488d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d2636214d0b430d929ef27e9592488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d2636214d0b430d929ef27e9592488d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d2636214d0b430d929ef27e9592488d"}]}] Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7d2636214d0b430d929ef27e9592488d Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminTestJSON-1337622145-project Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: feb7e91603d6463e9428e71c31efb6b3 Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminTestJSON-1337622145-project Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e12c5461-6640-443e-be0e-23f058fcb802 could not be found. Oct 28 09:57:46.350210 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e12c5461-6640-443e-be0e-23f058fcb802'} Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e12c5461-6640-443e-be0e-23f058fcb802 could not be found. Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:46.351323 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e12c5461-6640-443e-be0e-23f058fcb802 could not be found. Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e12c5461-6640-443e-be0e-23f058fcb802 could not be found. Oct 28 09:57:46.353211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:46.354833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Returning 404 to user: Instance e12c5461-6640-443e-be0e-23f058fcb802 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:46.354833 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b615fda-1195-4281-81a5-636acfd18e16 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802" status: 404 len: 111 microversion: 2.1 time: 0.060784 Oct 28 09:57:46.354833 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 991/1988] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:46 2022] GET /compute/v2.1/servers/e12c5461-6640-443e-be0e-23f058fcb802 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:46.367866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.368524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.387219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.388805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.395585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.396427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.397765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.401945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.451029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:46.592179 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2185de1b-b7b1-4de0-9e40-6d5ccdea8297 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "POST /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.393856 Oct 28 09:57:46.595416 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 998/1989] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Oct 28 09:57:46 2022] POST /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:57:46.607745 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ededc25-91ae-40c8-bc25-dc3983b17f2d tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "DELETE /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 204 len: 0 microversion: 2.1 time: 0.242590 Oct 28 09:57:46.610551 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 992/1990] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:46 2022] DELETE /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:46.619786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.623496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-23f15f71-6fc8-467d-a35c-b545d301aede req-85e18611-3ec5-41c5-aef2-4f9a777f93e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec4e013-e1ac-4e82-992a-ac0aba822538", "tag": "3ca1e8b5-523a-4d6a-b906-057b0c3b5737"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:46.625758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.646117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.646395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-23f15f71-6fc8-467d-a35c-b545d301aede req-85e18611-3ec5-41c5-aef2-4f9a777f93e4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.647577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-23f15f71-6fc8-467d-a35c-b545d301aede req-85e18611-3ec5-41c5-aef2-4f9a777f93e4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.648164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-23f15f71-6fc8-467d-a35c-b545d301aede req-85e18611-3ec5-41c5-aef2-4f9a777f93e4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.650302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.651016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.651822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.652555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.653028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.666460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-23f15f71-6fc8-467d-a35c-b545d301aede req-85e18611-3ec5-41c5-aef2-4f9a777f93e4 service nova] Creating event network-changed:3ca1e8b5-523a-4d6a-b906-057b0c3b5737 for instance dec4e013-e1ac-4e82-992a-ac0aba822538 on n-h2-zed-1 Oct 28 09:57:46.673786 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-23f15f71-6fc8-467d-a35c-b545d301aede req-85e18611-3ec5-41c5-aef2-4f9a777f93e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060553 Oct 28 09:57:46.679727 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 993/1991] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:46.689103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.689921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.699336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.700797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.701588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.702703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.703810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.704544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.887301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:46.897783 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e76297b4-4594-450c-b1ce-05f2e2129330 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1587 microversion: 2.1 time: 0.300707 Oct 28 09:57:46.898717 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 999/1992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:46 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1587 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:46.904993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:46.905935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:46.914319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.914822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.916146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.917178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:46.917872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:46.919822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:46.956551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:46.966482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44fdd1a7-3896-4de5-9da6-c67a19a4cb42 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1469 microversion: 2.1 time: 0.282357 Oct 28 09:57:46.968162 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 994/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:46 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1469 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:47.018392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:47.031964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:47.034442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:47.041797 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6d9d5d92-a7b7-4ee3-95f8-269b4d7043c9 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.141116 Oct 28 09:57:47.043349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1000/1994] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:46 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:47.082572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:47.083204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:47.092226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:47.093796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:47.101683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:47.101683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:47.101683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:47.101683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:47.173501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:47.189234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:47.189234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:47.189234 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-571441d7-4d0d-4b2f-a4b2-b6d935aa387e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.107423 Oct 28 09:57:47.189613 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 995/1995] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:47 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:47.996187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:47.996819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.006922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.007412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.007848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.008567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.016820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.017459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.072850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.073501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.085710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.087712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.088714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.090231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.092096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.094475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.123707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:48.200783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.212798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.214259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.219988 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-622204b8-f6a9-41d2-a5ef-609b9254c8d4 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.152257 Oct 28 09:57:48.220877 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 996/1996] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:48 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:48.226696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.227578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.237321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.239634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.240360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.241327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.241965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.242565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.269800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.277786 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9871c03-0ef2-4696-bafe-c55fae29f966 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1469 microversion: 2.1 time: 0.285999 Oct 28 09:57:48.293364 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1001/1997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:47 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1469 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:48.329849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.337319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.339183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:48.340731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ebc48b7d-b00f-4564-9581-b909ae887fbc tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.118695 Oct 28 09:57:48.341831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 997/1998] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:48 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:48.372816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.375140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.381117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.381602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.382042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.382742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.383201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.383628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.414311 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de5931f1-3450-44bf-bac8-4e9a8179f613 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045708 Oct 28 09:57:48.414883 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1002/1999] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:48 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:48.426387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:48.426994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:48.434007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.434821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.435432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.436241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:48.436797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:48.437254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:48.524147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lazy-loading 'services' on Instance uuid 7dd40166-156e-4d19-aa39-44ce7e03bbaf {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:48.609979 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dcf0fb0a-cc2b-41e8-8bee-cdd9675f6889 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments/075cdde8-9d72-40e3-84e8-730b470336ab" status: 202 len: 0 microversion: 2.1 time: 0.187556 Oct 28 09:57:48.610634 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 998/2000] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 09:57:48 2022] DELETE /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments/075cdde8-9d72-40e3-84e8-730b470336ab => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:57:48.973154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-19087238", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "22fc5637-6732-4716-999d-9f8191adb350"}], "block_device_mapping_v2": [{"uuid": "201eb6db-14b5-4909-95ca-7723b1380078", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:49.042058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] validate_networks() for [('22fc5637-6732-4716-999d-9f8191adb350', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:57:49.253551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:49.254261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:49.261845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.262338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.263081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.263802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.264325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.265025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.378849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.389289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.393870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.401197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d1c13214-ef33-4a5a-a1c2-096846f67070 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.150958 Oct 28 09:57:49.403932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 999/2001] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:49 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:49.410122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:49.411297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:49.418099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.418897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.419609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.420588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.421548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.422218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.503478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.515741 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7b60662d-eb37-40b0-a18d-ba3d437db8af tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 200 len: 1427 microversion: 2.1 time: 0.109235 Oct 28 09:57:49.516995 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1000/2002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:49 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 1427 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:49.523158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:49.524208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:49.531377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.532263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.533011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.534002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.534543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.535195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.647824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.658810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.661244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:49.663364 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5602abd-374a-4713-9ff5-c6a346e7e34c tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.144528 Oct 28 09:57:49.664192 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1001/2003] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:49 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:49.671380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e5abd844-1bf3-4494-bef8-b0b586e94074 req-6e046d82-8762-4252-ae97-297521f102fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102f91db-dd8e-4eba-bdbf-ca1b780a43c3", "name": "network-vif-deleted", "tag": "b3e43631-e765-4de2-a277-d17477fcacf1"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:49.688529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5abd844-1bf3-4494-bef8-b0b586e94074 req-6e046d82-8762-4252-ae97-297521f102fe service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.689802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5abd844-1bf3-4494-bef8-b0b586e94074 req-6e046d82-8762-4252-ae97-297521f102fe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.690410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5abd844-1bf3-4494-bef8-b0b586e94074 req-6e046d82-8762-4252-ae97-297521f102fe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.704912 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e5abd844-1bf3-4494-bef8-b0b586e94074 req-6e046d82-8762-4252-ae97-297521f102fe service nova] Creating event network-vif-deleted:b3e43631-e765-4de2-a277-d17477fcacf1 for instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 on n-h1-zed-1 Oct 28 09:57:49.710338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e5abd844-1bf3-4494-bef8-b0b586e94074 req-6e046d82-8762-4252-ae97-297521f102fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043303 Oct 28 09:57:49.710553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:49.710769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:49.711209 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1002/2004] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:57:49.711334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:49.711773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:49.712222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:49.729065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.729592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.730077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.730848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:49.731314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:49.731747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:49.767710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:49.775713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Getting quotas for user d76e0eb51a9b418bb28e81b5ac1520f9 and project 38bd1e9a411e49c0b6c13914f4b53caf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:50.435558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:50.436277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:50.443840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.444320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.444755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.445477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.445930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.446353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.517696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.526059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.527503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.532374 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a9da8f9c-dfcb-4731-9fb3-bf5574fc0e22 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.101743 Oct 28 09:57:50.534469 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1003/2005] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:50 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:50.539058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:50.539681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: 102f91db-dd8e-4eba-bdbf-ca1b780a43c3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:50.547631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.548062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.548503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.549247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.549703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.550131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.564950 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] HTTP exception thrown: Instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 could not be found. Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Request method failure captured: Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 HTTP/1.1 Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6cXFCD1L-UtKiluaGKDHhR3SyWKWt2AviPVbYzxwcKQr5GB23eDCGCb5AUA869xOKyxA235amCnvxMF6fiwnvRm4DyZwgMUmFMjBdpPjQ_-EuOfmO4l7zfWx5KTOVEnYkhftmVF-XLDyuAg3Z8eVQPXorQsJYZiQRzkNhZ9j7tfgak Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7d2636214d0b430d929ef27e9592488d Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:57:50.566592 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d2636214d0b430d929ef27e9592488d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d2636214d0b430d929ef27e9592488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d2636214d0b430d929ef27e9592488d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d2636214d0b430d929ef27e9592488d"}]}] Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7d2636214d0b430d929ef27e9592488d Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminTestJSON-1337622145-project Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: feb7e91603d6463e9428e71c31efb6b3 Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminTestJSON-1337622145-project Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 could not be found. Oct 28 09:57:50.568502 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '102f91db-dd8e-4eba-bdbf-ca1b780a43c3'} Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 could not be found. Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:50.569613 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 could not be found. Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 could not be found. Oct 28 09:57:50.571314 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:50.573174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Returning 404 to user: Instance 102f91db-dd8e-4eba-bdbf-ca1b780a43c3 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:50.573174 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c156f1e9-1bbb-42f4-85fb-e4bb7c31cb1a tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3" status: 404 len: 111 microversion: 2.1 time: 0.032594 Oct 28 09:57:50.573174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1004/2006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:50 2022] GET /compute/v2.1/servers/102f91db-dd8e-4eba-bdbf-ca1b780a43c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:57:50.578486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:50.579426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:50.581785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:50.588174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.588174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.588501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.589239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.589701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.590135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.617916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:50.700193 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc8800a4-8e68-4687-adf3-d5f2547f3502 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "DELETE /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 204 len: 0 microversion: 2.1 time: 0.125216 Oct 28 09:57:50.704085 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1005/2007] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:50 2022] DELETE /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:50.706746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:50.707552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:50.714482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.715037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.715439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.716197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.716655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.717133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.786146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.795988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.798022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.799241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a124f358-c1d0-4509-841b-c3982a8d8f19 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.097204 Oct 28 09:57:50.812969 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1006/2008] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:50 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:50.812969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:50.812969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:50.812969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.812969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.813537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.813859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:50.814223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:50.814650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:50.946540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:50.954750 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-186c6439-71cd-48b1-bd0a-62d9736c2a3f tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1470 microversion: 2.1 time: 0.153194 Oct 28 09:57:50.955556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1007/2009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:50 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:51.562134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:51.562800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:51.570278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.570771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.571213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:51.572558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.573056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.573497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:51.649366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:51.657967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:51.659438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:51.664424 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfd7ead5-b9a5-4169-a68a-d4a625778a3f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.106269 Oct 28 09:57:51.665036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1008/2010] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:51 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:51.828634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:51.829169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:51.835277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.835773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.836215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:51.836926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.837422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.837836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:51.906853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:51.914885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:51.916811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:51.917991 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c87cdffc-1755-4e30-ba17-b28a09a8757d tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.093508 Oct 28 09:57:51.918558 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1009/2011] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:51 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:51.978866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:51.979488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:51.985903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.986400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.986983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:51.987553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:51.988010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:51.988437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:52.126322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:52.134809 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46948dea-d0bf-4341-9b3d-d380dc21fd53 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1470 microversion: 2.1 time: 0.160321 Oct 28 09:57:52.135508 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1010/2012] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:51 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1470 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:52.693363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:52.694087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:52.701599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:52.702096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:52.702588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:52.703312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:52.703779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:52.704202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:52.771500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:52.783774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:52.788640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:52.794831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c49883e-1499-434c-a5d9-bec48dc19271 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.105165 Oct 28 09:57:52.803480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1011/2013] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:52 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:52.856019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f7b9ec85-e7d3-483f-a101-cff735fa5c26 req-1b598c81-255a-45b9-9d3f-2d25d9c85894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caca59f2-508b-4f81-b2c9-73857a7e7cbb", "name": "network-vif-deleted", "tag": "5df6dcc3-c245-46be-ace9-9232b18e4b70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:52.865838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f7b9ec85-e7d3-483f-a101-cff735fa5c26 req-1b598c81-255a-45b9-9d3f-2d25d9c85894 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:52.866325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f7b9ec85-e7d3-483f-a101-cff735fa5c26 req-1b598c81-255a-45b9-9d3f-2d25d9c85894 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:52.866750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f7b9ec85-e7d3-483f-a101-cff735fa5c26 req-1b598c81-255a-45b9-9d3f-2d25d9c85894 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:52.869636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:52.885558 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f7b9ec85-e7d3-483f-a101-cff735fa5c26 req-1b598c81-255a-45b9-9d3f-2d25d9c85894 service nova] Creating event network-vif-deleted:5df6dcc3-c245-46be-ace9-9232b18e4b70 for instance caca59f2-508b-4f81-b2c9-73857a7e7cbb on n-h1-zed-1 Oct 28 09:57:52.891125 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f7b9ec85-e7d3-483f-a101-cff735fa5c26 req-1b598c81-255a-45b9-9d3f-2d25d9c85894 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038865 Oct 28 09:57:52.891963 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1012/2014] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:57:52.947226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:52.948207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:52.957197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:52.958259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:52.958898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:52.959818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:52.960565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:52.961263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:53.039467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:53.050891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:53.053227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:53.054581 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3e980ab-93a8-4c19-b1e4-8408a26fc7bd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.113033 Oct 28 09:57:53.055101 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1013/2015] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:52 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:53.157651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:53.158546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:53.164880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:53.165497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:53.166459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:53.167475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:53.168053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:53.168725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:53.204626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:53.205223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:53.205762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:53.206278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lazy-loading 'fault' on Instance uuid caca59f2-508b-4f81-b2c9-73857a7e7cbb {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:53.249473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:53.257413 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c21685e-ad59-475f-bc15-cc6384e4834e tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1304 microversion: 2.1 time: 0.103376 Oct 28 09:57:53.257998 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1014/2016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:53 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:53.825248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:53.825929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:53.833304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:53.833802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:53.834248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:53.834980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:53.835438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:53.835870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:53.906695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:53.916316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:53.917890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:53.923505 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-60ecc3f9-fcc7-47d8-807d-797946b2ae12 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.102162 Oct 28 09:57:53.924107 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1015/2017] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:53 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:54.085148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:54.085808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:54.092443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.092966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.093415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.094124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.094585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.095021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.161836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:54.170341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:54.172069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:54.173196 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3398bfa-5f3a-46f9-8693-2eed4504acbe tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1366 microversion: 2.47 time: 0.092052 Oct 28 09:57:54.174019 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1016/2018] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:54 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:54.280578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:54.281137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:54.287207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.287696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.288139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.288869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.289357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.289786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.322404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.322896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.323336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.323785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lazy-loading 'fault' on Instance uuid caca59f2-508b-4f81-b2c9-73857a7e7cbb {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:57:54.364177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'feb7e91603d6463e9428e71c31efb6b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d2636214d0b430d929ef27e9592488d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:54.372018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-896b2663-f5c0-4158-bf43-b5a0c2d257bb tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 200 len: 1304 microversion: 2.1 time: 0.095640 Oct 28 09:57:54.372837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1017/2019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:54 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:54.885267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:54.887456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:54.890523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:54.895609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.896111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.896559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.897293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.897972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.898606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.918210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:57:54.920566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='201eb6db-14b5-4909-95ca-7723b1380078',volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:57:54.943409 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-82f3c478-5712-473a-ac77-4ce394190bfc tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063066 Oct 28 09:57:54.944095 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1018/2020] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:54 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:57:54.951840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:54.952548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:54.958465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.959162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.959636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:54.960341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:54.960802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:54.961275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.049978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.065623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.068703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.078957 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-610cf105-4f75-4746-976a-d820f55d7bd1 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.130986 Oct 28 09:57:55.089485 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1019/2021] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:54 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:55.095237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:55.097773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:55.105228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.105724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.106171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.106920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.107371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.107804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.141771 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e3681ae8-cf4a-49f4-ab81-54ae90dfefee tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050349 Oct 28 09:57:55.142356 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1020/2022] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:57:55 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:57:55.200041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:55.200697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:55.208734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.209648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.210706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.212608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.213412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.214097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.239320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ee9239c-ceba-464f-b720-db4e3aa369ff tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.270116 Oct 28 09:57:55.240264 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1003/2023] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:57:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 6272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:57:55.246072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:55.249408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:55.257241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.258237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.258913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.259873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.260547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.261212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.265231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:55.292858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:55.293599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.303315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.304747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.305986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24463542-2fcd-4349-aa6e-fe30a30344c3 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1372 microversion: 2.47 time: 0.110213 Oct 28 09:57:55.321477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1021/2024] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:55 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:55.321477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad1c862e-5ec6-46d7-b715-ca5ca622db99 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:55.321477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad1c862e-5ec6-46d7-b715-ca5ca622db99 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:55.366993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad1c862e-5ec6-46d7-b715-ca5ca622db99 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.374790 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad1c862e-5ec6-46d7-b715-ca5ca622db99 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1051 microversion: 2.1 time: 0.066311 Oct 28 09:57:55.388930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1022/2025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:55 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1051 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:55.410815 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-51d8d2a1-8b23-4418-b06b-feadc332441d tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 204 len: 0 microversion: 2.1 time: 0.168710 Oct 28 09:57:55.411988 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1004/2026] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:57:55 2022] DELETE /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:57:55.413633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:55.414262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] [instance: caca59f2-508b-4f81-b2c9-73857a7e7cbb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:55.422063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.422308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:55.422571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.423097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.423702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:55.423840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.424254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.424671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.435294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.436372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.437013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.437924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:55.438998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:55.439889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:55.440857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] HTTP exception thrown: Instance caca59f2-508b-4f81-b2c9-73857a7e7cbb could not be found. Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Request method failure captured: Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb HTTP/1.1 Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6cXFCD1L-UtKiluaGKDHhR3SyWKWt2AviPVbYzxwcKQr5GB23eDCGCb5AUA869xOKyxA235amCnvxMF6fiwnvRm4DyZwgMUmFMjBdpPjQ_-EuOfmO4l7zfWx5KTOVEnYkhftmVF-XLDyuAg3Z8eVQPXorQsJYZiQRzkNhZ9j7tfgak Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7d2636214d0b430d929ef27e9592488d Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:57:55.443026 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d2636214d0b430d929ef27e9592488d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d2636214d0b430d929ef27e9592488d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d2636214d0b430d929ef27e9592488d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d2636214d0b430d929ef27e9592488d"}]}] Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7d2636214d0b430d929ef27e9592488d Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminTestJSON-1337622145 Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminTestJSON-1337622145-project Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: feb7e91603d6463e9428e71c31efb6b3 Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminTestJSON-1337622145-project Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance caca59f2-508b-4f81-b2c9-73857a7e7cbb could not be found. Oct 28 09:57:55.444936 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'caca59f2-508b-4f81-b2c9-73857a7e7cbb'} Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caca59f2-508b-4f81-b2c9-73857a7e7cbb could not be found. Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:57:55.446286 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caca59f2-508b-4f81-b2c9-73857a7e7cbb could not be found. Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caca59f2-508b-4f81-b2c9-73857a7e7cbb could not be found. Oct 28 09:57:55.448159 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:57:55.450604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] Returning 404 to user: Instance caca59f2-508b-4f81-b2c9-73857a7e7cbb could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:57:55.450604 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19e973de-01e5-47ed-83bf-e6dbda8db8f5 tempest-ServersAdminTestJSON-1337622145 tempest-ServersAdminTestJSON-1337622145-project] 10.222.0.16 "GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb" status: 404 len: 111 microversion: 2.1 time: 0.040841 Oct 28 09:57:55.450604 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1023/2027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:55 2022] GET /compute/v2.1/servers/caca59f2-508b-4f81-b2c9-73857a7e7cbb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:57:55.624941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:55.635525 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-54830b07-d434-4a8f-bf5b-626352b42e2a tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1680 microversion: 2.1 time: 0.218440 Oct 28 09:57:55.654346 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1005/2028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:55 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1680 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:56.117795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:56.123269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:56.138855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.144995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.145655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.146568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.147436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.148216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.230540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.239083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.240525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.245945 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50bedad4-2a5b-4243-84e3-7ae824d66552 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.135351 Oct 28 09:57:56.246808 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1024/2029] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:56 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:56.335770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:56.336578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:56.345388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.346143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.346773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.347661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.348291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.348929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.403651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:56.404634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:56.414217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.415139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.415860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.416844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.417511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.418107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.428399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.438042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.439759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.441395 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf546579-3f9b-4970-8cdd-b35c9468baec tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1372 microversion: 2.47 time: 0.110120 Oct 28 09:57:56.443404 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1006/2030] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:56 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:56.496579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.505792 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6e2e7e9-d395-4290-bd1f-a1ed2392d512 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1149 microversion: 2.1 time: 0.107775 Oct 28 09:57:56.506799 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1025/2031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:56 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1149 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:56.661368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:56.662282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:56.668636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.669489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.669938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.670672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:56.671473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:56.672042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:56.834946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:56.844727 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-32f5c4b9-af46-495e-937c-c3733688fc9e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1680 microversion: 2.1 time: 0.187670 Oct 28 09:57:56.845499 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1007/2032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:56 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:57.274761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:57.275472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:57.283823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.284349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.284796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.285626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.286084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.286514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.356783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.365491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.366945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.373788 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ae7b8423-c9f1-4245-b7a6-a60aab4c8b3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.103266 Oct 28 09:57:57.374373 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1026/2033] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:57 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:57.469283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:57.469897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:57.477588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.478853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.479258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.480144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.480800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.481254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.531798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:57.532421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:57.539836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.541284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.541937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.542824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.543459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.545360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.554278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.565400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.567474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.569109 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b762804-a8de-4b3e-bf71-672bddad9406 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1357 microversion: 2.47 time: 0.103731 Oct 28 09:57:57.590497 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1008/2034] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:57 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1357 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:57.600678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:57.606994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.608168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Searching by: {'deleted': False, 'project_id': '0710c69d87dc4f7fa6999e314efc8022'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:57:57.613933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.615122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.615758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.617385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.618046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.618509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.651518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.679181 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19763fcc-8425-4a02-a253-253bcf0a7e82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1157 microversion: 2.1 time: 0.152202 Oct 28 09:57:57.693408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1027/2035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:57 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1157 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:57.751725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:57:57.838053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.846871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.847376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.847816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.862702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.864177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:57.872288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:57.873054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:57.879713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.880699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.881240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.882108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:57.882883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:57.883590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:57.985687 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e529793d-6b29-4e70-b46f-3bb8c2f3db69 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.389672 Oct 28 09:57:58.000932 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1009/2036] 10.222.0.16 () {60 vars in 1187 bytes} [Fri Oct 28 09:57:57 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:58.031036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:58.031932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:58.044538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.045120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.045571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.049591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.050087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.052803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.111614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:57:58.190785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.210650 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb3b287f-7266-4072-8d5b-459970600f1c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1680 microversion: 2.1 time: 0.346452 Oct 28 09:57:58.215540 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1028/2037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:57 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1680 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:58.271599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2853c32f-346a-4a1b-8805-fb28ac08e035 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 204 len: 0 microversion: 2.47 time: 0.246283 Oct 28 09:57:58.273784 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1010/2038] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 09:57:58 2022] DELETE /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 09:57:58.282723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:58.283432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:58.292119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.292685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.293161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.294855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.295563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.296169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.387752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.390556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.392468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.403161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:58.404080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:58.408310 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3cdf2bf-ee10-43fc-8f18-726d9664617b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1363 microversion: 2.47 time: 0.116944 Oct 28 09:57:58.417070 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1029/2039] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:58 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:58.418725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.419229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.419659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.420600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.421276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.421877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.558401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.578953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.580824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.586830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e466cbea-b88b-4df9-ba0f-b26783aaac15 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.189800 Oct 28 09:57:58.588422 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1011/2040] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:58 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:58.680468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-638211734", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": "none"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:57:58.703531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:58.704140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:58.716518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.717032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.717470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.718171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:58.718617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:58.719040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:58.855894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:58.878687 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14f5b560-5d96-4cc1-b92a-298d83d3c833 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1167 microversion: 2.1 time: 0.178713 Oct 28 09:57:58.893541 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1012/2041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:58 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1167 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:57:58.998859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:57:58.999202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:57:58.999688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:57:59.000139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:57:59.000538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:57:59.011299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.011804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.012257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.013163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.013641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.014078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.034713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Getting quotas for project d46da14317314fe5ad7ee374b335891f. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:57:59.042304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Getting quotas for user 679fbb3562d24d04af630ab8d37d35ae and project d46da14317314fe5ad7ee374b335891f. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:57:59.057576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:57:59.059955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:57:59.114542 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff45deff-bbec-4507-ba6e-66dde435f243 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.602536 Oct 28 09:57:59.121883 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1030/2042] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:57:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 28 09:57:59.135000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6eca9cfd-b4b9-43f2-bc2f-6d9e7d205eba tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:59.135966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6eca9cfd-b4b9-43f2-bc2f-6d9e7d205eba tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:59.238974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:59.239900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:59.246302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.246803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.247251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.247965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.248428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.248942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.267268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:57:59.319313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6eca9cfd-b4b9-43f2-bc2f-6d9e7d205eba tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.327705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6eca9cfd-b4b9-43f2-bc2f-6d9e7d205eba tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.329188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6eca9cfd-b4b9-43f2-bc2f-6d9e7d205eba tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.349635 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6eca9cfd-b4b9-43f2-bc2f-6d9e7d205eba tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1452 microversion: 2.91 time: 0.223285 Oct 28 09:57:59.350538 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1013/2043] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:59 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1452 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:57:59.424766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.435466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:59.436081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:59.438517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d121396d-c2e2-43e3-9583-4c2e94f0f310 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1612 microversion: 2.1 time: 0.203191 Oct 28 09:57:59.439187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1031/2044] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:59 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1612 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:57:59.445348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.445894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.446513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.447899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.448377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.449477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.617519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.620558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:59.621990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:59.629441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.630633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.631444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.632420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.633137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.634780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.644150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.649493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.654897 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da62c5e3-c151-4d7c-b280-2cda168289bf tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1363 microversion: 2.47 time: 0.221964 Oct 28 09:57:59.655510 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1014/2045] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:59 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:59.738322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.749713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.765805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:57:59.787502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa4561f0-9140-46d4-801e-b57b17e14630 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.174066 Oct 28 09:57:59.789556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1032/2046] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:57:59 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:57:59.903938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:57:59.904564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:57:59.919205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.919793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.920131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:57:59.920843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:57:59.921340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:57:59.921766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.147064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b2c75bcb-602a-4f96-b326-297adbbe8d5f req-85aac503-7547-44f4-aee3-67208aa5934a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dd40166-156e-4d19-aa39-44ce7e03bbaf", "name": "network-vif-deleted", "tag": "e4a0cf05-4ead-4e65-9732-3f4849c44d52"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:00.170455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b2c75bcb-602a-4f96-b326-297adbbe8d5f req-85aac503-7547-44f4-aee3-67208aa5934a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.174678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b2c75bcb-602a-4f96-b326-297adbbe8d5f req-85aac503-7547-44f4-aee3-67208aa5934a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.175503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b2c75bcb-602a-4f96-b326-297adbbe8d5f req-85aac503-7547-44f4-aee3-67208aa5934a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.199771 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b2c75bcb-602a-4f96-b326-297adbbe8d5f req-85aac503-7547-44f4-aee3-67208aa5934a service nova] Creating event network-vif-deleted:e4a0cf05-4ead-4e65-9732-3f4849c44d52 for instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf on n-h2-zed-1 Oct 28 09:58:00.213325 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b2c75bcb-602a-4f96-b326-297adbbe8d5f req-85aac503-7547-44f4-aee3-67208aa5934a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070972 Oct 28 09:58:00.216786 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1033/2047] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:00.271347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.285216 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-729f602b-312f-48ea-b053-7bb34651933a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1209 microversion: 2.1 time: 0.383037 Oct 28 09:58:00.288050 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1015/2048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:57:59 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1209 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:00.381871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:00.383035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:00.400291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.401196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.417111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.418660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.419533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.420011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.463706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:00.464332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:00.474886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.480598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.484956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.484956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.488265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.488773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.561105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.561711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.562166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.562635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lazy-loading 'fault' on Instance uuid 7dd40166-156e-4d19-aa39-44ce7e03bbaf {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:00.603621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.616215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.622970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.633621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:00.635577 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0fbcc285-6622-40b4-883f-a51e32087614 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1504 microversion: 2.91 time: 0.259217 Oct 28 09:58:00.636552 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1034/2049] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:00 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:00.682448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:00.683945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:00.689938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a8b4be16e0439dbacf9d3c6cfeb527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70725194c6a84c4a991a8acc16a8bf68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.697680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.698460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.699160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.701723 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a681346-c64d-44b1-9f56-c2468260313c tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 200 len: 1331 microversion: 2.1 time: 0.242431 Oct 28 09:58:00.705604 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1016/2050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:00 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 1331 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:00.708445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.709060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.709521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.781903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.782932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.783550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.784202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lazy-loading 'fault' on Instance uuid ec9a1642-8845-4327-ae6f-4702a4d5281e {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:00.822100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:00.822996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:00.838419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.841488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.842770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.845832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:00.846514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:00.847173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:00.854658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.865348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.869968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:00.877857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c03a20f9-5772-4fac-8c26-1bcc09a52010 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1368 microversion: 2.47 time: 0.200476 Oct 28 09:58:00.879446 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1035/2051] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:00 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:00.884856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:00.993255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.012262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.016119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.026093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e45210d3-d34f-4ef3-8b73-051de981081d tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.207062 Oct 28 09:58:01.027627 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1017/2052] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:00 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:01.313755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:01.315344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:01.329984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.332163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.332722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.340163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.341102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.342212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.642684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.650938 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9090e1ed-85cb-4c62-b565-724f45453ad4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1209 microversion: 2.1 time: 0.341123 Oct 28 09:58:01.651648 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1036/2053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:01 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1209 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:01.663663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:01.664332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:01.667780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:01.673036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.673539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.673980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.674691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.675148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.675574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.727717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:01.731724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:01.745347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.745975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.747994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.749170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.749724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.751597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.766057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.774192 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] HTTP exception thrown: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Request method failure captured: Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf HTTP/1.1 Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6a-WlWDLiZ6o6uTu3QsDXJrFCSRjZzuR7jcgaBIzoNonC5Y62UrDtzUYIJNFKeRAQUmaJYnJQ4g_DT9XhIrYuJGE-8GB2gRnjJv1p9Z7npnOBt2QC8E8lUkWdM0gB60yWDHnIc05Ind4PmmHoVPwyJsiWdEwNe1HTKbCDp8Rqf7kUI Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 70725194c6a84c4a991a8acc16a8bf68 Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:58:01.775899 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70725194c6a84c4a991a8acc16a8bf68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70725194c6a84c4a991a8acc16a8bf68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70725194c6a84c4a991a8acc16a8bf68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70725194c6a84c4a991a8acc16a8bf68"}]}] Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 70725194c6a84c4a991a8acc16a8bf68 Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachSCSIVolumeTestJSON-1483349063-project Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a0a8b4be16e0439dbacf9d3c6cfeb527 Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1483349063-project Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:01.777505 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7dd40166-156e-4d19-aa39-44ce7e03bbaf'} Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:01.778420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:01.780024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:01.781415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.781541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Returning 404 to user: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:01.781642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:01.781740 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2bfe28f0-b12f-4e08-a5f6-d4624809cbc7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 404 len: 111 microversion: 2.1 time: 0.053643 Oct 28 09:58:01.781740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1037/2054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:01 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:58:01.786434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-415dbeb5-728a-4ae3-a57b-03fcbd9ab96e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '.version_select at 0x7fca32e56550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:01.786678 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17536674-a74d-43fa-a7d8-061076076cdd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1510 microversion: 2.91 time: 0.126701 Oct 28 09:58:01.787380 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1018/2055] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:01 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1510 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:01.807517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-415dbeb5-728a-4ae3-a57b-03fcbd9ab96e tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471561052" status: 202 len: 0 microversion: 2.1 time: 0.023678 Oct 28 09:58:01.808578 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1038/2056] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 09:58:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471561052 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:58:01.910417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:01.911132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:01.918877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.919637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.920304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.921228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.921874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.922485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.971084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:01.971708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:01.972310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:01.972938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lazy-loading 'fault' on Instance uuid ec9a1642-8845-4327-ae6f-4702a4d5281e {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:02.058661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:02.059279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:02.069718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.070717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.071417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.072531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.073363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.073997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.134025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.147655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.149567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.151620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1512ff7-2a54-4362-9336-877749df741b tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 200 len: 1368 microversion: 2.47 time: 0.245786 Oct 28 09:58:02.161605 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1019/2057] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:01 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 1368 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:02.207146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.217360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.218900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.225161 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-742c14dd-1aae-4415-84ef-6635e06dbb3a tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.170949 Oct 28 09:58:02.243351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-44f6f4a6-702d-469b-9956-251749f97c54 req-ebfb0fa5-9176-48be-ad86-ac30e3d2a34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3251b41a-f111-4ff3-b549-d3d97fd3b0d2", "tag": "3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:02.249094 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1039/2058] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:02 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:02.258071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-44f6f4a6-702d-469b-9956-251749f97c54 req-ebfb0fa5-9176-48be-ad86-ac30e3d2a34a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.258870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-44f6f4a6-702d-469b-9956-251749f97c54 req-ebfb0fa5-9176-48be-ad86-ac30e3d2a34a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.259403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-44f6f4a6-702d-469b-9956-251749f97c54 req-ebfb0fa5-9176-48be-ad86-ac30e3d2a34a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.270967 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-44f6f4a6-702d-469b-9956-251749f97c54 req-ebfb0fa5-9176-48be-ad86-ac30e3d2a34a service nova] Creating event network-changed:3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466 for instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 on n-h1-zed-1 Oct 28 09:58:02.276556 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-44f6f4a6-702d-469b-9956-251749f97c54 req-ebfb0fa5-9176-48be-ad86-ac30e3d2a34a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040495 Oct 28 09:58:02.277323 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1020/2059] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:02.677428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:02.681240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:02.700438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.703720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.704938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.710276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.714392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.715797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.845702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:02.846937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:02.881773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:02.887350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.888626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.889739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.891165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:02.892665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:02.893700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:02.896273 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6ff5e8d-a0ab-4614-bd68-27be67afb82d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1209 microversion: 2.1 time: 0.224580 Oct 28 09:58:02.913524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1040/2060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:02 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1209 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:03.003376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.004337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.024862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.025707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.026445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.027604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.032941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.036969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.078165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.092309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.095329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.102496 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-57b0410c-cd17-4924-9f96-2d0fceae3a22 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1510 microversion: 2.91 time: 0.274851 Oct 28 09:58:03.104367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1021/2061] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:02 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1510 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:03.185453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.186595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: ec9a1642-8845-4327-ae6f-4702a4d5281e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.193616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.194131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.194633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.195431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.196187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.196496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.215494 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] HTTP exception thrown: Instance ec9a1642-8845-4327-ae6f-4702a4d5281e could not be found. Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Request method failure captured: Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e HTTP/1.1 Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6d5CjF37xEEUSNdDU5wFthCYubbUQTboJJpvr0M8XOKHRhN5s9SCK0qh097VyrOazLormx0cBrEQ7eMsPHGmNxNWJLjfZXokaJRhdNfc2yK7__GKxtNtPUyWcevrBkfRmgAB02bsGuikhqRViKP0FFyP14YzKz9lGgltLycta-05AQ Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 0710c69d87dc4f7fa6999e314efc8022 Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerShowV247Test-1173248830 Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:58:03.217883 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0710c69d87dc4f7fa6999e314efc8022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0710c69d87dc4f7fa6999e314efc8022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0710c69d87dc4f7fa6999e314efc8022", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0710c69d87dc4f7fa6999e314efc8022"}]}] Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerShowV247Test-1173248830 Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 0710c69d87dc4f7fa6999e314efc8022 Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerShowV247Test-1173248830 Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerShowV247Test-1173248830-project Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f9ad41b36abd4eb8945f3ec85ce8f5a5 Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerShowV247Test-1173248830-project Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ec9a1642-8845-4327-ae6f-4702a4d5281e could not be found. Oct 28 09:58:03.219777 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ec9a1642-8845-4327-ae6f-4702a4d5281e'} Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec9a1642-8845-4327-ae6f-4702a4d5281e could not be found. Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:03.221273 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec9a1642-8845-4327-ae6f-4702a4d5281e could not be found. Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec9a1642-8845-4327-ae6f-4702a4d5281e could not be found. Oct 28 09:58:03.223261 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:03.224937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Returning 404 to user: Instance ec9a1642-8845-4327-ae6f-4702a4d5281e could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:03.224937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c03b4ae-c24e-4c4d-ac19-cb2f7a18642e tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e" status: 404 len: 111 microversion: 2.47 time: 0.038507 Oct 28 09:58:03.224937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1022/2062] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:03 2022] GET /compute/v2.1/servers/ec9a1642-8845-4327-ae6f-4702a4d5281e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:58:03.229050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.229469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.236953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.238105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.238553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.239281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.239748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.240262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.260480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 6255ec55-f11e-457b-b949-b17da3834864 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:03.269632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:58:03.295686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0f49f95-8de8-4bbc-8a3d-d765ceadda8a tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 2416 microversion: 2.25 time: 0.299104 Oct 28 09:58:03.297146 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1041/2063] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:02 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 2416 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:03.315677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.316628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.328175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.328686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.329232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.329969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.330480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.330911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.387694 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f268fcb9-0299-4b8b-9935-7ff5bb4919fb tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67" status: 204 len: 0 microversion: 2.47 time: 0.163378 Oct 28 09:58:03.388622 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1023/2064] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 09:58:03 2022] DELETE /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 09:58:03.395634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-zed-1", "block_migration": "auto"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:03.398647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.408877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.409564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.410020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.410813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.411223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.411956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.421987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.435970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.437683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.441668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'flavor' on Instance uuid 6255ec55-f11e-457b-b949-b17da3834864 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:03.444462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6374575-e17d-4d5e-ad35-19fd9f1b45a0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.145916 Oct 28 09:58:03.447617 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1042/2065] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:03 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:03.452464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.453695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.459722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.460403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.461083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.462304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.463827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.464429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.479578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Going to try to live migrate instance to n-h1-zed-1 {{(pid=128748) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:58:03.544216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.554677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.557453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:03.558861 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75200313-4c2f-449b-8442-68d764ff9133 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67" status: 200 len: 1363 microversion: 2.47 time: 0.110090 Oct 28 09:58:03.559926 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1043/2066] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:03 2022] GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 => generated 1363 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:03.920715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:03.921536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:03.928711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.929329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.929994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:03.930710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:03.931758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:03.932197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.116513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.129681 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f24c8907-dac4-4a8a-ad23-58e9c41be590 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1209 microversion: 2.1 time: 0.212449 Oct 28 09:58:04.141474 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1044/2067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:03 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1209 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:58:04.152194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:04.152194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:04.157727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.158363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.158872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.182035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.184878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.188491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.340541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.350459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.352035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.357985 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f61f8925-7261-4480-865d-99c521058da8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1531 microversion: 2.91 time: 0.211261 Oct 28 09:58:04.358726 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1045/2068] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:04 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1531 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:04.503308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:04.505511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:04.515374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.516286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.517079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.519068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.521350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.522415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.644393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lazy-loading 'services' on Instance uuid 44005b9d-3f5a-4aab-919d-3c9072329bd6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:04.663141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75f791d8-5f27-4294-8d17-aca87aabb6a5 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1930 microversion: 2.91 time: 0.281258 Oct 28 09:58:04.663949 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1046/2069] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:04 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1930 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:04.668678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:04.669320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:04.675730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.676227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.676952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.677737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.678729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.679167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.749156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.757588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.759559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.766224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-103aa7fd-e1cb-4671-a3f3-229334487b4f tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.100688 Oct 28 09:58:04.767027 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1047/2070] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:04 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:04.776380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:04.777772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:04.786935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.787439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.788067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.788940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.789261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.789707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.861458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.869795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.871223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:04.872409 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-286148f8-959c-476a-a39d-3e88e1ceb5fd tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67" status: 200 len: 1363 microversion: 2.47 time: 0.104088 Oct 28 09:58:04.872994 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1048/2071] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:04 2022] GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 => generated 1363 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:04.895701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:04.896330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:04.903152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.903643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.904087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.904796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:04.905280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:04.905705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:04.908526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:04.986357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lazy-loading 'services' on Instance uuid 44005b9d-3f5a-4aab-919d-3c9072329bd6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:05.005902 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a306c7ad-8ba6-42f6-a4ba-82a24c1fa196 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1930 microversion: 2.91 time: 0.115664 Oct 28 09:58:05.006449 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1049/2072] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:04 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1930 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:05.033566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:05.038361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.038858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.039298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.040036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.040516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.040963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.065386 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b951148-4be9-43ba-bcd0-10874ead10fe tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 492 microversion: 2.91 time: 0.036139 Oct 28 09:58:05.065986 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1050/2073] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 09:58:05 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 492 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:58:05.078608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:05.079141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:05.085162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.085650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.086089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.087339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.087339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.087657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.111631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lazy-loading 'flavor' on Instance uuid 44005b9d-3f5a-4aab-919d-3c9072329bd6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:05.334145 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9638f00a-ebc7-4bee-aad7-12e0f435b4c8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action" status: 202 len: 0 microversion: 2.91 time: 0.259081 Oct 28 09:58:05.334877 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1051/2074] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:58:05 2022] POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 28 09:58:05.340169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:05.340866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:05.347106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.347596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.348033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.348746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.349216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.349648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.497215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.505089 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f56fa6f1-1688-430a-ac3b-2bf5d265e5f0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1197 microversion: 2.1 time: 0.169080 Oct 28 09:58:05.505668 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1052/2075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:05 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:05.510200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:05.510846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:05.517700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.518488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.518946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.519684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.520153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.520591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.588954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.597986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.599300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.605591 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6806ed9c-f1ef-402d-aed1-6fc015de1fc0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.098922 Oct 28 09:58:05.606163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1053/2076] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:05 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:05.794665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:05.795835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:05.802175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.802668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.803109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.803813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.804273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.804700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.901278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.916299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.917936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:05.923380 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4400095-e9a9-4b22-98e5-6faa2c5fd0f8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1447 microversion: 2.75 time: 0.132650 Oct 28 09:58:05.931585 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1054/2077] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:05 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1447 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:05.931585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:05.931585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:05.938180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.938690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.939141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:05.939831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:05.940287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:05.940721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.012151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.022114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.023779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.026113 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7d05eb3-55d7-4037-968e-3fb56dbcebaa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67" status: 200 len: 1363 microversion: 2.47 time: 0.100974 Oct 28 09:58:06.026899 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1055/2078] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:05 2022] GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 => generated 1363 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:06.530746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:06.531772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:06.538485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.539117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.539767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.540593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.541297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.541742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.669801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b5ace88-dde5-4063-9bdc-733e49f7a9bb tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/action" status: 202 len: 0 microversion: 2.25 time: 3.279538 Oct 28 09:58:06.671596 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1024/2079] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:58:03 2022] POST /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/action => generated 0 bytes in 3282 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:58:06.677723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:06.678630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:06.687440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.699532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.699756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.700193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.701005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.701487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.701946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.723874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-73ef8b5a-f6ab-4f3f-ac9e-f0978acc41b7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1197 microversion: 2.1 time: 0.196530 Oct 28 09:58:06.740073 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1056/2080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:06 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:06.751448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:06.752077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:06.760818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.761483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.762671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.763409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.763913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.764703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.831492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.841505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.847034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:06.854048 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bc9fd402-98fd-4d09-b6fb-8025ab9e63ae tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.180296 Oct 28 09:58:06.854667 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1025/2081] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:06 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:06.952932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:06.953531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:06.965669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.966680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.967345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:06.968611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:06.969279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:06.969914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.035789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.049244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.050949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.053023 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b46d5f7e-2bb6-46fd-a1a4-6ba22068476e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.306647 Oct 28 09:58:07.065380 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1057/2082] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:06 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:07.075050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.077402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:07.078268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:07.085054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.085758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.086386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.087341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.088701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.089349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.089980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.090641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.096982 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae8ba6ce-706d-461b-9fff-2aa1b64503a2 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1453 microversion: 2.75 time: 0.148196 Oct 28 09:58:07.098007 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1026/2083] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:06 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:07.129900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.130405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.130850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.131312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lazy-loading 'fault' on Instance uuid 6c0460f8-e443-4ccc-b8ab-1b5730367d67 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:07.190770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.200261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.201746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f9ad41b36abd4eb8945f3ec85ce8f5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0710c69d87dc4f7fa6999e314efc8022', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.202973 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-03a2b66b-cb70-40b8-9bf5-aa4766375513 tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67" status: 200 len: 1368 microversion: 2.47 time: 0.136280 Oct 28 09:58:07.203765 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1058/2084] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:07 2022] GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 => generated 1368 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:07.748170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:07.748811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:07.751291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:07.756536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.757060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.757506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.758205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.758841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.759322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.882437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:07.883242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:07.902206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.902796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.903498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.903809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.904714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:07.905297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:07.905885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:07.910897 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7ec22444-81fd-4318-a7ae-5cb5d4fe8fd8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1197 microversion: 2.1 time: 0.167084 Oct 28 09:58:07.912207 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1027/2085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:07 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:07.986869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.996740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:07.998371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:08.003831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a8b687e1-79c2-4915-8b81-2f9bc1f65fb0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.125370 Oct 28 09:58:08.004408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1059/2086] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:07 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:08.061427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:08.062125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:08.068884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.069481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.069992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.070774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.071299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.072405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.083170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:08.084466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:08.086923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] HTTP exception thrown: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Request method failure captured: Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf HTTP/1.1 Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6a-WlWDLiZ6o6uTu3QsDXJrFCSRjZzuR7jcgaBIzoNonC5Y62UrDtzUYIJNFKeRAQUmaJYnJQ4g_DT9XhIrYuJGE-8GB2gRnjJv1p9Z7npnOBt2QC8E8lUkWdM0gB60yWDHnIc05Ind4PmmHoVPwyJsiWdEwNe1HTKbCDp8Rqf7kUI Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 70725194c6a84c4a991a8acc16a8bf68 Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:58:08.089409 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70725194c6a84c4a991a8acc16a8bf68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70725194c6a84c4a991a8acc16a8bf68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70725194c6a84c4a991a8acc16a8bf68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70725194c6a84c4a991a8acc16a8bf68"}]}] Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 70725194c6a84c4a991a8acc16a8bf68 Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachSCSIVolumeTestJSON-1483349063-project Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a0a8b4be16e0439dbacf9d3c6cfeb527 Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1483349063-project Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.091268 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '7dd40166-156e-4d19-aa39-44ce7e03bbaf'} Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:08.092320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.094034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.095712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.095712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.095712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.095712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.096100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.096100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.097312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Returning 404 to user: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:08.098852 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b73816e-8fb2-4749-8fdc-bac2170a56e7 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 404 len: 111 microversion: 2.1 time: 0.041103 Oct 28 09:58:08.099955 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1028/2087] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:58:08 2022] DELETE /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:08.108710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:08.109849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] [instance: 7dd40166-156e-4d19-aa39-44ce7e03bbaf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:08.116547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.117361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.118027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.119066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.119742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.120374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.135322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] HTTP exception thrown: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Request method failure captured: Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf HTTP/1.1 Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6a-WlWDLiZ6o6uTu3QsDXJrFCSRjZzuR7jcgaBIzoNonC5Y62UrDtzUYIJNFKeRAQUmaJYnJQ4g_DT9XhIrYuJGE-8GB2gRnjJv1p9Z7npnOBt2QC8E8lUkWdM0gB60yWDHnIc05Ind4PmmHoVPwyJsiWdEwNe1HTKbCDp8Rqf7kUI Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 70725194c6a84c4a991a8acc16a8bf68 Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:58:08.137204 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70725194c6a84c4a991a8acc16a8bf68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/70725194c6a84c4a991a8acc16a8bf68"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_70725194c6a84c4a991a8acc16a8bf68", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/70725194c6a84c4a991a8acc16a8bf68"}]}] Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 70725194c6a84c4a991a8acc16a8bf68 Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1483349063 Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachSCSIVolumeTestJSON-1483349063-project Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a0a8b4be16e0439dbacf9d3c6cfeb527 Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1483349063-project Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.139010 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '7dd40166-156e-4d19-aa39-44ce7e03bbaf'} Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:08.140120 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. Oct 28 09:58:08.141808 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.144489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] Returning 404 to user: Instance 7dd40166-156e-4d19-aa39-44ce7e03bbaf could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:08.145589 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e299bd35-b947-4742-8778-d533221f6366 tempest-AttachSCSIVolumeTestJSON-1483349063 tempest-AttachSCSIVolumeTestJSON-1483349063-project] 10.222.0.16 "GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf" status: 404 len: 111 microversion: 2.1 time: 0.041330 Oct 28 09:58:08.146672 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1029/2088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:08 2022] GET /compute/v2.1/servers/7dd40166-156e-4d19-aa39-44ce7e03bbaf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:08.156761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:08.161607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:08.177839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.178730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.179246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.180182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.180587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.181140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.264968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:08.270001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:08.276311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:08.277924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:08.279519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-26a7a63e-f4f9-4452-8b65-0cefb0977f31 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.201262 Oct 28 09:58:08.280762 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1060/2089] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:08 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:08.300877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:08.301441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:08.302516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] [instance: 6c0460f8-e443-4ccc-b8ab-1b5730367d67] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:08.303155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:08.309346 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a5889251-de95-4a72-a841-bae2e11bdd43 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1453 microversion: 2.75 time: 0.161335 Oct 28 09:58:08.310042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.310219 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1030/2090] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:08 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:08.311084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.311687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.312567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.313214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.313824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:08.330445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] HTTP exception thrown: Instance 6c0460f8-e443-4ccc-b8ab-1b5730367d67 could not be found. Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Request method failure captured: Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 HTTP/1.1 Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6d5CjF37xEEUSNdDU5wFthCYubbUQTboJJpvr0M8XOKHRhN5s9SCK0qh097VyrOazLormx0cBrEQ7eMsPHGmNxNWJLjfZXokaJRhdNfc2yK7__GKxtNtPUyWcevrBkfRmgAB02bsGuikhqRViKP0FFyP14YzKz9lGgltLycta-05AQ Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 0710c69d87dc4f7fa6999e314efc8022 Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerShowV247Test-1173248830 Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:58:08.332582 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0710c69d87dc4f7fa6999e314efc8022"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0710c69d87dc4f7fa6999e314efc8022"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0710c69d87dc4f7fa6999e314efc8022", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0710c69d87dc4f7fa6999e314efc8022"}]}] Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerShowV247Test-1173248830 Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 0710c69d87dc4f7fa6999e314efc8022 Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerShowV247Test-1173248830 Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerShowV247Test-1173248830-project Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f9ad41b36abd4eb8945f3ec85ce8f5a5 Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerShowV247Test-1173248830-project Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 6c0460f8-e443-4ccc-b8ab-1b5730367d67 could not be found. Oct 28 09:58:08.334343 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '6c0460f8-e443-4ccc-b8ab-1b5730367d67'} Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0460f8-e443-4ccc-b8ab-1b5730367d67 could not be found. Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:08.335215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0460f8-e443-4ccc-b8ab-1b5730367d67 could not be found. Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0460f8-e443-4ccc-b8ab-1b5730367d67 could not be found. Oct 28 09:58:08.337706 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:08.339749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] Returning 404 to user: Instance 6c0460f8-e443-4ccc-b8ab-1b5730367d67 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:08.339749 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0453cbb2-cc20-43a1-a76a-94a8a755abfa tempest-ServerShowV247Test-1173248830 tempest-ServerShowV247Test-1173248830-project] 10.222.0.16 "GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67" status: 404 len: 111 microversion: 2.47 time: 0.052343 Oct 28 09:58:08.339749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1061/2091] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:08 2022] GET /compute/v2.1/servers/6c0460f8-e443-4ccc-b8ab-1b5730367d67 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:58:08.952624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:08.956793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:08.983060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:08.989324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:08.991525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.000732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:09.001270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:09.002111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.032734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:09.033389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:09.044947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:09.049782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:09.050511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.051444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:09.052335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:09.052984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.053763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:09.174117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.186596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.188285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.204238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5fbcc9a9-6a49-4a5e-b582-685e186ad25e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.176396 Oct 28 09:58:09.205180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1062/2092] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:09 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:09.305671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:09.307284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:09.309015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.315873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:09.317014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:09.317648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.318974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:09.319781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:09.320397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.331459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:09.362370 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-64562f11-416e-496f-8b39-be13594c1ae4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1197 microversion: 2.1 time: 0.423694 Oct 28 09:58:09.362962 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1031/2093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:08 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1197 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:09.382667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:09.383884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:09.397606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:09.399979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:09.401123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.402986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:09.405343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:09.405995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:09.606254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.617378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.619976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.622115 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31f87494-9325-4415-8e94-744d1b7cce91 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.320694 Oct 28 09:58:09.624496 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1063/2094] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:09 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:09.630737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.633212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:09.643734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.645207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:09.659717 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a73da2e6-9534-4707-b20d-fb18af0b3969 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1453 microversion: 2.75 time: 0.286481 Oct 28 09:58:09.660891 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1032/2095] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:09 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1453 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:10.235973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:10.236604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:10.247456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.248287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.249467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.250150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.250823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.251547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.315406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:10.390102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:10.391292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:10.404120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.404802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.405771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.406757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.407332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.407872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.409963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:10.420142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:10.431618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:10.437986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37dfc9e1-6a1d-4c9e-a7db-1a982f50c3ce tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.208187 Oct 28 09:58:10.438572 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1064/2096] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:10 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:10.637358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:10.649054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:10.649772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:10.650110 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41aefa48-380a-49bc-8463-942a32a33c82 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1197 microversion: 2.1 time: 0.265437 Oct 28 09:58:10.652243 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1033/2097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:10 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1197 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:58:10.670794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.671316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.671762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.672491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.673244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.673393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.692914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:10.693678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:10.705500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.708986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.709718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.710491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:10.716684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:10.717558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:10.840841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:10.850862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:10.852317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:10.859235 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-02cdb3ce-213c-4b8e-abfe-c341037838dc tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1453 microversion: 2.75 time: 0.171239 Oct 28 09:58:10.895436 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1034/2098] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:10 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1453 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:11.315586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:11.331525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:11.334888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:11.336403 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a1cc2d9-b05c-4ee5-8c2e-a9bfe1651578 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.692524 Oct 28 09:58:11.338655 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1065/2099] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:10 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:11.483645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:11.484155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:11.496428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:11.496973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:11.497641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:11.499913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:11.500577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:11.501288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:11.646095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:11.657219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:11.658591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:11.675166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:11.676074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:11.676219 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2106877d-5496-4d1b-b18b-33afa764271c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.209316 Oct 28 09:58:11.678868 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1035/2100] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:11 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:11.684768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:11.685739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:11.686407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:11.687451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:11.688151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:11.693560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:11.896448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:11.904773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:11.913811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:11.914639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:11.915526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:11.916826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:11.917525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:11.918177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.009956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:12.020779 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ec9557a-897e-4c90-898d-1d7ae06fce0a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1197 microversion: 2.1 time: 0.349802 Oct 28 09:58:12.024271 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1066/2101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:11 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1197 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:12.045855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:12.054917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:12.057851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:12.076880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7b7baf6-be48-46af-8bd6-b37c3e69a823 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1438 microversion: 2.75 time: 0.185506 Oct 28 09:58:12.089201 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1036/2102] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:11 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1438 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:12.367299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:12.367970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:12.381993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.382853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.385581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.388343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.389122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.391013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.550867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:12.558747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:12.568533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.569450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.570361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.571554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.572314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.572954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.727800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:58:12.728778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:58:12.729294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:58:12.729711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:58:12.730134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:58:12.815825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:12.823018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:12.825698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.826518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.827400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.828609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.829368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.830346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.940056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:12.961629 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1dae2db9-ea8b-4532-a397-bb3cae3e7ece tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a/action" status: 202 len: 1936 microversion: 2.75 time: 0.855339 Oct 28 09:58:12.964159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1067/2103] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:58:12 2022] POST /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a/action => generated 1936 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 28 09:58:12.969878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:12.970735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:12.977142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.977939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.979547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:12.980502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:12.981184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:12.981788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:13.108732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:13.122737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:13.125502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:13.133245 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b15808d1-cc06-41d9-ac6b-f4c834dd5fde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.167560 Oct 28 09:58:13.135837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1068/2104] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:12 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:13.150854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-29521fd2-fea3-41fa-9550-bd2ad9720758 req-f00182d7-f1ff-431a-aa99-69f742aa6a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3251b41a-f111-4ff3-b549-d3d97fd3b0d2", "name": "network-vif-plugged", "status": "completed", "tag": "3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:13.176169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-29521fd2-fea3-41fa-9550-bd2ad9720758 req-f00182d7-f1ff-431a-aa99-69f742aa6a31 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:13.178066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-29521fd2-fea3-41fa-9550-bd2ad9720758 req-f00182d7-f1ff-431a-aa99-69f742aa6a31 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:13.191778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-29521fd2-fea3-41fa-9550-bd2ad9720758 req-f00182d7-f1ff-431a-aa99-69f742aa6a31 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:13.221372 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-29521fd2-fea3-41fa-9550-bd2ad9720758 req-f00182d7-f1ff-431a-aa99-69f742aa6a31 service nova] Creating event network-vif-plugged:3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466 for instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 on n-h1-zed-1 Oct 28 09:58:13.233141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-29521fd2-fea3-41fa-9550-bd2ad9720758 req-f00182d7-f1ff-431a-aa99-69f742aa6a31 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095949 Oct 28 09:58:13.237306 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1069/2105] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:13.249101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:13.249983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:13.257593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:13.258103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:13.258553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:13.259836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:13.260306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:13.260744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:13.316619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:13.343949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:13.351610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:13.358947 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc11536c-9c77-465d-9abc-2995be3d2983 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.990535 Oct 28 09:58:13.359740 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1037/2106] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:12 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:13.368353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:13.372007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:13.387901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:13.391452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:13.392000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:13.393004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:13.393553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:13.394082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:13.452434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:13.490363 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9e03d232-21d5-424e-ad16-488f78b89785 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.251668 Oct 28 09:58:13.491080 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1070/2107] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:13 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:13.971455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.001175 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c65f791-6140-4df1-a265-a00993587de4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1197 microversion: 2.1 time: 0.639186 Oct 28 09:58:14.006731 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1038/2108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:13 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1197 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:14.173166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:14.173960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:14.182560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:14.186039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:14.186774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:14.188294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:14.190062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:14.191125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:14.391100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:14.392288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:14.407612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:14.410275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:14.414629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:14.415756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:14.417915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:14.418760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:14.573467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.593086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.595053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.607840 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f9e1a54-f1ae-40b3-843e-c4c59ecd82e3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.442837 Oct 28 09:58:14.623067 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1071/2109] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:14 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:14.636536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:14.637205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:14.646196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:14.646767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:14.647405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:14.647981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:14.648511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:14.648969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:14.789892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:14.834261 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2e461d9a-6764-4431-970a-2752b425959e tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.209461 Oct 28 09:58:14.835088 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1072/2110] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:14 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:14.956304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.967208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.970347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:14.974793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae68304d-8f6e-4d31-b7b6-0856caed707f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.585369 Oct 28 09:58:14.975565 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1039/2111] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:14 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:15.027845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:15.028587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:15.043388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.045173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.046113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:15.048070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.049634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.050329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:15.051313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:15.489672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:15.504380 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f2a03b3d-b652-4d24-871b-da5f33d5842e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1381 microversion: 2.1 time: 0.480983 Oct 28 09:58:15.526248 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1073/2112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:15 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1381 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:15.642359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:15.643712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:15.654148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.657360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.660712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:15.662540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.664768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.665563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:15.817883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:15.819186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:15.828447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.829241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.829860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:15.830780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.831418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.832070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:15.832264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:15.841318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:15.846287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:15.859861 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e50d7dcb-f380-483d-b082-69d20ba1bb25 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.224488 Oct 28 09:58:15.880620 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1074/2113] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:15 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:15.892244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:15.892859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:15.909455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.910170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.910814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:15.911736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:15.912376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:15.913015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.038565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:16.060491 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bde74562-3c9e-4cc2-b12f-5886d4df57bb tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.178436 Oct 28 09:58:16.061148 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1075/2114] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:15 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:16.066386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:16.067019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:16.074347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.074858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.075303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.076035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.076497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.077257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.232476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:16.242614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:16.244203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:16.246188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5330ee29-7c22-4269-8441-b5813fbb799d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.184070 Oct 28 09:58:16.246763 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1076/2115] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:16 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:16.463507 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6537a9ee-bda6-42c1-8df3-4a90cae6dc7a tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1526 microversion: 2.1 time: 0.932230 Oct 28 09:58:16.464088 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1040/2116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:15 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1526 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:16.486361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:16.487063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:16.493845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.494449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.494891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.495655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.496181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.496706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.631937 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a691168d-b6e3-4218-b4ab-66565c943cac tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1526 microversion: 2.1 time: 0.149127 Oct 28 09:58:16.632620 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1077/2117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:16 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:58:16.655384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:16.659251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.659848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.660360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.661356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.662042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.662468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.687408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fea1b98c-410e-44f1-8263-a320e268f657 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 0.035750 Oct 28 09:58:16.688024 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1041/2118] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 09:58:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:58:16.701374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-zed-1", "block_migration": false, "disk_over_commit": false}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:16.703992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:16.710207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.710712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.711155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.711865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.713542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.714178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.717034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:16.755224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lazy-loading 'flavor' on Instance uuid 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:16.771567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Going to try to live migrate instance to n-h2-zed-1 {{(pid=128747) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 09:58:16.895731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:16.897141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:16.907551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.909989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.910719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:16.911700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:16.912864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:16.916007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:17.140035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:17.178310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:17.188019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:17.202977 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ac7fe24-1eb6-4ac1-b172-fcc740be2f17 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.310975 Oct 28 09:58:17.204319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1042/2119] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:16 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:17.214203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:17.216433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:17.235085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:17.243326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:17.244614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:17.245604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:17.246571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:17.247601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:17.514167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:17.564647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99b94b9f-a36d-4c2f-bedb-4e0916a0e2d6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.358437 Oct 28 09:58:17.565789 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1043/2120] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:17 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:17.572820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:17.573870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:17.583499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:17.584414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:17.585123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:17.586193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:17.586804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:17.587509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:17.819941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:17.832770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:17.836598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:17.839609 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d379d915-9be3-429b-8ad9-90ebb21b69d5 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.272523 Oct 28 09:58:17.841366 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1044/2121] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:17 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:18.233495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:18.234501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:18.243569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:18.244076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:18.244525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:18.245279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:18.245741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:18.246175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:18.401334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:18.411300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:18.423761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:18.434927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f5122e9-bdf1-427a-a185-5005da4bf7ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.205498 Oct 28 09:58:18.450438 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1045/2122] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:18 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:18.598100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:18.598817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:18.611204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:18.611800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:18.612311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:18.613149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:18.613614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:18.617218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:18.726648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:18.769886 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d3b1d68e-bdc4-4f9a-aa94-31622bbddb88 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.174988 Oct 28 09:58:18.771998 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1046/2123] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:18 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:18.867925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:18.868891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:18.877657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:18.881338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:18.882023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:18.885157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:18.886620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:18.889109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:19.201607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:19.221407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:19.223237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:19.225844 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eeb54fe3-b907-4ee3-9120-1fcb6140919c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.362424 Oct 28 09:58:19.237125 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1047/2124] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:18 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:19.266365 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-01415cff-21ff-4f39-be78-33a9a7d5d306 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2/action" status: 202 len: 0 microversion: 2.1 time: 2.569509 Oct 28 09:58:19.267351 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1078/2125] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:58:16 2022] POST /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2/action => generated 0 bytes in 2571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 09:58:19.276473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:19.278118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:19.285056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:19.285540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:19.286200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:19.286916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:19.289257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:19.290993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:19.469363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:19.470141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:19.504672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:19.505712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:19.506963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:19.512541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:19.513774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:19.515720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:19.941083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:19.954632 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7054a2a-b446-4a37-8071-20d878054eb9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.682539 Oct 28 09:58:19.956025 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1048/2126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:19 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:19.960939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:19.961951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:19.965406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:19.973728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:19.975965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:19.978047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:19.979055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:19.980324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:19.981691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:20.007570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:20.023069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:20.036546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:20.039694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:20.065216 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-90563e8b-6b2c-4e9c-900e-d535e669c8fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.588939 Oct 28 09:58:20.068262 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1079/2127] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:19 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:20.125834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:20.147907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.190473 Oct 28 09:58:20.149180 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1049/2128] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:19 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:20.271250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:20.272792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:20.282899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:20.283379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:20.283874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:20.284826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:20.285274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:20.285802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:20.515426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:20.516479 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0acc37cf-dfd3-49b5-a66c-dc4a1ee4d7f3 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001698 Oct 28 09:58:20.526176 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1050/2129] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 09:58:20 2022] GET /compute/ => generated 377 bytes in 12 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 09:58:20.595682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:20.607487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:20.611444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:20.616172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b6485f6-d508-4170-8384-062ebe7fd15d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.349567 Oct 28 09:58:20.617169 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1080/2130] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:20 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:20.982574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:20.983516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:20.991521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:20.992014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:20.995371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:20.996659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:20.997255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:20.997768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:21.096565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:21.097362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:21.107222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:21.108265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:21.109003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:21.110003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:21.111444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:21.112195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:21.236892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:21.248488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:21.258211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:21.266629 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-802f21cd-371e-4954-9e01-5ef452e31be1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.175143 Oct 28 09:58:21.268289 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1081/2131] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:21 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:21.273657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:21.275323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:21.282722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:21.283666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:21.284388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:21.285431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:21.286131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:21.286795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:21.394771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:21.419595 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca11ca71-a802-45cf-ae30-7786902ff0ed tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.149909 Oct 28 09:58:21.435388 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1082/2132] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:21 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:21.472750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7214812f-86ca-40a1-b976-4ea8006ccd6e req-6cd61468-1ff9-4904-a332-00fdb6cd6b15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6255ec55-f11e-457b-b949-b17da3834864", "name": "network-vif-unplugged", "status": "completed", "tag": "dedd9f55-4ec9-4fd5-bc71-af4596ace404"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:21.490483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7214812f-86ca-40a1-b976-4ea8006ccd6e req-6cd61468-1ff9-4904-a332-00fdb6cd6b15 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:21.491779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7214812f-86ca-40a1-b976-4ea8006ccd6e req-6cd61468-1ff9-4904-a332-00fdb6cd6b15 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:21.492835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7214812f-86ca-40a1-b976-4ea8006ccd6e req-6cd61468-1ff9-4904-a332-00fdb6cd6b15 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:21.513407 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7214812f-86ca-40a1-b976-4ea8006ccd6e req-6cd61468-1ff9-4904-a332-00fdb6cd6b15 service nova] Creating event network-vif-unplugged:dedd9f55-4ec9-4fd5-bc71-af4596ace404 for instance 6255ec55-f11e-457b-b949-b17da3834864 on n-h2-zed-1 Oct 28 09:58:21.518427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7214812f-86ca-40a1-b976-4ea8006ccd6e req-6cd61468-1ff9-4904-a332-00fdb6cd6b15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055259 Oct 28 09:58:21.519715 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1083/2133] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:58:21.562612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:21.573320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8220d5e5-5143-4ab8-9bfb-17347c1dcbd0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.594625 Oct 28 09:58:21.574317 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1051/2134] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:20 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:21.796313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:21.797036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:21.805312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:21.806551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:21.807188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:21.808087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:21.808756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:21.809818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:22.186366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.195258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.197496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.198925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d8d144e-af4c-4dee-bc4e-d8c99e38152f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.558677 Oct 28 09:58:22.213366 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1084/2135] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:21 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:22.297316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:22.297938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:22.309342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:22.312781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:22.313555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:22.318440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:22.319152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:22.319805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:22.452292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:22.453281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:22.464947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:22.465632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:22.467368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:22.470797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:22.470797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:22.470797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:22.498170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.512508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.518317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.530790 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-125504c8-53d9-4e90-bd75-5bcad0ac62d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.237580 Oct 28 09:58:22.532318 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1052/2136] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:22 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:22.591939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:22.604392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:22.605618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:22.616163 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-789310b6-cea4-48bc-8bff-4b3c8d8657ac tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.167883 Oct 28 09:58:22.617261 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1085/2137] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:22 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:22.618993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:22.619678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:22.620183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:22.620892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:22.621366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:22.621790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:22.909555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:22.918486 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5e9cd88-ac61-4182-bf63-ec18578a143a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.318472 Oct 28 09:58:22.925292 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1053/2138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:22 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:23.233425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:23.234285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:23.252426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.253523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.254230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.256890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.257644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.259589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.566408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:23.566809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:23.578837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.579363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.579807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.580547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.587788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.588704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.667972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:23.683748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:23.691415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:23.695189 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2439cbe0-e1cb-45ab-8256-05ba9c17e48e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.467647 Oct 28 09:58:23.697217 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1086/2139] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:23 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:23.716765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6494dbf7-cc97-494f-9e98-25c8514ea720 req-f36ea317-d5c5-4b83-86d1-d6eca0946f1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6255ec55-f11e-457b-b949-b17da3834864", "tag": "dedd9f55-4ec9-4fd5-bc71-af4596ace404"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:23.748560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6494dbf7-cc97-494f-9e98-25c8514ea720 req-f36ea317-d5c5-4b83-86d1-d6eca0946f1b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.754399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6494dbf7-cc97-494f-9e98-25c8514ea720 req-f36ea317-d5c5-4b83-86d1-d6eca0946f1b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.754901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6494dbf7-cc97-494f-9e98-25c8514ea720 req-f36ea317-d5c5-4b83-86d1-d6eca0946f1b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.755425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:23.771969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:23.777827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:23.784535 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6494dbf7-cc97-494f-9e98-25c8514ea720 req-f36ea317-d5c5-4b83-86d1-d6eca0946f1b service nova] Creating event network-changed:dedd9f55-4ec9-4fd5-bc71-af4596ace404 for instance 6255ec55-f11e-457b-b949-b17da3834864 on n-h2-zed-1 Oct 28 09:58:23.790596 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-960c1ebb-43bf-4391-8c95-7afc7a6470bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.228818 Oct 28 09:58:23.799555 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1054/2140] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:23 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:23.804941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:23.809651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:23.818436 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6494dbf7-cc97-494f-9e98-25c8514ea720 req-f36ea317-d5c5-4b83-86d1-d6eca0946f1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119604 Oct 28 09:58:23.819066 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1087/2141] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:23.823256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.823997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.824626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.825553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.826231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.827986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.952114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:23.953369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:23.966382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.967560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.968468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:23.970854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:23.972884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:23.975446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:23.976083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:24.009150 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f6075ebd-3dbf-422e-aada-8a693512e147 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.208012 Oct 28 09:58:24.025970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1055/2142] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:23 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:24.526412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:24.538747 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-88b5bea5-c243-4d22-a3ab-32f188ffda0b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.591755 Oct 28 09:58:24.540513 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1088/2143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:23 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:24.728719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:24.729577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:24.741629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:24.744953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:24.757930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:24.760610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:24.764318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:24.767603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:24.847172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:24.849357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:24.870965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:24.872012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:24.873208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:24.875432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:24.878666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:24.881250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:25.017676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:25.030546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:25.034959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:25.053371 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2300bd5-37d4-46dc-ade8-30836366a987 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.219080 Oct 28 09:58:25.054910 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1089/2144] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:24 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:25.060273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:25.063638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:25.077585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:25.078585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:25.081783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:25.082935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:25.083609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:25.086917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:25.152434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:25.172190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:25.178549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:25.181899 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-950a2dde-1f55-4478-a89c-fb894e54152c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.457829 Oct 28 09:58:25.182964 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1056/2145] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:24 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:25.214591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:25.234626 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4399cd98-bc35-46c3-9c75-1ba5871b652a tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.178274 Oct 28 09:58:25.235611 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1090/2146] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:25 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:25.566457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:25.567084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:25.602136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:25.603485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:25.604116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:25.605032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:25.605600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:25.606329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:25.954423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:25.972028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb03f50f-8f2f-4718-b85e-588759a6c63a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.409397 Oct 28 09:58:25.972657 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1057/2147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:25 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:26.084617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:26.084617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:26.116275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:26.119653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:26.121214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:26.123689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:26.124172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:26.124635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:26.210219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:26.210905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:26.222568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:26.223067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:26.223501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:26.224232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:26.224687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:26.225144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:26.277893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:26.287046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:26.300589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:26.311228 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c2c335c-e890-4046-8ce7-299d958e8364 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.231243 Oct 28 09:58:26.313438 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1091/2148] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:26 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:26.327428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:26.329043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:26.341689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:26.342501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:26.343114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:26.344031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:26.344661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:26.345459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:26.508824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:26.536654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:26.559171 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-84d8b23c-6983-4da2-aa4e-35cf7316d6f0 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.244395 Oct 28 09:58:26.573303 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1092/2149] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:26 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:26.669156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:26.823936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:26.839857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:26.841910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:26.844528 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-052dbd3f-7abf-44b6-a817-86cbe71de037 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.640042 Oct 28 09:58:26.862592 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1058/2150] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:26 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:27.008035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:27.008635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:27.022530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.023278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.026158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:27.027101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.029643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.030138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:27.350266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:27.352490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:27.364154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.364922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.365590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:27.366527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.367089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.367605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:27.397810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:27.414775 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2a630620-a7e8-4e2a-91ba-f9a314566f20 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.411303 Oct 28 09:58:27.416739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1093/2151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:27 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:27.488279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:27.500712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:27.502786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:27.512185 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c4e2a1c7-4795-483c-b094-7d98ced97a38 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.168065 Oct 28 09:58:27.513599 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1059/2152] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:27 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:27.593464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:27.594118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:27.602908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.603408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.603851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:27.604568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.606230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.606755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:27.759858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:27.800353 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-039277fd-a210-480e-aee0-5cc02ad1acfd tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.212113 Oct 28 09:58:27.813546 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1094/2153] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:27 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:27.874483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:27.875959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:27.904857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.905808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.917316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:27.920707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:27.922844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:27.923931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:28.268827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:28.282026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:28.283900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:28.285541 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7ec2f02f-0d46-4b7e-8f48-140348a3ae48 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.415447 Oct 28 09:58:28.286706 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1060/2154] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:27 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:28.457742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:28.461864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:28.490882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:28.491556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:28.492005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:28.492787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:28.493271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:28.494233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:28.543698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:28.544190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:28.554963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:28.557685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:28.558454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:28.559409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:28.561568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:28.562277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:28.709369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:28.718439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:28.719936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:28.725397 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc90acf8-9b6e-464a-a506-00a6e76ce2e2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.186730 Oct 28 09:58:28.726537 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1061/2155] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:28 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:28.835028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:28.835648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:28.852702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:28.853228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:28.853657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:28.854376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:28.854827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:28.855251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:28.857350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:28.881399 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57c8d777-1ffe-4cd3-9a9d-de8418fee502 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.434526 Oct 28 09:58:28.882004 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1095/2156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:28 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:28.951810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:28.977068 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-18c63087-2f16-4525-9fa3-9b07aa581996 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.143493 Oct 28 09:58:28.977068 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1062/2157] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:28 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:29.315773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:29.316396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:29.346542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:29.347143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:29.347534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:29.352366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:29.360018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:29.360484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:29.748344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:29.761004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:29.762374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:29.780349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:29.783917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:29.786948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:29.787210 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-69bf8a16-4fdd-4d08-805a-6d3e38909d5c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.475022 Oct 28 09:58:29.787525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:29.788497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:29.789279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:29.792125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:29.793956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:29.808368 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1096/2158] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:29 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:29.907838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:29.910337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:29.918399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:29.919195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:29.920214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:29.921161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:29.921799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:29.922408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:29.929923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:29.954904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:29.962030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:29.976476 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-be5efca7-0e15-419c-b9f3-389200f9e942 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.221600 Oct 28 09:58:29.982032 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1063/2159] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:29 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:30.006268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:30.007160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:30.019357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:30.019866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:30.020374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:30.021080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:30.021865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:30.022834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:30.161473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:30.182367 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d5093cd1-01f5-436c-a8b2-19503472b355 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.180007 Oct 28 09:58:30.183164 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1064/2160] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:30 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:30.270042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:30.280797 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed153e60-6efe-4407-b55d-e11be8d80aaa tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.376884 Oct 28 09:58:30.282416 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1097/2161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:29 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:30.816978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:30.817591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:30.823735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:30.824469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:30.825108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:30.825988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:30.826606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:30.827201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:30.996070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:31.000793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:31.008185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:31.008820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:31.010931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:31.012659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:31.014460 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0aa6bda-f12d-436d-8737-c5282d25a5da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.201229 Oct 28 09:58:31.020591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:31.021475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:31.026172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1065/2162] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:30 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:31.026948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:31.027908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:31.028579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:31.029224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:31.161877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:31.176437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:31.182038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:31.191253 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-16ce048e-53f0-4c12-bf0e-0bbd789a464d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.187093 Oct 28 09:58:31.207432 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1098/2163] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:31 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:31.213563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:31.214201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:31.221237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:31.221729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:31.222166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:31.225307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:31.225799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:31.226600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:31.306546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:31.306945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:31.309075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:31.323608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:31.324177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:31.324650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:31.327422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:31.327766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:31.328193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:31.360114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:31.423804 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46ac6b00-f8cd-4112-990a-311881ed9890 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.214891 Oct 28 09:58:31.427422 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1066/2164] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:31 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:31.781691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:31.792216 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75c7953a-3dd2-4538-8446-d31a737fed16 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.491242 Oct 28 09:58:31.805742 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1099/2165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:31 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:32.042384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:32.043178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:32.059773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.060431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.060995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.061977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.062685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.063326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.224261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:32.226506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:32.240156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.241280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.241993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.242982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.243733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.244591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.375489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:32.386690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:32.388525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:32.394432 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2fdcb897-a407-42b9-9362-43e47c3f08b2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.177266 Oct 28 09:58:32.395328 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1100/2166] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:32 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:32.458333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:32.459408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:32.466728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.467602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.468405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.469722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.470488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.471184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.579449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:32.608236 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5902c51-2807-4481-8d19-2d7e1e710b7d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.154221 Oct 28 09:58:32.609511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1101/2167] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:32 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:32.830049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:32.830676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:32.831753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:32.844938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.845586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.846173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.847109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:32.847642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:32.848364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:32.850586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:32.852304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:32.857390 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4aea40f-4700-48e3-bf2e-79ab0eaa802e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.819227 Oct 28 09:58:32.862588 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1067/2168] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:32 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:33.425849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:33.426456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:33.435109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:33.436072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:33.436705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:33.437823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:33.438526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:33.439301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:33.513428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:33.527833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:33.529701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:33.536282 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a3a4acf-885a-4edf-8830-87e353673f31 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.115279 Oct 28 09:58:33.537562 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1068/2169] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:33 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:33.636133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:33.636800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:33.643823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:33.646781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:33.647440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:33.648375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:33.649211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:33.650515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:33.691821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:33.701382 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f6fb1f7-2528-41d0-9536-650f1ef9fadd tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.875786 Oct 28 09:58:33.702317 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1102/2170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:32 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:58:33.735289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:33.760820 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6d5a87a2-7f6a-43cf-aa73-11dab0939da9 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.128369 Oct 28 09:58:33.761741 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1069/2171] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:33 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:33.893545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:33.894250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:33.902976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:33.903781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:33.905095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:33.906014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:33.906653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:33.907259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:34.437858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:34.454921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:34.455124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-918552f5-074c-4977-9005-bfae51324e89 tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Calling method '.version_select at 0x7fca328d6a60>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:34.464202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:34.466789 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ecf49239-122c-4285-a729-1a8c44194008 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.576810 Oct 28 09:58:34.469599 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1103/2172] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:33 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:34.528217 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-918552f5-074c-4977-9005-bfae51324e89 tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.348400 Oct 28 09:58:34.529198 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1070/2173] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 09:58:34 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:58:34.547150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e41db908-f4c4-4a73-92ea-d7fac324485b tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Action: 'create', calling method: .version_select at 0x7fca33072790>, body: {"pool": "non_exist_pool"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:34.568429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:34.569630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:34.585641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:34.586489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:34.587795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:34.588918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:34.590205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:34.591181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:34.702720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:34.715189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:34.717996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:34.725163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-591cad27-53be-4d90-9775-6234c1042b41 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.162402 Oct 28 09:58:34.726499 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1071/2174] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:34 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:34.749178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:34.750344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:34.765983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:34.769498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:34.769977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:34.771018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:34.771699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:34.772103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:34.782057 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e41db908-f4c4-4a73-92ea-d7fac324485b tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] HTTP exception thrown: Floating IP pool not found. Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e41db908-f4c4-4a73-92ea-d7fac324485b tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Request method failure captured: Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 26 Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fKj9c2uScfABBuioUCRNDa45iAEl3zYDvCladgkH3gMKlEmt7-FVzQItWT6pBz9p5ysHToWzEDVpMTEMkuEnevkYHrXfG_ZlRx-DPiJPiOZdZ8l09mBtivSkbP-poQkgwjRqd3TgMLqv1f6TyHprSIOK5QKOxzRax3qS45HqK1Dz8 Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3fd10cfadbca4c68a0bbc2e3e5a7ccd8 Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-849877956 Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:58:34.783728 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3fd10cfadbca4c68a0bbc2e3e5a7ccd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3fd10cfadbca4c68a0bbc2e3e5a7ccd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3fd10cfadbca4c68a0bbc2e3e5a7ccd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3fd10cfadbca4c68a0bbc2e3e5a7ccd8"}]}] Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-849877956 Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3fd10cfadbca4c68a0bbc2e3e5a7ccd8 Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-849877956 Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FloatingIPsNegativeTestJSON-849877956-project Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 0879ef2ee11848b99f8a2421b36a8628 Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-849877956-project Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: {"pool": "non_exist_pool"} Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: exception: Floating IP pool not found. Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 28 09:58:34.785616 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:34.787009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e41db908-f4c4-4a73-92ea-d7fac324485b tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Returning 404 to user: Floating IP pool not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:34.788856 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e41db908-f4c4-4a73-92ea-d7fac324485b tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.247320 Oct 28 09:58:34.790927 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1104/2175] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 09:58:34 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:58:34.798583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:34.799187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:34.818134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:34.818888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:34.819505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:34.826626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:34.827177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:34.827626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:35.012213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:35.034286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:35.043241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff6a1be9-9652-4596-8b61-8eb7311830b6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.249086 Oct 28 09:58:35.052998 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1105/2176] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:34 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:35.074581 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-36b4b2e7-29bf-485c-b307-1ed087ac38e6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.345465 Oct 28 09:58:35.078802 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1072/2177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:34 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:35.079645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70daea7a-6b33-4b61-a8d7-56287ab859ba tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Calling method '.version_select at 0x7fca32fd9ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:35.173674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-70daea7a-6b33-4b61-a8d7-56287ab859ba tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1ad8439c-978c-42f3-aef9-dd6ed685467f could not be found", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:58:35.174635 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-70daea7a-6b33-4b61-a8d7-56287ab859ba tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] HTTP exception thrown: Floating IP not found for ID 1ad8439c-978c-42f3-aef9-dd6ed685467f Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70daea7a-6b33-4b61-a8d7-56287ab859ba tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Request method failure captured: Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-floating-ips/1ad8439c-978c-42f3-aef9-dd6ed685467f HTTP/1.1 Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fKj9c2uScfABBuioUCRNDa45iAEl3zYDvCladgkH3gMKlEmt7-FVzQItWT6pBz9p5ysHToWzEDVpMTEMkuEnevkYHrXfG_ZlRx-DPiJPiOZdZ8l09mBtivSkbP-poQkgwjRqd3TgMLqv1f6TyHprSIOK5QKOxzRax3qS45HqK1Dz8 Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3fd10cfadbca4c68a0bbc2e3e5a7ccd8 Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-849877956 Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:58:35.176889 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3fd10cfadbca4c68a0bbc2e3e5a7ccd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3fd10cfadbca4c68a0bbc2e3e5a7ccd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3fd10cfadbca4c68a0bbc2e3e5a7ccd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3fd10cfadbca4c68a0bbc2e3e5a7ccd8"}]}] Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-849877956 Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3fd10cfadbca4c68a0bbc2e3e5a7ccd8 Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-849877956 Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FloatingIPsNegativeTestJSON-849877956-project Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 0879ef2ee11848b99f8a2421b36a8628 Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-849877956-project Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: exception: Floating IP not found for ID 1ad8439c-978c-42f3-aef9-dd6ed685467f Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '1ad8439c-978c-42f3-aef9-dd6ed685467f'} Oct 28 09:58:35.179032 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:58:35.180151 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1ad8439c-978c-42f3-aef9-dd6ed685467f could not be found Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5749193b-f86b-48e7-83e8-e6c118afc68d'] Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1ad8439c-978c-42f3-aef9-dd6ed685467f. Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:35.181838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1ad8439c-978c-42f3-aef9-dd6ed685467f Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:35.184717 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:35.189396 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1ad8439c-978c-42f3-aef9-dd6ed685467f Oct 28 09:58:35.189396 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:35.189396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70daea7a-6b33-4b61-a8d7-56287ab859ba tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] Returning 404 to user: Floating IP not found for ID 1ad8439c-978c-42f3-aef9-dd6ed685467f {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:35.189396 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70daea7a-6b33-4b61-a8d7-56287ab859ba tempest-FloatingIPsNegativeTestJSON-849877956 tempest-FloatingIPsNegativeTestJSON-849877956-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/1ad8439c-978c-42f3-aef9-dd6ed685467f" status: 404 len: 111 microversion: 2.1 time: 0.132577 Oct 28 09:58:35.189396 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1106/2178] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 09:58:35 2022] DELETE /compute/v2.1/os-floating-ips/1ad8439c-978c-42f3-aef9-dd6ed685467f => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:58:35.499786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:35.501266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:35.527579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:35.528093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:35.528521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:35.529263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:35.533355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:35.534019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:35.759411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:35.763051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:35.783114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:35.784750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:35.785323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:35.786871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:35.787618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:35.789605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:35.949876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:35.971352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:35.975811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:35.984148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:35.996839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:36.000538 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5b835e8-4555-48be-8981-2b4205d46a2c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.244376 Oct 28 09:58:36.002923 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1107/2179] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:35 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:36.018084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:36.019369 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-281bef1d-2221-4284-8f3d-3d4b15354f06 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1813 microversion: 2.25 time: 0.523788 Oct 28 09:58:36.019965 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1073/2180] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:35 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1813 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:36.081395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:36.082307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:36.090421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:36.091168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:36.091830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:36.092741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:36.093420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:36.094028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:36.102421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:36.103114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:36.112648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:36.113174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:36.113608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:36.114345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:36.114798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:36.115221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:36.295970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:36.333146 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6a86f73-ab85-461c-8136-796cd917a562 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.256098 Oct 28 09:58:36.334863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1108/2181] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:36 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:36.510891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:36.519415 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-029879a5-9d99-49a1-a082-918e2a69e0dc tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.420832 Oct 28 09:58:36.520002 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1074/2182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:36 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:58:36.665141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47d23221-f459-4867-a138-31977ce6e207"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:36.668887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:36.688268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:36.692544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:36.694854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:36.698924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:36.705412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:36.706008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:36.995601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:37.037318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:37.038208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:37.065189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:37.066410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:37.067072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:37.070958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:37.073688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:37.074393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:37.286475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14a2fcb9-3c05-44ef-b306-9768a16052be tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "POST /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.629483 Oct 28 09:58:37.287109 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1109/2183] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 09:58:36 2022] POST /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 194 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:37.319687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:37.322493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:37.359850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:37.370044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:37.371474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:37.377282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:37.382642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:37.386784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:37.698164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:37.720682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:37.730762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:37.753323 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7bf85df-53a2-4e6f-b6ad-53bbb3cba3fa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1558 microversion: 2.91 time: 0.719986 Oct 28 09:58:37.754358 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1075/2184] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:37 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1558 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:37.768711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5fc15ccd-c29d-4a13-aa5f-ac55ceec52d8 req-182084a9-6724-4bd1-8ee9-70c61c036d71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3251b41a-f111-4ff3-b549-d3d97fd3b0d2", "name": "network-vif-unplugged", "status": "completed", "tag": "3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:37.794408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5fc15ccd-c29d-4a13-aa5f-ac55ceec52d8 req-182084a9-6724-4bd1-8ee9-70c61c036d71 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:37.794896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5fc15ccd-c29d-4a13-aa5f-ac55ceec52d8 req-182084a9-6724-4bd1-8ee9-70c61c036d71 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:37.795331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5fc15ccd-c29d-4a13-aa5f-ac55ceec52d8 req-182084a9-6724-4bd1-8ee9-70c61c036d71 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:37.827424 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5fc15ccd-c29d-4a13-aa5f-ac55ceec52d8 req-182084a9-6724-4bd1-8ee9-70c61c036d71 service nova] Creating event network-vif-unplugged:3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466 for instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 on n-h1-zed-1 Oct 28 09:58:37.844976 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5fc15ccd-c29d-4a13-aa5f-ac55ceec52d8 req-182084a9-6724-4bd1-8ee9-70c61c036d71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087435 Oct 28 09:58:37.846947 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1076/2185] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:37.879265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:37.879979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:37.897013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:37.897523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:37.906025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:37.906862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:37.908002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:37.908441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:37.959738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:37.985818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:37.992745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:38.000744 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dba6a9c6-9dfd-46ef-86f8-aad4cb86bee7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1803 microversion: 2.25 time: 0.707911 Oct 28 09:58:38.002347 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1110/2186] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:37 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1803 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:38.026475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:38.027849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:38.059954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.065838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.066622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.067725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.068640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.072042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.172460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:38.227176 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07f13d89-6fe8-45ab-9d52-8dcafe6ccde7 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.377317 Oct 28 09:58:38.229572 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1077/2187] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:37 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:38.242814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-879f1c80-a138-4375-8aea-e7c0228845cd tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '.version_select at 0x7fca329de670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:38.253198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-879f1c80-a138-4375-8aea-e7c0228845cd tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.263691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-879f1c80-a138-4375-8aea-e7c0228845cd tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.264842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-879f1c80-a138-4375-8aea-e7c0228845cd tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.317629 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-879f1c80-a138-4375-8aea-e7c0228845cd tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 3119 microversion: 2.25 time: 0.086686 Oct 28 09:58:38.330200 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1078/2188] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 09:58:38 2022] GET /compute/v2.1/os-migrations => generated 3119 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:38.335783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:38.336670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:38.344789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.345628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.346243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.347139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.347787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.348403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.796664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:38.818244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75e1fea0-fa23-483d-9203-0d273a52f236 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.811548 Oct 28 09:58:38.819540 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1111/2189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:38 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:38.847949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 6255ec55-f11e-457b-b949-b17da3834864 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:38.854725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:38.856108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:38.870778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.871299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.871752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.872474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.872958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.873399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.874315 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46b61649-b464-4c47-9b95-9519393f6add tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 2416 microversion: 2.25 time: 0.542621 Oct 28 09:58:38.890319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1079/2190] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:38 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 2416 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:38.904805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:38.905564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:38.912480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.913377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.914054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.915947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:38.920719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:38.922050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:38.991484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:39.007393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:39.010745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:39.034354 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81de4a92-e4b8-484d-955d-59056a3a450c tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.186852 Oct 28 09:58:39.034983 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1112/2191] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:38 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:39.267996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:39.268654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:39.278097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:39.285682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:39.288182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:39.289261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:39.293294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:39.293992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:39.533097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:39.631534 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4362d38f-93fb-4cb8-9820-8bf1f5b654ea tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.368323 Oct 28 09:58:39.635888 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1113/2192] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:39 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:39.731414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid 6255ec55-f11e-457b-b949-b17da3834864 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:39.801093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c904919f-2fe6-4d75-9d39-65a54f4fa3f0 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 2416 microversion: 2.25 time: 0.901853 Oct 28 09:58:39.805274 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1080/2193] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:38 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 2416 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:39.849265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:39.850559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:39.875759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:39.876494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:39.882413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:39.884721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:39.885616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:39.886400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.003484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-be0cbd20-01d0-4853-a1f3-9789ac712541 req-52c9a7fa-2771-4327-bc47-3610a8c9c42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3251b41a-f111-4ff3-b549-d3d97fd3b0d2", "tag": "3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:40.037129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-be0cbd20-01d0-4853-a1f3-9789ac712541 req-52c9a7fa-2771-4327-bc47-3610a8c9c42b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.037675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-be0cbd20-01d0-4853-a1f3-9789ac712541 req-52c9a7fa-2771-4327-bc47-3610a8c9c42b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.038997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-be0cbd20-01d0-4853-a1f3-9789ac712541 req-52c9a7fa-2771-4327-bc47-3610a8c9c42b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.085673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-be0cbd20-01d0-4853-a1f3-9789ac712541 req-52c9a7fa-2771-4327-bc47-3610a8c9c42b service nova] Creating event network-changed:3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466 for instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 on n-h1-zed-1 Oct 28 09:58:40.104297 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-be0cbd20-01d0-4853-a1f3-9789ac712541 req-52c9a7fa-2771-4327-bc47-3610a8c9c42b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099847 Oct 28 09:58:40.110254 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1081/2194] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:58:40.131796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:40.134033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:40.171334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.173938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.176437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.179338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.187944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.192268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.433647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:40.454175 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24e47749-cd6f-4610-b584-6c93b2792fa3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.605445 Oct 28 09:58:40.468306 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1114/2195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:39 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:40.479300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:40.479815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:40.491387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:40.502445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.502850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:40.504302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:40.505033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.505712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.514461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.516440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.529027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.552127 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f568b13f-f3da-48b9-906d-b74c241a72d3 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.436699 Oct 28 09:58:40.560285 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1082/2196] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:40 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:40.668128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:40.668760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:40.696999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.701063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.701361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.710821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:40.711329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:40.711777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:40.730074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lazy-loading 'services' on Instance uuid 6255ec55-f11e-457b-b949-b17da3834864 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:41.010548 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6df7ffe0-09b8-426e-a4ff-a4b0b13f8374 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments/35033aba-1e52-4038-adcc-f5b643a905c2" status: 202 len: 0 microversion: 2.25 time: 0.539642 Oct 28 09:58:41.011943 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1115/2197] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Oct 28 09:58:40 2022] DELETE /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments/35033aba-1e52-4038-adcc-f5b643a905c2 => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:58:41.030551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:41.053102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:41.086008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.090557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.091140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.093928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.098446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.099107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.273966 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c1a1e02-a6c7-48c8-8037-b45b4ba61390 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.251012 Oct 28 09:58:41.280484 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1116/2198] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:41 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:41.479104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad2ecac0-4ae5-43e1-aed6-2dca18d60e5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'create', calling method: .version_select at 0x7fca32fb8160>, body: {"keypair": {"name": "tempest-keypair-1626393128", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM1avq7hxztvxoENt80s3rF263YOvTP4Tjwc7xtpqhKE1PCq1Dmth/Nd3zdFMV+zdLPx6TI7nk24TiX5tsSKd3/+Oe6R4On/FJavCvLY0TxVSA5eFkccozGzFEMgykvqA=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:41.523931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ad2ecac0-4ae5-43e1-aed6-2dca18d60e5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:58:41.540878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ad2ecac0-4ae5-43e1-aed6-2dca18d60e5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for user f864f72343c84ff4a54ef0467bf34c04 and project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:58:41.598098 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad2ecac0-4ae5-43e1-aed6-2dca18d60e5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.232918 Oct 28 09:58:41.608897 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1117/2199] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 09:58:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 244 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 28 09:58:41.622453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:41.626827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:41.644230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.645270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.647976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.649779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.650589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.656539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.736345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:41.768788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:41.827387 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2845ceba-3366-48a2-a11f-9ba1f0deb329 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 1.163446 Oct 28 09:58:41.830686 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1083/2200] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:40 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:41.842888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:41.845489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:41.866577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.868795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.870152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:41.871974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:41.873796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:41.875042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.092816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:42.109532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:42.115912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:42.132660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:42.135843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1e7dc61-b12c-4d09-b6cd-235d5ad18244 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.303818 Oct 28 09:58:42.141124 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1084/2201] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:41 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:42.291331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:42.293825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:42.311986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.312486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.312987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.313679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.314138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.314568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.377666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:42.395058 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ece704d-51b8-4532-b2e5-d102d1dc78af tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.775939 Oct 28 09:58:42.402613 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-226345da-2cf2-4f44-a408-19d02fd71b82 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.115113 Oct 28 09:58:42.403670 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1085/2202] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:42 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:42.412772 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1118/2203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:41 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:42.869963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:42.870580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:42.884413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.885732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.887798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:42.889096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:42.890003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:42.890989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.172035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:43.173335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:43.183309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.183822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.184454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.185012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.189230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:43.194860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.195788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.282606 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ebd895f7-5780-4272-a918-0fb4895a4f70 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.416147 Oct 28 09:58:43.289674 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1086/2204] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:42 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:43.416338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:43.418798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:43.439822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.443925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.444422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.448429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.451332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.451926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.537701 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ff0a7ce2-0ad1-4416-ae70-4040106f731e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.123454 Oct 28 09:58:43.542997 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1087/2205] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:43 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:58:43.560196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:43.563951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:43.589413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.589579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.589993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.592854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:43.593395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:43.594664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:43.616788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:43.628004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:43.629477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:43.657451 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b77f1615-d924-4163-81ed-251fa02228bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.489431 Oct 28 09:58:43.658059 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1119/2206] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:43 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:44.113268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:44.127283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1f35603c-7099-4c94-8c4c-6eb66a151af1 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.581300 Oct 28 09:58:44.129311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1088/2207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:43 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:44.326866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:44.328240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:44.351237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.352164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.354322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.357847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.358721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.359431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.536184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:44.558462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:44.560897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:44.576968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.577245 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d3c9b10-bf31-45f2-b38d-1542d78d29d1 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1923 microversion: 2.75 time: 0.255104 Oct 28 09:58:44.578283 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1120/2208] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:44 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1923 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:44.579756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.585197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.586270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.587000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.588167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.661418 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af19127f-21e2-4730-81ad-fd313c67907b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114536 Oct 28 09:58:44.667220 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1089/2209] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:44 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:44.693923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:44.694888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:44.719996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.720277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.720755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.727259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:44.727813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:44.728472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:44.905140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:44.922308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:44.923777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:44.929895 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d949fe5d-fdc5-47ac-88c4-92743beb8c39 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.239912 Oct 28 09:58:44.937271 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1121/2210] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:44 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:45.151676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:45.152997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:45.173215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.181649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.198662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.202311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.202803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.209699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.431804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:45.441754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f2787107-dc75-48fc-80f5-77ad6d839347 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.295030 Oct 28 09:58:45.442978 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1090/2211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:45 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:45.614563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:45.615173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:45.625188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.625691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.626141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.627164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.627854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.628297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.675580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:45.678906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:45.689492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.693311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.695339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.696967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:45.701956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:45.702874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:45.764927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e677b737-851f-4835-b17c-b1f6ede49923 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.094279 Oct 28 09:58:45.770556 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1091/2212] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:45 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:45.794536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1450763750", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76f7baad-2e8f-4d15-a3ea-3b38c1dbbcd6"}], "security_groups": [{"name": "tempest-securitygroup--131837142"}], "key_name": "tempest-keypair-1626393128", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:45.910105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:45.980103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f33e140-bfab-427d-abff-6ae411913c77 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1929 microversion: 2.75 time: 0.369249 Oct 28 09:58:45.980705 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1122/2213] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:45 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1929 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:46.030570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:46.033617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:46.045081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.046883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.047661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.049101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.049908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.050626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.097990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] validate_networks() for [('76f7baad-2e8f-4d15-a3ea-3b38c1dbbcd6', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:58:46.288382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:46.306391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:46.314343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:46.337490 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-999321e3-9d92-4f37-8ded-95963b0df512 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.331135 Oct 28 09:58:46.353830 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1123/2214] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:46 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:46.467363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:46.468969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:46.481346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.481854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.484979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.486234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.490200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.491131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.794505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:58:46.799994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:58:46.800851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:58:46.805498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:58:46.806855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:58:46.817181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.820365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.821221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.822336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.825865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.826629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.838496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:46.842597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:46.871639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:58:46.873192 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04250d57-ba92-465d-b6fb-71facfd618c6 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.389044 Oct 28 09:58:46.873869 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1124/2215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:46 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:46.884025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for user f864f72343c84ff4a54ef0467bf34c04 and project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:58:46.897638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:46.903871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:46.912605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:58:46.916822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:58:46.931807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.945042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.945528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:46.946508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:46.947134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:46.947620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.015614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f95a2761-5963-45c3-abcc-1d64190ddb23 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.239170 Oct 28 09:58:47.017146 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1092/2216] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:58:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1246 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:58:47.024148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:47.025795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:47.035875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.036818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.038124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.039254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.040212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.040441 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ccbacd13-061a-4a4a-bd30-b4c706081890 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.165186 Oct 28 09:58:47.041616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.042609 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1125/2217] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:46 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:47.055537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74606fd7-e518-40fc-a9e1-4989ce882d6e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:47.056812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74606fd7-e518-40fc-a9e1-4989ce882d6e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:47.237170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74606fd7-e518-40fc-a9e1-4989ce882d6e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:47.264028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74606fd7-e518-40fc-a9e1-4989ce882d6e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:47.272564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74606fd7-e518-40fc-a9e1-4989ce882d6e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:47.282256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:47.282874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74606fd7-e518-40fc-a9e1-4989ce882d6e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1282 microversion: 2.20 time: 0.230567 Oct 28 09:58:47.286547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1126/2218] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:47 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1282 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:47.338488 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b4d86fd-2fc3-45e7-a39d-1ae7fc64300d tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1929 microversion: 2.75 time: 0.319943 Oct 28 09:58:47.339460 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1093/2219] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:47 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1929 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:47.369597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:47.370222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:47.378491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.378989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.386211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.387768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.392996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.395283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.551053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:47.564667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:47.566636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:47.573886 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62330825-800c-4755-8770-e4fa0443aff0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.209956 Oct 28 09:58:47.575103 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1127/2220] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:47 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:47.908838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:47.911278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:47.944186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.945683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.948623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:47.952426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:47.953615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:47.955017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.057898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:48.062607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:48.079053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.080271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.082298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.084487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.086233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.089354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.155692 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-66e19146-4562-4aad-93b5-91957957c7b9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.103900 Oct 28 09:58:48.163241 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1128/2221] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:48 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:48.312756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:48.315009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:48.329297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.330140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.331390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.332393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.333092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.334174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.431633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:48.449156 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c77673b6-1149-4fd7-a5c7-e017ef7a7f46 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.552341 Oct 28 09:58:48.450216 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1094/2222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:47 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:48.455228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:48.456222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:48.468103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.469824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.470727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.471947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.472790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.473484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.474500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:48.490101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:48.502658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:48.503835 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-26eee403-bac9-41e8-8372-b0393eb4820c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1286 microversion: 2.20 time: 0.196279 Oct 28 09:58:48.504672 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1129/2223] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:48 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:48.605331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:48.606632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:48.618810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.619319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.619769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.620494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:48.621166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:48.621533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:48.631221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:48.671077 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f102f72-b04e-4b81-945b-551776a06032 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1929 microversion: 2.75 time: 0.219456 Oct 28 09:58:48.675245 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1095/2224] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:48 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1929 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:48.777590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:48.788037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:48.789520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:48.810167 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b47fd198-3a8a-4978-8b25-5cf2c3f28b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.208729 Oct 28 09:58:48.810832 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1130/2225] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:48 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:49.171087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:49.173988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:49.192329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.192856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.193392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:49.194026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.194487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.194917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:49.286731 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d748429f-caf8-4ed2-aa12-3e0ca931fbd2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120367 Oct 28 09:58:49.292205 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1096/2226] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:49 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:49.476998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:49.477722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:49.480692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:49.503453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.504025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.504490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:49.508635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.509754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.510272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:49.532331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:49.533899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:49.551407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.557558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.558917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:49.560604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.565482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.569057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:49.794800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:49.810700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:49.815815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:49.820521 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6894430d-8355-4bac-823a-7e879180989f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1334 microversion: 2.20 time: 0.291274 Oct 28 09:58:49.823192 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1097/2227] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:49 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1334 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:49.835141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:49.837305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:49.856198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.857300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.858006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:49.858934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:49.860376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:49.863318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:50.027989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:50.044296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:50.054285 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78008d26-e174-47b2-9038-2310a673875d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.583083 Oct 28 09:58:50.054873 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1131/2228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:49 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:50.089294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:50.090369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:50.100791 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9a4b328-a04d-4f4e-b813-f1a266c7a6a6 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1929 microversion: 2.75 time: 0.274545 Oct 28 09:58:50.103491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:50.105219 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1098/2229] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:49 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1929 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:50.114514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:50.115183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:50.118936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:50.119528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:50.120051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:50.304180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:50.311506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:50.343331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:50.353816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:50.360949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:50.369959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:50.371381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:50.372894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:50.430447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:50.484229 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec1c4cb9-5d86-467c-bfcf-5b975fbe9e57 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.179537 Oct 28 09:58:50.489685 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1099/2230] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:50 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:58:50.507671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:50.521272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:50.532792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:50.542864 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5774995e-3fbf-43a7-8824-8446edcc16da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.477258 Oct 28 09:58:50.562017 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1132/2231] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:50 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:50.855677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:50.856525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:50.868724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:50.870827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:50.871365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:50.872407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:50.873828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:50.875082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.037067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:51.049683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:51.054165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:51.057104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9d5cef27-182e-4e5b-95fc-1d0d409bf6dd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1340 microversion: 2.20 time: 0.207841 Oct 28 09:58:51.060079 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1100/2232] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:50 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1340 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:51.077892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:51.078876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:51.087390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.091260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.091824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.092688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.094559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.095098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.140120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:51.143343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:51.160710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.163527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.164725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.168998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.169770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.170481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.341198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:51.359407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] Lazy-loading 'services' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:51.383061 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4baabf68-d27c-4092-a12a-f9acb5d0d23f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.307044 Oct 28 09:58:51.387038 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1133/2233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:51 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:51.410481 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70242e5a-ddb0-4fe2-9b26-70fabef18752 tempest-ServersAdmin275Test-1633619094 tempest-ServersAdmin275Test-1633619094-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1914 microversion: 2.75 time: 0.275028 Oct 28 09:58:51.413690 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1101/2234] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:51 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1914 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:51.463937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:51.464455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:51.501574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:51.503808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:51.506746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.507456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.507919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.508683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.509312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.509634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.514304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.514683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.515128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.515844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.516298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.516725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.609213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:58:51.622657 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ff80abbe-6065-45f0-b01b-667318bcc702 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.124995 Oct 28 09:58:51.633315 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1102/2235] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:51 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:51.638798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:51.643420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:51.659542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.660277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.660952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.661871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.665685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.666443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.782515 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-becb681a-1333-46b3-be3f-0e3cac9f4a92 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 204 len: 0 microversion: 2.75 time: 0.323896 Oct 28 09:58:51.785878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1134/2236] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 09:58:51 2022] DELETE /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 09:58:51.794379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:51.800753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:51.820043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.820805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.822263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.823688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:51.824386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:51.824846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:51.960562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:51.981519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.005900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.022283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c3de36d-5d30-422d-959d-296633755e5b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.387379 Oct 28 09:58:52.024501 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1103/2237] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:51 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:52.064689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.081996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.086421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.089905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:52.090673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:52.101361 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-653cdd4e-5e4e-4f7b-8b00-40a7551c92c8 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1444 microversion: 2.75 time: 0.309673 Oct 28 09:58:52.103705 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1135/2238] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:51 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1444 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:52.105222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:52.106046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:52.106876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:52.109655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:52.110565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:52.112448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:52.410354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:52.410975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:52.429173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:52.429856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:52.430319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:52.431634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:52.432105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:52.432533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:52.627556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.642339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.644243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.647177 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ad1f936-1cee-43a2-9936-e69abe1d75d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.562329 Oct 28 09:58:52.649727 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1104/2239] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:52 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:52.665536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:52.668759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:52.685333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:52.685833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:52.686266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:52.686972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:52.691073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:52.692103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:52.771636 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b17cee9b-784c-4204-92d0-db4436f78353 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.120484 Oct 28 09:58:52.778718 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1105/2240] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:52 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:58:52.843543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:52.874819 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c430bbb8-9fb8-47dd-8d18-69c0b8c4c392 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.467821 Oct 28 09:58:52.878812 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1136/2241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:52 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:53.053468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:53.054597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:53.066056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.068491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.069238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.083206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.084476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.087494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.131850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:53.132993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:53.164052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.170156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.174119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.184667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.187191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.189235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.372047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:53.388289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:53.401728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:53.418304 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ccdb5a44-ebfd-49d2-a9d2-20d0216ca003 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.367716 Oct 28 09:58:53.432930 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1106/2242] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:53 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:53.460156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:53.470963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:53.478948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:53.495075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-16b5c28a-0721-4e74-b89d-b4b530dfc0aa tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1444 microversion: 2.75 time: 0.367706 Oct 28 09:58:53.495681 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1137/2243] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:53 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1444 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:58:53.678203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:53.679570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:53.694005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.696794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.698466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.703628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.704859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.706940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.784676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:53.787312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:53.803825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.804416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.804869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.812058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:53.827613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:53.828078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:53.981116 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-01a8a5a6-107f-4970-a501-705340b7eff2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.192961 Oct 28 09:58:53.981778 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1138/2244] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:53 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 197 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 09:58:54.006938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:54.020505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:54.060880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.061418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.061873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.062601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.063066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.063504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.427219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:54.441287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:54.459442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:54.463547 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-982ee77c-2f53-4478-a088-ba33781516dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.786868 Oct 28 09:58:54.464375 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1107/2245] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:53 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:54.495879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5974c9cc-e440-489c-b0be-249d3c3a5735 req-34f71a69-f616-424d-aabf-58e5a25d1aaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7831b2e-dc40-4e1b-981b-94cb7d1736f0", "tag": "a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:58:54.515233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5974c9cc-e440-489c-b0be-249d3c3a5735 req-34f71a69-f616-424d-aabf-58e5a25d1aaa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.515726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5974c9cc-e440-489c-b0be-249d3c3a5735 req-34f71a69-f616-424d-aabf-58e5a25d1aaa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.516156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5974c9cc-e440-489c-b0be-249d3c3a5735 req-34f71a69-f616-424d-aabf-58e5a25d1aaa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.551202 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5974c9cc-e440-489c-b0be-249d3c3a5735 req-34f71a69-f616-424d-aabf-58e5a25d1aaa service nova] Creating event network-changed:a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a for instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 on n-h1-zed-1 Oct 28 09:58:54.561750 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5974c9cc-e440-489c-b0be-249d3c3a5735 req-34f71a69-f616-424d-aabf-58e5a25d1aaa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082080 Oct 28 09:58:54.568270 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1108/2246] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:58:54.591111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:54.591829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:54.622528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.624183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.624645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.625459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.625981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.626426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.897417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:54.909014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ab86690-ff6d-4a50-baa8-7889560fbdc9 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.925477 Oct 28 09:58:54.909649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1139/2247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:53 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:54.941785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:54.942966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:54.950678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.951376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.952013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.952934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.953570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.954194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.998214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:54.998886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:54.999334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:54.999907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lazy-loading 'fault' on Instance uuid e5122d50-ffc8-4549-ac97-b9f7faa4f10a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:58:55.002069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:55.246838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.266978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.273032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2f86992e452c4ab9b95e9d8fe8126f87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc6c533cbae4341a2e0b678b75cf49c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.293710 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca7e4558-0e3c-4963-9bd2-5c76375fc8b0 tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 200 len: 1449 microversion: 2.75 time: 0.361052 Oct 28 09:58:55.296225 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1140/2248] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:54 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 1449 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:55.318278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:55.322949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:55.351089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:55.351597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:55.352043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:55.353366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:55.353832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:55.354263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:55.464043 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c3de83d-a800-4b8c-9fb3-ca891b4b547d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.166379 Oct 28 09:58:55.470160 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1141/2249] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 09:58:55 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:55.502183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:55.502846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:55.549394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:55.550188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:55.550667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:55.551459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:55.554070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:55.554517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:55.648792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.661577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.669090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.683281 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1d95ba5-b08a-4c3b-9717-60348d534c82 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 1.110794 Oct 28 09:58:55.684932 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1109/2250] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:54 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:55.837183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.847170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.848642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:55.857321 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d3fb9fe-9ac8-49b3-8bb2-797304fe23e9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.366402 Oct 28 09:58:55.858596 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1142/2251] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:55 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:55.938963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:55.940011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:55.947493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:55.948238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:55.948932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:55.949856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:55.950491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:55.951095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:56.279293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:56.301024 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c71fc365-3989-49c7-8149-20998c48c201 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.367219 Oct 28 09:58:56.301905 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1110/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:55 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:56.328660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:56.330063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] [instance: e5122d50-ffc8-4549-ac97-b9f7faa4f10a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:56.338914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:56.339792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:56.340800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:56.341954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:56.342644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:56.343295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:56.364385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] HTTP exception thrown: Instance e5122d50-ffc8-4549-ac97-b9f7faa4f10a could not be found. Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Request method failure captured: Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a HTTP/1.1 Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6eD1l8GQhMsvm8ruw8MWzi--k7lCb7Od81U3RZUUM33roE4axX4zTsLQ_kAjXVXxHnCvQQUEKN_i2BCFyfQh3Hq6i73GzxZXLkT3VggKbRa3Mk1OpawsqvS7pBJogi8BaTJYv4aY7_egxK-rrGo9cU0Ne8BGyf6YE4pRjPWy1AB-8o Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.75 Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7cc6c533cbae4341a2e0b678b75cf49c Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdmin275Test-1510383980 Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:58:56.366171 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7cc6c533cbae4341a2e0b678b75cf49c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7cc6c533cbae4341a2e0b678b75cf49c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7cc6c533cbae4341a2e0b678b75cf49c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7cc6c533cbae4341a2e0b678b75cf49c"}]}] Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdmin275Test-1510383980 Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7cc6c533cbae4341a2e0b678b75cf49c Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdmin275Test-1510383980 Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdmin275Test-1510383980-project Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2f86992e452c4ab9b95e9d8fe8126f87 Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdmin275Test-1510383980-project Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e5122d50-ffc8-4549-ac97-b9f7faa4f10a could not be found. Oct 28 09:58:56.368258 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e5122d50-ffc8-4549-ac97-b9f7faa4f10a'} Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5122d50-ffc8-4549-ac97-b9f7faa4f10a could not be found. Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:58:56.369414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5122d50-ffc8-4549-ac97-b9f7faa4f10a could not be found. Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5122d50-ffc8-4549-ac97-b9f7faa4f10a could not be found. Oct 28 09:58:56.371248 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:58:56.372887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] Returning 404 to user: Instance e5122d50-ffc8-4549-ac97-b9f7faa4f10a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:58:56.373676 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8e993b3-f5d6-44f6-899b-0b61e021c76b tempest-ServersAdmin275Test-1510383980 tempest-ServersAdmin275Test-1510383980-project] 10.222.0.16 "GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a" status: 404 len: 111 microversion: 2.75 time: 0.046900 Oct 28 09:58:56.378041 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1143/2253] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:56 2022] GET /compute/v2.1/servers/e5122d50-ffc8-4549-ac97-b9f7faa4f10a => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:58:56.715727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:56.717335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:56.750934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:56.751993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:56.753428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:56.755933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:56.756698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:56.757396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:56.835360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:56.889274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:56.890189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:56.899296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:56.903934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:56.905615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:56.906366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:56.908554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:56.914221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:56.926673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:56.927701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:56.929162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:56.937175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:56.971052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-db2491d8-bb76-410a-be2a-e0f228ba4081 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.255931 Oct 28 09:58:56.972294 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1111/2254] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:56 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:57.251209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:57.330633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:57.331555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:57.343913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:57.349738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:57.354324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:57.355872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:57.359812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:57.360264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:57.780574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:57.799374 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-167f864b-3870-4be8-90b9-fe1d7d10b726 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.473165 Oct 28 09:58:57.800703 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1112/2255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:57 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:57.821004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:57.833021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:57.843226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:57.845932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f436e571-3c29-4e3a-9ea1-4fa4166e8563 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.965799 Oct 28 09:58:57.848249 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1144/2256] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:56 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:58.013836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:58.014832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:58.021585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:58.022616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:58.023337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:58.024383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:58.025354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:58.026077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:58.194602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:58.214073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:58.218834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:58.234315 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-962b8fec-eac9-46c3-9073-b0bed6149c13 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.227718 Oct 28 09:58:58.249888 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1113/2257] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:58 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:58.827966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:58.831444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:58.859363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:58.860806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:58.861811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:58.867229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:58.876861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:58.878389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:58.887633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:58.891801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:58.900426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:58.909036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:58.911697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:58.912714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:58.915873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:58.921667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:59.291504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.311151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.314780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.318719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e8fe7081-e5e6-4b97-9425-60023e84c4fd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.446674 Oct 28 09:58:59.320690 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1114/2258] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:58 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:58:59.328569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:58:59.330185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:58:59.347712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.354779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:59.357442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:59.357960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:59.358670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:58:59.359865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:58:59.360161 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e65165d-1a09-43ed-a822-3656ca082e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.540375 Oct 28 09:58:59.361368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:58:59.379972 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1145/2259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:58:58 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:58:59.538908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.560869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.568407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:58:59.594789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:58:59.601598 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af1971d0-9f33-4ee8-bbab-7027f2942c97 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.278019 Oct 28 09:58:59.606343 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1115/2260] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:58:59 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:00.325060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-464edd07-ff22-4007-aac5-2f4a6306a564 tempest-FloatingIPDetailsNegativeTestJSON-809633885 tempest-FloatingIPDetailsNegativeTestJSON-809633885-project] Calling method '.version_select at 0x7fca330c01f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:00.356074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:00.356878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:00.414463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:00.423218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:00.426837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:00.432656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:00.442733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:00.446736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:00.487287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-464edd07-ff22-4007-aac5-2f4a6306a564 tempest-FloatingIPDetailsNegativeTestJSON-809633885 tempest-FloatingIPDetailsNegativeTestJSON-809633885-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP cfac8e0a-fab8-41fb-bb46-6d16379b0799 could not be found", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 09:59:00.488370 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-464edd07-ff22-4007-aac5-2f4a6306a564 tempest-FloatingIPDetailsNegativeTestJSON-809633885 tempest-FloatingIPDetailsNegativeTestJSON-809633885-project] HTTP exception thrown: Floating IP not found for ID cfac8e0a-fab8-41fb-bb46-6d16379b0799 Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-464edd07-ff22-4007-aac5-2f4a6306a564 tempest-FloatingIPDetailsNegativeTestJSON-809633885 tempest-FloatingIPDetailsNegativeTestJSON-809633885-project] Request method failure captured: Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-floating-ips/cfac8e0a-fab8-41fb-bb46-6d16379b0799 HTTP/1.1 Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fjSuUERecDMm8frwM_QTPuQ3jGcMnRhLGZukZWrEmEMHfSca3RPHdivmCRjN7D1F2_PEGhqvvxADkbj1KnoQE9CY2EPFYa4r0dzpfZvqID6FJsihnNuKuaHvO6FijPGKPF7wihs6wl-exFjZzy2uI2mhUH8Xg1HNl5jE3AGJ2RQEI Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 8b56a1a5cb59465aa604e4e0b520e46e Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-809633885 Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:00.491199 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8b56a1a5cb59465aa604e4e0b520e46e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8b56a1a5cb59465aa604e4e0b520e46e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8b56a1a5cb59465aa604e4e0b520e46e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8b56a1a5cb59465aa604e4e0b520e46e"}]}] Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-809633885 Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 8b56a1a5cb59465aa604e4e0b520e46e Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-809633885 Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-809633885-project Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a8c39a85c2fa406783a56a555bdea66a Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-809633885-project Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: exception: Floating IP not found for ID cfac8e0a-fab8-41fb-bb46-6d16379b0799 Oct 28 09:59:00.493026 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'cfac8e0a-fab8-41fb-bb46-6d16379b0799'} Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:59:00.494589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP cfac8e0a-fab8-41fb-bb46-6d16379b0799 could not be found Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc2a9732-a174-41a9-8a30-fe62bfc199f1'] Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID cfac8e0a-fab8-41fb-bb46-6d16379b0799. Oct 28 09:59:00.496239 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID cfac8e0a-fab8-41fb-bb46-6d16379b0799 Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:00.499513 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:00.506528 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:00.506528 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID cfac8e0a-fab8-41fb-bb46-6d16379b0799 Oct 28 09:59:00.506528 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:00.506528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-464edd07-ff22-4007-aac5-2f4a6306a564 tempest-FloatingIPDetailsNegativeTestJSON-809633885 tempest-FloatingIPDetailsNegativeTestJSON-809633885-project] Returning 404 to user: Floating IP not found for ID cfac8e0a-fab8-41fb-bb46-6d16379b0799 {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:00.507265 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-464edd07-ff22-4007-aac5-2f4a6306a564 tempest-FloatingIPDetailsNegativeTestJSON-809633885 tempest-FloatingIPDetailsNegativeTestJSON-809633885-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/cfac8e0a-fab8-41fb-bb46-6d16379b0799" status: 404 len: 111 microversion: 2.1 time: 0.413003 Oct 28 09:59:00.508384 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1146/2261] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 09:59:00 2022] GET /compute/v2.1/os-floating-ips/cfac8e0a-fab8-41fb-bb46-6d16379b0799 => generated 111 bytes in 417 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:00.510504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:00.519211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:00.526257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:00.542288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:00.546644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:00.548267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:00.551914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:00.554460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:00.556922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:00.917222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:00.937028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:00.938565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:00.939722 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6bcf0094-259c-40d4-8589-795c12a79ccd tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.591175 Oct 28 09:59:00.940281 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1116/2262] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:00 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:00.980895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:00.981668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:01.016463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:01.022866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:01.025190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:01.026079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:01.031525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:01.031982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:01.127465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:01.167238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d60a58e-dbfc-4ce7-8cac-9a4120873baf tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.654801 Oct 28 09:59:01.169174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1147/2263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:00 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:01.210995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:01.224470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:01.231083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:01.251814 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c17c729-c82d-46dc-ba13-044b1c4045df tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.295652 Oct 28 09:59:01.263130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1117/2264] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:00 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:01.965356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:01.967391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:01.980385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:01.984095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:01.984848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:01.985929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:01.991019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:01.991926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:02.191719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:02.193016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:02.208792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:02.213852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:02.214600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:02.223782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:02.224451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:02.225104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:02.554801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.578295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.592897 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f37fdbed-2b65-47d5-b238-10e56b8a6e49 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.402664 Oct 28 09:59:02.603829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.614007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.617561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1118/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:02 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:02.621076 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74801379-a1ef-44a8-bf12-0f809ea86a82 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.656966 Oct 28 09:59:02.621699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1148/2266] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:01 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:02.624356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:02.625470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:02.632503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:02.633402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:02.634139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:02.635089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:02.635793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:02.636455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:02.789770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.814666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.817548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:02.825517 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b805a3c3-1475-4a9f-b19f-190f49cca8e0 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.206122 Oct 28 09:59:02.827590 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1119/2267] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:02 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:03.623699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:03.625977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:03.649143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:03.651196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:03.658422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:03.659195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:03.660017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:03.660971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:03.661947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:03.666066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:03.667356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:03.673068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:03.674841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:03.676582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:03.677337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:03.678308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:04.260734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.272308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.278675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.281719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-23e532f0-3097-459a-be8a-927ac84f94bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 0.635618 Oct 28 09:59:04.299244 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1120/2268] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:03 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:04.320848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:04.324042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:04.344032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:04.347844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:04.350375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:04.351907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:04.352611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:04.353681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:04.443499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.458533 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9323f400-e4cb-4a7c-9984-cd5ea7863b50 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1391 microversion: 2.1 time: 0.838932 Oct 28 09:59:04.463483 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1149/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:03 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1391 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:04.602601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.614946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.625015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:04.644040 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-991f5dd0-7031-4518-9e42-c547d3fbe6eb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.332344 Oct 28 09:59:04.645111 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1121/2270] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:04 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:04.870627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:04.876413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:04.876984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:04.880133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:04.883925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:04.887721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:04.892682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.030547 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7b030699-08c2-43a0-9856-208a138b8db2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 929 microversion: 2.1 time: 0.562855 Oct 28 09:59:05.046590 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1150/2271] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:59:04 2022] GET /compute/v2.1/os-services => generated 929 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:05.060441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-591cf8f3-e0d5-41d0-82e0-ec1deab8a768 req-1b4ccd24-6fa2-4300-90d3-f27589d879fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7831b2e-dc40-4e1b-981b-94cb7d1736f0", "name": "network-vif-plugged", "status": "completed", "tag": "a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:05.108123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-591cf8f3-e0d5-41d0-82e0-ec1deab8a768 req-1b4ccd24-6fa2-4300-90d3-f27589d879fe service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.112167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-591cf8f3-e0d5-41d0-82e0-ec1deab8a768 req-1b4ccd24-6fa2-4300-90d3-f27589d879fe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.114583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-591cf8f3-e0d5-41d0-82e0-ec1deab8a768 req-1b4ccd24-6fa2-4300-90d3-f27589d879fe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.171659 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-591cf8f3-e0d5-41d0-82e0-ec1deab8a768 req-1b4ccd24-6fa2-4300-90d3-f27589d879fe service nova] Creating event network-vif-plugged:a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a for instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 on n-h1-zed-1 Oct 28 09:59:05.187018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-591cf8f3-e0d5-41d0-82e0-ec1deab8a768 req-1b4ccd24-6fa2-4300-90d3-f27589d879fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135487 Oct 28 09:59:05.197154 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1151/2272] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:05.216654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:05.226430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.228334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.229007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.232102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8f952da3-c1ec-4b9e-b299-4f7c5dc37d44"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:05.232843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.235563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.235734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:05.235980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.265264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.265778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.266228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.270344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.270848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.271302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.399615 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-861f66cc-7dab-4a31-9803-e91cfc3841d2 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 929 microversion: 2.1 time: 0.198744 Oct 28 09:59:05.414602 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1152/2273] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 09:59:05 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 929 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:05.427189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:05.427933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:05.439887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.440384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.441777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.451330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.452653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.453607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.558877 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] HTTP exception thrown: Volume 8f952da3-c1ec-4b9e-b299-4f7c5dc37d44 could not be found. Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Request method failure captured: Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments/47d23221-f459-4867-a138-31977ce6e207 HTTP/1.1 Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 74 Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6djnYcFz2LrQd8D_EwAcRbhxyOq0_XRBbCzLDiyizgkJCdT0-ZOukMVtNpP0yXzkwYTpklUHhZ5tCD3ZxUgMOFaPwR6kPUVM57BSGfPwjiZKJABSQHMzBHOs-ERtf9Y7_uuQW-vzpR25DRfOu4kmihe7FIHMuID1kpevD5hOy1Jl-M Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 4847dbc2755946869b6206a5c04666a9 Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesAdminNegativeTest-1040737502 Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:59:05.601895 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4847dbc2755946869b6206a5c04666a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4847dbc2755946869b6206a5c04666a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4847dbc2755946869b6206a5c04666a9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4847dbc2755946869b6206a5c04666a9"}]}] Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesAdminNegativeTest-1040737502 Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 4847dbc2755946869b6206a5c04666a9 Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1040737502 Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesAdminNegativeTest-1040737502-project-admin Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b6de9b26fccd4f22b745eba7f04dd157 Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesAdminNegativeTest-1040737502-project-admin Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: {"volumeAttachment": {"volumeId": "8f952da3-c1ec-4b9e-b299-4f7c5dc37d44"}} Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:59:05.604352 n-d-zed-1 devstack@n-api.service[128748]: exception: Volume 8f952da3-c1ec-4b9e-b299-4f7c5dc37d44 could not be found. Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '40c22437-c39a-4889-bb0d-56bb97a135ea', 'id': '47d23221-f459-4867-a138-31977ce6e207', 'body': {'volumeAttachment': {'volumeId': '8f952da3-c1ec-4b9e-b299-4f7c5dc37d44'}}} Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:05.605740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8f952da3-c1ec-4b9e-b299-4f7c5dc37d44 could not be found. (HTTP 404) (Request-ID: req-51c5b1b9-339e-45f9-be71-54ea94be1d35) Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:05.607205 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8f952da3-c1ec-4b9e-b299-4f7c5dc37d44 could not be found. Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:05.609162 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8f952da3-c1ec-4b9e-b299-4f7c5dc37d44 could not be found. Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8f952da3-c1ec-4b9e-b299-4f7c5dc37d44 could not be found. Oct 28 09:59:05.610991 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:05.614326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Returning 400 to user: Volume 8f952da3-c1ec-4b9e-b299-4f7c5dc37d44 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:05.615555 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-60bf3eb8-e491-46fb-8d05-5314626ab480 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments/47d23221-f459-4867-a138-31977ce6e207" status: 400 len: 107 microversion: 2.1 time: 0.969157 Oct 28 09:59:05.616398 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1122/2274] 10.222.0.16 () {60 vars in 1433 bytes} [Fri Oct 28 09:59:04 2022] PUT /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments/47d23221-f459-4867-a138-31977ce6e207 => generated 107 bytes in 971 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:59:05.622020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:05.631194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.635774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.636513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.638787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.642891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.643915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.714505 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8fa444e8-6a1f-449e-8a31-aabee3792bfc tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 929 microversion: 2.1 time: 0.096807 Oct 28 09:59:05.716598 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1123/2275] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:59:05 2022] GET /compute/v2.1/os-services => generated 929 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:05.742886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:05.744582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:05.757379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.760012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.760469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:05.761258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:05.761726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:05.762159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.060058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.071961 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d22cdd9-37db-40c8-a4e6-711142f21087 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1381 microversion: 2.1 time: 0.353332 Oct 28 09:59:06.075896 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1124/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:05 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1381 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:06.103838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.108462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:06.142957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.146906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.148102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.150082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.152382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.153238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.316378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.326342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.335265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.348147 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e8b9137-af08-415e-a1d1-d372d0ebd3c2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.270923 Oct 28 09:59:06.350652 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1125/2277] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:06 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:06.369265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.376337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.377099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.380830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.381834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.382472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.384299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.447466 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3c6d18c-feed-46e9-b11b-f78b699a2cb1 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-zed-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.094624 Oct 28 09:59:06.451244 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1126/2278] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Oct 28 09:59:06 2022] GET /compute/v2.1/os-services?host=n-d-zed-1&binary=xxx => generated 16 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:59:06.464578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.465129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:06.481487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.481848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.485573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.486425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.486878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.489708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.516337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.531394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.539501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:06.548532 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a147ee0e-6179-419d-9ae8-75139903552c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1407 microversion: 2.20 time: 1.129247 Oct 28 09:59:06.551023 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1153/2279] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:05 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1407 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:06.566748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f6a530b-7446-4e28-878e-a3f68c887313 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '.version_select at 0x7fca33603dc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.570344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f6a530b-7446-4e28-878e-a3f68c887313 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.570831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f6a530b-7446-4e28-878e-a3f68c887313 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.571323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f6a530b-7446-4e28-878e-a3f68c887313 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.611232 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f6a530b-7446-4e28-878e-a3f68c887313 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 2617 microversion: 2.1 time: 0.057984 Oct 28 09:59:06.630178 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1154/2280] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 09:59:06 2022] GET /compute/v2.1/os-migrations => generated 2617 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:06.635261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.640404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.643268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.643925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.646698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.647657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.648308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.717042 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b2adaf4-24d0-4627-a794-b64f0f5a400a tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 929 microversion: 2.1 time: 0.085353 Oct 28 09:59:06.717678 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1155/2281] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:59:06 2022] GET /compute/v2.1/os-services => generated 929 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:06.730780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.731186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:06.746427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.746943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.747395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.748126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.748593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.749073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.749355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lazy-loading 'services' on Instance uuid 40c22437-c39a-4889-bb0d-56bb97a135ea {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:06.947425 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f478db0a-daa5-46e7-8485-00f077a5e11d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments/47d23221-f459-4867-a138-31977ce6e207" status: 202 len: 0 microversion: 2.1 time: 0.491328 Oct 28 09:59:06.953006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1127/2282] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 09:59:06 2022] DELETE /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments/47d23221-f459-4867-a138-31977ce6e207 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:06.965768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:06.971236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.972040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.972721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:06.974053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:06.974790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:06.976156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.025807 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c10e4feb-4b61-42a4-bc1c-f521326a6681 tempest-ServicesAdminNegativeTestJSON-762253530 tempest-ServicesAdminNegativeTestJSON-762253530-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.068593 Oct 28 09:59:07.027683 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1128/2283] 10.222.0.16 () {58 vars in 1198 bytes} [Fri Oct 28 09:59:06 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:59:07.039347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:07.044158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:07.054053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.055118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.055911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.067164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.067376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.067663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.136230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19d468f7-461a-4fac-ad06-f6cd2d706b78 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106849 Oct 28 09:59:07.137185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1129/2284] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:07 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:07.264122 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-384f2474-00d3-4e6a-a714-1be25d8c7551 tempest-LiveMigrationTest-107594348 tempest-LiveMigrationTest-107594348-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1526 microversion: 2.1 time: 0.545350 Oct 28 09:59:07.276976 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1156/2285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:06 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1526 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:07.300263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:07.301085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:07.311051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.312944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.314235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.315297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.316004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.316671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.352016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:07.399401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1107030-899f-4882-ab3a-1aa76e56ea80 tempest-ServicesAdminNegativeTestJSON-1094271096 tempest-ServicesAdminNegativeTestJSON-1094271096-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:07.404887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1107030-899f-4882-ab3a-1aa76e56ea80 tempest-ServicesAdminNegativeTestJSON-1094271096 tempest-ServicesAdminNegativeTestJSON-1094271096-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3e780b1741cd4d558a8cf39c3f352cc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bec2cad7804348bfbd4610e37619c4b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1107030-899f-4882-ab3a-1aa76e56ea80 tempest-ServicesAdminNegativeTestJSON-1094271096 tempest-ServicesAdminNegativeTestJSON-1094271096-project] Request method failure captured: Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6fmvW2hK76Llmtcr4w1PMBqOdcdHZ2A11KN20IkemY56VNxAba5ZZ82GT9v76igl0SgbGJkvecWTx4ckJ4odN8s4bs1lxfVdri-Ru0KI5EL9DJJqsCpNIzRq-6nmO8LiuqIyIzHYKKsNPQX68nZa_zMWlDFm3DE9i0d6rZWVZmRGTE Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: bec2cad7804348bfbd4610e37619c4b5 Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1094271096 Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:59:07.425207 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec2cad7804348bfbd4610e37619c4b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bec2cad7804348bfbd4610e37619c4b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bec2cad7804348bfbd4610e37619c4b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bec2cad7804348bfbd4610e37619c4b5"}]}] Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1094271096 Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: bec2cad7804348bfbd4610e37619c4b5 Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1094271096 Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServicesAdminNegativeTestJSON-1094271096-project Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 3e780b1741cd4d558a8cf39c3f352cc2 Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1094271096-project Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 09:59:07.426994 n-d-zed-1 devstack@n-api.service[128748]: action_args: {} Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:59:07.427943 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 09:59:07.429693 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:07.431710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1107030-899f-4882-ab3a-1aa76e56ea80 tempest-ServicesAdminNegativeTestJSON-1094271096 tempest-ServicesAdminNegativeTestJSON-1094271096-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:07.431710 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1107030-899f-4882-ab3a-1aa76e56ea80 tempest-ServicesAdminNegativeTestJSON-1094271096 tempest-ServicesAdminNegativeTestJSON-1094271096-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.288626 Oct 28 09:59:07.437249 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1130/2286] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:59:07 2022] GET /compute/v2.1/os-services => generated 112 bytes in 299 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:07.442476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:07.443103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:07.468994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.469827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.472206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.472206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.472206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.472206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.548108 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-acd983bc-e6c8-470d-a908-82bdc76e075a tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 204 len: 0 microversion: 2.1 time: 0.248140 Oct 28 09:59:07.552623 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1157/2287] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:07 2022] DELETE /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:07.563401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:07.570599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:07.600482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.601010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.604539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.612719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.613393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.613859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.757668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:07.791125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:07.799866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:07.814223 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-32afe33d-3248-4d3b-8c71-b7c21de168ec tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.375754 Oct 28 09:59:07.817331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1131/2288] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:07 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:07.855735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:07.861892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:07.891758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.892238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.892698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:07.893444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:07.893905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:07.894340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:08.228207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:08.240113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:08.245152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:08.254992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:08.260035 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-428fc563-6b15-4f57-adf9-5b799758960b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1599 microversion: 2.20 time: 0.439449 Oct 28 09:59:08.260639 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1132/2289] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:07 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1599 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:08.260970 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b805ff89-436f-4a48-9fb1-efaeecf7ceb4 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1387 microversion: 2.1 time: 0.702718 Oct 28 09:59:08.277903 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1158/2290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:07 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1387 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:08.286148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:08.288059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:08.296025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:08.296815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:08.298868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:08.301014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:08.302312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:08.302976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:08.303850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:08.316939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:08.353707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:08.354227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:08.359489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:08.360342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:08.363633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:08.366242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:08.427135 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-79979101-6744-4a72-9347-f6b4870392ed tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.145094 Oct 28 09:59:08.428520 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1159/2291] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 09:59:08 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-interface => generated 284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:59:08.474610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3546d1c8-4053-470e-a153-a8ccbba0582f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.189904 Oct 28 09:59:08.481397 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1133/2292] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:08 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:08.853955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:08.861927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:08.879996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:08.882727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:08.883240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:08.884525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:08.890972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:08.891452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:09.091852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:09.098039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:09.107937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:09.110029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:09.120026 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96928229-5c55-4834-9676-acc71207f5da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.273193 Oct 28 09:59:09.135640 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1160/2293] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:08 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:09.287438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:09.288070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:09.307710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:09.308224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:09.308671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:09.309429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:09.309881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:09.316786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:09.494094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:09.496747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:09.528983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:09.529511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:09.532123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:09.536436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:09.539827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:09.542656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:09.647515 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0aaab218-dac7-4338-b577-d7bb74a24fe8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163673 Oct 28 09:59:09.654251 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1161/2294] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:09 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:09.875844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:09.886090 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-932a4d8c-345d-4396-ad44-43a90fd16940 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1387 microversion: 2.1 time: 0.603678 Oct 28 09:59:09.906994 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1134/2295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:09 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1387 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:10.155435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:10.156713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:10.174163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:10.175371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:10.176610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:10.180507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:10.181564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:10.183207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:10.457505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:10.486542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:10.492347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:10.515213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d67ea6d9-db31-4a0d-86eb-ab60d2651105 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1535 microversion: 2.91 time: 0.364458 Oct 28 09:59:10.517211 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1162/2296] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:10 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1535 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:10.623862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-297bc1fd-809c-40a9-a5a0-741eabe2358d req-29bb24ef-f401-4725-8b4e-003996c1bc01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3251b41a-f111-4ff3-b549-d3d97fd3b0d2", "name": "network-vif-deleted", "tag": "3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:10.648516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-297bc1fd-809c-40a9-a5a0-741eabe2358d req-29bb24ef-f401-4725-8b4e-003996c1bc01 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:10.649322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-297bc1fd-809c-40a9-a5a0-741eabe2358d req-29bb24ef-f401-4725-8b4e-003996c1bc01 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:10.649780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-297bc1fd-809c-40a9-a5a0-741eabe2358d req-29bb24ef-f401-4725-8b4e-003996c1bc01 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:10.666553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:10.669179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:10.684038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:10.684816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:10.686560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:10.687306 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-297bc1fd-809c-40a9-a5a0-741eabe2358d req-29bb24ef-f401-4725-8b4e-003996c1bc01 service nova] Creating event network-vif-deleted:3e0c9a0c-34f3-47c9-8673-9b6ccd3bb466 for instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 on n-h2-zed-1 Oct 28 09:59:10.688177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:10.688895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:10.689821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:10.703518 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-297bc1fd-809c-40a9-a5a0-741eabe2358d req-29bb24ef-f401-4725-8b4e-003996c1bc01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096509 Oct 28 09:59:10.707353 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1135/2297] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:10.745206 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f4602af-714e-42ac-8e6e-3e59190c21e5 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084105 Oct 28 09:59:10.747014 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1163/2298] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:10 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:10.925649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:10.926652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:10.943095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:10.944835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:10.947577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:10.950426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:10.952637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:10.956306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:10.999404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:11.098268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:11.109544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1a49067c-0e57-4661-8e06-2d837202fa45 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.190617 Oct 28 09:59:11.125112 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1136/2299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:10 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:11.522426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-89eac2c4-f730-4ca9-a489-3ffb58e1292c req-feb4a477-a17a-49e2-9289-fc2bb12086d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7831b2e-dc40-4e1b-981b-94cb7d1736f0", "tag": "a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:11.549533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:11.550266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:11.561946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-89eac2c4-f730-4ca9-a489-3ffb58e1292c req-feb4a477-a17a-49e2-9289-fc2bb12086d1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:11.562459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-89eac2c4-f730-4ca9-a489-3ffb58e1292c req-feb4a477-a17a-49e2-9289-fc2bb12086d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:11.562880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-89eac2c4-f730-4ca9-a489-3ffb58e1292c req-feb4a477-a17a-49e2-9289-fc2bb12086d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:11.569903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:11.570330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:11.572964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:11.574178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:11.578655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:11.578655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:11.610703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-89eac2c4-f730-4ca9-a489-3ffb58e1292c req-feb4a477-a17a-49e2-9289-fc2bb12086d1 service nova] Creating event network-changed:a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a for instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 on n-h1-zed-1 Oct 28 09:59:11.616859 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-89eac2c4-f730-4ca9-a489-3ffb58e1292c req-feb4a477-a17a-49e2-9289-fc2bb12086d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098499 Oct 28 09:59:11.620626 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1164/2300] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:11.742235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:11.759423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:11.762441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:11.763221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:11.771445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:11.781552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:11.782886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:11.785287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:11.791220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:11.793067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:11.793722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:11.797873 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c9912bc-a302-49a3-8689-a14c99f5e099 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1535 microversion: 2.91 time: 0.253221 Oct 28 09:59:11.798918 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1137/2301] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:11 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1535 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:11.873830 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-658d171c-952d-42d7-a68c-44f8cb6b7f6d tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118722 Oct 28 09:59:11.878329 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1165/2302] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:11 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:12.143781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:12.148441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:12.160818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:12.162629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:12.163525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:12.164737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:12.165514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:12.166338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:12.334625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:12.349834 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-611b6caf-8627-49ed-a8dd-ad964e70e6f8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.216962 Oct 28 09:59:12.351437 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1138/2303] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:12 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:12.830582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:12.831354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:12.845970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:12.846781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:12.847333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:12.848172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:12.850055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:12.850636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:12.888878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:12.891682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:12.904169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:12.906786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:12.911175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:12.913721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:12.916863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:12.917177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:12.996160 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-729e49b9-14ce-4b81-9b29-60434acfa697 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112439 Oct 28 09:59:13.009349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1139/2304] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:12 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:13.374162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:13.375524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:13.381904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:13.382885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:13.385013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:13.386765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:13.388141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:13.388935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:13.401507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:13.423337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:13.430868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:13.441495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:13.450117 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-32958f49-d9ba-4740-8d3b-b344ef8612d1 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1478 microversion: 2.91 time: 0.618136 Oct 28 09:59:13.453674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1166/2305] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:12 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1478 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:13.500364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:13.504981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:13.517527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:13.518979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:13.520176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:13.521779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:13.522551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:13.523370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:13.531146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:13.558189 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8999aa2-909b-4d75-8a46-2c3fde5d7a36 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.183216 Oct 28 09:59:13.559967 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1140/2306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:13 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:13.624691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-zed-1". {{(pid=128747) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 09:59:13.769776 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1b97c01-99fe-4ec1-83cb-5ece722d1f69 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action" status: 202 len: 0 microversion: 2.91 time: 0.283587 Oct 28 09:59:13.770682 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1167/2307] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:59:13 2022] POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:13.781834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:13.782674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:13.794546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:13.795160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:13.795459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:13.796171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:13.796618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:13.797813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:13.908929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:13.927957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:13.929913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:13.935985 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edf74950-9c53-4cce-bb8b-5d35aca79922 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1486 microversion: 2.91 time: 0.159758 Oct 28 09:59:13.952172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1141/2308] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:13 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1486 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:14.007718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:14.011629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:14.021804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.028137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:14.033780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.041749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:14.042757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Searching by: {'deleted': False, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:59:14.043169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.044240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.047776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.048413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.058135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.061950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.062680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.066171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.067232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.067868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.131120 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a336da5-878a-4fcf-bb21-b407e7b5738f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124187 Oct 28 09:59:14.135154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:59:14.136537 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1168/2309] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:14 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:14.237348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab9b36ad-093b-4e69-8d75-90c33143ba01 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.213001 Oct 28 09:59:14.243331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1142/2310] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 09:59:14 2022] GET /compute/v2.1/servers => generated 339 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:14.253405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:14.258944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:14.265498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Searching by: {'deleted': False, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 09:59:14.277912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.278674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.279303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.280302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.281004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.282177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.459741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 09:59:14.585873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:14.597590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.597980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.598486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.770283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-532df9c6-e758-4a02-a300-fd39ada6ece2 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Calling method '.version_select at 0x7fca32793670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:14.801500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-532df9c6-e758-4a02-a300-fd39ada6ece2 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] HTTP exception thrown: Image not found. Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-532df9c6-e758-4a02-a300-fd39ada6ece2 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Request method failure captured: Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/811d25d1-025a-4827-ae6c-1a6d9eb3409c/metadata/os_distro HTTP/1.1 Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6fy-q0ncMrVVVqidLXbLKqBpp5fg-wgkTG3c7rg9Q17sl2yvS7WPiqLxOy0Sm77Z9BuTldCgsXZuBujooe3FRUeYyxjTaKpHeMdq0dIyyFUGYb11gIudEQzDH0tjhfpXFrm19ggT6Lt8JYXJGSJeLudgAop_pkqf14ytkGGSya4OsQ Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:59:14.812335 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b42c182ea9bf440ab942b314ccb7b3f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b42c182ea9bf440ab942b314ccb7b3f7"}]}] Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 69fa799041b644fb8887330c0709a3e0 Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'image_id': '811d25d1-025a-4827-ae6c-1a6d9eb3409c', 'id': 'os_distro'} Oct 28 09:59:14.814486 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:14.815744 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 811d25d1-025a-4827-ae6c-1a6d9eb3409c Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:14.817426 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 811d25d1-025a-4827-ae6c-1a6d9eb3409c could not be found. Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:14.819164 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:59:14.821956 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:14.823628 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-858e73f2-c856-4b4b-8713-f5a79b13fb8d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1708 microversion: 2.1 time: 0.570345 Oct 28 09:59:14.823628 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1169/2311] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 09:59:14 2022] GET /compute/v2.1/servers/detail => generated 1708 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:14.825525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-532df9c6-e758-4a02-a300-fd39ada6ece2 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:14.826868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-532df9c6-e758-4a02-a300-fd39ada6ece2 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] 10.222.0.16 "DELETE /compute/v2.1/images/811d25d1-025a-4827-ae6c-1a6d9eb3409c/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.512309 Oct 28 09:59:14.827964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:14.828184 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1143/2312] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 09:59:14 2022] DELETE /compute/v2.1/images/811d25d1-025a-4827-ae6c-1a6d9eb3409c/metadata/os_distro => generated 62 bytes in 515 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 09:59:14.831227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:14.844542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.848472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.849713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.851240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:14.853138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:14.854338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:14.915200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-672208443", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:14.950838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:14.964176 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d88cf70-bc10-4dc9-9b1d-06d3da75934f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.143066 Oct 28 09:59:14.976927 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1170/2313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:14 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:14.980881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e545748e-9071-412c-8f93-f288bf68a86e tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Calling method '.version_select at 0x7fca330c0550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:14.990510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:59:15.028479 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e545748e-9071-412c-8f93-f288bf68a86e tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] HTTP exception thrown: Image not found. Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e545748e-9071-412c-8f93-f288bf68a86e tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Request method failure captured: Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/images/fb68563c-1d3c-47cd-add1-c00b09e2ad31/metadata/os_version HTTP/1.1 Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fy-q0ncMrVVVqidLXbLKqBpp5fg-wgkTG3c7rg9Q17sl2yvS7WPiqLxOy0Sm77Z9BuTldCgsXZuBujooe3FRUeYyxjTaKpHeMdq0dIyyFUGYb11gIudEQzDH0tjhfpXFrm19ggT6Lt8JYXJGSJeLudgAop_pkqf14ytkGGSya4OsQ Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:15.030926 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b42c182ea9bf440ab942b314ccb7b3f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b42c182ea9bf440ab942b314ccb7b3f7"}]}] Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 69fa799041b644fb8887330c0709a3e0 Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'image_id': 'fb68563c-1d3c-47cd-add1-c00b09e2ad31', 'id': 'os_version'} Oct 28 09:59:15.032810 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.034073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fb68563c-1d3c-47cd-add1-c00b09e2ad31 Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.035651 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fb68563c-1d3c-47cd-add1-c00b09e2ad31 could not be found. Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:15.037530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.039317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e545748e-9071-412c-8f93-f288bf68a86e tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:15.040976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e545748e-9071-412c-8f93-f288bf68a86e tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] 10.222.0.16 "GET /compute/v2.1/images/fb68563c-1d3c-47cd-add1-c00b09e2ad31/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.065709 Oct 28 09:59:15.040976 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1171/2314] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 09:59:14 2022] GET /compute/v2.1/images/fb68563c-1d3c-47cd-add1-c00b09e2ad31/metadata/os_version => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:59:15.040976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6e92bca0-23a9-4310-bb2e-dba71b02de1e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:15.062622 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6e92bca0-23a9-4310-bb2e-dba71b02de1e tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028658 Oct 28 09:59:15.063221 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1172/2315] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 09:59:15 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:15.076944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:15.081912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:15.091785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.092301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.092743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.093506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.093971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.094406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.228099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:15.240418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:15.242614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:15.250037 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98dec84a-0361-4909-b868-bb2fc556ff0e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1488 microversion: 2.91 time: 0.181994 Oct 28 09:59:15.266907 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1173/2316] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:15 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1488 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:15.282096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-184a3418-646b-4150-8a4c-f93ba446e21d tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Calling method '.version_select at 0x7fca3313a1f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:15.313693 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-184a3418-646b-4150-8a4c-f93ba446e21d tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] HTTP exception thrown: Image not found. Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-184a3418-646b-4150-8a4c-f93ba446e21d tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Request method failure captured: Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/images/ae04b619-f5c3-46a7-8679-bd49b0589607/metadata HTTP/1.1 Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fy-q0ncMrVVVqidLXbLKqBpp5fg-wgkTG3c7rg9Q17sl2yvS7WPiqLxOy0Sm77Z9BuTldCgsXZuBujooe3FRUeYyxjTaKpHeMdq0dIyyFUGYb11gIudEQzDH0tjhfpXFrm19ggT6Lt8JYXJGSJeLudgAop_pkqf14ytkGGSya4OsQ Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:15.315907 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b42c182ea9bf440ab942b314ccb7b3f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b42c182ea9bf440ab942b314ccb7b3f7"}]}] Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 69fa799041b644fb8887330c0709a3e0 Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'image_id': 'ae04b619-f5c3-46a7-8679-bd49b0589607'} Oct 28 09:59:15.317845 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.319102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ae04b619-f5c3-46a7-8679-bd49b0589607 Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.320643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ae04b619-f5c3-46a7-8679-bd49b0589607 could not be found. Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:15.322515 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:59:15.324276 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.329309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-184a3418-646b-4150-8a4c-f93ba446e21d tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:15.329309 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-184a3418-646b-4150-8a4c-f93ba446e21d tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] 10.222.0.16 "GET /compute/v2.1/images/ae04b619-f5c3-46a7-8679-bd49b0589607/metadata" status: 404 len: 62 microversion: 2.1 time: 0.060378 Oct 28 09:59:15.330040 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1174/2317] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 09:59:15 2022] GET /compute/v2.1/images/ae04b619-f5c3-46a7-8679-bd49b0589607/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:59:15.349512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:15.351768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:15.365263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.366186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.366819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.367734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.369069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.369678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.436132 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1263ead2-2fd3-4662-9710-7540a330c26b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101166 Oct 28 09:59:15.437600 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1175/2318] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 09:59:15 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 09:59:15.445151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6aed7c03-5f71-41d5-80f7-d3c4066afac7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Action: 'update_all', calling method: .version_select at 0x7fca3313a3a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:15.472122 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6aed7c03-5f71-41d5-80f7-d3c4066afac7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] HTTP exception thrown: Image not found. Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6aed7c03-5f71-41d5-80f7-d3c4066afac7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Request method failure captured: Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: request: PUT /compute/v2.1/images/e5c79d26-2b92-4c51-bd1f-7c91c4ce45f7/metadata HTTP/1.1 Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 57 Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fy-q0ncMrVVVqidLXbLKqBpp5fg-wgkTG3c7rg9Q17sl2yvS7WPiqLxOy0Sm77Z9BuTldCgsXZuBujooe3FRUeYyxjTaKpHeMdq0dIyyFUGYb11gIudEQzDH0tjhfpXFrm19ggT6Lt8JYXJGSJeLudgAop_pkqf14ytkGGSya4OsQ Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:15.477305 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b42c182ea9bf440ab942b314ccb7b3f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b42c182ea9bf440ab942b314ccb7b3f7"}]}] Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 69fa799041b644fb8887330c0709a3e0 Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 09:59:15.480024 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'image_id': 'e5c79d26-2b92-4c51-bd1f-7c91c4ce45f7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.481236 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e5c79d26-2b92-4c51-bd1f-7c91c4ce45f7 Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.482732 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e5c79d26-2b92-4c51-bd1f-7c91c4ce45f7 could not be found. Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:15.484413 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:59:15.487285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.489294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6aed7c03-5f71-41d5-80f7-d3c4066afac7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:15.489294 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6aed7c03-5f71-41d5-80f7-d3c4066afac7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] 10.222.0.16 "PUT /compute/v2.1/images/e5c79d26-2b92-4c51-bd1f-7c91c4ce45f7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.040191 Oct 28 09:59:15.489294 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1176/2319] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 09:59:15 2022] PUT /compute/v2.1/images/e5c79d26-2b92-4c51-bd1f-7c91c4ce45f7/metadata => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:59:15.497453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:15.498143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:15.524177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.527204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.528102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.528884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.530394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.531708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.537924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:59:15.539190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:59:15.541443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:59:15.542268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:59:15.543381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:59:15.558348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.559150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.560360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.563331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.564044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.564739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.565049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:15.608566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Getting quotas for project e901479a6ca34dd1bcecfe2211ea82f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:15.615925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Getting quotas for user 9e0bbdc67f9440b1bcf92e62720385cf and project e901479a6ca34dd1bcecfe2211ea82f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:15.633856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:59:15.637487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:59:15.733971 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa7d3556-f4d3-4cc7-a9ec-fb722e5f17cb tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "DELETE /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 204 len: 0 microversion: 2.1 time: 0.244350 Oct 28 09:59:15.737684 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31cd9428-ee30-4981-8512-6ca399554332 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905372 Oct 28 09:59:15.738142 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1177/2320] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:15 2022] DELETE /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:15.742281 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1144/2321] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:59:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:59:15.750069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4162e93-8f12-4f8d-b0ec-eadc4596a042 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Action: 'update', calling method: .version_select at 0x7fca3805b280>, body: {"meta": {"os_distro": "alt"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:15.753678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:15.755266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:15.762500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.763237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.763874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.765036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:15.765673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:15.766280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:15.788498 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f4162e93-8f12-4f8d-b0ec-eadc4596a042 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] HTTP exception thrown: Image not found. Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4162e93-8f12-4f8d-b0ec-eadc4596a042 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Request method failure captured: Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: request: PUT /compute/v2.1/images/3e50de53-c504-4e4f-8e9d-f8a1741bcd11/metadata/os_distro HTTP/1.1 Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 30 Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fy-q0ncMrVVVqidLXbLKqBpp5fg-wgkTG3c7rg9Q17sl2yvS7WPiqLxOy0Sm77Z9BuTldCgsXZuBujooe3FRUeYyxjTaKpHeMdq0dIyyFUGYb11gIudEQzDH0tjhfpXFrm19ggT6Lt8JYXJGSJeLudgAop_pkqf14ytkGGSya4OsQ Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:15.792005 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b42c182ea9bf440ab942b314ccb7b3f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b42c182ea9bf440ab942b314ccb7b3f7"}]}] Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 69fa799041b644fb8887330c0709a3e0 Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: {"meta": {"os_distro": "alt"}} Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 09:59:15.793737 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'image_id': '3e50de53-c504-4e4f-8e9d-f8a1741bcd11', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.795234 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3e50de53-c504-4e4f-8e9d-f8a1741bcd11 Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:15.796523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3e50de53-c504-4e4f-8e9d-f8a1741bcd11 could not be found. Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:15.800928 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:59:15.805277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:15.808743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4162e93-8f12-4f8d-b0ec-eadc4596a042 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:15.810039 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4162e93-8f12-4f8d-b0ec-eadc4596a042 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] 10.222.0.16 "PUT /compute/v2.1/images/3e50de53-c504-4e4f-8e9d-f8a1741bcd11/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.069815 Oct 28 09:59:15.811377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1178/2322] 10.222.0.16 () {60 vars in 1310 bytes} [Fri Oct 28 09:59:15 2022] PUT /compute/v2.1/images/3e50de53-c504-4e4f-8e9d-f8a1741bcd11/metadata/os_distro => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:59:15.822148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-76649548-2b0a-45d7-ab03-8d64a5eddd39 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:15.823309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-76649548-2b0a-45d7-ab03-8d64a5eddd39 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:15.912176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-76649548-2b0a-45d7-ab03-8d64a5eddd39 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:15.921369 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-76649548-2b0a-45d7-ab03-8d64a5eddd39 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1213 microversion: 2.1 time: 0.108586 Oct 28 09:59:15.936099 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1179/2323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:15 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:15.940958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-757676011", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "85535b7b-3d98-4509-9816-a4f492217981"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:16.015621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:16.030672 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-567636f0-3b49-443e-9cd8-7fb1515cbf3d tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1711 microversion: 2.1 time: 0.281231 Oct 28 09:59:16.034278 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1145/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:15 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1711 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:16.054649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-10910339-9cf1-473e-96c6-4b4644fffed7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Action: 'create', calling method: .version_select at 0x7fca328a7280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:16.061257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] validate_networks() for [('85535b7b-3d98-4509-9816-a4f492217981', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:59:16.105028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-10910339-9cf1-473e-96c6-4b4644fffed7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] HTTP exception thrown: Image not found. Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-10910339-9cf1-473e-96c6-4b4644fffed7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Request method failure captured: Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/images/e2133749-c8f8-49e1-941e-b1f61a0fb511/metadata HTTP/1.1 Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 57 Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6fy-q0ncMrVVVqidLXbLKqBpp5fg-wgkTG3c7rg9Q17sl2yvS7WPiqLxOy0Sm77Z9BuTldCgsXZuBujooe3FRUeYyxjTaKpHeMdq0dIyyFUGYb11gIudEQzDH0tjhfpXFrm19ggT6Lt8JYXJGSJeLudgAop_pkqf14ytkGGSya4OsQ Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:59:16.109271 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b42c182ea9bf440ab942b314ccb7b3f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b42c182ea9bf440ab942b314ccb7b3f7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b42c182ea9bf440ab942b314ccb7b3f7"}]}] Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: b42c182ea9bf440ab942b314ccb7b3f7 Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-842106363 Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 69fa799041b644fb8887330c0709a3e0 Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-842106363-project Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 09:59:16.111117 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'image_id': 'e2133749-c8f8-49e1-941e-b1f61a0fb511', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:16.112355 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e2133749-c8f8-49e1-941e-b1f61a0fb511 Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 09:59:16.113962 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2133749-c8f8-49e1-941e-b1f61a0fb511 could not be found. Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:16.115817 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 09:59:16.117489 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:16.123427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-10910339-9cf1-473e-96c6-4b4644fffed7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:16.123427 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-10910339-9cf1-473e-96c6-4b4644fffed7 tempest-ImagesMetadataNegativeTestJSON-842106363 tempest-ImagesMetadataNegativeTestJSON-842106363-project] 10.222.0.16 "POST /compute/v2.1/images/e2133749-c8f8-49e1-941e-b1f61a0fb511/metadata" status: 404 len: 62 microversion: 2.1 time: 0.086568 Oct 28 09:59:16.124378 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1146/2325] 10.222.0.16 () {60 vars in 1281 bytes} [Fri Oct 28 09:59:16 2022] POST /compute/v2.1/images/e2133749-c8f8-49e1-941e-b1f61a0fb511/metadata => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 09:59:16.144514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:16.152342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:16.167295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:16.168709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:16.170817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:16.172244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:16.172891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:16.176066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:16.330608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:16.341662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd650550-c03a-4313-b418-c903c6c8fdef tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.215253 Oct 28 09:59:16.343902 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1147/2326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:16 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:16.374295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:16.375521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:16.391809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:16.392651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:16.393548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:16.394499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:16.402003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:16.403359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:16.558890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:16.577634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:16.580325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:16.588440 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d6db778-fda2-440e-81eb-d68e239c0228 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.231154 Oct 28 09:59:16.589851 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1148/2327] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:16 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:16.948839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:16.949494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:16.976161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:16.976795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:16.984062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:16.985097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:16.988736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:16.990384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:17.282950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:59:17.283664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:59:17.284279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:59:17.285390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:59:17.286402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:59:17.329360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:17.330839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:17.332362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:17.337888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:17.339353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:17.340017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:17.340475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:17.347776 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76311a44-3638-4ac1-a89b-22629cb3104e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1209 microversion: 2.1 time: 0.403612 Oct 28 09:59:17.348361 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1149/2328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:16 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1209 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:17.379642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:17.380273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:17.391564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:17.401652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Getting quotas for project aa7146c7cb464ce99ad2f6593f0ebb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:17.418318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Getting quotas for user b2706dd9c4f24a41a1e990c0517b792e and project aa7146c7cb464ce99ad2f6593f0ebb0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:17.419294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:17.419794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:17.420237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:17.420994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:17.421481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:17.421869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:17.465000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:59:17.477027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:59:17.724663 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1d84625-4320-48f1-817b-d79f98c746f2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800758 Oct 28 09:59:17.725529 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1180/2329] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:59:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:59:17.760153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:17.760847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:17.820727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:17.821874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:17.822878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:17.824042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:17.824763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:17.825597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:17.908529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:18.052206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:18.068828 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ac2d1a0f-6e12-4f3d-a694-d6200bfe555f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1711 microversion: 2.1 time: 0.692855 Oct 28 09:59:18.069733 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1150/2330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:17 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1711 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:18.074825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:18.081637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:18.105110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:18.105724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:18.106173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:18.106930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:18.107367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:18.107798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:18.143531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:18.161710 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca057836-cfcb-419e-a2cb-63ecffb739c8 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.428463 Oct 28 09:59:18.183248 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1181/2331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:17 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:18.188357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-717f6d36-37e6-41ac-b547-8f63a59c7de4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:18.194846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-717f6d36-37e6-41ac-b547-8f63a59c7de4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:19.175296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-717f6d36-37e6-41ac-b547-8f63a59c7de4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:19.198312 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-717f6d36-37e6-41ac-b547-8f63a59c7de4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1217 microversion: 2.1 time: 1.013778 Oct 28 09:59:19.200482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1182/2332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:18 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1217 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:19.212244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:19.217883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:19.248407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:19.254011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:19.254805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:19.255742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:19.256392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:19.275496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:19.459522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:19.475212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:19.487884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:19.510736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-66138d5f-19f1-4154-a128-d465479ec760 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 1.439490 Oct 28 09:59:19.512669 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1151/2333] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:18 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:19.552353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:19.553727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:19.580266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:19.584397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:19.589280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:19.597081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:19.603832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:19.605382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:19.814251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:19.834979 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-773316b8-8cba-48a8-bcea-7fc1ae6a724e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1271 microversion: 2.1 time: 0.627050 Oct 28 09:59:19.857143 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1183/2334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:19 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1271 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:19.880898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:19.883094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:19.910789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:19.911690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:19.913577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:19.915695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:19.917405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:19.918102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:20.246390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:20.262258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-561c582c-065b-4b56-8180-ea4b6e6f710f tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1644 microversion: 2.1 time: 0.746997 Oct 28 09:59:20.263514 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1152/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:19 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1644 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:20.279978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:20.281055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:20.292248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:20.294694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:20.295452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:20.298020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:20.299080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:20.301364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:20.381567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:20.391394 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48553f70-7c95-40b8-956c-b18b389fad8f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.530466 Oct 28 09:59:20.440067 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1184/2336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:19 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:20.551574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:20.552342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:20.571723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:20.578604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:20.581388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:20.582179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:20.582665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:20.591834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:20.671919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:20.689132 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7fe9839b-25ff-4aec-80e0-4d81aa6a58a2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1269 microversion: 2.1 time: 0.419593 Oct 28 09:59:20.690145 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1153/2337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:20 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1269 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:20.863733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:20.864409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:20.871857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:20.886858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:20.887921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:20.888885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:20.889541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:20.890168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:20.943733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:20.966081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:20.976168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:20.983222 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3faec00d-3afa-4885-b65b-a365d7690881 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.439728 Oct 28 09:59:20.983816 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1185/2338] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:20 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:21.291691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:21.292323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:21.328837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:21.336548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:21.338019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:21.342344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:21.347588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:21.350736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:21.433431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:21.447541 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5e90e22-0a5d-4639-91f1-5d95568ce457 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1271 microversion: 2.1 time: 0.586230 Oct 28 09:59:21.449819 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1154/2339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:20 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1271 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:21.456179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ea34aaf8-cd7e-456b-b920-c53168c643b3 req-fe832678-54ac-4a3e-8e52-4b42a937f026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec4e013-e1ac-4e82-992a-ac0aba822538", "name": "network-vif-deleted", "tag": "3ca1e8b5-523a-4d6a-b906-057b0c3b5737"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:21.479581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ea34aaf8-cd7e-456b-b920-c53168c643b3 req-fe832678-54ac-4a3e-8e52-4b42a937f026 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:21.480868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ea34aaf8-cd7e-456b-b920-c53168c643b3 req-fe832678-54ac-4a3e-8e52-4b42a937f026 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:21.483901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ea34aaf8-cd7e-456b-b920-c53168c643b3 req-fe832678-54ac-4a3e-8e52-4b42a937f026 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:21.538751 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ea34aaf8-cd7e-456b-b920-c53168c643b3 req-fe832678-54ac-4a3e-8e52-4b42a937f026 service nova] Creating event network-vif-deleted:3ca1e8b5-523a-4d6a-b906-057b0c3b5737 for instance dec4e013-e1ac-4e82-992a-ac0aba822538 on n-h2-zed-1 Oct 28 09:59:21.549680 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ea34aaf8-cd7e-456b-b920-c53168c643b3 req-fe832678-54ac-4a3e-8e52-4b42a937f026 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098459 Oct 28 09:59:21.551009 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1155/2340] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:21.559467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:21.560543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:21.582045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:21.587899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:21.589579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:21.592616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:21.598269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:21.601091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:21.614348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:21.625212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:21.628956 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-049e890f-7c18-463a-bf68-d666cf760f45 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1361 microversion: 2.1 time: 0.341575 Oct 28 09:59:21.645219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1186/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:21 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:21.719608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:21.720593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:21.731527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:21.736311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:21.738885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:21.739851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:21.742642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:21.744612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:21.927285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:21.961961 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2c53fa4-cc35-4991-98bd-8a86f2161595 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1275 microversion: 2.1 time: 0.242079 Oct 28 09:59:21.967373 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1187/2342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:21 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1275 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:22.019101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:22.020049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:22.034630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.035853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.037988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.038975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.039632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.041192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.048646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:22.073275 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d9784df-3861-48f2-be79-9824a49e07fe tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.520128 Oct 28 09:59:22.076190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1156/2343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:21 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:22.140007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:22.152258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:22.154055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:22.162705 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d837b53-9f8f-4bcd-a365-c89c41ef207f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.150634 Oct 28 09:59:22.163908 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1188/2344] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:22 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:22.472698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:22.473735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:22.497537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.504539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.506445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.516271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.517223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.517696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.661750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:22.662390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:22.709502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.712201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.715148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.720020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.725512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.732014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.910203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:22.913817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:22.916126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:22.919209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lazy-loading 'fault' on Instance uuid dec4e013-e1ac-4e82-992a-ac0aba822538 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:23.055552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be43920925d44c94ae226ee021925d73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fef6627ff6418c9b64f7f1535dfe75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:23.073864 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75e01393-270a-4bb8-89b9-83cf0d696fbc tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 200 len: 1366 microversion: 2.1 time: 0.412198 Oct 28 09:59:23.077205 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1189/2345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:22 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:23.101289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:23.102360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:23.117491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:23.134888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-396eb1f4-fe66-416d-8d68-9da3f2516817 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1271 microversion: 2.1 time: 0.666418 Oct 28 09:59:23.140359 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1157/2346] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:22 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1271 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:23.159136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.162621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.163199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.167102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.180052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:23.180432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.182935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:23.183112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.201734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.202518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.203342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.204248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.205001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.207239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.461610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:23.474791 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c1ca73a5-a52b-4d71-b89b-920280e77f16 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1275 microversion: 2.1 time: 0.393853 Oct 28 09:59:23.490574 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1190/2347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:23 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1275 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:23.490574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:23.490574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:23.506822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.507309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.518629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.519506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:23.521509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:23.521989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:23.676573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:23.690745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:23.693691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:23.704464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6d28c51-dee6-4dc3-ac58-36ffad23309a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.225507 Oct 28 09:59:23.706166 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1191/2348] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:23 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:23.904007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:23.914146 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07fb6281-4aa4-4e5e-870e-a2db10a57533 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.747973 Oct 28 09:59:23.920242 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1158/2349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:23 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:24.000119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-371523541", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:24.103950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:24.104634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] [instance: dec4e013-e1ac-4e82-992a-ac0aba822538] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:24.115182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.115722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.116225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.117058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.117517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.118539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.119380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:59:24.185679 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] HTTP exception thrown: Instance dec4e013-e1ac-4e82-992a-ac0aba822538 could not be found. Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Request method failure captured: Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 HTTP/1.1 Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6eIxnsYbV4eyV5Kuh_TYdty1qSTTEe6eGInuA2gwH4n82Zj3UXv0EBOKH3AYKRf-wmltX2Xb819TE4yaZwu1C7F3w6nasSLQwYVF91juQMxIxDyEWOAsf-ebSeVtgv77co8UyBUUKv1GgDiAB2meahjmN2MtJK2DOjWgx8pJi15_z0 Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 78fef6627ff6418c9b64f7f1535dfe75 Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestManualDisk-569399944 Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:59:24.187524 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78fef6627ff6418c9b64f7f1535dfe75"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/78fef6627ff6418c9b64f7f1535dfe75"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_78fef6627ff6418c9b64f7f1535dfe75", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/78fef6627ff6418c9b64f7f1535dfe75"}]}] Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestManualDisk-569399944 Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 78fef6627ff6418c9b64f7f1535dfe75 Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestManualDisk-569399944 Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestManualDisk-569399944-project Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: be43920925d44c94ae226ee021925d73 Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestManualDisk-569399944-project Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance dec4e013-e1ac-4e82-992a-ac0aba822538 could not be found. Oct 28 09:59:24.189334 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'dec4e013-e1ac-4e82-992a-ac0aba822538'} Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec4e013-e1ac-4e82-992a-ac0aba822538 could not be found. Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:24.190335 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec4e013-e1ac-4e82-992a-ac0aba822538 could not be found. Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec4e013-e1ac-4e82-992a-ac0aba822538 could not be found. Oct 28 09:59:24.191886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:24.196575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Returning 404 to user: Instance dec4e013-e1ac-4e82-992a-ac0aba822538 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:24.209888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fbfdf75d-1481-4d73-8841-157705afea33 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538" status: 404 len: 111 microversion: 2.1 time: 0.110803 Oct 28 09:59:24.214334 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1159/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:24 2022] GET /compute/v2.1/servers/dec4e013-e1ac-4e82-992a-ac0aba822538 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 09:59:24.238686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:24.250268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:24.273260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.273650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.274113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.274853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.307277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.308093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.795156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:59:24.796449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:59:24.797559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:59:24.798445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:59:24.799187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:59:24.824582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.825455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.826310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.827455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:24.828216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:24.828859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:24.863454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Getting quotas for project fd976570de164b69b58bfae7d4379e26. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:24.874010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Getting quotas for user 4ec2ec5910404cc9aa621b4998b067bd and project fd976570de164b69b58bfae7d4379e26. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:24.904611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:59:24.907276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:59:24.980743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:25.023050 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bbe07529-898b-4c52-9e8c-5592cfec17cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.314567 Oct 28 09:59:25.024212 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1192/2351] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:59:25.031964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-66bde909-5f39-4da6-a73e-75b41250f501 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] Calling method '.version_select at 0x7fca330379d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:25.067469 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-66bde909-5f39-4da6-a73e-75b41250f501 tempest-ServersTestManualDisk-569399944 tempest-ServersTestManualDisk-569399944-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-885268190" status: 202 len: 0 microversion: 2.1 time: 0.036814 Oct 28 09:59:25.068792 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1193/2352] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 09:59:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-885268190 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:25.097337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:25.100677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.102691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:25.115557 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf97460d-1c9c-4519-80d4-a08fdde99111 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.899272 Oct 28 09:59:25.128991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.129428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.129915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.130958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.131227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1160/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:24 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:25.131762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.131762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.150639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:25.154388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:25.170566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.174743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.175502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.176535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.180193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.181479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.526589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.551949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.553898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.594313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:25.604811 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e10a4ef7-3387-4fa7-9daa-a8032550ee6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.466177 Oct 28 09:59:25.605464 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1161/2354] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:25 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:25.645836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:25.651604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:25.666170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.684659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:25.685004 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7ec2c5c-aa57-47dc-84f8-4589c52d243c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.605754 Oct 28 09:59:25.700588 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1194/2355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:25 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:25.700820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.700820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.700820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.700820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:25.701313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:25.701313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:25.701861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f3ec5a7-00ab-4e57-a2b8-659e09f7e382 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:25.703382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f3ec5a7-00ab-4e57-a2b8-659e09f7e382 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:25.937686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.938433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f3ec5a7-00ab-4e57-a2b8-659e09f7e382 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:25.945920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f3ec5a7-00ab-4e57-a2b8-659e09f7e382 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1216 microversion: 2.1 time: 0.256542 Oct 28 09:59:25.947085 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1195/2356] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:25 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:25.955286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7dadddec-daf3-4620-9c5e-24e62f3cfbd3 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1182 microversion: 2.1 time: 0.345124 Oct 28 09:59:25.961601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1162/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:25 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1182 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:26.149123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:26.151667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:26.177457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.179974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.182445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.190335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.194632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.195703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.613676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:26.627458 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dfee402-2b1d-431e-a1d8-282150c37acb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.483138 Oct 28 09:59:26.628059 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1196/2358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:26 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:26.638474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:26.639083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:26.648535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.656689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.657580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.660060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.661557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.663962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.708034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:26.708684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:26.731810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.732461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.732771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.741861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:26.743846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:26.744312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:26.954337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:26.977655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:26.981923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:27.023023 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c73f291b-3ba5-47ea-b3b8-041784e68582 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.389196 Oct 28 09:59:27.027659 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1163/2359] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:26 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:27.054067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:27.054891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:27.086625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.090706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.091760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.094533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.096653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.097409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.105436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:27.120744 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c40d981c-d6f5-4b82-b70e-599d52b3bd7e tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.416538 Oct 28 09:59:27.121375 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1197/2360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:26 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:27.148069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:27.150121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:27.178259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.179053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.190645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.198068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.198683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.199106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.287564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.288058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.292112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.292828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lazy-loading 'fault' on Instance uuid 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:27.424784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:27.451476 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22a95788-bcd9-4576-9134-286fe5029808 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1187 microversion: 2.1 time: 0.319781 Oct 28 09:59:27.468285 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1198/2361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:27 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1187 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:27.511173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:27.519221 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dcf8d995-28b7-4dc0-bc5e-2d0239317abe tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1268 microversion: 2.1 time: 0.490412 Oct 28 09:59:27.525227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1164/2362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:27 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1268 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:27.654671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:27.655883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:27.671684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.672194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.672674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.673390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:27.673848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:27.674282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:27.978801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:27.994470 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-66774fe2-ea5b-419c-a9be-33c1662d32c5 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.345273 Oct 28 09:59:27.995121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1199/2363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:27 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:28.077617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:28.081273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:28.103724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.104218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.104655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.109180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.113196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.113866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.150290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:28.151632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:28.161136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.161637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.167248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.168029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.168513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.177201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.481415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:28.484488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:28.494122 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-596f0f1f-3d81-45b3-b35f-fe3dd0b32ada tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.348516 Oct 28 09:59:28.495524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1200/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:28 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:28.502054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:28.503059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:28.518335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.519275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.520033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.521632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.523497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.525060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.629228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.631395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.632777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.635531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lazy-loading 'fault' on Instance uuid 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:28.757644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:28.768629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:28.782903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:28.800790 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2adbdba0-300a-4ddf-b042-b00e84407fe2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.735970 Oct 28 09:59:28.801476 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1165/2365] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:28 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:28.832210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:28.833190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:28.842184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.843059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.843739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.844670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:28.845495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:28.855032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:28.959744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:28.970559 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed50e053-f344-45d0-b59e-64d4c7eed649 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 200 len: 1141 microversion: 2.1 time: 0.473539 Oct 28 09:59:28.976319 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1201/2366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:28 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 1141 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:29.022911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:29.023549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:29.043970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.044484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.049248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.052802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.054002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.057296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.271727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:29.282304 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eaf7d548-c916-4283-8356-c5f95655b093 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1274 microversion: 2.1 time: 0.467956 Oct 28 09:59:29.301657 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1166/2367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:28 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1274 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:29.399360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:29.418182 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-090cc98f-f39a-4e3a-974f-e5fe9e1bedbb tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.401234 Oct 28 09:59:29.418837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1202/2368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:29 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:29.520193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:29.522519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:29.533706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.536478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.537322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.538432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.540732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.546808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.841793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:29.843784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:29.863904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.864399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.864850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:29.865600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:29.866111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:29.866595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.039560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:30.056074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:30.057872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:30.069403 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d6b858e7-becb-444c-a6ec-79f5e7e7118f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.235080 Oct 28 09:59:30.070657 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1203/2369] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:29 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:30.082540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:30.083565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 3251b41a-f111-4ff3-b549-d3d97fd3b0d2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:30.094786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.151138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.151138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.151138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.151138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.151808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.161122 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] HTTP exception thrown: Instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 could not be found. Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Request method failure captured: Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 HTTP/1.1 Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZPJ8vDPZw5XVZPJtVAuZZLfb9Q86IXLXWoGqtkQWWVGc5rShTo7XxmHRNSr5tJgYcCZcZJQHftvUZNtOrkAjcqb1VsVXxw6JzVrtmwOFLkf0sz3oUzfSlkF1yca5vMUmBxbOW6eTEc8Ghr4626WK3f68oppqOfpJ1QvuIRIleepPM Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:30.165119 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38bd1e9a411e49c0b6c13914f4b53caf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38bd1e9a411e49c0b6c13914f4b53caf"}]}] Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: d76e0eb51a9b418bb28e81b5ac1520f9 Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 could not be found. Oct 28 09:59:30.166233 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '3251b41a-f111-4ff3-b549-d3d97fd3b0d2'} Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 could not be found. Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:30.166838 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 could not be found. Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 could not be found. Oct 28 09:59:30.167872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:30.171760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Returning 404 to user: Instance 3251b41a-f111-4ff3-b549-d3d97fd3b0d2 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:30.171760 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0cb4d66-5394-4ec9-a49b-4b8469c0acab tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2" status: 404 len: 111 microversion: 2.1 time: 0.098390 Oct 28 09:59:30.171760 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1204/2370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:30 2022] GET /compute/v2.1/servers/3251b41a-f111-4ff3-b549-d3d97fd3b0d2 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:30.200118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:30.217563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-57c0e2bd-b98f-4257-85cc-4c6d117b169b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.701304 Oct 28 09:59:30.219291 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1167/2371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:29 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:30.307961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:30.308970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:30.340402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.346390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.349554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.355382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.355873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.356319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.458921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:30.460393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:30.476222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.476980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.477612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.479428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:30.489784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:30.490391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:30.899089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:30.908164 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-abb3dffb-d966-4cc8-98a4-5086218864b3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.604323 Oct 28 09:59:30.908955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1205/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:30 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:31.107270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:31.107902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:31.124599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.127262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.127996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:31.129053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.133872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.134340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:31.414328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:31.455516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:31.457032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:31.493814 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8c5dbef-5c9d-421e-a452-4cbeb9f17232 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.390991 Oct 28 09:59:31.494524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1206/2373] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:31 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:31.507392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:31.513399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:31.534957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.545254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.546154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:31.547725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:31.548436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:31.549237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.085988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:32.095172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6706ee2a-750e-42c9-9b63-9bc0a7b584ed tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.599337 Oct 28 09:59:32.095989 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1207/2374] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:31 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:32.113034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:32.113519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:32.117217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:32.130156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.131183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.133469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.138294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.139024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.140620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.144280 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39b62ae1-57da-4e0a-b842-766ab78bbf5e tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 1.704459 Oct 28 09:59:32.145124 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1168/2375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:30 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 1706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:32.265956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-173a2ff5-533f-4e1d-b3fc-37c840460358 req-9088d129-3a71-430c-be5b-3f148ee843cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17dc7353-723f-476f-bfe0-2ea04fdd34a9", "tag": "fb7b337f-fd39-4e13-878a-45eabf01dbc0"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:32.287276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-173a2ff5-533f-4e1d-b3fc-37c840460358 req-9088d129-3a71-430c-be5b-3f148ee843cb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.287792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-173a2ff5-533f-4e1d-b3fc-37c840460358 req-9088d129-3a71-430c-be5b-3f148ee843cb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.288240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-173a2ff5-533f-4e1d-b3fc-37c840460358 req-9088d129-3a71-430c-be5b-3f148ee843cb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.324458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-173a2ff5-533f-4e1d-b3fc-37c840460358 req-9088d129-3a71-430c-be5b-3f148ee843cb service nova] Creating event network-changed:fb7b337f-fd39-4e13-878a-45eabf01dbc0 for instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 on n-h1-zed-1 Oct 28 09:59:32.331727 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-173a2ff5-533f-4e1d-b3fc-37c840460358 req-9088d129-3a71-430c-be5b-3f148ee843cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069663 Oct 28 09:59:32.334827 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1169/2376] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:32.527849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:32.528557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:32.539343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:32.542405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.542911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.543406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.544481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:32.545114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:32.545687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:32.554117 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1b29dfb0-6f5f-4704-91a0-3ccb0d1be654 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.452786 Oct 28 09:59:32.554718 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1208/2377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:32 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:32.866681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:32.876831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:32.883645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:32.898154 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec87e181-fc38-47cc-a992-d902e5b68223 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.374784 Oct 28 09:59:32.906764 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1170/2378] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:32 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:33.122398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:33.122941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:33.134019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:33.139209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:33.139390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:33.141630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:33.142251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:33.145086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:33.174431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:33.175231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:33.193326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:33.197447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:33.200627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:33.203712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:33.205573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:33.206192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:33.718364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:33.731602 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83d57503-bc54-4444-95c4-49e266116701 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.614318 Oct 28 09:59:33.732214 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1209/2379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:33 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:33.737033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:33.737656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:33.758638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:33.759644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:33.760189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:33.760929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:33.761556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:33.762135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.123113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.142748 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e92ea0cc-194a-4446-b459-a63f10abfa9b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.408755 Oct 28 09:59:34.157547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1210/2380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:33 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:34.164338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1cd4c8e5-3b3f-4251-8b9d-d5d2ab620eb6 req-8d120d0b-764c-46dd-834e-47e10354a085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d5baa6d-2dce-4a40-8e01-11209f47b532", "tag": "6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:34.199188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1cd4c8e5-3b3f-4251-8b9d-d5d2ab620eb6 req-8d120d0b-764c-46dd-834e-47e10354a085 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.199770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1cd4c8e5-3b3f-4251-8b9d-d5d2ab620eb6 req-8d120d0b-764c-46dd-834e-47e10354a085 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.200230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1cd4c8e5-3b3f-4251-8b9d-d5d2ab620eb6 req-8d120d0b-764c-46dd-834e-47e10354a085 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.232114 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1cd4c8e5-3b3f-4251-8b9d-d5d2ab620eb6 req-8d120d0b-764c-46dd-834e-47e10354a085 service nova] Creating event network-changed:6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53 for instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 on n-h2-zed-1 Oct 28 09:59:34.240844 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1cd4c8e5-3b3f-4251-8b9d-d5d2ab620eb6 req-8d120d0b-764c-46dd-834e-47e10354a085 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081624 Oct 28 09:59:34.245882 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1211/2381] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:34.257877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:34.259522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:34.269320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.269894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.270355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.271093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.271934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.272551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.436031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.450202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.459610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.476953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0f9f006-7319-44f7-8bae-e29ebf093ab6 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.228113 Oct 28 09:59:34.481413 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1212/2382] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:34 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:34.491745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ddbf215c-27e2-484f-82fd-90db00ef3f24 req-d7ac8390-07cd-43e7-bbe2-7266fb1c54f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "504310c7-eadc-46ad-bbe8-83c30a6fd6ff", "tag": "28e3f7b2-4c64-47fc-8c95-8b7dfee356ed"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:34.527717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ddbf215c-27e2-484f-82fd-90db00ef3f24 req-d7ac8390-07cd-43e7-bbe2-7266fb1c54f8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.528471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ddbf215c-27e2-484f-82fd-90db00ef3f24 req-d7ac8390-07cd-43e7-bbe2-7266fb1c54f8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.529126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ddbf215c-27e2-484f-82fd-90db00ef3f24 req-d7ac8390-07cd-43e7-bbe2-7266fb1c54f8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.543607 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ddbf215c-27e2-484f-82fd-90db00ef3f24 req-d7ac8390-07cd-43e7-bbe2-7266fb1c54f8 service nova] Creating event network-changed:28e3f7b2-4c64-47fc-8c95-8b7dfee356ed for instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff on n-h2-zed-1 Oct 28 09:59:34.550541 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ddbf215c-27e2-484f-82fd-90db00ef3f24 req-d7ac8390-07cd-43e7-bbe2-7266fb1c54f8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066361 Oct 28 09:59:34.551129 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1213/2383] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:34.577234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:34.625112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5309ad40-16a5-4209-b71f-6c6e5def5576 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 1.456545 Oct 28 09:59:34.626739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1171/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:33 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:34.765123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:34.765715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:34.780210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.780727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.781259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.781997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:34.782513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:34.782886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:34.841524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:35.047095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:35.060564 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-948854d0-c4d0-49c8-8a78-fee200501d4a tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.305484 Oct 28 09:59:35.061778 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1214/2385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:34 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:35.170642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:35.171263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:35.188618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.189096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.189539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.190252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.190707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.191459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.508630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:35.509796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:35.524466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.525693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.527361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.529099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.530961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.531608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.619902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:35.628861 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a6ad9b7-96c3-4a07-8be4-cd0813a61080 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.462446 Oct 28 09:59:35.631381 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1172/2386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:35 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:35.663680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:35.667677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:35.674107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:35.682122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.682845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.683602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.685156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:35.685672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:35.685969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:35.686555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:35.688151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:35.703151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ac2f72a-e0a2-4619-acb3-3d94d2b07b98 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.198985 Oct 28 09:59:35.704108 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1215/2387] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:35 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:35.862024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:35.871033 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c1294a3-3c49-44f0-8e5c-d0776f197216 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.225090 Oct 28 09:59:35.873182 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1173/2388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:35 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:36.088703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:36.089738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:36.096205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=20 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:36.098517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.099356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.099927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.100804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.101481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.102140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.350799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:36.362519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1676100d-9fd6-40bd-ae2c-344624de44db tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.278095 Oct 28 09:59:36.374338 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1216/2389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:36 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:36.654725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:36.655456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:36.662629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.663124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.663567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.664271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.664732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.665220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.668101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:36.735001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:36.736365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:36.748174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.749052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.749637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.751108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.751700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.752291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.848307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:36.869444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:36.871481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:36.878843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f9b828c8-f0f7-436b-ba56-365922149448 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.147128 Oct 28 09:59:36.880186 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1217/2390] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:36 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:36.903873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:36.904766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:36.919418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.920269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.920872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.921776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:36.923135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:36.923759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:36.942971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:36.953270 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b9f7e202-d6f5-43f2-9d65-eec93d26a475 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.302453 Oct 28 09:59:36.968945 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1174/2391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:36 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:37.101385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:37.129201 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-213ab2f7-bd43-4dde-9572-5f5f5a06b2f0 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.227775 Oct 28 09:59:37.129201 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1218/2392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:36 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:37.150473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:37.152256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:37.167264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.168307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.169061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:37.170117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.171073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.171722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:37.204353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:37.221109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-913478623", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7035122b-a147-4d22-80a1-0879f4691bf4"}], "block_device_mapping_v2": [{"uuid": "ff866f38-8b03-433f-8c31-6bac9f55d597", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:37.384804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] validate_networks() for [('7035122b-a147-4d22-80a1-0879f4691bf4', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:59:37.448377 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbec43b5-5b62-4754-9a09-3bb178210f8d tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 204 len: 0 microversion: 2.1 time: 0.317063 Oct 28 09:59:37.456530 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1175/2393] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:37 2022] DELETE /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:37.459652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:37.464476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:37.483003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.483681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.484367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:37.485230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:37.485780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:37.486308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.127616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.135673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-263e58ab-55da-48d0-8bb8-e56a0d6ffc86 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.680294 Oct 28 09:59:38.136335 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1176/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:37 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:38.141514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.142203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.149743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.150515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.151140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.152418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.152980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.153596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.292863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:59:38.293451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:59:38.294648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:59:38.295275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:59:38.296503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:59:38.301502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.309761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.310034 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96499ee5-d2da-4d80-a4bc-7cb688d7ca8b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1667 microversion: 2.1 time: 0.172615 Oct 28 09:59:38.310493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.311133 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1177/2395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:38.311365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.312296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.313075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.313476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.315964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.316569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.321388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:38.323368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.324129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.324737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.325615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.326355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.326918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.335389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:38.342640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Getting quotas for user 52e08cff441e4fb0b01886d81a7b5ad6 and project a563769bd6e84594b3837db9d0fdafd4. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:38.413586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:59:38.415669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ff866f38-8b03-433f-8c31-6bac9f55d597',volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:59:38.422570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.433899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.435322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.443367 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-156758ab-4daa-4a4a-883f-5d072eee2286 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1531 microversion: 2.91 time: 0.130991 Oct 28 09:59:38.445363 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1178/2396] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1531 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:38.451260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.452100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.458848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.459574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.460801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.462340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.462990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.463611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.590498 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bcba0df8-4a26-4784-9f44-845ea2935f0a tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.374306 Oct 28 09:59:38.598569 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1219/2397] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 09:59:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1383 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 09:59:38.604175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.605036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.613213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.613773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.614227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.614959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.615426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.615857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.670731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.680084 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d73986a7-b667-4da8-b647-852af5ec585f tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.232164 Oct 28 09:59:38.680732 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1179/2398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:38.685618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.686343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.692418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.693162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.693698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.694486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.695051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.695694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.778251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lazy-loading 'services' on Instance uuid 44005b9d-3f5a-4aab-919d-3c9072329bd6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:38.797478 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b85b55ed-2910-445f-9f47-12ccac5a11c4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1930 microversion: 2.91 time: 0.115246 Oct 28 09:59:38.812491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1180/2399] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1930 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:38.812491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f98f7d7-f565-4180-bf60-b908da0bed3f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:38.812491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f98f7d7-f565-4180-bf60-b908da0bed3f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.857831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f98f7d7-f565-4180-bf60-b908da0bed3f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.859165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.865484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f98f7d7-f565-4180-bf60-b908da0bed3f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.868747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f98f7d7-f565-4180-bf60-b908da0bed3f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:38.870419 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca8b8821-003b-4d8f-90ac-a619a6ac7ebe tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.270492 Oct 28 09:59:38.870855 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f98f7d7-f565-4180-bf60-b908da0bed3f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1103 microversion: 2.25 time: 0.070804 Oct 28 09:59:38.871971 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1181/2400] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1103 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:38.873572 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1220/2401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:38 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:38.878197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:38.878967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:38.886549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.887310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.887936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.888836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:38.889317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:38.889747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:38.928296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lazy-loading 'flavor' on Instance uuid 44005b9d-3f5a-4aab-919d-3c9072329bd6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:39.159812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:39.160687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:39.172926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.173923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.174529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.177336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.178207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.179976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.277376 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d771a66-5a44-4f9e-a00b-9dd6c15388aa tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action" status: 202 len: 0 microversion: 2.91 time: 0.403900 Oct 28 09:59:39.281154 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1182/2402] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:59:38 2022] POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:39.293095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:39.293814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:39.309832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.310768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.311025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.311863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.313511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.313938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.476152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:39.485314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:39.490311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:39.504115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6948a45e-6f20-42e2-a479-3851b1aafe6a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.215290 Oct 28 09:59:39.504705 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1183/2403] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:39 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:39.522372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:39.523295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:39.529773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.530271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.530718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.531433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.531893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.532323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.595684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:39.610790 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d9df8a7-e670-4de7-874a-f668995510c0 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.454719 Oct 28 09:59:39.612174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1221/2404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:39 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:39.708773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:39.716396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:39.727195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.727722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.731968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.732937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.734603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.735225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.754667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:39.763500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3fd1c749-975a-4335-b072-92846f716867 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1667 microversion: 2.1 time: 0.257705 Oct 28 09:59:39.768169 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1184/2405] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:39 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1667 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:39.893539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:39.894744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:39.905161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.907883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.908383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:39.910393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:39.910873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:39.912610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.056455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.064521 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08f530d9-8e17-4fb1-b5b1-1a0b927ac892 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.360319 Oct 28 09:59:40.065196 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1222/2406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:39 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:40.069720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:40.070492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:40.076677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.077268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.077704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.078402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.078851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.079272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.127595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.135467 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-37bf380f-a7c9-4390-8ce8-e6ccbbebc625 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.246092 Oct 28 09:59:40.136034 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1185/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:39 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:40.144154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.152467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.154192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.155454 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-68f436fa-d6d0-4f5d-aabe-6a06dea2bd12 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1232 microversion: 2.25 time: 0.089387 Oct 28 09:59:40.156108 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1223/2408] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:40 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1232 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:40.532522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:40.533387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:40.540334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.540867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.541329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.541854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-59c1c5d1-1164-4e15-8ed2-a75f12c26dc1 req-9bdc0020-b737-4e51-b0a2-8572cb9fd877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17dc7353-723f-476f-bfe0-2ea04fdd34a9", "name": "network-vif-plugged", "status": "completed", "tag": "fb7b337f-fd39-4e13-878a-45eabf01dbc0"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:40.542030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.542482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.542903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.566920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-59c1c5d1-1164-4e15-8ed2-a75f12c26dc1 req-9bdc0020-b737-4e51-b0a2-8572cb9fd877 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.567970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-59c1c5d1-1164-4e15-8ed2-a75f12c26dc1 req-9bdc0020-b737-4e51-b0a2-8572cb9fd877 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.568556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-59c1c5d1-1164-4e15-8ed2-a75f12c26dc1 req-9bdc0020-b737-4e51-b0a2-8572cb9fd877 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.599827 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-59c1c5d1-1164-4e15-8ed2-a75f12c26dc1 req-9bdc0020-b737-4e51-b0a2-8572cb9fd877 service nova] Creating event network-vif-plugged:fb7b337f-fd39-4e13-878a-45eabf01dbc0 for instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 on n-h1-zed-1 Oct 28 09:59:40.629376 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-59c1c5d1-1164-4e15-8ed2-a75f12c26dc1 req-9bdc0020-b737-4e51-b0a2-8572cb9fd877 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088480 Oct 28 09:59:40.630046 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1224/2409] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:40.640235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:40.643837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:40.657194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.658971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.659761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.660213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.661962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.662056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.662476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.667692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.670411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:40.688573 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ecd5ed85-ca78-474b-9190-e4f4b676e04d tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.160060 Oct 28 09:59:40.689203 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1186/2410] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:40 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:40.790617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:40.792126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:40.799241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:40.802315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.804416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.806464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:40.807437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:40.808094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:40.808743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.070245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:41.072572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:41.084699 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c34f66e-1867-4fbc-b3bd-581c9eb3c997 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1667 microversion: 2.1 time: 0.301697 Oct 28 09:59:41.085273 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1187/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:40 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1667 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:41.110382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:41.111129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:41.127838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.128357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.128969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.129735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.132397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.132958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.378777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:41.391545 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a6bdc40f-dc4b-436a-8d12-fbd54a7c9f87 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.285248 Oct 28 09:59:41.392165 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1188/2412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:41 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:41.397095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:41.397477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:41.404093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.404587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.406236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.410820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.411072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.411754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.707161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:41.714273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:41.722726 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-076cf697-57f7-4b4a-a216-cc81342864b6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 1.091376 Oct 28 09:59:41.724753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1225/2413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:40 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:41.728664 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f1cd4ec-49cd-4483-8a2c-28b838d09409 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1313 microversion: 2.1 time: 0.331645 Oct 28 09:59:41.731584 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1189/2414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:41 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:41.746289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:41.746579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:41.747381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:41.748159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:41.760842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:41.764314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.766949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.767879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.768851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.771567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.772175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.773440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.773942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.774444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.777725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:41.778237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:41.778692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:41.933689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:41.948141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:41.951020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:41.966840 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b9b9e217-e1b6-42f2-adde-c7062c5e7062 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.232082 Oct 28 09:59:41.969048 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1190/2415] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:41 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:42.113185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:42.113820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:42.127121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:42.127630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:42.128079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:42.128936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:42.135850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:42.136323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:42.258149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:42.266855 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b74decb-75ed-4fd7-ba29-e38a25c51e05 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1599 microversion: 2.1 time: 0.158295 Oct 28 09:59:42.269935 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1191/2416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:42 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1599 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:42.417076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:42.417715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:42.434904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:42.435402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:42.435843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:42.436565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:42.437069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:42.437499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:42.557358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:42.570282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:42.574915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:42.576822 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f01860dd-cfde-4a9b-8a85-fe8a2566d828 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1292 microversion: 2.25 time: 0.850240 Oct 28 09:59:42.579013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1226/2417] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:41 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1292 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:42.771996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:42.772633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:42.784795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:42.785322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:42.791619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:42.792453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:42.792965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:42.793413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.178686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:43.197492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:43.201719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a44ae43a-b8e6-489a-a4a5-40f0515ac6ec tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.782080 Oct 28 09:59:43.212553 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-242eeb85-a686-429f-8a31-a9f157eb7e23 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.443058 Oct 28 09:59:43.224929 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1227/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:42 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:43.225360 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1192/2419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:42 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:43.229574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:43.230502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-34b9620e-fa7c-4426-a324-09cc6533abcd req-f1563d41-0ad3-43f5-bbd5-87784967bf18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5baa6d-2dce-4a40-8e01-11209f47b532", "name": "network-vif-plugged", "status": "completed", "tag": "6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:43.230620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:43.241448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.241951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.245646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.246490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.252389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34b9620e-fa7c-4426-a324-09cc6533abcd req-f1563d41-0ad3-43f5-bbd5-87784967bf18 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.252890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34b9620e-fa7c-4426-a324-09cc6533abcd req-f1563d41-0ad3-43f5-bbd5-87784967bf18 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.253349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34b9620e-fa7c-4426-a324-09cc6533abcd req-f1563d41-0ad3-43f5-bbd5-87784967bf18 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.262095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.264393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.284737 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-34b9620e-fa7c-4426-a324-09cc6533abcd req-f1563d41-0ad3-43f5-bbd5-87784967bf18 service nova] Creating event network-vif-plugged:6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53 for instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 on n-h2-zed-1 Oct 28 09:59:43.311300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-34b9620e-fa7c-4426-a324-09cc6533abcd req-f1563d41-0ad3-43f5-bbd5-87784967bf18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090635 Oct 28 09:59:43.318435 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1193/2420] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:43.350191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:43.353463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:43.373996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.375846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.376612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.379693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.380668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.381296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.549167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:43.562079 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddd81108-bd44-439e-8d38-81fcbb35a384 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1463 microversion: 2.1 time: 0.346754 Oct 28 09:59:43.563015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1228/2421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:43 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1463 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:43.575784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-39003ddd-fbbd-4af2-a75f-f65f8c1578d3 req-6bb79857-3e50-4e21-bd4f-29e533c2b207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73f7b43e-9af7-48b0-b0fc-ad060328abbf", "name": "network-vif-deleted", "tag": "5a5bee98-bf90-4c92-b3a5-a7436e5ffedb"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:43.623068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-39003ddd-fbbd-4af2-a75f-f65f8c1578d3 req-6bb79857-3e50-4e21-bd4f-29e533c2b207 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.623575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-39003ddd-fbbd-4af2-a75f-f65f8c1578d3 req-6bb79857-3e50-4e21-bd4f-29e533c2b207 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.624018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-39003ddd-fbbd-4af2-a75f-f65f8c1578d3 req-6bb79857-3e50-4e21-bd4f-29e533c2b207 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.676424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:43.682533 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-39003ddd-fbbd-4af2-a75f-f65f8c1578d3 req-6bb79857-3e50-4e21-bd4f-29e533c2b207 service nova] Creating event network-vif-deleted:5a5bee98-bf90-4c92-b3a5-a7436e5ffedb for instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf on n-h2-zed-1 Oct 28 09:59:43.690715 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-39003ddd-fbbd-4af2-a75f-f65f8c1578d3 req-6bb79857-3e50-4e21-bd4f-29e533c2b207 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124871 Oct 28 09:59:43.691774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:43.699412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1229/2422] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:43.700082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:43.710757 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-abb38792-feae-4274-bc7a-c581dcd26eeb tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.390541 Oct 28 09:59:43.714403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:43.714785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:43.728931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1194/2423] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:43 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:43.729717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.729717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.729717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.743650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.743650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.743650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.799241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.800030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.800487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.800988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lazy-loading 'fault' on Instance uuid 73f7b43e-9af7-48b0-b0fc-ad060328abbf {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:43.875326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:43.884442 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00b248ca-a889-466c-8887-1376427244ca tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1323 microversion: 2.1 time: 0.183246 Oct 28 09:59:43.885084 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1230/2424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:43 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1323 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:43.920532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:43.924130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:43.940091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.942092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.942872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:43.957451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:43.958128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:43.959500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.134595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Calling method '.version_select at 0x7fca3272c310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.161476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.161967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.162409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.191414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:44.203910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:44.210417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:44.211247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.212702 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b776afe-c45a-4517-a2a5-bf2e51494609 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1292 microversion: 2.25 time: 0.306206 Oct 28 09:59:44.217387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.217940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.222912 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1231/2425] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:43 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1292 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:44.228706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.229388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:44.242726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.244258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.244258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.244548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.245051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.245447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.263282 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f3cbba99-4858-4236-8acf-337d63747d06 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/e901479a6ca34dd1bcecfe2211ea82f9?start=2022-10-27T09%3A59%3A43.582745&end=2022-10-29T09%3A59%3A43.582745" status: 200 len: 650 microversion: 2.1 time: 0.544145 Oct 28 09:59:44.264108 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1195/2426] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Oct 28 09:59:43 2022] GET /compute/v2.1/os-simple-tenant-usage/e901479a6ca34dd1bcecfe2211ea82f9?start=2022-10-27T09%3A59%3A43.582745&end=2022-10-29T09%3A59%3A43.582745 => generated 650 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:44.270316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.270932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:44.283014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.283612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.284573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.285388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.288179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.290845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.539133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:44.555244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1edebc2d-a33c-4b75-91f9-523871e1ad9d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1316 microversion: 2.1 time: 0.329560 Oct 28 09:59:44.556671 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1232/2427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:44 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1316 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:44.561913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '.version_select at 0x7fca3329e700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.578139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.578840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.579437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.629463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.629957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.630579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.668896 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9f49bcc0-e8e6-487e-aa7c-e5585858ec5c tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/e901479a6ca34dd1bcecfe2211ea82f9?start=2022-10-27T09%3A59%3A43.582745&end=2022-10-29T09%3A59%3A43.582745" status: 200 len: 650 microversion: 2.1 time: 0.110523 Oct 28 09:59:44.669894 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1233/2428] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Oct 28 09:59:44 2022] GET /compute/v2.1/os-simple-tenant-usage/e901479a6ca34dd1bcecfe2211ea82f9?start=2022-10-27T09%3A59%3A43.582745&end=2022-10-29T09%3A59%3A43.582745 => generated 650 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:44.676009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7d0fd0e4-d4aa-4f3c-a891-eee7c2ccfe0e req-71870bfc-c35f-4a38-8c5e-f2048df00400 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab", "tag": "fa96b0ac-478a-4896-b414-e05f78c6fcea"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:44.689829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7d0fd0e4-d4aa-4f3c-a891-eee7c2ccfe0e req-71870bfc-c35f-4a38-8c5e-f2048df00400 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.690727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7d0fd0e4-d4aa-4f3c-a891-eee7c2ccfe0e req-71870bfc-c35f-4a38-8c5e-f2048df00400 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.691308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7d0fd0e4-d4aa-4f3c-a891-eee7c2ccfe0e req-71870bfc-c35f-4a38-8c5e-f2048df00400 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.710697 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7d0fd0e4-d4aa-4f3c-a891-eee7c2ccfe0e req-71870bfc-c35f-4a38-8c5e-f2048df00400 service nova] Creating event network-changed:fa96b0ac-478a-4896-b414-e05f78c6fcea for instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab on n-h1-zed-1 Oct 28 09:59:44.717690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7d0fd0e4-d4aa-4f3c-a891-eee7c2ccfe0e req-71870bfc-c35f-4a38-8c5e-f2048df00400 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046006 Oct 28 09:59:44.718775 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1234/2429] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:44.728722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Calling method '.version_select at 0x7fca3323c0d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.749083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.761840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.762302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.781431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.782271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.782941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.870221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:44.888061 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45c59146-780e-4860-bad1-8155cbde1332 tempest-TenantUsagesTestJSON-131300451 tempest-TenantUsagesTestJSON-131300451-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T09%3A59%3A43.582745&end=2022-10-29T09%3A59%3A43.582745&detailed=1" status: 200 len: 24262 microversion: 2.1 time: 0.167542 Oct 28 09:59:44.888835 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1235/2430] 10.222.0.16 () {58 vars in 1335 bytes} [Fri Oct 28 09:59:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T09%3A59%3A43.582745&end=2022-10-29T09%3A59%3A43.582745&detailed=1 => generated 24262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:59:44.906250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.906250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:44.906250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.906250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.906553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.906553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.906553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.906553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.926245 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-972375df-218e-488b-bf76-c773dc145fa6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.660891 Oct 28 09:59:44.927152 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1196/2431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:44 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:44.932747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:44.933394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:44.941535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.942218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.942670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:44.943392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:44.943851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:44.944357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.053310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.060402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.061215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.061864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lazy-loading 'fault' on Instance uuid 73f7b43e-9af7-48b0-b0fc-ad060328abbf {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:45.075146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.088139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.089689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.097526 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-559f19eb-9fbe-4a01-84ef-3dd041f0ead8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.207452 Oct 28 09:59:45.108749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1236/2432] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:44 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:45.122013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.123341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:45.131206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.131884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.132253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.133011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.134206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.135758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.138771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.147080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fab38458-325e-408a-88db-39d0b7b7b329 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 200 len: 1323 microversion: 2.1 time: 0.218780 Oct 28 09:59:45.147675 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1197/2433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:44 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:45.168452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:45.235766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:45.257917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.259252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:45.288133 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72b1009a-2f88-4cf5-a477-db7368ada4f1 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "DELETE /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 204 len: 0 microversion: 2.1 time: 0.173721 Oct 28 09:59:45.288653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.289134 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1237/2434] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:45 2022] DELETE /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:45.290547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.292071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.293257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.296981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.298200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.299313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.300015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:45.310744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.311315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.311765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.316087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.316862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.317554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.608952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.618901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-731a3528-7da9-424e-9eb8-5b7749e7620f tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1469 microversion: 2.1 time: 0.324260 Oct 28 09:59:45.630741 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1238/2435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1469 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:45.636938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-bb9fd5f3-d36f-4110-9d26-36e6ff71262b req-bd961807-5868-4c38-a4f4-493b16be2e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504310c7-eadc-46ad-bbe8-83c30a6fd6ff", "name": "network-vif-plugged", "status": "completed", "tag": "28e3f7b2-4c64-47fc-8c95-8b7dfee356ed"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:45.646724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bb9fd5f3-d36f-4110-9d26-36e6ff71262b req-bd961807-5868-4c38-a4f4-493b16be2e3f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.647534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bb9fd5f3-d36f-4110-9d26-36e6ff71262b req-bd961807-5868-4c38-a4f4-493b16be2e3f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.648225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bb9fd5f3-d36f-4110-9d26-36e6ff71262b req-bd961807-5868-4c38-a4f4-493b16be2e3f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.663584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-bb9fd5f3-d36f-4110-9d26-36e6ff71262b req-bd961807-5868-4c38-a4f4-493b16be2e3f service nova] Creating event network-vif-plugged:28e3f7b2-4c64-47fc-8c95-8b7dfee356ed for instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff on n-h2-zed-1 Oct 28 09:59:45.671467 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-bb9fd5f3-d36f-4110-9d26-36e6ff71262b req-bd961807-5868-4c38-a4f4-493b16be2e3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039191 Oct 28 09:59:45.672683 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1239/2436] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:45.678775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.681269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:45.695460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.696628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.696628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.697677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.698248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.698777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.705986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.715516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.716987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.718122 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-88bef812-68b1-4eae-b462-35bbf81984bf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1292 microversion: 2.25 time: 0.467338 Oct 28 09:59:45.718683 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1198/2437] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1292 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:45.945141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:45.955516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:45.956237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:45.962843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a146f963-4e67-4ace-8e84-b94832181139 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1465 microversion: 2.1 time: 0.282388 Oct 28 09:59:45.963810 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1240/2438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1465 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:45.967507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.968355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.969904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.970896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:45.973331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:45.973825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:45.994961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-512642123", "metadata": {"image_type": "test"}}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:45.998914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:46.014628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.018982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.020306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.021698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.023649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.026247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.078099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Getting quotas for project fd976570de164b69b58bfae7d4379e26. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:46.084643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Getting quotas for user 4ec2ec5910404cc9aa621b4998b067bd and project fd976570de164b69b58bfae7d4379e26. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:46.345052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8aafcea9-f647-4a86-b893-fc29ec08af56 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "POST /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532/action" status: 202 len: 0 microversion: 2.1 time: 0.357579 Oct 28 09:59:46.346069 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1241/2439] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 09:59:45 2022] POST /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 28 09:59:46.358296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.359056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:46.366910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.367501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.368496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.369241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.369763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.370197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.465621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:46.477342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:46.479028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:46.486770 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6a8cdd5b-abe4-4bcd-9b04-e8d5ec672e49 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.133122 Oct 28 09:59:46.487937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1242/2440] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:46.494544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.495576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: 73f7b43e-9af7-48b0-b0fc-ad060328abbf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:46.503492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.503988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.504574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.505345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.505809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.506348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.528571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] HTTP exception thrown: Instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf could not be found. Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Request method failure captured: Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf HTTP/1.1 Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZPJ8vDPZw5XVZPJtVAuZZLfb9Q86IXLXWoGqtkQWWVGc5rShTo7XxmHRNSr5tJgYcCZcZJQHftvUZNtOrkAjcqb1VsVXxw6JzVrtmwOFLkf0sz3oUzfSlkF1yca5vMUmBxbOW6eTEc8Ghr4626WK3f68oppqOfpJ1QvuIRIleepPM Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:46.530561 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38bd1e9a411e49c0b6c13914f4b53caf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38bd1e9a411e49c0b6c13914f4b53caf"}]}] Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: d76e0eb51a9b418bb28e81b5ac1520f9 Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf could not be found. Oct 28 09:59:46.531651 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '73f7b43e-9af7-48b0-b0fc-ad060328abbf'} Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf could not be found. Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:46.532257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf could not be found. Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf could not be found. Oct 28 09:59:46.533865 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:46.534733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Returning 404 to user: Instance 73f7b43e-9af7-48b0-b0fc-ad060328abbf could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:46.534733 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-42852273-353d-4c56-8eb5-ad34be576d55 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf" status: 404 len: 111 microversion: 2.1 time: 0.043113 Oct 28 09:59:46.534733 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1243/2441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/servers/73f7b43e-9af7-48b0-b0fc-ad060328abbf => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:46.541217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.541857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:46.550203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.551030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.551480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.552261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.553418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.553872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.597388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d0b4af3c-25ca-4908-a923-d9f08e55b756 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/ips" status: 200 len: 152 microversion: 2.20 time: 0.063238 Oct 28 09:59:46.598284 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1244/2442] 10.222.0.16 () {60 vars in 1289 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/ips => generated 152 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 09:59:46.602956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-576a7a40-8dcb-408b-880f-74ccd28be76d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3ba238b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.608327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:46.619898 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1397dc2d-afb3-410c-a5ed-e8843f6fda95 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1317 microversion: 2.1 time: 0.668734 Oct 28 09:59:46.640106 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1199/2443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:45 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1317 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:46.644856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c41bcc14-89ca-4e7a-84fa-a2949eec19c2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '.version_select at 0x7fca3276f430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.677665 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c41bcc14-89ca-4e7a-84fa-a2949eec19c2 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-409309044" status: 202 len: 0 microversion: 2.1 time: 0.038970 Oct 28 09:59:46.682333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1200/2444] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 09:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-409309044 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 09:59:46.682524 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-576a7a40-8dcb-408b-880f-74ccd28be76d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.081774 Oct 28 09:59:46.685590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.686346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:46.695638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.696456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.697130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.698034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.698581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.699058 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1245/2445] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:46.700551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.748493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:46.749136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:46.765441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.766114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.766570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:46.767301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:46.771374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:46.771828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:47.198599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.206854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-37f6bcf3-4f25-4e9e-afff-f15815503273 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1469 microversion: 2.1 time: 0.526477 Oct 28 09:59:47.207444 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1201/2446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1469 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:47.221225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.229939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.240095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.243807 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c228802-a236-4bcc-8185-c40e39f0c40c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1292 microversion: 2.25 time: 0.496044 Oct 28 09:59:47.247356 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1246/2447] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:46 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1292 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:47.517148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:47.518007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:47.527407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:47.529513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:47.530159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:47.531851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:47.535051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:47.536370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:47.647757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:47.648771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:47.664568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:47.665945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:47.668551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:47.669697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:47.670648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:47.671391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:47.842109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.855035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.858613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:47.880209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0bb4580c-2524-41ab-9052-a9874121c0fe tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.367916 Oct 28 09:59:47.881764 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1202/2448] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:47 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:47.897873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93a74aaf-688d-4fa5-be65-da65e4a45bc3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3272c430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:47.975357 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93a74aaf-688d-4fa5-be65-da65e4a45bc3 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.090275 Oct 28 09:59:47.976442 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1203/2449] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:47 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:48.224768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:48.238363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:48.242795 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-94e1e3d4-b70b-4458-bb43-5d29250c506f tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1508 microversion: 2.1 time: 0.597676 Oct 28 09:59:48.242795 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1247/2450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:47 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1508 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:48.257110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:48.281250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:48.282189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:48.295216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:48.295723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:48.296165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:48.296887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:48.297369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:48.297802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:48.300169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:48.300668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:48.302944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:48.303686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:48.306456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:48.309477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:48.355967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:48.464660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:48.474864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dba32a05-86f8-49d2-b8e1-b9977803b463 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1427 microversion: 2.1 time: 0.246941 Oct 28 09:59:48.489103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1204/2451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:48 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1427 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:48.848824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-79ca7901-bc31-47e4-bdb0-391703432adb req-ab8e1e3d-4412-43dd-9b64-766e6f48b511 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17dc7353-723f-476f-bfe0-2ea04fdd34a9", "name": "network-vif-deleted", "tag": "fb7b337f-fd39-4e13-878a-45eabf01dbc0"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:48.870768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:48.877228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79ca7901-bc31-47e4-bdb0-391703432adb req-ab8e1e3d-4412-43dd-9b64-766e6f48b511 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:48.879298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79ca7901-bc31-47e4-bdb0-391703432adb req-ab8e1e3d-4412-43dd-9b64-766e6f48b511 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:48.879877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79ca7901-bc31-47e4-bdb0-391703432adb req-ab8e1e3d-4412-43dd-9b64-766e6f48b511 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:48.895894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-79ca7901-bc31-47e4-bdb0-391703432adb req-ab8e1e3d-4412-43dd-9b64-766e6f48b511 service nova] Creating event network-vif-deleted:fb7b337f-fd39-4e13-878a-45eabf01dbc0 for instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 on n-h1-zed-1 Oct 28 09:59:48.903032 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-79ca7901-bc31-47e4-bdb0-391703432adb req-ab8e1e3d-4412-43dd-9b64-766e6f48b511 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058712 Oct 28 09:59:48.903823 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1205/2452] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:48.922054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:48.923412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:48.934630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:48.935724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:48.936532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:48.937640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:48.938335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:48.939537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:48.978023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:48.990422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:48.991845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:49.002398 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ab0ef973-a1ca-466a-877f-0b46d2eb4664 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1292 microversion: 2.25 time: 0.727743 Oct 28 09:59:49.002999 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1248/2453] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:48 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1292 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:49.008295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d0879eb-ee74-4ced-b310-bff9c5f22c6d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3ba23700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:49.041309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:49.063827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:49.065556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:49.075630 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d0879eb-ee74-4ced-b310-bff9c5f22c6d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.070760 Oct 28 09:59:49.085337 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1249/2454] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:49 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:49.091851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-207ec9f0-a21a-4694-960c-836d6d825685 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.174540 Oct 28 09:59:49.105310 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1206/2455] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:48 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:49.111401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:49.112282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:49.124500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.125224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.126403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.127762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.128502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.129367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.164196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:49.340489 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5bb27994-363b-4bcd-8610-e2ac8549e07c tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 204 len: 0 microversion: 2.1 time: 0.232748 Oct 28 09:59:49.343629 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1250/2456] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:49 2022] DELETE /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:49.351904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:49.352897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:49.363114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.363608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.364046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.368315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.368807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.372357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.503188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:49.504184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:49.514846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.516506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.519109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.520011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.520664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.522402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.616421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.616936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.617395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.621379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lazy-loading 'fault' on Instance uuid 17dc7353-723f-476f-bfe0-2ea04fdd34a9 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:49.635228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:49.643993 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b2c34f4-1d2e-4a89-9768-e6e350d1a3c0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1485 microversion: 2.1 time: 0.296004 Oct 28 09:59:49.658272 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1207/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:49 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1485 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:49.714692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:49.730671 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4429363-d51d-416f-b431-d5b9603b993b tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1303 microversion: 2.1 time: 0.232480 Oct 28 09:59:49.731754 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1251/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:49 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1303 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:49.888383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:49.889505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:49.901235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.901910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.902508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.903362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:49.903966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:49.904542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:49.957646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:49.967894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lazy-loading 'flavor' on Instance uuid f7831b2e-dc40-4e1b-981b-94cb7d1736f0 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:50.028427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:50.030090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:50.043225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.044005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.045500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.048245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.051585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.053416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.309420 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c8327781-84c7-45c2-8c7b-58cfe180a59b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/action" status: 202 len: 0 microversion: 2.20 time: 0.425225 Oct 28 09:59:50.313961 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1208/2459] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 09:59:49 2022] POST /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/action => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:50.320798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84acc39d-cef5-44ad-ac1b-ef13833f3183 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3296c940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:50.400844 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84acc39d-cef5-44ad-ac1b-ef13833f3183 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.085120 Oct 28 09:59:50.401445 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1209/2460] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:50 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:50.408031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:50.409404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:50.421762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.422547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.423994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.425034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.426275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.426706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.508954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.517752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.519449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.525535 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1f390280-2636-458e-83d5-dd6e85c76eaf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.122857 Oct 28 09:59:50.526842 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1210/2461] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:50 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:50.531976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:50.532739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:50.540328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.541153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.541821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.543135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.544219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.545085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.697248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.708493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.712598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.713927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.715527 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ff01a23-0d5e-42b1-aa62-d3ab5bdf68ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1280 microversion: 2.25 time: 0.691741 Oct 28 09:59:50.724766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.726162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.728042 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d37d3d9-ce03-49a5-990d-6889401b1ee5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.199298 Oct 28 09:59:50.728896 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1211/2462] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:50 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:50.735600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:50.736482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:50.737969 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1252/2463] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:50 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1280 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:50.743742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.749329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.750596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.751722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.753018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.753639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.756350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:50.757401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:50.764114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.765351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.765992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.766893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.767541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.768634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.811258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:50.811769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:50.812200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:50.812813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lazy-loading 'fault' on Instance uuid 17dc7353-723f-476f-bfe0-2ea04fdd34a9 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:50.904423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.904884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e0bbdc67f9440b1bcf92e62720385cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901479a6ca34dd1bcecfe2211ea82f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:50.912640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:50.915848 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8d3f5e08-ad55-4491-8871-5d91d05f4f89 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 200 len: 1303 microversion: 2.1 time: 0.163590 Oct 28 09:59:50.916235 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ba9a2f5-2f56-44a7-a21c-bcda6c1f4aa7 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1485 microversion: 2.1 time: 0.185681 Oct 28 09:59:50.916944 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1253/2464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:50 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 1303 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:50.917101 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1212/2465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:50 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1485 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:51.064634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "1dc92488-3cdc-4f58-9691-57485c022794"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:51.067506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:51.074291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.074800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.075244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.076165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.076614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.077094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.159052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] HTTP exception thrown: Volume b2b80e57-6109-4885-b703-7a97949a71ce could not be found. Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Request method failure captured: Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff/os-volume_attachments/b2b80e57-6109-4885-b703-7a97949a71ce HTTP/1.1 Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 74 Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6djnYcFz2LrQd8D_EwAcRbhxyOq0_XRBbCzLDiyizgkJCdT0-ZOukMVtNpP0yXzkwYTpklUHhZ5tCD3ZxUgMOFaPwR6kPUVM57BSGfPwjiZKJABSQHMzBHOs-ERtf9Y7_uuQW-vzpR25DRfOu4kmihe7FIHMuID1kpevD5hOy1Jl-M Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 4847dbc2755946869b6206a5c04666a9 Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesAdminNegativeTest-1040737502 Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 09:59:51.161794 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4847dbc2755946869b6206a5c04666a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/4847dbc2755946869b6206a5c04666a9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_4847dbc2755946869b6206a5c04666a9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/4847dbc2755946869b6206a5c04666a9"}]}] Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesAdminNegativeTest-1040737502 Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 4847dbc2755946869b6206a5c04666a9 Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1040737502 Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesAdminNegativeTest-1040737502-project-admin Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b6de9b26fccd4f22b745eba7f04dd157 Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesAdminNegativeTest-1040737502-project-admin Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: {"volumeAttachment": {"volumeId": "1dc92488-3cdc-4f58-9691-57485c022794"}} Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:59:51.163054 n-d-zed-1 devstack@n-api.service[128748]: exception: Volume b2b80e57-6109-4885-b703-7a97949a71ce could not be found. Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '504310c7-eadc-46ad-bbe8-83c30a6fd6ff', 'id': 'b2b80e57-6109-4885-b703-7a97949a71ce', 'body': {'volumeAttachment': {'volumeId': '1dc92488-3cdc-4f58-9691-57485c022794'}}} Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:51.163778 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b2b80e57-6109-4885-b703-7a97949a71ce could not be found. (HTTP 404) (Request-ID: req-405b6390-2e09-49f5-8c59-e5599f62190e) Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 09:59:51.164648 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b2b80e57-6109-4885-b703-7a97949a71ce could not be found. Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:51.165725 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b2b80e57-6109-4885-b703-7a97949a71ce could not be found. Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b2b80e57-6109-4885-b703-7a97949a71ce could not be found. Oct 28 09:59:51.166650 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:51.167626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] Returning 404 to user: Volume b2b80e57-6109-4885-b703-7a97949a71ce could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:51.167626 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87214736-33a1-421b-bdfa-42a8035316a4 tempest-VolumesAdminNegativeTest-1040737502 tempest-VolumesAdminNegativeTest-1040737502-project-admin] 10.222.0.16 "PUT /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff/os-volume_attachments/b2b80e57-6109-4885-b703-7a97949a71ce" status: 404 len: 109 microversion: 2.1 time: 0.107097 Oct 28 09:59:51.167626 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1213/2466] 10.222.0.16 () {60 vars in 1433 bytes} [Fri Oct 28 09:59:51 2022] PUT /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff/os-volume_attachments/b2b80e57-6109-4885-b703-7a97949a71ce => generated 109 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:51.419070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-164d7542-713c-43b3-8ff8-2343dc9d7347 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b9ffca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:51.472638 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-164d7542-713c-43b3-8ff8-2343dc9d7347 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.059381 Oct 28 09:59:51.473587 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1254/2467] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:51 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:51.556737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:51.557402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:51.569483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.569987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.570432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.571230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.571693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.572131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.690983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:51.702510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:51.707822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:51.719346 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2bfcdfec-8adc-4f40-929f-977a8fc0b24b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.168057 Oct 28 09:59:51.725402 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1214/2468] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:51 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:51.746738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a45e5b24-86d5-46b8-9a7c-572856c22a1d req-96ca6007-6d64-41c1-a96e-95c761013d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5cc4e4d-4dff-444f-ac54-f4821dccae07", "name": "network-vif-deleted", "tag": "aaabdd70-5e8c-41df-8b5d-9902110dc424"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:51.755323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:51.756287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:51.780391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a45e5b24-86d5-46b8-9a7c-572856c22a1d req-96ca6007-6d64-41c1-a96e-95c761013d9b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.781270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.785932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.787589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.789829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a45e5b24-86d5-46b8-9a7c-572856c22a1d req-96ca6007-6d64-41c1-a96e-95c761013d9b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.791274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.793018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.793582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a45e5b24-86d5-46b8-9a7c-572856c22a1d req-96ca6007-6d64-41c1-a96e-95c761013d9b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.794710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.826952 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a45e5b24-86d5-46b8-9a7c-572856c22a1d req-96ca6007-6d64-41c1-a96e-95c761013d9b service nova] Creating event network-vif-deleted:aaabdd70-5e8c-41df-8b5d-9902110dc424 for instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 on n-h2-zed-1 Oct 28 09:59:51.864828 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a45e5b24-86d5-46b8-9a7c-572856c22a1d req-96ca6007-6d64-41c1-a96e-95c761013d9b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126410 Oct 28 09:59:51.869015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1255/2469] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:51.901972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:51.902707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:51.931747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.937713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.938194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:51.938964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:51.944165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:51.945809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.105159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.119595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.121197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.122422 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-00e9dc5d-0d09-41ff-ad3d-a7c5337fc4d6 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1280 microversion: 2.25 time: 0.380694 Oct 28 09:59:52.130793 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1215/2470] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:51 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1280 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:52.146236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5131f1d8-7edd-42d0-995c-52aaf8a26358 req-b8dd562e-7ab5-4936-97c0-904202171669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5baa6d-2dce-4a40-8e01-11209f47b532", "name": "network-vif-plugged", "status": "completed", "tag": "6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:52.166136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5131f1d8-7edd-42d0-995c-52aaf8a26358 req-b8dd562e-7ab5-4936-97c0-904202171669 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.167817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5131f1d8-7edd-42d0-995c-52aaf8a26358 req-b8dd562e-7ab5-4936-97c0-904202171669 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.168429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5131f1d8-7edd-42d0-995c-52aaf8a26358 req-b8dd562e-7ab5-4936-97c0-904202171669 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.204684 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5131f1d8-7edd-42d0-995c-52aaf8a26358 req-b8dd562e-7ab5-4936-97c0-904202171669 service nova] Creating event network-vif-plugged:6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53 for instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 on n-h2-zed-1 Oct 28 09:59:52.210292 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5131f1d8-7edd-42d0-995c-52aaf8a26358 req-b8dd562e-7ab5-4936-97c0-904202171669 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077126 Oct 28 09:59:52.211170 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1216/2471] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:52.217916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:52.218610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] [instance: 17dc7353-723f-476f-bfe0-2ea04fdd34a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:52.224931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.225431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.225867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.226561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.227006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.227517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.242651 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] HTTP exception thrown: Instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 could not be found. Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Request method failure captured: Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 HTTP/1.1 Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6fw8kQjyQ-CJTp3cmE10UuG_nDw2nT3xCN0aJrN4ZdQ1AxlFou9GCoouglwKEaxJrTIbiOU1PO-h6gX6sD5mGN1KkQjoy6M6r-wMVHK3l749m9vVH3asfb5qwO3FIrRrHcKLv-PgT5gzcg9RdGsajKh62q0PfaeCMQ-xo-jMYpk0rs Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e901479a6ca34dd1bcecfe2211ea82f9 Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TenantUsagesTestJSON-1363861262 Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:59:52.243783 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e901479a6ca34dd1bcecfe2211ea82f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e901479a6ca34dd1bcecfe2211ea82f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e901479a6ca34dd1bcecfe2211ea82f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e901479a6ca34dd1bcecfe2211ea82f9"}]}] Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TenantUsagesTestJSON-1363861262 Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e901479a6ca34dd1bcecfe2211ea82f9 Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1363861262 Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TenantUsagesTestJSON-1363861262-project Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 9e0bbdc67f9440b1bcf92e62720385cf Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TenantUsagesTestJSON-1363861262-project Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 could not be found. Oct 28 09:59:52.245035 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '17dc7353-723f-476f-bfe0-2ea04fdd34a9'} Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 could not be found. Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:52.245715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 could not be found. Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 could not be found. Oct 28 09:59:52.246698 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:52.248321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] Returning 404 to user: Instance 17dc7353-723f-476f-bfe0-2ea04fdd34a9 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:52.248321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-21700a01-019a-445a-9ece-2aef79524406 tempest-TenantUsagesTestJSON-1363861262 tempest-TenantUsagesTestJSON-1363861262-project] 10.222.0.16 "GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9" status: 404 len: 111 microversion: 2.1 time: 0.032281 Oct 28 09:59:52.248321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1217/2472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:52 2022] GET /compute/v2.1/servers/17dc7353-723f-476f-bfe0-2ea04fdd34a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:52.252758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:52.272882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.276580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:52.281539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.283017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.284827 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10c495fb-9fca-4292-8e70-31327646b92a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.410363 Oct 28 09:59:52.285452 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1256/2473] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:51 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:52.291085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.291577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.292012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.292709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.302029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.306909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.397985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.398504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.398912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.399522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lazy-loading 'fault' on Instance uuid f5cc4e4d-4dff-444f-ac54-f4821dccae07 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:52.457610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.471430 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12c99c51-8d70-497f-80d4-e9f3c1cbbe6b tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 200 len: 1300 microversion: 2.1 time: 0.224172 Oct 28 09:59:52.472562 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1218/2474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:52 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 1300 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:52.487718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cd886cbd-1591-47df-ba00-77a75ab70e14 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b9ff790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:52.542898 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cd886cbd-1591-47df-ba00-77a75ab70e14 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.058445 Oct 28 09:59:52.543514 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1257/2475] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:52 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:52.757592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:52.759691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:52.773738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.774406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.775501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.776559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:52.777637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:52.780081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:52.828102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-697568135", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "f4ed94e4-d576-40d8-b9b4-a86ace481d9b"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:52.916337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] validate_networks() for [('f4ed94e4-d576-40d8-b9b4-a86ace481d9b', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 09:59:52.927729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.937578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.939412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:52.945147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c9bbb94c-7c5b-44ef-bea4-e3f64e8a5b9e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.192353 Oct 28 09:59:52.946902 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1258/2476] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:52 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:53.157167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.158039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:53.173691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.176146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.177566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.178571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.182053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.184117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.424644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.436417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.438699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.439999 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d6f06937-4d50-498e-9d36-5ad55bd4b7fd tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1280 microversion: 2.25 time: 0.287558 Oct 28 09:59:53.441064 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1259/2477] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:53 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1280 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:53.448599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.449502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:53.456626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.457569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.458298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.459215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.459879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.460514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.632762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 09:59:53.634307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 09:59:53.634966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 09:59:53.635553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 09:59:53.636143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 09:59:53.651289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.654517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.655195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.656220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.656747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.660162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.671670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.685473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Getting quotas for project c1b921cd14fb49308c16ce63d1120b1d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 09:59:53.688628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.691507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Getting quotas for user 2b4bc09d609742b5b57d7e7fd6b47118 and project c1b921cd14fb49308c16ce63d1120b1d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 09:59:53.694110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.697033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-247b8438-abe3-4223-b75b-25f200e23dac tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.254662 Oct 28 09:59:53.703379 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1260/2478] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:53 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:53.707170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 09:59:53.709928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 09:59:53.713050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.713679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: f5cc4e4d-4dff-444f-ac54-f4821dccae07] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:53.729127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.729628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.730073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.730787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.731245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.731670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.767631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ff25cace-73e7-41d0-969f-376c9d6dfcde tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.142236 Oct 28 09:59:53.777122 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1219/2479] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 09:59:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 09:59:53.778407 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] HTTP exception thrown: Instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 could not be found. Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Request method failure captured: Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 HTTP/1.1 Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ZPJ8vDPZw5XVZPJtVAuZZLfb9Q86IXLXWoGqtkQWWVGc5rShTo7XxmHRNSr5tJgYcCZcZJQHftvUZNtOrkAjcqb1VsVXxw6JzVrtmwOFLkf0sz3oUzfSlkF1yca5vMUmBxbOW6eTEc8Ghr4626WK3f68oppqOfpJ1QvuIRIleepPM Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 09:59:53.780543 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38bd1e9a411e49c0b6c13914f4b53caf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38bd1e9a411e49c0b6c13914f4b53caf"}]}] Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: d76e0eb51a9b418bb28e81b5ac1520f9 Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 could not be found. Oct 28 09:59:53.782012 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f5cc4e4d-4dff-444f-ac54-f4821dccae07'} Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 could not be found. Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:53.782801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 could not be found. Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 could not be found. Oct 28 09:59:53.784040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:53.785185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Returning 404 to user: Instance f5cc4e4d-4dff-444f-ac54-f4821dccae07 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:53.785185 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-687b5895-9f33-4544-a5a8-cbe535bda550 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07" status: 404 len: 111 microversion: 2.1 time: 0.078178 Oct 28 09:59:53.786133 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1261/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:53 2022] GET /compute/v2.1/servers/f5cc4e4d-4dff-444f-ac54-f4821dccae07 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:53.791945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-616da771-79f5-406a-8266-3f912d39bf54 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3284fb80>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.799535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-76017ad5-10ea-41c5-b9fc-0234c0a0f2a8 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.803671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-76017ad5-10ea-41c5-b9fc-0234c0a0f2a8 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:53.853332 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-616da771-79f5-406a-8266-3f912d39bf54 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.073826 Oct 28 09:59:53.864235 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1220/2481] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:53 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:53.870326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.871032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:53.879600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.880320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.881045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.882512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:53.883223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:53.884594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:53.926423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:53.947238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-76017ad5-10ea-41c5-b9fc-0234c0a0f2a8 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:53.956636 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-76017ad5-10ea-41c5-b9fc-0234c0a0f2a8 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1216 microversion: 2.1 time: 0.169400 Oct 28 09:59:53.958739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1262/2482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:53 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:53.984209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:53.987693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:53.991156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:54.001770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.002280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.002723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.006579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.007445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.010923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.061057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:54.076003 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a49c113-fd5b-4631-a827-355309e6113f tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 204 len: 0 microversion: 2.1 time: 0.210205 Oct 28 09:59:54.080041 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1221/2483] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:53 2022] DELETE /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:54.087692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:54.089147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:54.097003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.097582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.097912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.099059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.099813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.100796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.167709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:54.179110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:54.182281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:54.208824 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d1efb6bb-08c2-40a9-8a1c-355c4782f318 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.229265 Oct 28 09:59:54.213181 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1263/2484] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:53 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:54.382377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:54.399199 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aa865e50-8456-443d-90a8-4ce670c8e9b0 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1500 microversion: 2.1 time: 0.316396 Oct 28 09:59:54.399978 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1222/2485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:54 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1500 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:54.471325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:54.472995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:54.490255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.491671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.494362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.497000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.498323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.502483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.610003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:54.610761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:54.623469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.624240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.624978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.625998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.626807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.627781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.689704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 09:59:54.780735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:54.786326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 09:59:54.872717 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-905a33d5-8983-4dba-8bcb-cf4b027754d6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "DELETE /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 204 len: 0 microversion: 2.1 time: 0.263479 Oct 28 09:59:54.874617 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1223/2486] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 09:59:54 2022] DELETE /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 09:59:54.881338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:54.882525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:54.892488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.893490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.894270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:54.895312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:54.895974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:54.896656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.001894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.016214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.017698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.018836 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b07334e-5794-44cd-a0c3-4977cf1dd817 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1280 microversion: 2.25 time: 0.552010 Oct 28 09:59:55.019413 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1264/2487] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:54 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1280 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:55.057713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ae6d2ad-fc0a-4618-90e1-b6c7a234e618 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3ba363a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:55.156404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ae6d2ad-fc0a-4618-90e1-b6c7a234e618 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.135859 Oct 28 09:59:55.159080 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1265/2488] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:55 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:55.165777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.169225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:55.170042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:55.178256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.178940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.179962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.181455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.182242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.182927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.187042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.190284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.191527 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a64b95cc-f5b3-4ee8-9f57-01dfddd54816 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.315519 Oct 28 09:59:55.192095 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1224/2489] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:54 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:55.206898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:55.207520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:55.232328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.234847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.239096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.243174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.243735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.244242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.387274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.401754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e87391aa-bfe5-497b-8336-ae26071fe39c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1268 microversion: 2.1 time: 0.201512 Oct 28 09:59:55.402928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1225/2490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:55 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1268 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:55.407916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:55.408532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:55.417128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.417636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.418081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.422915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.423830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.425488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.535602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.543993 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-675f4643-716b-4970-8721-1b307046a6dd tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1514 microversion: 2.1 time: 0.383651 Oct 28 09:59:55.544574 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1266/2491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:55 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1514 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:55.552303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:55.552940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:55.562387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.576103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.577137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.577921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.578405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.578842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.605205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.616011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.629934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.648035 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-508c0f09-cb1c-4f13-8b2f-8159cf65c7bc tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.235876 Oct 28 09:59:55.648706 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1226/2492] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:55 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:55.777279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:55.785170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c322694d-e032-4e59-87f9-636162757c57 req-a7898fff-8711-4beb-90c8-bb1bf1268d20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab", "name": "network-vif-plugged", "status": "completed", "tag": "fa96b0ac-478a-4896-b414-e05f78c6fcea"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:55.801305 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c76f768-178c-42f5-9ce9-e5b496d7c312 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1458 microversion: 2.1 time: 0.245703 Oct 28 09:59:55.801935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1267/2493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:55 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1458 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:55.811707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c322694d-e032-4e59-87f9-636162757c57 req-a7898fff-8711-4beb-90c8-bb1bf1268d20 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:55.812200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c322694d-e032-4e59-87f9-636162757c57 req-a7898fff-8711-4beb-90c8-bb1bf1268d20 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:55.812629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c322694d-e032-4e59-87f9-636162757c57 req-a7898fff-8711-4beb-90c8-bb1bf1268d20 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:55.843081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c322694d-e032-4e59-87f9-636162757c57 req-a7898fff-8711-4beb-90c8-bb1bf1268d20 service nova] Creating event network-vif-plugged:fa96b0ac-478a-4896-b414-e05f78c6fcea for instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab on n-h1-zed-1 Oct 28 09:59:55.870925 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c322694d-e032-4e59-87f9-636162757c57 req-a7898fff-8711-4beb-90c8-bb1bf1268d20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096461 Oct 28 09:59:55.872227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1227/2494] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:55.942917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-38f5e3a3-f1ee-436e-9b2d-b8e5d427edc4 req-0ef43747-bbca-46b6-8f77-38d3d84eb78d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4b982ea-8435-4b99-ac22-6dfe4fdb0f31", "name": "network-vif-deleted", "tag": "bd7a6588-4a23-403b-8d3d-0767543db082"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:55.992271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-38f5e3a3-f1ee-436e-9b2d-b8e5d427edc4 req-0ef43747-bbca-46b6-8f77-38d3d84eb78d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.005315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-38f5e3a3-f1ee-436e-9b2d-b8e5d427edc4 req-0ef43747-bbca-46b6-8f77-38d3d84eb78d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.005887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-38f5e3a3-f1ee-436e-9b2d-b8e5d427edc4 req-0ef43747-bbca-46b6-8f77-38d3d84eb78d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.052140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.053169 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-38f5e3a3-f1ee-436e-9b2d-b8e5d427edc4 req-0ef43747-bbca-46b6-8f77-38d3d84eb78d service nova] Creating event network-vif-deleted:bd7a6588-4a23-403b-8d3d-0767543db082 for instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 on n-h1-zed-1 Oct 28 09:59:56.054704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:56.069763 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-38f5e3a3-f1ee-436e-9b2d-b8e5d427edc4 req-0ef43747-bbca-46b6-8f77-38d3d84eb78d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130685 Oct 28 09:59:56.072753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1268/2495] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 09:59:56.080329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.081398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.084984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.086215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.087394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.090394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.179966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1da73d8-c55d-40bd-9e62-8ff807bfdb5d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3ba0bd30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.284726 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1da73d8-c55d-40bd-9e62-8ff807bfdb5d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.109886 Oct 28 09:59:56.285699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1269/2496] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:56 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:56.311133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.312373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:56.328994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.348340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.349627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.356012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.357878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.380062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.436201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.459462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.473425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.475265 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0577d0d1-06c5-4fff-8ff0-e0fe8a30cbe8 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1280 microversion: 2.25 time: 0.428653 Oct 28 09:59:56.476178 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1228/2497] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:56 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1280 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:56.497446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.498712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:56.515379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.522592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.526625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.528921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.531163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.531639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.641560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.650401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.659843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.670035 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-143a75b8-ede4-47b2-ae47-371ad17e1ac8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.382551 Oct 28 09:59:56.671478 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1270/2498] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:56 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:56.686058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.687020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:56.694541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.697698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.698214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.698664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.700125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.700599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.701066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.705304 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d16c869-8780-44c0-8ba0-82b1cffcbd5f tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1274 microversion: 2.1 time: 0.227944 Oct 28 09:59:56.705904 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1229/2499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:56 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1274 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:56.711270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.711965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:56.735021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.735021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.735439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.736111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.736579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.737033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.881230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.905829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.908220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:56.917267 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d8bbe98e-6da4-48e5-a905-a57a827f9796 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.210248 Oct 28 09:59:56.918897 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1230/2500] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:56 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:56.936153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:56.937118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:56.952735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.955188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.955948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:56.957105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:56.959251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:56.961235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:57.006095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:57.006944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:57.007727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:57.009065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lazy-loading 'fault' on Instance uuid d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:57.092701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd76e0eb51a9b418bb28e81b5ac1520f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38bd1e9a411e49c0b6c13914f4b53caf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:57.104438 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90d6ae0d-bac2-41a4-93aa-163cc9e1c458 tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 200 len: 1300 microversion: 2.1 time: 0.183714 Oct 28 09:59:57.123255 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1231/2501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:56 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 1300 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:57.301238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27815e04-f42c-45ff-b655-2fbf858d939b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3270c040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:57.390101 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-27815e04-f42c-45ff-b655-2fbf858d939b tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.092884 Oct 28 09:59:57.400342 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1232/2502] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:57 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 09:59:57.507264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:57.507894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:57.519920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:57.520431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:57.525687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:57.533892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:57.534392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:57.534859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:57.845389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:57.856751 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb475a9a-0bb1-45ef-8b66-6f03066ff46b tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1514 microversion: 2.1 time: 1.182649 Oct 28 09:59:57.878753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1271/2503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:56 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1514 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:57.906538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:57.920211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:57.924344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:57.932262 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-68d0f494-4ffd-461e-ae8c-cccd20e09959 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1280 microversion: 2.25 time: 0.429371 Oct 28 09:59:57.936993 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1233/2504] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:57 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1280 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:57.948626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:57.949280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:57.967127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:57.967860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:57.968562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:57.969320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:57.969771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:57.970205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.198528 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19896aa8-baa5-44e5-ae3c-909c263bdbde tempest-TenantUsagesNegativeTestJSON-1561957488 tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T09%3A59%3A57.668786&end=2022-10-29T09%3A59%3A57.668786" status: 404 len: 112 microversion: - time: 0.315456 Oct 28 09:59:58.206550 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1272/2505] 10.222.0.16 () {58 vars in 1316 bytes} [Fri Oct 28 09:59:57 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-27T09%3A59%3A57.668786&end=2022-10-29T09%3A59%3A57.668786 => generated 112 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 09:59:58.220029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.222641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:58.242529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.243760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.244376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.245997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.247452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.248151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.319078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.328547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.334525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.335993 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fea2ba38-94a3-4555-b1fc-9f67db64f830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.397780 Oct 28 09:59:58.351872 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1234/2506] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:57 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:58.363342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.363964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:58.376679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.377215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.377749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.378438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.379057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.379775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.476525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.482034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.494293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.496707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.505159 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8a9e016-8046-496a-985d-8150a6447c59 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.154612 Oct 28 09:59:58.506063 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1235/2507] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:58.511059 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7274f07f-b3c8-4e89-bb6b-eef02e078ddf tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1274 microversion: 2.1 time: 0.301614 Oct 28 09:59:58.512413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.513085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] [instance: d4b982ea-8435-4b99-ac22-6dfe4fdb0f31] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:58.517517 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1273/2508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1274 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:58.519215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.519889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.520570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.521565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.522157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.522718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.535559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da21d969-bd38-489a-aaf0-d3771b7817dd tempest-TenantUsagesNegativeTestJSON-1561957488 tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin] Calling method '.version_select at 0x7fca3b9a35e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.542281 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-da21d969-bd38-489a-aaf0-d3771b7817dd tempest-TenantUsagesNegativeTestJSON-1561957488 tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 28 09:59:58.555489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] HTTP exception thrown: Instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 could not be found. Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Request method failure captured: Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 HTTP/1.1 Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ZPJ8vDPZw5XVZPJtVAuZZLfb9Q86IXLXWoGqtkQWWVGc5rShTo7XxmHRNSr5tJgYcCZcZJQHftvUZNtOrkAjcqb1VsVXxw6JzVrtmwOFLkf0sz3oUzfSlkF1yca5vMUmBxbOW6eTEc8Ghr4626WK3f68oppqOfpJ1QvuIRIleepPM Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:59:58.558024 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/38bd1e9a411e49c0b6c13914f4b53caf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_38bd1e9a411e49c0b6c13914f4b53caf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/38bd1e9a411e49c0b6c13914f4b53caf"}]}] Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 38bd1e9a411e49c0b6c13914f4b53caf Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-LiveMigrationTest-1897467687 Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: d76e0eb51a9b418bb28e81b5ac1520f9 Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-LiveMigrationTest-1897467687-project Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 could not be found. Oct 28 09:59:58.559312 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'd4b982ea-8435-4b99-ac22-6dfe4fdb0f31'} Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 could not be found. Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:58.560073 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 could not be found. Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 could not be found. Oct 28 09:59:58.561346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.562629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] Returning 404 to user: Instance d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:58.562629 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc16de09-4de4-4af6-b0e1-d3195fd6242e tempest-LiveMigrationTest-1897467687 tempest-LiveMigrationTest-1897467687-project] 10.222.0.16 "GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31" status: 404 len: 111 microversion: 2.1 time: 0.052356 Oct 28 09:59:58.562629 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1236/2509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/servers/d4b982ea-8435-4b99-ac22-6dfe4fdb0f31 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:58.571691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-149ac778-c2f3-4a84-a8c5-a38ffd4ea5f9 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3260a670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da21d969-bd38-489a-aaf0-d3771b7817dd tempest-TenantUsagesNegativeTestJSON-1561957488 tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin] Request method failure captured: Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-simple-tenant-usage/bacc4338668a483cb1db22e32729a5f1?start=2022-10-29T09%3A59%3A57.668786&end=2022-10-27T09%3A59%3A57.668786 HTTP/1.1 Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6gdrqmvQI9WkZw8ZQLzg2y3HAZ5WxTMNuYws5IFSXqGKxrG8xE1kgszuly0z5K1tf7kauTvr8UcsTP64S-VA6XgDJ19OX4D3kgD5JcgGt_RNSqEIVRcjSoes6tq_hBJxn04QLSpHH0fvF8UENr4uKfa9sdK5nCHoqaxgU8IV8trKg4 Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 5dbe371f8b8f45a489923a2cfa2a096f Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1561957488 Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 09:59:58.592960 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5dbe371f8b8f45a489923a2cfa2a096f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/5dbe371f8b8f45a489923a2cfa2a096f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_5dbe371f8b8f45a489923a2cfa2a096f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/5dbe371f8b8f45a489923a2cfa2a096f"}]}] Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1561957488 Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 5dbe371f8b8f45a489923a2cfa2a096f Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1561957488 Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 82034c5ee1fb4eb28fae15c16f271b70 Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid start time. The start time cannot occur after the end time. Oct 28 09:59:58.594292 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'bacc4338668a483cb1db22e32729a5f1'} Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 09:59:58.595102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 28 09:59:58.596206 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.598894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da21d969-bd38-489a-aaf0-d3771b7817dd tempest-TenantUsagesNegativeTestJSON-1561957488 tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:58.603946 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da21d969-bd38-489a-aaf0-d3771b7817dd tempest-TenantUsagesNegativeTestJSON-1561957488 tempest-TenantUsagesNegativeTestJSON-1561957488-project-admin] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage/bacc4338668a483cb1db22e32729a5f1?start=2022-10-29T09%3A59%3A57.668786&end=2022-10-27T09%3A59%3A57.668786" status: 400 len: 111 microversion: 2.1 time: 0.077352 Oct 28 09:59:58.609165 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1274/2510] 10.222.0.16 () {58 vars in 1412 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/os-simple-tenant-usage/bacc4338668a483cb1db22e32729a5f1?start=2022-10-29T09%3A59%3A57.668786&end=2022-10-27T09%3A59%3A57.668786 => generated 111 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 09:59:58.627151 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-149ac778-c2f3-4a84-a8c5-a38ffd4ea5f9 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.065601 Oct 28 09:59:58.628321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1237/2511] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:58.646651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c5745fc4-aff3-4668-aaa5-4a2b56653c62 req-c390abe5-babb-4697-bb4b-041313127849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "504310c7-eadc-46ad-bbe8-83c30a6fd6ff", "name": "network-vif-deleted", "tag": "28e3f7b2-4c64-47fc-8c95-8b7dfee356ed"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 09:59:58.674582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c5745fc4-aff3-4668-aaa5-4a2b56653c62 req-c390abe5-babb-4697-bb4b-041313127849 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.675079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c5745fc4-aff3-4668-aaa5-4a2b56653c62 req-c390abe5-babb-4697-bb4b-041313127849 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.675524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c5745fc4-aff3-4668-aaa5-4a2b56653c62 req-c390abe5-babb-4697-bb4b-041313127849 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.699685 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c5745fc4-aff3-4668-aaa5-4a2b56653c62 req-c390abe5-babb-4697-bb4b-041313127849 service nova] Creating event network-vif-deleted:28e3f7b2-4c64-47fc-8c95-8b7dfee356ed for instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff on n-h2-zed-1 Oct 28 09:59:58.713152 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c5745fc4-aff3-4668-aaa5-4a2b56653c62 req-c390abe5-babb-4697-bb4b-041313127849 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093971 Oct 28 09:59:58.715494 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1275/2512] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 09:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 09:59:58.880770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99547223-7240-439f-8e25-19629e527cae tempest-TenantUsagesNegativeTestJSON-1810533 tempest-TenantUsagesNegativeTestJSON-1810533-project] Calling method '.version_select at 0x7fca3271ee50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.886919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-99547223-7240-439f-8e25-19629e527cae tempest-TenantUsagesNegativeTestJSON-1810533 tempest-TenantUsagesNegativeTestJSON-1810533-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '9c8f9fcac85e4b218eb284c19667eca0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bacc4338668a483cb1db22e32729a5f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99547223-7240-439f-8e25-19629e527cae tempest-TenantUsagesNegativeTestJSON-1810533 tempest-TenantUsagesNegativeTestJSON-1810533-project] Request method failure captured: Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T09%3A59%3A57.668786&end=2022-10-29T09%3A59%3A57.668786&detailed=1 HTTP/1.1 Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6gcLJibIrgVF1mRjF3BB9Wf18riJEh51qyuXUUeuPr2ml4BltVzDdpj66T9GHBm9PtGvP9zcXbTZCtDPvRokeeryF4QMsp5NCJtDNM0Qw9uYnTey08HVQiDTEcEb17g8ki4YqZjOwpIRSxtB0kVDzOLiUEnzT3Q4s1cq2AxtIL69H0 Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: bacc4338668a483cb1db22e32729a5f1 Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1810533 Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 09:59:58.890533 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bacc4338668a483cb1db22e32729a5f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bacc4338668a483cb1db22e32729a5f1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bacc4338668a483cb1db22e32729a5f1", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bacc4338668a483cb1db22e32729a5f1"}]}] Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1810533 Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: bacc4338668a483cb1db22e32729a5f1 Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1810533 Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TenantUsagesNegativeTestJSON-1810533-project Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 9c8f9fcac85e4b218eb284c19667eca0 Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1810533-project Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: action_args: {} Oct 28 09:59:58.891670 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 09:59:58.892380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 09:59:58.893604 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 09:59:58.894583 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 28 09:59:58.894583 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 09:59:58.896890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.899072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:58.900270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99547223-7240-439f-8e25-19629e527cae tempest-TenantUsagesNegativeTestJSON-1810533 tempest-TenantUsagesNegativeTestJSON-1810533-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 09:59:58.901334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99547223-7240-439f-8e25-19629e527cae tempest-TenantUsagesNegativeTestJSON-1810533 tempest-TenantUsagesNegativeTestJSON-1810533-project] 10.222.0.16 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T09%3A59%3A57.668786&end=2022-10-29T09%3A59%3A57.668786&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.271782 Oct 28 09:59:58.902414 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1238/2513] 10.222.0.16 () {58 vars in 1335 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-27T09%3A59%3A57.668786&end=2022-10-29T09%3A59%3A57.668786&detailed=1 => generated 123 bytes in 273 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 09:59:58.923585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.928106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.929568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.934693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.935428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.936486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.968347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:58.969338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:58.983816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.984327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:58.984770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:58.998322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:58.998829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.005592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.070228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:59.070883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.071415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.073044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lazy-loading 'fault' on Instance uuid 504310c7-eadc-46ad-bbe8-83c30a6fd6ff {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 09:59:59.152511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.168071 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bdb1bde5-b611-447c-9c12-b4cc77c7bb3c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 200 len: 1307 microversion: 2.1 time: 0.276895 Oct 28 09:59:59.168686 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1276/2514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 1307 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 09:59:59.374871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:59.379085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:59.397366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:59.398312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.399076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.400075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:59.400685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.401337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.594698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.632768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.638149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.643614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7218a298-fe8c-494a-87fc-f311566b71e9 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1476 microversion: 2.25 time: 0.678613 Oct 28 09:59:59.645389 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1239/2515] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:58 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1476 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 09:59:59.670034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:59.675548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:59.702455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:59.702984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.709436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.710509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:59.711141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.712399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.739241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.753286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.755187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.759304 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3882b24e-10cc-4d4a-987c-9037bad6696c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.394383 Oct 28 09:59:59.767915 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1277/2516] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:59 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:59.774706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:59.775541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 09:59:59.782040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:59.782849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.783516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.784418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 09:59:59.785126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 09:59:59.785757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 09:59:59.829397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.843914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.847127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 09:59:59.856482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b44b3aa8-8320-4075-a623-d232fd517bbf tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.209155 Oct 28 09:59:59.858144 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1240/2517] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:59 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 09:59:59.863488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14a4a702-40df-4285-9ae6-84f7c5a03128 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca326fadc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 09:59:59.934385 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14a4a702-40df-4285-9ae6-84f7c5a03128 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.074859 Oct 28 09:59:59.935133 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1241/2518] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 09:59:59 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:00.095473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:00.110776 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a0470c3-ab48-4c0a-9a58-78e0080bdf97 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1316 microversion: 2.1 time: 0.340560 Oct 28 10:00:00.112042 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1278/2519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 09:59:59 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:00.191454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:00.192713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 504310c7-eadc-46ad-bbe8-83c30a6fd6ff] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:00.212217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.218662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.219551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.221704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.222279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.223007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.261324 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] HTTP exception thrown: Instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff could not be found. Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Request method failure captured: Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff HTTP/1.1 Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6dbsmBL3RidMEyomNAp27AR5YjtMARAGgV9PLloZpJx93aP8jJLVdvAdtKHl8dwkQe-F5bJBALo5I2UaUXQDuYfOvMmCn0n0g1ZBl02ghb334sIonLjYWvbQhAKZmvr8zNJ3wEtu-vDRTA58CqOGMzPum0rnZXVpjAT28qoH3zvGKg Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: aa7146c7cb464ce99ad2f6593f0ebb0b Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesAdminNegativeTest-1836362498 Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:00:00.268070 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa7146c7cb464ce99ad2f6593f0ebb0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa7146c7cb464ce99ad2f6593f0ebb0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aa7146c7cb464ce99ad2f6593f0ebb0b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aa7146c7cb464ce99ad2f6593f0ebb0b"}]}] Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesAdminNegativeTest-1836362498 Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: aa7146c7cb464ce99ad2f6593f0ebb0b Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1836362498 Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesAdminNegativeTest-1836362498-project Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b2706dd9c4f24a41a1e990c0517b792e Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesAdminNegativeTest-1836362498-project Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff could not be found. Oct 28 10:00:00.270106 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '504310c7-eadc-46ad-bbe8-83c30a6fd6ff'} Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff could not be found. Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:00:00.270892 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff could not be found. Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff could not be found. Oct 28 10:00:00.271879 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:00.276449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Returning 404 to user: Instance 504310c7-eadc-46ad-bbe8-83c30a6fd6ff could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:00:00.277849 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d5646ed-64d1-4eba-a798-bb2d65eba5c4 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff" status: 404 len: 111 microversion: 2.1 time: 0.090780 Oct 28 10:00:00.281932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1279/2520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:00 2022] GET /compute/v2.1/servers/504310c7-eadc-46ad-bbe8-83c30a6fd6ff => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:00:00.362647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:00.363460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:00.387871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.391081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.395055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.397930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.398549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.399120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.744280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1595fb3c-1846-463f-a3e6-937f9eeed11f req-d27c399a-787e-4ad8-b9c4-4f7770212d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97720d58-c735-4f4c-923c-8de1508c14af", "tag": "8c4cf8ae-960d-42bc-a63b-7c599e875c1e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:00.774950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:00:00.799482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1595fb3c-1846-463f-a3e6-937f9eeed11f req-d27c399a-787e-4ad8-b9c4-4f7770212d19 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.800321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1595fb3c-1846-463f-a3e6-937f9eeed11f req-d27c399a-787e-4ad8-b9c4-4f7770212d19 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.801153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1595fb3c-1846-463f-a3e6-937f9eeed11f req-d27c399a-787e-4ad8-b9c4-4f7770212d19 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.846230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-86d4dc4c-2641-4110-a682-78fdd2a78168 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1962 microversion: 2.25 time: 0.909482 Oct 28 10:00:00.851564 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1242/2521] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 09:59:59 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1962 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:00.851854 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1595fb3c-1846-463f-a3e6-937f9eeed11f req-d27c399a-787e-4ad8-b9c4-4f7770212d19 service nova] Creating event network-changed:8c4cf8ae-960d-42bc-a63b-7c599e875c1e for instance 97720d58-c735-4f4c-923c-8de1508c14af on n-h1-zed-1 Oct 28 10:00:00.861152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:00.866492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:00.866702 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1595fb3c-1846-463f-a3e6-937f9eeed11f req-d27c399a-787e-4ad8-b9c4-4f7770212d19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127381 Oct 28 10:00:00.867886 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1280/2522] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:00.881496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.885985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:00.886713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:00.887015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.887782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.888770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.890675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.892162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.896478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.897004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.897446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.898157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:00.898611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:00.899089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:00.912949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:01.187221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:00:01.223199 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49024faf-3ec5-4808-8a8b-0ec327e0ae37 tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1962 microversion: 2.25 time: 0.335948 Oct 28 10:00:01.224158 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1281/2523] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:00 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1962 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:01.229203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:01.229818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:01.254771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.255263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.255705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.256437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.264180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.264659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.332575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.347610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.350653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.351900 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3871618f-e869-491c-84ec-247504ff3002 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.497101 Oct 28 10:00:01.354303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1243/2524] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:00 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:01.395867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-537b0b41-4fbb-4835-ab4a-f8da5d916534 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca32898f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:01.410433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.433824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.435421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:01.441044 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c43c8269-4c5c-4910-953f-f002666d5e00 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.215742 Oct 28 10:00:01.441950 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1282/2525] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:01 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:01.451464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:01.452062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:01.468450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.469057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.469504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.470233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.470689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.471110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.512203 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-537b0b41-4fbb-4835-ab4a-f8da5d916534 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.153135 Oct 28 10:00:01.521513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1244/2526] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:01 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:01.535944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:01.547371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.548169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.550106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.553258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.554287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.556327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.676774 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b19a26db-ca43-4c2a-aec5-387d646c203f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 418 microversion: 2.25 time: 0.153966 Oct 28 10:00:01.688133 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1245/2527] 10.222.0.16 () {60 vars in 1217 bytes} [Fri Oct 28 10:00:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 418 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:00:01.693865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-zed-1", "block_migration": "auto"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:01.709172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:01.716514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.717387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.718780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.719789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:01.720475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:01.721172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:01.751626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:01.756345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'flavor' on Instance uuid d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:00:01.773812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Going to try to live migrate instance to n-h2-zed-1 {{(pid=128748) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 10:00:02.105425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:02.132424 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb824683-965e-4b95-ad30-1f16e7e6b8f3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1316 microversion: 2.1 time: 0.683682 Oct 28 10:00:02.133145 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1283/2528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:01 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1316 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:02.385208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:02.386057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:02.397881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:02.404385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:02.405099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:02.406216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:02.406859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:02.407508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:02.701196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:02.711416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:02.714396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:02.716241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b66248c-5e4f-43df-999d-0ba802d212a8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.337387 Oct 28 10:00:02.717708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1284/2529] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:02 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:02.722724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:02.723733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:02.738374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:02.749649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:02.751548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:02.752783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:02.754847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:02.756228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:02.989643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:02.999389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:03.001502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:03.008063 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-82b6781c-974d-4063-9033-be218d7cb39a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.288642 Oct 28 10:00:03.009265 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1285/2530] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:02 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:03.014068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-11cce9d1-a46b-4e0c-8e72-730c7f5dc35e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3ba36c10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:03.065831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-11cce9d1-a46b-4e0c-8e72-730c7f5dc35e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.055312 Oct 28 10:00:03.078372 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1286/2531] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:03 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:03.156258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:03.157212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:03.167635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:03.168602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:03.170651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:03.178446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:03.183300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:03.184184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:03.699565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:03.953030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:04.134925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:04.145647 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f54122f7-b4bc-46fe-ac59-dac3bb2b863b tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1316 microversion: 2.1 time: 0.993134 Oct 28 10:00:04.149260 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1287/2532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:03 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1316 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:04.158556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:04.159595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:04.178199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:04.183568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:04.185952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:04.186992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:04.188800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:04.189558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:04.715360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:04.724056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:04.736805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:04.740057 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aec2f010-2fa7-4a67-a1e0-145aa8ed4614 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.589441 Oct 28 10:00:04.753092 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1288/2533] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:04 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:04.764669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:04.767092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:04.787041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:04.791907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:04.794078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:04.796296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:04.802283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:04.803059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:05.107999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:05.129631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:05.131570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:05.138765 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6bce046-8d69-4cb1-b5b3-84c54a1d6b7a tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.384293 Oct 28 10:00:05.139453 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1289/2534] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:04 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:05.144246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-110b8658-63b2-4c58-ab31-a876b6a35035 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b9c9670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:05.202288 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-110b8658-63b2-4c58-ab31-a876b6a35035 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.061512 Oct 28 10:00:05.204032 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1290/2535] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:05 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:05.456080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba0a76d5-0887-45c3-bc3e-09631eba8128 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:05.476668 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba0a76d5-0887-45c3-bc3e-09631eba8128 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.270948 Oct 28 10:00:05.488218 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1291/2536] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:05.497321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:05.499030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:05.506007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:05.506776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:05.507373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:05.509335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:05.510030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:05.510650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:05.715889 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a2620c4-f39a-4410-85fd-59b855ef707f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab/action" status: 202 len: 0 microversion: 2.25 time: 4.026000 Oct 28 10:00:05.716942 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1246/2537] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 10:00:01 2022] POST /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab/action => generated 0 bytes in 4028 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:00:05.724466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6decc6d3-3db4-481a-8e30-1b2a17589459 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:05.789398 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6decc6d3-3db4-481a-8e30-1b2a17589459 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.070889 Oct 28 10:00:05.790945 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1247/2538] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:00:05 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:05.796011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:05.796682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:05.805477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:05.805991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:05.806430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:05.807241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:05.808103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:05.808701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:05.960569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:05.975754 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-76f21831-dabf-4db9-8cfa-56b67f8894be tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1316 microversion: 2.1 time: 0.480644 Oct 28 10:00:05.978444 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1292/2539] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:05 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:06.006051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.013012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:06.016833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.035702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.038578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.039256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.041443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.042624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.043463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.045433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.045904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.048448 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a8d9b109-9b07-4eb0-bf8e-62b60830898b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.256219 Oct 28 10:00:06.065114 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1248/2540] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:05 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:06.076215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee3f7305-b57b-4d5c-b9a2-6363393c0ade tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.084944 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee3f7305-b57b-4d5c-b9a2-6363393c0ade tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018175 Oct 28 10:00:06.086232 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1249/2541] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:06.099706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4aa5dd93-2f85-48bc-afca-f7c65ec5a078 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.121168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4aa5dd93-2f85-48bc-afca-f7c65ec5a078 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025091 Oct 28 10:00:06.128745 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1250/2542] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:06.136491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b64debfe-e61b-4df9-83a4-b7a978d2d2b4 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.182428 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b64debfe-e61b-4df9-83a4-b7a978d2d2b4 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.051359 Oct 28 10:00:06.183211 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1251/2543] 10.222.0.16 () {58 vars in 1165 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:00:06.189505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.191106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:06.198622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.199805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.200868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.203066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.203795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.204388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.237206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:00:06.356258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe4907fb-dfd6-4482-b1d1-9a5656f17922 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "DELETE /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 204 len: 0 microversion: 2.1 time: 0.170332 Oct 28 10:00:06.360397 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1252/2544] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:00:06 2022] DELETE /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:00:06.363950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.365052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:06.373589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.374829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.375376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.376233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.376796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.377345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.379942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.389910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.402137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.403675 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e346ca04-b90d-48c3-8358-88dd7bc05fe9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1745 microversion: 2.20 time: 0.413695 Oct 28 10:00:06.405619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1293/2545] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:05 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1745 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:06.412581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bd245d9-e0e0-46c3-b292-c36bb422d1b4 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.431075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2bd245d9-e0e0-46c3-b292-c36bb422d1b4 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023513 Oct 28 10:00:06.431884 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1294/2546] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:06.443827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30b76bba-4c83-4cb1-bf2f-a6096fa71192 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b9c9430>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.503180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.511787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.512856 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30b76bba-4c83-4cb1-bf2f-a6096fa71192 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1423 microversion: 2.1 time: 0.080125 Oct 28 10:00:06.513231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.515701 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1295/2547] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:06.520871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.530232 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c0f8cb6-72ab-4013-87a5-05e6d6be4413 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1558 microversion: 2.91 time: 0.170710 Oct 28 10:00:06.531080 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1253/2548] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:06.533826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:06.538301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4506fbd-05cc-42ff-aa91-568a56f5e598 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.550210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.550714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.551158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.551871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:06.552334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:06.552779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:06.578104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4506fbd-05cc-42ff-aa91-568a56f5e598 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.044011 Oct 28 10:00:06.592181 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1254/2549] 10.222.0.16 () {58 vars in 1169 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:06.617838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5ff4c98-fa4e-4a99-9ce8-4e8e67a7cc91 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.645125 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5ff4c98-fa4e-4a99-9ce8-4e8e67a7cc91 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.034563 Oct 28 10:00:06.646251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1255/2550] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:06.666959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04167cc1-0357-470e-8913-a4d7e065fd8c tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.691162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-04167cc1-0357-470e-8913-a4d7e065fd8c tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.032770 Oct 28 10:00:06.692872 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1256/2551] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:00:06.709991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4faf6404-22dc-4db9-a449-ee069ea26297 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.786311 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4faf6404-22dc-4db9-a449-ee069ea26297 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.081729 Oct 28 10:00:06.788568 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1257/2552] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:06.811169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e39b00a-4ef4-41b0-8b56-a3b3374a72a0 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.832388 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e39b00a-4ef4-41b0-8b56-a3b3374a72a0 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028808 Oct 28 10:00:06.834316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1258/2553] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:00:06.850946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-978dac6f-4c2f-489f-b908-73da2582df7b tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.882051 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-978dac6f-4c2f-489f-b908-73da2582df7b tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.039755 Oct 28 10:00:06.883366 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1259/2554] 10.222.0.16 () {58 vars in 1144 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:06.900857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00520184-7561-4da0-8174-0257773b8648 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.907185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:06.920364 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-00520184-7561-4da0-8174-0257773b8648 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025469 Oct 28 10:00:06.922114 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-078d7cfe-ac3b-494e-ae96-150826725dd6 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1681 microversion: 2.1 time: 0.405138 Oct 28 10:00:06.922254 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1260/2555] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:00:06.930859 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1296/2556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1681 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:06.957182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b4f17b3-985b-4cc6-914f-47344f87344e tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:06.979379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:06.983897 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b4f17b3-985b-4cc6-914f-47344f87344e tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.031807 Oct 28 10:00:06.995332 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1261/2557] 10.222.0.16 () {58 vars in 1148 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:07.001184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5df20a08-180a-4e13-9ad9-c64d93af384e tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:07.008760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:07.011382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:07.048438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:07.049851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:07.051768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:07.052755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:07.053268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:07.053709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:07.055349 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5df20a08-180a-4e13-9ad9-c64d93af384e tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.058774 Oct 28 10:00:07.065539 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1297/2558] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 10:00:06 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:00:07.079237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe23f580-d2ac-4c37-826a-51a8cdade8de tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:07.095791 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe23f580-d2ac-4c37-826a-51a8cdade8de tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028425 Oct 28 10:00:07.096963 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1298/2559] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:07.120268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:07.121190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:07.158067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:07.158565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:07.164842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:07.169179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:07.169913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:07.170614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:07.434321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:07.445523 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a1430a8-f935-4f2b-8b3d-1add7797665e tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1316 microversion: 2.1 time: 0.443025 Oct 28 10:00:07.449841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1262/2560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:07 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1316 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:07.458540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-58983dcd-78fd-421f-a299-036e8e7715eb tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:07.577488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:07.593806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:07.599096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:07.602911 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-067b1a29-04fc-4cff-bcd3-64ccae35c9c0 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.504739 Oct 28 10:00:07.605136 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1299/2561] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:07 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:07.614654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:07.619933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:07.641085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:07.643321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:07.645783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:07.646899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:07.665657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:07.668176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:07.838772 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-58983dcd-78fd-421f-a299-036e8e7715eb tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.384756 Oct 28 10:00:07.850224 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1263/2562] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:00:07 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:07.850224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23cbe80b-848a-40e0-afa0-9cf9c37a2da2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca326174c0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:08.352734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:08.366504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:08.369847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:08.374094 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8299e2e0-eed5-4d2d-ba39-98cd1bb8986f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1745 microversion: 2.20 time: 0.766704 Oct 28 10:00:08.377872 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1300/2563] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:07 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1745 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:08.384431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:08.389267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:08.403320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:08.409867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:08.410551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:08.411781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:08.412259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:08.412760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:08.612410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:08.626489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:08.627971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:08.646264 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-33783cac-29a6-44db-8f15-6e9c67dc1bc8 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.266779 Oct 28 10:00:08.646874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1301/2564] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:08 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:08.657256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-811c1d71-0c34-4e09-a319-2388fa7cf8d1 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:08.692039 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-811c1d71-0c34-4e09-a319-2388fa7cf8d1 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044005 Oct 28 10:00:08.706321 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1302/2565] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:00:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:08.711487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:08.713076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:08.719849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:08.720628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:08.721325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:08.722288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:08.725439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:08.726120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:10.333895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:10.372678 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d407bb73-ae7b-43a5-811c-fc7103fe29b8 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1681 microversion: 2.1 time: 1.659402 Oct 28 10:00:10.393899 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1303/2566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:08 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1681 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:10.447953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:10.455724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:10.485085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:10.488451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:10.489908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:10.496701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:10.505037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:10.513127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:11.263463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:11.295078 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85a08e57-2183-4af1-956e-d745224c10a3 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1316 microversion: 2.1 time: 0.877441 Oct 28 10:00:11.295687 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1304/2567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:10 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1316 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:11.338240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:11.338858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:11.388611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:11.389557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:11.390162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:11.391036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:11.396118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:11.396793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:11.451646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:11.571835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:12.185415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.194842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.196328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.207007 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-969046f7-f086-4f57-bce6-f86da62b0a9c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.875306 Oct 28 10:00:12.207840 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1305/2568] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:11 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:12.216365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f186e962-5f9c-43fb-b92e-72214ccbe7f8 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:12.255075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f186e962-5f9c-43fb-b92e-72214ccbe7f8 tempest-FlavorsV2TestJSON-2075576992 tempest-FlavorsV2TestJSON-2075576992-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.043813 Oct 28 10:00:12.266705 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1306/2569] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:12.286291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:12.287295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:12.301060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:12.301960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:12.302635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:12.304346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:12.305885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:12.306820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:12.619634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.636624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.647672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.651521 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f76b0b16-e594-472d-a17c-3b780459a8fb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.383153 Oct 28 10:00:12.667806 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1307/2570] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:12 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:12.667806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:12.668805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:12.702128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:12.708243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:12.710235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:12.716068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:12.719691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:12.722215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:12.934827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.944514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.947202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:12.953175 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef2a0237-956b-44a8-bdd2-8d7d4d84c0f2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.299290 Oct 28 10:00:12.972939 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1308/2571] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:12 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:12.975440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ec97598a-ca48-4541-85e2-527107595100 req-100640ff-8325-4b77-a490-cb96895c3f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97720d58-c735-4f4c-923c-8de1508c14af", "name": "network-vif-plugged", "status": "completed", "tag": "8c4cf8ae-960d-42bc-a63b-7c599e875c1e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:13.020073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ec97598a-ca48-4541-85e2-527107595100 req-100640ff-8325-4b77-a490-cb96895c3f2c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:13.022066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ec97598a-ca48-4541-85e2-527107595100 req-100640ff-8325-4b77-a490-cb96895c3f2c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:13.026045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ec97598a-ca48-4541-85e2-527107595100 req-100640ff-8325-4b77-a490-cb96895c3f2c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:13.060872 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ec97598a-ca48-4541-85e2-527107595100 req-100640ff-8325-4b77-a490-cb96895c3f2c service nova] Creating event network-vif-plugged:8c4cf8ae-960d-42bc-a63b-7c599e875c1e for instance 97720d58-c735-4f4c-923c-8de1508c14af on n-h1-zed-1 Oct 28 10:00:13.068968 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ec97598a-ca48-4541-85e2-527107595100 req-100640ff-8325-4b77-a490-cb96895c3f2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105061 Oct 28 10:00:13.070159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1309/2572] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:13.077217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:13.081516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:13.112050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:13.113644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:13.115449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:13.117424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:13.118750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:13.121179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:13.311377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:13.312052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:13.313836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:13.314565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lazy-loading 'fault' on Instance uuid 40c22437-c39a-4889-bb0d-56bb97a135ea {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:00:13.497142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2706dd9c4f24a41a1e990c0517b792e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa7146c7cb464ce99ad2f6593f0ebb0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:13.520169 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca70a278-52f1-4967-8b50-c5ebc0b6567c tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 200 len: 1331 microversion: 2.1 time: 0.436257 Oct 28 10:00:13.521027 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1310/2573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:13 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 1331 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:13.549196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c55d82d5-d681-425c-93d6-e51835427be0 req-33a0026c-26c5-424e-ac95-0609c33be621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40c22437-c39a-4889-bb0d-56bb97a135ea", "name": "network-vif-deleted", "tag": "7e04bab9-b1e8-431c-b7c3-915d16d255fe"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:13.615127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c55d82d5-d681-425c-93d6-e51835427be0 req-33a0026c-26c5-424e-ac95-0609c33be621 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:13.615802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c55d82d5-d681-425c-93d6-e51835427be0 req-33a0026c-26c5-424e-ac95-0609c33be621 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:13.617488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c55d82d5-d681-425c-93d6-e51835427be0 req-33a0026c-26c5-424e-ac95-0609c33be621 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:13.656280 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c55d82d5-d681-425c-93d6-e51835427be0 req-33a0026c-26c5-424e-ac95-0609c33be621 service nova] Creating event network-vif-deleted:7e04bab9-b1e8-431c-b7c3-915d16d255fe for instance 40c22437-c39a-4889-bb0d-56bb97a135ea on n-h2-zed-1 Oct 28 10:00:13.680084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c55d82d5-d681-425c-93d6-e51835427be0 req-33a0026c-26c5-424e-ac95-0609c33be621 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142816 Oct 28 10:00:13.683607 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1311/2574] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:13.696712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:13.698784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:13.716082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:13.724865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:13.729362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:13.731843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:13.733159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:13.735263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:13.736440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:14.144637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:14.162716 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d46bc0fe-6797-4237-83e3-bb4e50aa5629 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1316 microversion: 2.1 time: 0.475287 Oct 28 10:00:14.163486 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1312/2575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:13 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1316 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:14.181267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:14.182129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:14.193131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:14.193775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:14.194234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:14.194958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:14.195423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:14.195894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:14.497761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:14.519255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:14.528387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:14.543329 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-17269a61-f158-42a7-b086-9d8ef36278b2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.371244 Oct 28 10:00:14.550624 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1313/2576] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:14 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:14.558801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:14.559444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:14.612676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:14.613214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:14.613669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:14.614404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:14.614866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:14.615301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:15.655333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:15.677857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:15.681852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:15.685943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-458909b7-d875-4282-9746-839d8ded95bb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 1.133437 Oct 28 10:00:15.704463 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1314/2577] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:14 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:15.733983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:15.735085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:15.749361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:15.750101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:15.752316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:15.753268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:15.755452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:15.756073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:15.976696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:15.993927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:16.014464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:16.035603 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4359ebea-df31-4e87-b17e-6f8bd2bea054 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.317207 Oct 28 10:00:16.050520 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1315/2578] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:15 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:16.068071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:16.081396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] [instance: 40c22437-c39a-4889-bb0d-56bb97a135ea] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:16.095509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:16.096243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:16.096829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:16.098282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:16.098907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:16.099524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:16.129788 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] HTTP exception thrown: Instance 40c22437-c39a-4889-bb0d-56bb97a135ea could not be found. Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Request method failure captured: Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea HTTP/1.1 Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6dbsmBL3RidMEyomNAp27AR5YjtMARAGgV9PLloZpJx93aP8jJLVdvAdtKHl8dwkQe-F5bJBALo5I2UaUXQDuYfOvMmCn0n0g1ZBl02ghb334sIonLjYWvbQhAKZmvr8zNJ3wEtu-vDRTA58CqOGMzPum0rnZXVpjAT28qoH3zvGKg Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: aa7146c7cb464ce99ad2f6593f0ebb0b Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesAdminNegativeTest-1836362498 Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:00:16.134881 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa7146c7cb464ce99ad2f6593f0ebb0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/aa7146c7cb464ce99ad2f6593f0ebb0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_aa7146c7cb464ce99ad2f6593f0ebb0b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/aa7146c7cb464ce99ad2f6593f0ebb0b"}]}] Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesAdminNegativeTest-1836362498 Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: aa7146c7cb464ce99ad2f6593f0ebb0b Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1836362498 Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesAdminNegativeTest-1836362498-project Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b2706dd9c4f24a41a1e990c0517b792e Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesAdminNegativeTest-1836362498-project Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 40c22437-c39a-4889-bb0d-56bb97a135ea could not be found. Oct 28 10:00:16.136151 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '40c22437-c39a-4889-bb0d-56bb97a135ea'} Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40c22437-c39a-4889-bb0d-56bb97a135ea could not be found. Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:00:16.136812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40c22437-c39a-4889-bb0d-56bb97a135ea could not be found. Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40c22437-c39a-4889-bb0d-56bb97a135ea could not be found. Oct 28 10:00:16.137916 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:16.150641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Returning 404 to user: Instance 40c22437-c39a-4889-bb0d-56bb97a135ea could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:00:16.155272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15fcc2e9-397d-4983-a40d-e39d05857fa2 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea" status: 404 len: 111 microversion: 2.1 time: 0.090562 Oct 28 10:00:16.156412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1316/2579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:16 2022] GET /compute/v2.1/servers/40c22437-c39a-4889-bb0d-56bb97a135ea => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:16.167137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:16.168241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:16.185017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:16.186026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:16.186708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:16.192140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:16.193002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:16.193652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:16.868197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:16.878247 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-115e9811-1e15-4846-b0bc-aad037ddfe88 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1505 microversion: 2.1 time: 0.720386 Oct 28 10:00:16.879424 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1317/2580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:16 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1505 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:16.884800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-af24af3e-2732-4983-a160-09c665077197 req-cfaa9d98-d6c9-43a5-bcab-bc755f8bbf35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7831b2e-dc40-4e1b-981b-94cb7d1736f0", "name": "network-vif-plugged", "status": "completed", "tag": "a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:16.918880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-af24af3e-2732-4983-a160-09c665077197 req-cfaa9d98-d6c9-43a5-bcab-bc755f8bbf35 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:16.926583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-af24af3e-2732-4983-a160-09c665077197 req-cfaa9d98-d6c9-43a5-bcab-bc755f8bbf35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:16.930210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-af24af3e-2732-4983-a160-09c665077197 req-cfaa9d98-d6c9-43a5-bcab-bc755f8bbf35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:16.985811 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-af24af3e-2732-4983-a160-09c665077197 req-cfaa9d98-d6c9-43a5-bcab-bc755f8bbf35 service nova] Creating event network-vif-plugged:a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a for instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 on n-h1-zed-1 Oct 28 10:00:17.008017 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-af24af3e-2732-4983-a160-09c665077197 req-cfaa9d98-d6c9-43a5-bcab-bc755f8bbf35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127119 Oct 28 10:00:17.009423 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1318/2581] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:17.046426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:17.047313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:17.079877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:17.080725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:17.081490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:17.082461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:17.083133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:17.083777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:17.447751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:17.737151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:17.751137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:17.758571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:17.759819 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74ed9a1d-e1f6-4baf-9943-321e0156cf5b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.745665 Oct 28 10:00:17.773743 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1319/2582] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:17 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:17.784362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ee0e8e3-4401-4955-a123-41fd98f794b7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] Calling method '.version_select at 0x7fca3ba365e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:17.820437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=5 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:17.862814 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ee0e8e3-4401-4955-a123-41fd98f794b7 tempest-VolumesAdminNegativeTest-1836362498 tempest-VolumesAdminNegativeTest-1836362498-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234078248" status: 202 len: 0 microversion: 2.1 time: 0.093232 Oct 28 10:00:17.864232 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1320/2583] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:00:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1234078248 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:00:18.284663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce983a37-450e-431b-bae0-45241fb6ef1e tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:18.314350 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce983a37-450e-431b-bae0-45241fb6ef1e tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.435590 Oct 28 10:00:18.315638 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1321/2584] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:18.321402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:18.341900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:18.369822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:18.379661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:18.379940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:18.380701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:18.381191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:18.381685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:18.715814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:18.733708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:18.740798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:18.743404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a302da11-18d3-4980-bb35-8f6302be6c50 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.423707 Oct 28 10:00:18.745619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1322/2585] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:18 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:18.756545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:18.756874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:18.771661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:18.775898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:18.775898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:18.777175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:18.781881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:18.783144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:18.846833 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c4e406c-467b-45b7-9900-9e7b8118e4fa tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af/ips" status: 200 len: 109 microversion: 2.1 time: 0.100003 Oct 28 10:00:18.852982 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1323/2586] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:00:18 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af/ips => generated 109 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:18.862495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:18.866347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:18.886000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:18.887166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:18.887846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:18.902762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:18.903619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:18.904296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.055627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.072053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.075191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.082893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-05107131-4090-4afa-af5e-7d728bc6e42b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.228224 Oct 28 10:00:19.084160 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1324/2587] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:18 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:19.092722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:19.097173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:19.126795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.127713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.128210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.130296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.131344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.131796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.516675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.527058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.528552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:19.529772 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-615d5f0e-3e65-45b9-9e0e-91a97a701183 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.444391 Oct 28 10:00:19.537292 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1325/2588] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:19 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:19.549719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:19.550268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:19.565986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.566663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.566856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.567656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.568128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.568894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.633322 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-977e3fb2-58e0-4238-9a9e-3877fa6685b5 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af/ips" status: 200 len: 109 microversion: 2.1 time: 0.094625 Oct 28 10:00:19.661374 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1326/2589] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:00:19 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af/ips => generated 109 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:19.667344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:19.667848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:19.694022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.697634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.698278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.699165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.701179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.702920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.747694 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-139bbf84-d711-44ac-aaec-297c4ea1b00c tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af/ips/tempest-ServerAddressesTestJSON-200847877-network" status: 200 len: 94 microversion: 2.1 time: 0.085114 Oct 28 10:00:19.748879 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1327/2590] 10.222.0.16 () {58 vars in 1398 bytes} [Fri Oct 28 10:00:19 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af/ips/tempest-ServerAddressesTestJSON-200847877-network => generated 94 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:00:19.779331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:19.780836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:19.812025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.814476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.816128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.819138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:19.820225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:19.821747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:19.858339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:19.874916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:00:20.130033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-60a1afdd-e929-4558-ad34-7d49a16aac60 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 204 len: 0 microversion: 2.1 time: 0.372584 Oct 28 10:00:20.137795 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1328/2591] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:00:19 2022] DELETE /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:00:20.144729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:20.145283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:20.161485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:20.162019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:20.162737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:20.163465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:20.163921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:20.164348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:20.441257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:20.451286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:20.455602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:20.459314 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ebf2e7b-4648-4a0b-b391-b6d003be518b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.322679 Oct 28 10:00:20.478408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1329/2592] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:20 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:20.486618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:20.487671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:20.508340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:20.508847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:20.514853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:20.515625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:20.516094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:20.516528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:20.724761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:20.735334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:20.739758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:20.751938 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4480a49a-0f05-488f-8f01-42d17f60c4ad tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.271934 Oct 28 10:00:20.765955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1330/2593] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:20 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:20.776485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:20.779650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:20.801357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:20.801869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:20.802317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:20.803043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:20.803505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:20.803934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:21.109768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:21.124133 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4b2760bb-06dd-468d-94b9-fbf7d9203a6d tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1511 microversion: 2.1 time: 0.356765 Oct 28 10:00:21.126997 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1331/2594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:20 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1511 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:21.140457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:21.141626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:21.153216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:21.153778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:21.154273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:21.155096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:21.155658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:21.156204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:21.314181 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-23cbe80b-848a-40e0-afa0-9cf9c37a2da2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1432 microversion: 2.1 time: 13.473697 Oct 28 10:00:21.317238 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1264/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:07 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1432 bytes in 13477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:21.341284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f6968d63-87b4-48f1-9c18-b2b01968bf51 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca32716550>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:21.589908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:21.608237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:21.614749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:21.616450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e3f4438d-7f30-469b-bcce-ca79fcd0b5d3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.487981 Oct 28 10:00:21.619401 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1332/2596] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:21 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:21.661296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:21.661929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:21.677535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:21.678037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:21.678478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:21.679374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:21.680597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:21.681918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:22.250599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:22.295502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:22.303950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:22.314547 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1761f87c-b778-4ec5-899f-4059a0e0c71a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.686642 Oct 28 10:00:22.317219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1333/2597] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:21 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:22.337168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:22.339067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:22.379269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:22.380227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:22.381127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:22.382166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:22.382979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:22.384390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:22.714627 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f6968d63-87b4-48f1-9c18-b2b01968bf51 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 200 len: 1432 microversion: 2.1 time: 1.384518 Oct 28 10:00:22.727479 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1265/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:21 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 1432 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:22.744743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:22.745577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:22.758614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:22.760306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:22.762024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:22.764030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:22.766279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:22.767713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:22.821613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:22.835462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:22.840691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:22.877368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19d0e87a-d575-46dd-96c5-f9e2b8a91a07 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.557827 Oct 28 10:00:22.883514 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1334/2599] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:22 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:22.901756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:22.902742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:22.909510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:22.913870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:22.915532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:22.916548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:22.917142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:22.917678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:23.062873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b4bc09d609742b5b57d7e7fd6b47118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1b921cd14fb49308c16ce63d1120b1d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:23.103972 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-965ef6c1-79f1-4bb6-baa2-b95694ae3bb2 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 200 len: 1469 microversion: 2.1 time: 0.371262 Oct 28 10:00:23.116929 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1266/2600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:22 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 1469 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:23.130530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:23.133120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:23.184846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:23.186594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:23.188732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:23.192349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:23.192837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:23.196330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:23.566214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:23.608732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:23.619305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:23.628216 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52da529e-0b31-4585-926f-1b5241d9b323 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.737408 Oct 28 10:00:23.630256 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1335/2601] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:22 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:23.644095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4402679-cc6d-49fa-a74a-f071134e1e29 tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1897479838", "imageRef": "5208d049-d7c1-48d0-92f0-572ef64a7ee3", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:23.874829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:23.889706 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1a4a7220-c4ee-4a50-9bce-480fe7f38839 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1478 microversion: 2.1 time: 0.778428 Oct 28 10:00:23.906221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1267/2602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:23 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1478 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:23.916348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:23.919799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:23.937688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:23.943623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:23.944812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:23.946417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:23.947308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:23.948182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:25.180947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:25.193196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:25.196823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:25.198427 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-37d6e75f-d5e2-4149-acea-d4bf69e985d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 1.291002 Oct 28 10:00:25.199328 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1268/2603] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:23 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:25.205108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9a78abe1-3de7-4840-99cb-0c241dc2618a req-01c95341-ec74-4fe4-b7f3-5d2c0d34dcba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97720d58-c735-4f4c-923c-8de1508c14af", "name": "network-vif-deleted", "tag": "8c4cf8ae-960d-42bc-a63b-7c599e875c1e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:25.217733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9a78abe1-3de7-4840-99cb-0c241dc2618a req-01c95341-ec74-4fe4-b7f3-5d2c0d34dcba service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:25.218459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9a78abe1-3de7-4840-99cb-0c241dc2618a req-01c95341-ec74-4fe4-b7f3-5d2c0d34dcba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:25.219037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9a78abe1-3de7-4840-99cb-0c241dc2618a req-01c95341-ec74-4fe4-b7f3-5d2c0d34dcba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:25.232360 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9a78abe1-3de7-4840-99cb-0c241dc2618a req-01c95341-ec74-4fe4-b7f3-5d2c0d34dcba service nova] Creating event network-vif-deleted:8c4cf8ae-960d-42bc-a63b-7c599e875c1e for instance 97720d58-c735-4f4c-923c-8de1508c14af on n-h1-zed-1 Oct 28 10:00:25.251128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9a78abe1-3de7-4840-99cb-0c241dc2618a req-01c95341-ec74-4fe4-b7f3-5d2c0d34dcba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049681 Oct 28 10:00:25.251898 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1269/2604] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:25.260188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:25.261469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:25.273042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:25.281773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:25.282381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:25.283350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:25.283924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:25.284483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:25.461237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:25.476655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:25.476655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:25.507142 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c4a08c3c-142e-42a0-b3e3-020e35f6aa3b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.253833 Oct 28 10:00:25.515428 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1270/2605] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:25 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:25.520614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:25.541828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] [instance: 97720d58-c735-4f4c-923c-8de1508c14af] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:25.568450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:25.569375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:25.570020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:25.571496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:25.577361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:25.578253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:25.629346 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] HTTP exception thrown: Instance 97720d58-c735-4f4c-923c-8de1508c14af could not be found. Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Request method failure captured: Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af HTTP/1.1 Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6gYS_C45hEASeUuVg30fvjz-X-PgnV_UFH0YoTxc3FweiPSePwsl8bBq9kisuLSho9YblKdTmtRQPLLWOG5-e_HpH-YGzaJmUKZiYlTHgG7eYE_pWSDiaey6gjXjcv-D3Cgh_K7dT_lGZQ-CCVt3gIf0JaAy5ST0dAIphGtb_Jaa2g Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: c1b921cd14fb49308c16ce63d1120b1d Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerAddressesTestJSON-731179905 Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:00:25.631533 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1b921cd14fb49308c16ce63d1120b1d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c1b921cd14fb49308c16ce63d1120b1d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c1b921cd14fb49308c16ce63d1120b1d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c1b921cd14fb49308c16ce63d1120b1d"}]}] Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerAddressesTestJSON-731179905 Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: c1b921cd14fb49308c16ce63d1120b1d Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerAddressesTestJSON-731179905 Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerAddressesTestJSON-731179905-project Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2b4bc09d609742b5b57d7e7fd6b47118 Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerAddressesTestJSON-731179905-project Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 97720d58-c735-4f4c-923c-8de1508c14af could not be found. Oct 28 10:00:25.632779 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '97720d58-c735-4f4c-923c-8de1508c14af'} Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97720d58-c735-4f4c-923c-8de1508c14af could not be found. Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:00:25.634263 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97720d58-c735-4f4c-923c-8de1508c14af could not be found. Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97720d58-c735-4f4c-923c-8de1508c14af could not be found. Oct 28 10:00:25.635575 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:25.638324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] Returning 404 to user: Instance 97720d58-c735-4f4c-923c-8de1508c14af could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:00:25.639407 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eab093a6-2b72-4443-a720-cd77f9e72d02 tempest-ServerAddressesTestJSON-731179905 tempest-ServerAddressesTestJSON-731179905-project] 10.222.0.16 "GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af" status: 404 len: 111 microversion: 2.1 time: 0.122675 Oct 28 10:00:25.645717 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1271/2606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:25 2022] GET /compute/v2.1/servers/97720d58-c735-4f4c-923c-8de1508c14af => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:00:25.660985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:25.677875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:25.693738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:25.694536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:25.695174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:25.696129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:25.699576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:25.703969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:26.126993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:26.138387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:26.147086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:26.158400 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3d17faf5-8c94-4d26-8501-58e3f36abcec tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.511064 Oct 28 10:00:26.167133 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1272/2607] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:25 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:26.172595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:26.177455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:26.203567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:26.204883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:26.205867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:26.207278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:26.207886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:26.217204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:26.703495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:26.712920 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-08d96c98-55ed-416d-8111-0e69c91e6bc1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1465 microversion: 2.1 time: 0.544089 Oct 28 10:00:26.717822 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1273/2608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:26 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1465 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:27.155036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b2d5a12e-4c34-4db9-b6e7-62791f985388 tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] Action: 'create', calling method: .version_select at 0x7fca3275b0d0>, body: {"security_group": {"name": "tempest-securitygroup-810160385", "description": "tempest-description-447456277"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:29.530269 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b2d5a12e-4c34-4db9-b6e7-62791f985388 tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 2.807981 Oct 28 10:00:29.530975 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1274/2609] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:00:26 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 2813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:29.537855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:29.538736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:29.569817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:29.571808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:29.588878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:29.590528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:29.607572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:29.607968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:30.027676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:30.043189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:30.044799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:30.050016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-83c95615-4baf-4c45-bce4-d2d277d92e2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.517817 Oct 28 10:00:30.082249 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1275/2610] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:29 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:30.091793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:30.094749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:30.110518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:30.111385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:30.125793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:30.126918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:30.127610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:30.128246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:30.259772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:30.272898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:30.274946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:30.286261 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3e9fe2b6-d468-4e42-b018-74ef7befbdde tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1553 microversion: 2.91 time: 0.202330 Oct 28 10:00:30.309008 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1276/2611] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:30 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1553 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:30.318852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4272596f-f3b4-4f32-b92b-0d19561ae0a1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3272c310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:30.351159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b4402679-cc6d-49fa-a74a-f071134e1e29 tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:00:30.482482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4272596f-f3b4-4f32-b92b-0d19561ae0a1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/c7ac23d6-0e32-4a44-9d15-3c8a5df377c1" status: 200 len: 784 microversion: 2.1 time: 0.171458 Oct 28 10:00:30.493704 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1277/2612] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:30 2022] GET /compute/v2.1/images/c7ac23d6-0e32-4a44-9d15-3c8a5df377c1 => generated 784 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:30.504001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:30.504749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:30.516793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:30.518062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:30.518735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:30.519852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:30.520685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:30.521639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:31.021210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:31.040243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:31.045117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:31.050263 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a714770-660e-4dbd-8d30-9b4e11cbabdf tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.556857 Oct 28 10:00:31.051186 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1278/2613] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:30 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:31.072886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-10962576-4214-4d19-9603-f8f4520cfa17 req-085aac7e-8f95-4b8c-a451-700ad6b6a61d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5baa6d-2dce-4a40-8e01-11209f47b532", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:31.128567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-10962576-4214-4d19-9603-f8f4520cfa17 req-085aac7e-8f95-4b8c-a451-700ad6b6a61d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:31.129833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-10962576-4214-4d19-9603-f8f4520cfa17 req-085aac7e-8f95-4b8c-a451-700ad6b6a61d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:31.131247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-10962576-4214-4d19-9603-f8f4520cfa17 req-085aac7e-8f95-4b8c-a451-700ad6b6a61d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:31.166435 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-10962576-4214-4d19-9603-f8f4520cfa17 req-085aac7e-8f95-4b8c-a451-700ad6b6a61d service nova] Creating event network-vif-unplugged:6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53 for instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 on n-h2-zed-1 Oct 28 10:00:31.184887 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-10962576-4214-4d19-9603-f8f4520cfa17 req-085aac7e-8f95-4b8c-a451-700ad6b6a61d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126253 Oct 28 10:00:31.187282 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1279/2614] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:31.202111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-036bbbb6-b409-4517-99e8-cef5b318d94f tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] Action: 'create', calling method: .version_select at 0x7fca3275b3a0>, body: {"security_group": {"name": "tempest-securitygroup-500532576", "description": "tempest-description-1828168339"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:31.477658 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b4402679-cc6d-49fa-a74a-f071134e1e29 tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4402679-cc6d-49fa-a74a-f071134e1e29 tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] Request method failure captured: Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 143 Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6gwg-BBdL1SjIchk7MvkuB7oMLOYXj0yCpq1xdVckLQkHRq9XX-gtLMTn_OWwME_huWqswyk_TU-1AbmZoKJTzmr65k8yErlNE0t_Vwum5RnuYEZ07ZQ04_tRUoePPuTD6Irt2nFq3qaF7zJ36MYGPCSiSWC-2oyGI6l7z6UXFfxZk Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 62cc361b65c04697b7c9b850ed2374d9 Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FlavorsV2NegativeTest-54291000 Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:00:31.488128 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62cc361b65c04697b7c9b850ed2374d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/62cc361b65c04697b7c9b850ed2374d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_62cc361b65c04697b7c9b850ed2374d9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/62cc361b65c04697b7c9b850ed2374d9"}]}] Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FlavorsV2NegativeTest-54291000 Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 62cc361b65c04697b7c9b850ed2374d9 Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-54291000 Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FlavorsV2NegativeTest-54291000-project Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a721f00ecff14a01b2b7a600581eafe9 Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FlavorsV2NegativeTest-54291000-project Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1897479838", "imageRef": "5208d049-d7c1-48d0-92f0-572ef64a7ee3", "flavorRef": "452"}} Oct 28 10:00:31.489755 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: exception: Flavor's memory is too small for requested image. Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1897479838', 'imageRef': '5208d049-d7c1-48d0-92f0-572ef64a7ee3', 'flavorRef': '452'}}} Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:31.490490 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:31.491815 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:31.494026 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:31.494026 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:31.494026 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:00:31.494026 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:00:31.494026 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 28 10:00:31.494026 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:00:31.495963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4402679-cc6d-49fa-a74a-f071134e1e29 tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:00:31.497796 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4402679-cc6d-49fa-a74a-f071134e1e29 tempest-FlavorsV2NegativeTest-54291000 tempest-FlavorsV2NegativeTest-54291000-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 7.863875 Oct 28 10:00:31.508762 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1336/2615] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:00:23 2022] POST /compute/v2.1/servers => generated 93 bytes in 7866 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:00:31.522551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83d833e2-7a97-4696-8d6e-d0d2f1d54364 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:31.540488 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83d833e2-7a97-4696-8d6e-d0d2f1d54364 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029263 Oct 28 10:00:31.551140 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1337/2616] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:00:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:31.567447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:31.570038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:31.603403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:31.605528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:31.609969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:31.612707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:31.614299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:31.615157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:32.052692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-036bbbb6-b409-4517-99e8-cef5b318d94f tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.861219 Oct 28 10:00:32.053427 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1280/2617] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:00:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:32.059491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:32.060450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:32.078542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:32.094151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:32.097732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:32.099992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:32.100672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:32.103308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:32.196306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:32.230063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:32.235839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:32.238338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d147cd1e-aa45-45d6-a07b-8881218235a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.685828 Oct 28 10:00:32.239176 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1338/2618] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:31 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:32.246876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52330b67-ee63-4572-98f6-31c26becffb1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b989e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:32.316944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:32.331468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:32.338474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:32.344797 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c8812b7f-532b-46d8-8505-a5bcf5ab4ab2 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1535 microversion: 2.91 time: 0.289345 Oct 28 10:00:32.371437 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1281/2619] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:32 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1535 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:32.531386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-623528f6-7c14-4387-8e78-9a1ebfec1522 tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Action: 'create', calling method: .version_select at 0x7fca326faa60>, body: {"security_group": {"name": "tempest-securitygroup-2074255682", "description": "tempest-description-44467082"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:33.416070 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52330b67-ee63-4572-98f6-31c26becffb1 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "DELETE /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 204 len: 0 microversion: 2.1 time: 1.174641 Oct 28 10:00:33.417901 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1339/2620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:00:32 2022] DELETE /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 0 bytes in 1178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:00:33.427233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:33.428584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:33.446850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:33.448645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:33.449320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:33.453719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:33.455284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:33.456738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:33.736329 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-623528f6-7c14-4387-8e78-9a1ebfec1522 tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.363337 Oct 28 10:00:33.750185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1282/2621] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:00:32 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:33.758871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a721be51-c99b-4861-8251-2846b347ac77 req-90e601ee-3150-4d1d-9d32-7e1dc2d1b9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab", "name": "network-vif-unplugged", "status": "completed", "tag": "fa96b0ac-478a-4896-b414-e05f78c6fcea"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:33.784234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a721be51-c99b-4861-8251-2846b347ac77 req-90e601ee-3150-4d1d-9d32-7e1dc2d1b9a4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:33.788157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a721be51-c99b-4861-8251-2846b347ac77 req-90e601ee-3150-4d1d-9d32-7e1dc2d1b9a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:33.788888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a721be51-c99b-4861-8251-2846b347ac77 req-90e601ee-3150-4d1d-9d32-7e1dc2d1b9a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:33.806429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a721be51-c99b-4861-8251-2846b347ac77 req-90e601ee-3150-4d1d-9d32-7e1dc2d1b9a4 service nova] Creating event network-vif-unplugged:fa96b0ac-478a-4896-b414-e05f78c6fcea for instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab on n-h1-zed-1 Oct 28 10:00:33.816380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a721be51-c99b-4861-8251-2846b347ac77 req-90e601ee-3150-4d1d-9d32-7e1dc2d1b9a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064312 Oct 28 10:00:33.817463 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1283/2622] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:33.824126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:33.825844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:33.835710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:33.837279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:33.837966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:33.839500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:33.841174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:33.842203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:34.175076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.192565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.194130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.217185 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef4a1ebe-f9f2-42df-bd6e-a3e7c56eee68 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.391497 Oct 28 10:00:34.217869 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1284/2623] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:33 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:34.252120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:34.252769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:34.280266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:34.281159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:34.281842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:34.282768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:34.283682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:34.284320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:34.402301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.420169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.422324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.438812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec6a3f5f-caaa-4c1e-9421-a1b8f6d4d4da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1538 microversion: 2.91 time: 0.196283 Oct 28 10:00:34.458079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.471711 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1285/2624] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:34 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1538 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:34.475886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.478286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:34.478588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fca8229-42e8-4b7f-9e60-1c114d4057f4 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca33eb0ca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:34.483052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6937f204-e56a-4f1f-8d03-e9a700394c6d tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 1.060924 Oct 28 10:00:34.484116 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1340/2625] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:33 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:34.504787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7fc1b76-d92c-4a99-abc2-d0d7288fb8d6 tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Action: 'create', calling method: .version_select at 0x7fca3b9344c0>, body: {"security_group": {"name": "tempest-securitygroup-2063442654", "description": "tempest-description-1083145648"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:34.526891 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4fca8229-42e8-4b7f-9e60-1c114d4057f4 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] HTTP exception thrown: Image not found. Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fca8229-42e8-4b7f-9e60-1c114d4057f4 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Request method failure captured: Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b HTTP/1.1 Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6f6MG6C8KLuWoomI-QRv3TD9z95Bsxs9x7V0er0u4YFcDeYEhm107lrs6AFJ5OvjCWN8mS857qeZ-4aSZv3nsObmJ2tVD7fw9ru-i4qG6YGukIGxI6-4i9tmuKHlv2XNFuOPIVu6Pk73S59teNaqzMLWsSWnXyEAPI3Oqlth81uwBQ Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: fd976570de164b69b58bfae7d4379e26 Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:00:34.532255 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd976570de164b69b58bfae7d4379e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd976570de164b69b58bfae7d4379e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd976570de164b69b58bfae7d4379e26", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd976570de164b69b58bfae7d4379e26"}]}] Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: fd976570de164b69b58bfae7d4379e26 Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerTestJSON-1675285825-project Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 4ec2ec5910404cc9aa621b4998b067bd Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerTestJSON-1675285825-project Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '8b02871a-2b4c-45bb-be7a-c8c93c07e67b'} Oct 28 10:00:34.533631 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:00:34.534394 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8b02871a-2b4c-45bb-be7a-c8c93c07e67b Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:00:34.535630 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b02871a-2b4c-45bb-be7a-c8c93c07e67b could not be found. Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:00:34.536727 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:00:34.537821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:00:34.541222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fca8229-42e8-4b7f-9e60-1c114d4057f4 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:00:34.542647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4fca8229-42e8-4b7f-9e60-1c114d4057f4 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 404 len: 62 microversion: 2.1 time: 0.069005 Oct 28 10:00:34.547251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1286/2626] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:34 2022] GET /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 62 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:00:34.558563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:34.565735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:34.583517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:34.584444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:34.588301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:34.590719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:34.592097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:34.592822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:34.724683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-zed-1". {{(pid=128748) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 10:00:34.806861 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f9c7e34-d3b6-4512-8d6b-987a2c91ee17 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action" status: 202 len: 0 microversion: 2.91 time: 0.259894 Oct 28 10:00:34.808691 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1287/2627] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 10:00:34 2022] POST /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:00:34.815389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-598553995"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:34.818567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:34.833120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:34.833925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:34.834587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:34.835573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:34.836349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:34.837115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:34.880733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:35.350762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07c5e324-31d8-4049-8fbd-719e2040773d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "POST /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532/action" status: 202 len: 0 microversion: 2.1 time: 0.521631 Oct 28 10:00:35.354098 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1288/2628] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:00:34 2022] POST /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:00:35.363723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:35.364744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:35.374287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:35.374925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:35.375480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:35.376304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:35.376876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:35.377447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:35.530914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:35.541861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:35.545288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:35.551632 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-306ff5f1-7606-4851-8c26-4a3c66d980bd tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1486 microversion: 2.91 time: 0.194262 Oct 28 10:00:35.552787 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1289/2629] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:35 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1486 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:35.558398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:35.559897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:35.576834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:35.577788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:35.578456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:35.579401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:35.580092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:35.581136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:36.027184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.042758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.047827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.049132 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf7d8ac5-b563-4d80-93ba-692783ccbe9d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.495063 Oct 28 10:00:36.049723 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1290/2630] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:35 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:36.070518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e30924e3-2b2e-4819-968b-958d8dccac5d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3270c940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:36.192123 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e30924e3-2b2e-4819-968b-958d8dccac5d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 0.139543 Oct 28 10:00:36.193992 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1291/2631] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:36 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:36.202279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:36.203171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:36.210885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:36.212675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:36.213462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:36.215341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:36.216944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:36.218536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:36.357445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7fc1b76-d92c-4a99-abc2-d0d7288fb8d6 tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.872056 Oct 28 10:00:36.358717 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1341/2632] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:00:34 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:36.365904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-73ddc02c-1815-4a8c-b513-feb738e405e7 req-c285858e-aa39-4506-a00f-27bb20f7fb08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab", "tag": "fa96b0ac-478a-4896-b414-e05f78c6fcea"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:36.404519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-73ddc02c-1815-4a8c-b513-feb738e405e7 req-c285858e-aa39-4506-a00f-27bb20f7fb08 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:36.405164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-73ddc02c-1815-4a8c-b513-feb738e405e7 req-c285858e-aa39-4506-a00f-27bb20f7fb08 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:36.405622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-73ddc02c-1815-4a8c-b513-feb738e405e7 req-c285858e-aa39-4506-a00f-27bb20f7fb08 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:36.450921 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-73ddc02c-1815-4a8c-b513-feb738e405e7 req-c285858e-aa39-4506-a00f-27bb20f7fb08 service nova] Creating event network-changed:fa96b0ac-478a-4896-b414-e05f78c6fcea for instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab on n-h1-zed-1 Oct 28 10:00:36.469114 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-73ddc02c-1815-4a8c-b513-feb738e405e7 req-c285858e-aa39-4506-a00f-27bb20f7fb08 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108951 Oct 28 10:00:36.473099 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1342/2633] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:36.484192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Calling method '.version_select at 0x7fca3b9744c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:36.560115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.573553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.575483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.576275 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5365c17b-fd0e-4a00-b736-95dca6a9c5c3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.380639 Oct 28 10:00:36.576841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1292/2634] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:36 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:36.616855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:36.617509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:36.644953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:36.645461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:36.649089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:36.655794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:36.658849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:36.661784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:36.885573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.898664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.900408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:36.920053 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1496521b-8dd6-43be-8d7c-b9d0e25f8d3e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.326628 Oct 28 10:00:36.933242 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1293/2635] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:36 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:37.081124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:37.082373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:37.095768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:37.101802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:37.102960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:37.104066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:37.104690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:37.105337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:37.469182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:37.482792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:37.485976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:37.488547 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71b4173f-a87b-4505-890d-3859e25f6b31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.414272 Oct 28 10:00:37.489762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1294/2636] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:37 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:00:37.521835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5772c4cb-da24-4bc7-b730-d761657f3358 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3265c160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:38.197450 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5772c4cb-da24-4bc7-b730-d761657f3358 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 0.706006 Oct 28 10:00:38.208443 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1295/2637] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:37 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:38.230454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:38.234666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:38.271047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:38.272621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:38.273324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:38.275655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:38.277258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:38.277953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:38.617928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:38.627593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:38.635014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:38.638138 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b9edf76d-029a-422b-a37d-496559c88a59 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.426082 Oct 28 10:00:38.640485 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1296/2638] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:38 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:38.653281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:38.654247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:38.668514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:38.669395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:38.669945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:38.671019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:38.671769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:38.673083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:38.862175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:38.880021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:38.882712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:38.897036 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd0ce7ef-8487-4ab7-8e9e-6928f0253981 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.254997 Oct 28 10:00:38.900485 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1297/2639] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:38 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:38.907421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f9f0a42-9605-4939-ac4b-6ebb9e854394 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca326ba5e0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:39.027489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8f9f0a42-9605-4939-ac4b-6ebb9e854394 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab" status: 200 len: 637 microversion: 2.1 time: 0.125624 Oct 28 10:00:39.028764 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1298/2640] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:38 2022] GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab => generated 637 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:39.034569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:39.035604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:39.043131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:39.043891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:39.044704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:39.045854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:39.046539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:39.047170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:39.646361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:39.659585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:39.672759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:39.675603 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2c1070bb-465e-4d6f-98ee-e5801d667428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1740 microversion: 2.20 time: 0.645188 Oct 28 10:00:39.690232 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1299/2641] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:39 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1740 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:39.701394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-adfb11a9-d2fb-44d3-8e0a-80e18984e016 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update_all', calling method: .version_select at 0x7fca32793f70>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:40.910035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b7116ee-87f0-4d37-8f96-3a2b67c89c15 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:00:40.911589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Neutron security group 7b7116ee-87f0-4d37-8f96-3a2b67c89c15 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 10:00:40.912301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.security_groups [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Security Group ID 7b7116ee-87f0-4d37-8f96-3a2b67c89c15 does not exist {{(pid=128747) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 28 10:00:40.995214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7b7116ee-87f0-4d37-8f96-3a2b67c89c15 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:00:40.997369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Neutron security group 7b7116ee-87f0-4d37-8f96-3a2b67c89c15 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 10:00:40.998060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.security_groups [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Security Group ID 7b7116ee-87f0-4d37-8f96-3a2b67c89c15 does not exist {{(pid=128747) _format_security_group_rule /opt/stack/nova/nova/api/openstack/compute/security_groups.py:75}} Oct 28 10:00:42.996644 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-06b5a8c6-b561-49ce-9a9a-8d530c814a0b tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 9786 microversion: 2.1 time: 6.521793 Oct 28 10:00:42.997702 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1343/2642] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 10:00:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 9786 bytes in 6524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:43.002686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-789065c0-4027-41d6-a6b3-76570fa55a15 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b99d3a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:46.400201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:46.419676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:46.762071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-adfb11a9-d2fb-44d3-8e0a-80e18984e016 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:00:46.772412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-adfb11a9-d2fb-44d3-8e0a-80e18984e016 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:00:46.781729 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-789065c0-4027-41d6-a6b3-76570fa55a15 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 3.782313 Oct 28 10:00:46.783944 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1344/2643] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:42 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 3786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:46.807258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:46.809745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:46.835177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:46.838411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:46.840589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:46.845566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:46.846254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:46.850843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:47.542233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:47.552518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:47.553478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:47.554834 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-227196e8-da74-4fef-b57a-ce2ed1da59ef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1486 microversion: 2.25 time: 0.766467 Oct 28 10:00:47.577324 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1345/2644] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:46 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1486 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:47.590968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:47.591600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:47.622905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:47.623412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:47.623866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:47.624582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:47.625114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:47.625556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:47.925199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:47.934146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:47.935596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:47.991524 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8e45b15-09d9-4394-b64d-6e2dec345c9b tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.410845 Oct 28 10:00:47.992154 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1346/2645] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:47 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:48.014996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:48.021215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:48.052209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:48.058712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:48.060100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:48.061768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:48.064803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:48.066432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:48.740823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:48.762402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:48.771649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:48.772961 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-16a2d42c-8375-496f-8c8a-1f329745400d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1722 microversion: 2.20 time: 0.775135 Oct 28 10:00:48.784080 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1347/2646] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:47 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1722 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:48.789356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f5141fd5-a879-4602-8faa-223b5f757af9 req-2f92e0e8-15a5-446a-9db8-60e60ac65605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5baa6d-2dce-4a40-8e01-11209f47b532", "name": "network-vif-plugged", "status": "completed", "tag": "6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:48.843953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f5141fd5-a879-4602-8faa-223b5f757af9 req-2f92e0e8-15a5-446a-9db8-60e60ac65605 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:48.845240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f5141fd5-a879-4602-8faa-223b5f757af9 req-2f92e0e8-15a5-446a-9db8-60e60ac65605 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:48.845904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f5141fd5-a879-4602-8faa-223b5f757af9 req-2f92e0e8-15a5-446a-9db8-60e60ac65605 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:48.884574 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f5141fd5-a879-4602-8faa-223b5f757af9 req-2f92e0e8-15a5-446a-9db8-60e60ac65605 service nova] Creating event network-vif-plugged:6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53 for instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 on n-h2-zed-1 Oct 28 10:00:48.916008 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f5141fd5-a879-4602-8faa-223b5f757af9 req-2f92e0e8-15a5-446a-9db8-60e60ac65605 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130198 Oct 28 10:00:48.919057 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1348/2647] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:48.930078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a77ebfa-dc51-4484-a744-291f80868586 tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] Calling method '.version_select at 0x7fca3b974a60>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:49.651193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:50.466838 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a77ebfa-dc51-4484-a744-291f80868586 tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 1.546389 Oct 28 10:00:50.467866 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1349/2648] 10.222.0.16 () {58 vars in 1191 bytes} [Fri Oct 28 10:00:48 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:50.472615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d1444c4-2f85-47aa-866b-8eb6a22a9098 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b943310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:56.796579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:56.811487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=78 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:00:57.564109 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-adfb11a9-d2fb-44d3-8e0a-80e18984e016 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 61 microversion: 2.1 time: 17.873199 Oct 28 10:00:57.564721 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1300/2649] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:00:39 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 61 bytes in 17874 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:00:57.584735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:57.589197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:57.590680 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d1444c4-2f85-47aa-866b-8eb6a22a9098 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 7.121594 Oct 28 10:00:57.607455 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1350/2650] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:50 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 7139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:57.612401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:57.613187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:57.616989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:57.618127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:57.618578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:57.619313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:57.619801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:57.622905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:57.634190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:57.634705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:57.635154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:57.635892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:57.636357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:57.636795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:57.759651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:57.770149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:57.772506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:57.779975 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aec36875-12f7-4517-8f08-6008ccf1b6b4 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.171318 Oct 28 10:00:57.780940 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1351/2651] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:57 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:57.785811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:57.786599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:57.793447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:57.794198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:57.794844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:57.795790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:57.796460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:57.797092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:57.995165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:58.057821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:58.074936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:58.074936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:58.075259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:58.075259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:58.083575 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29601b95-8558-42dc-baba-d7d9d5582344 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1476 microversion: 2.25 time: 0.511502 Oct 28 10:00:58.090765 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1301/2652] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:57 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1476 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:58.097695 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb347cdf-7c63-4908-8996-eebec7c4b949 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1665 microversion: 2.20 time: 0.315325 Oct 28 10:00:58.113176 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1352/2653] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:57 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1665 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:58.113281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e8308b7e-3c88-4be3-b32e-344ed58fc598 tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Calling method '.version_select at 0x7fca328905e0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:58.426723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-2904a1b3-f7bc-4965-914d-dbc55855bc2d req-93c63078-a165-4baf-bbbd-0b2fd0c6caf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7831b2e-dc40-4e1b-981b-94cb7d1736f0", "name": "network-vif-unplugged", "status": "completed", "tag": "a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:58.453965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2904a1b3-f7bc-4965-914d-dbc55855bc2d req-93c63078-a165-4baf-bbbd-0b2fd0c6caf1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:58.457026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2904a1b3-f7bc-4965-914d-dbc55855bc2d req-93c63078-a165-4baf-bbbd-0b2fd0c6caf1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:58.465188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2904a1b3-f7bc-4965-914d-dbc55855bc2d req-93c63078-a165-4baf-bbbd-0b2fd0c6caf1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:58.490829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.server_external_events [req-2904a1b3-f7bc-4965-914d-dbc55855bc2d req-93c63078-a165-4baf-bbbd-0b2fd0c6caf1 service nova] Unable to find a host for instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0. Dropping event network-vif-unplugged {{(pid=128747) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 10:00:58.492648 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-2904a1b3-f7bc-4965-914d-dbc55855bc2d req-93c63078-a165-4baf-bbbd-0b2fd0c6caf1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.389008 Oct 28 10:00:58.493510 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1353/2654] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 390 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 10:00:58.592397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2330dbbb-15f5-4645-b14a-8b15769ff6fb tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Action: 'create', calling method: .version_select at 0x7fca3b97a160>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1368628374", "policies": ["affinity"]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:58.624637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2330dbbb-15f5-4645-b14a-8b15769ff6fb tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:00:58.649469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2330dbbb-15f5-4645-b14a-8b15769ff6fb tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:00:58.702673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e8308b7e-3c88-4be3-b32e-344ed58fc598 tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/fc12810e-cec6-46c7-bb96-893e1aa780a9" status: 202 len: 0 microversion: 2.1 time: 0.603470 Oct 28 10:00:58.707275 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1302/2655] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:00:58 2022] DELETE /compute/v2.1/os-security-groups/fc12810e-cec6-46c7-bb96-893e1aa780a9 => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:00:58.716383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfb23813-8df1-4983-9b67-433b8e5a0181 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca327b2550>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:58.751612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2330dbbb-15f5-4645-b14a-8b15769ff6fb tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:00:58.764681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2330dbbb-15f5-4645-b14a-8b15769ff6fb tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:00:58.784723 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2330dbbb-15f5-4645-b14a-8b15769ff6fb tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.289817 Oct 28 10:00:58.786665 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1354/2656] 10.222.0.16 () {60 vars in 1174 bytes} [Fri Oct 28 10:00:58 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:58.792041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3ec2e677-106b-4438-ba29-a219fa80304f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '.version_select at 0x7fca3b967b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:58.796563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec2e677-106b-4438-ba29-a219fa80304f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:58.797384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec2e677-106b-4438-ba29-a219fa80304f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:58.798563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ec2e677-106b-4438-ba29-a219fa80304f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:58.814319 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3ec2e677-106b-4438-ba29-a219fa80304f tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/os-migrations" status: 200 len: 1647 microversion: 2.25 time: 0.026215 Oct 28 10:00:58.826091 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1355/2657] 10.222.0.16 () {60 vars in 1184 bytes} [Fri Oct 28 10:00:58 2022] GET /compute/v2.1/os-migrations => generated 1647 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:58.832105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f580faf6-9f9b-4c81-aae9-e23b72630b69"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:58.835424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:58.843708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:58.844216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:58.844661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:58.845414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:58.845888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:58.846302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:59.301394 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfb23813-8df1-4983-9b67-433b8e5a0181 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "DELETE /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.592524 Oct 28 10:00:59.302453 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1303/2658] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 10:00:58 2022] DELETE /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata/os_version => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:00:59.308093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e855980-40af-46f1-8139-1cbf680a779e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3276f0d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:59.441628 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e855980-40af-46f1-8139-1cbf680a779e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 0.115453 Oct 28 10:00:59.441628 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1304/2659] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:00:59 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:00:59.441628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e6a2dcbb-f19b-40e0-8f01-ed2f3006de2f tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] Calling method '.version_select at 0x7fca32890040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:59.535119 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9dc07d0-46eb-40dc-810c-db175f198806 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.707711 Oct 28 10:00:59.536862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1356/2660] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Oct 28 10:00:58 2022] POST /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 188 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:00:59.542640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4b28b12b-8eca-4042-a73f-fe25cefdaf8a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Action: 'create', calling method: .version_select at 0x7fca3b9bad30>, body: {"server_group": {"name": "tempest-server-group-484244700", "policies": ["affinity"]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:00:59.569385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4b28b12b-8eca-4042-a73f-fe25cefdaf8a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:00:59.576130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4b28b12b-8eca-4042-a73f-fe25cefdaf8a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:00:59.647687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4b28b12b-8eca-4042-a73f-fe25cefdaf8a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:00:59.669319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4b28b12b-8eca-4042-a73f-fe25cefdaf8a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:00:59.709767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e6a2dcbb-f19b-40e0-8f01-ed2f3006de2f tempest-SecurityGroupsTestAdminJSON-1496242521 tempest-SecurityGroupsTestAdminJSON-1496242521-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/32e5d1c0-87d7-4ecf-a758-f560292eb37c" status: 202 len: 0 microversion: 2.1 time: 0.288232 Oct 28 10:00:59.710585 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1305/2661] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:00:59 2022] DELETE /compute/v2.1/os-security-groups/32e5d1c0-87d7-4ecf-a758-f560292eb37c => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:00:59.719140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:59.720209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:59.734305 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4b28b12b-8eca-4042-a73f-fe25cefdaf8a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.196045 Oct 28 10:00:59.740271 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1357/2662] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 10:00:59 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:00:59.740453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:59.740453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:59.740453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:59.740762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:59.741468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:00:59.743453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:59.744121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:59.745490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:59.749704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:59.749907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:59.750341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:59.751188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:00:59.751661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:00:59.752095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:00:59.856714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:59.872380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:59.874757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:00:59.886850 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a92c931d-ad9d-401e-be33-2f523d472516 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.173912 Oct 28 10:00:59.902242 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1306/2663] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:59 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:59.913445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] Lazy-loading 'services' on Instance uuid d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:00:59.915863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-463949fe-a602-4645-8053-979bd90839af tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca328903a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:00:59.933882 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4a5ca5c-7d93-49a9-882a-3e43542b266e tempest-LiveAutoBlockMigrationV225Test-54081984 tempest-LiveAutoBlockMigrationV225Test-54081984-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1962 microversion: 2.25 time: 0.196980 Oct 28 10:00:59.934747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1358/2664] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:00:59 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1962 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:00:59.977330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-463949fe-a602-4645-8053-979bd90839af tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 37 microversion: 2.1 time: 0.063126 Oct 28 10:00:59.978864 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1307/2665] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:00:59 2022] GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 37 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:00:59.985332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb12426e-7867-45d3-86c6-b833f1096886 tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] Calling method '.version_select at 0x7fca3284f160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:00.039281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1972850301", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "5c66667c-6d75-4e82-a8a4-4669c43d1d73"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:00.131909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] validate_networks() for [('5c66667c-6d75-4e82-a8a4-4669c43d1d73', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:01:00.310494 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb12426e-7867-45d3-86c6-b833f1096886 tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2ee1a984-919c-4489-90f3-da16c8d15b25" status: 202 len: 0 microversion: 2.1 time: 0.329899 Oct 28 10:01:00.311429 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1308/2666] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:00:59 2022] DELETE /compute/v2.1/os-security-groups/2ee1a984-919c-4489-90f3-da16c8d15b25 => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:00.319932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:00.321935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:00.345627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:00.346489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:00.347141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:00.348146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:00.348812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:00.349530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:00.426184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128748) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 10:01:00.568055 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-772e1dbd-b574-4e1f-9bb3-8f4f333cc185 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/action" status: 202 len: 0 microversion: 2.20 time: 0.255318 Oct 28 10:01:00.569141 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1309/2667] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 10:01:00 2022] POST /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:00.575263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4317ed0-be6a-4b70-93fe-53963d46471b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Action: 'create', calling method: .version_select at 0x7fca3284fca0>, body: {"server_group": {"name": "tempest-server-group-484244700", "policies": ["affinity"]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:00.616300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b4317ed0-be6a-4b70-93fe-53963d46471b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:00.625760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b4317ed0-be6a-4b70-93fe-53963d46471b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:00.695803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b4317ed0-be6a-4b70-93fe-53963d46471b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:00.707822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b4317ed0-be6a-4b70-93fe-53963d46471b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:00.765442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4317ed0-be6a-4b70-93fe-53963d46471b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.194843 Oct 28 10:01:00.772660 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1310/2668] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 10:01:00 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:00.788327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:00.789942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:00.811772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:00.812670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:00.813405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:00.814435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:00.815123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:00.815801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:00.866212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:01:00.866855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:01:00.867335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:01:00.867891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:01:00.868294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:01:00.868408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:01:00.891055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:00.894406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:00.895049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:00.896023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:00.902694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:00.903410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:00.967036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Getting quotas for project 0c49ee1d5d5642749e3e90fb9d596636. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:00.980366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Getting quotas for user 854e41184e0f4b06aa85a150fec89fd4 and project 0c49ee1d5d5642749e3e90fb9d596636. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:01.019738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e45c356-9e35-49c0-a11e-d17d40a4e111 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 204 len: 0 microversion: 2.25 time: 0.244665 Oct 28 10:01:01.021995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1311/2669] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:00 2022] DELETE /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:01:01.038338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-185ac4eb-1110-482e-9ef3-f37540ebe0be tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update_all', calling method: .version_select at 0x7fca32890b80>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:01.047400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:01:01.053681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:01:01.168865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-185ac4eb-1110-482e-9ef3-f37540ebe0be tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:01.187759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-185ac4eb-1110-482e-9ef3-f37540ebe0be tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:01.193084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0967cdd-b136-4cac-8e62-8941d23a39e6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.246129 Oct 28 10:01:01.195446 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1359/2670] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:00:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:01:01.206261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-051d8ea5-cc67-431b-a488-0186010e7f3e tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] Calling method '.version_select at 0x7fca3b974700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:01.785892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-051d8ea5-cc67-431b-a488-0186010e7f3e tempest-SecurityGroupsTestAdminJSON-1099344854 tempest-SecurityGroupsTestAdminJSON-1099344854-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/9a1ef203-2b6f-48ce-aa04-e79415208f53" status: 202 len: 0 microversion: 2.1 time: 0.585659 Oct 28 10:01:01.786942 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1360/2671] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:01:01 2022] DELETE /compute/v2.1/os-security-groups/9a1ef203-2b6f-48ce-aa04-e79415208f53 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:01.798655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff758299-35e5-44ac-af54-d57af3cc5dfb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca32d7a8b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.119949 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-185ac4eb-1110-482e-9ef3-f37540ebe0be tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 61 microversion: 2.1 time: 1.096348 Oct 28 10:01:02.121386 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1312/2672] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:01 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 61 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:02.128732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.129636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:02.152615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.153250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.153864 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff758299-35e5-44ac-af54-d57af3cc5dfb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 0.364150 Oct 28 10:01:02.154722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.155430 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1361/2673] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:01 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:02.157922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.159556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.173418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1fb9d01-21c6-4468-aa5b-29410b09fde3 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.174376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.288869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:02.300194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1fb9d01-21c6-4468-aa5b-29410b09fde3 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/5084b0ec-bec6-4a66-915a-9d0293b6cccc" status: 204 len: 0 microversion: 2.1 time: 0.141040 Oct 28 10:01:02.301648 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1362/2674] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:02 2022] DELETE /compute/v2.1/os-server-groups/5084b0ec-bec6-4a66-915a-9d0293b6cccc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:02.322422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.323765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:02.332232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.333815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.334547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.335535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.336443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.337144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.489965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.507755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.510510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.522701 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-33c45b3c-452d-496c-920f-84b1ca40697f tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.219222 Oct 28 10:01:02.549568 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1363/2675] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:02 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:02.556320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.557195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:02.566568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.567277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.568092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.569053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.569672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.570775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.639380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.655008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.658911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.663485 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b05dc79b-38ac-4d8b-a9ba-c093e76412ad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1751 microversion: 2.20 time: 0.539986 Oct 28 10:01:02.677192 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1313/2676] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:02 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1751 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:02.689592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.690503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:02.697113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.697838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.698449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.699378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:02.700019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:02.700610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:02.808006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.817433 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-596c902d-f80a-4f0c-8cbb-7fc62bbe8303 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1228 microversion: 2.1 time: 0.138747 Oct 28 10:01:02.818552 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1314/2677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:02 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1228 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:02.824044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8fdf8515-0647-4570-b536-d5d6915e1b7e tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca32890a60>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.909442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8fdf8515-0647-4570-b536-d5d6915e1b7e tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.089636 Oct 28 10:01:02.910026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1315/2678] 10.222.0.16 () {58 vars in 1290 bytes} [Fri Oct 28 10:01:02 2022] GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata/os_distro => generated 33 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:02.915446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9160233c-c116-4997-a3be-e3ad453c0eed tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:02.936322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.964857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.973703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:02.977687 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9160233c-c116-4997-a3be-e3ad453c0eed tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.065075 Oct 28 10:01:02.978345 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf80d9ae-93a7-4be9-9bca-037bb47816ce tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1482 microversion: 2.25 time: 0.424898 Oct 28 10:01:02.985487 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1316/2679] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:01:02 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:02.990788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-afb7cb5a-5e76-4791-a669-0a23af2da333 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update_all', calling method: .version_select at 0x7fca326fa4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:02.998014 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1364/2680] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:02 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1482 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:03.004422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea6aed17-2f98-4661-bf79-cedf8e8b51f3 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:03.037779 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea6aed17-2f98-4661-bf79-cedf8e8b51f3 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7" status: 204 len: 0 microversion: 2.1 time: 0.038293 Oct 28 10:01:03.040138 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1365/2681] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:02 2022] DELETE /compute/v2.1/os-server-groups/e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:03.048732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c6650545-a9e4-4def-a9d3-124131e261f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:03.067005 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c6650545-a9e4-4def-a9d3-124131e261f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022009 Oct 28 10:01:03.083805 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1366/2682] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:01:03 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:03.093776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-889a716c-39d2-411e-b7d0-021bd4e4d631 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Action: 'create', calling method: .version_select at 0x7fca33209a60>, body: {"server_group": {"name": "tempest-server-group-761241671", "policies": ["affinity"]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:03.095980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-afb7cb5a-5e76-4791-a669-0a23af2da333 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:03.109475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-afb7cb5a-5e76-4791-a669-0a23af2da333 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:03.150137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-889a716c-39d2-411e-b7d0-021bd4e4d631 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:03.159251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-889a716c-39d2-411e-b7d0-021bd4e4d631 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:03.287248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-889a716c-39d2-411e-b7d0-021bd4e4d631 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:03.302038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-889a716c-39d2-411e-b7d0-021bd4e4d631 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:03.335349 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-889a716c-39d2-411e-b7d0-021bd4e4d631 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.246809 Oct 28 10:01:03.336956 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1367/2683] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 10:01:03 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:03.350971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-304fe8bf-5b51-4b7b-9490-7b176c4a10fd tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b957ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:03.626485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-304fe8bf-5b51-4b7b-9490-7b176c4a10fd tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 0.288443 Oct 28 10:01:03.634722 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1368/2684] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:03 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:03.656953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b005ed9-e480-44bd-b2b5-c1198d50a61f tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:03.724890 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-afb7cb5a-5e76-4791-a669-0a23af2da333 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.737862 Oct 28 10:01:03.731892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1317/2685] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:02 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 61 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:03.737517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:03.741706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:03.762439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:03.763662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:03.765785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:03.768149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:03.768969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:03.773333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:03.785524 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b005ed9-e480-44bd-b2b5-c1198d50a61f tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/fe258c01-28ab-45f8-b1b0-80d7de35ec73" status: 204 len: 0 microversion: 2.1 time: 0.154429 Oct 28 10:01:03.786181 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1369/2686] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:03 2022] DELETE /compute/v2.1/os-server-groups/fe258c01-28ab-45f8-b1b0-80d7de35ec73 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:03.813183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:03.817464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:03.856569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:03.859081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:03.860934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:03.868555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:03.870418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:03.870866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:04.023140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:04.039487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:04.041303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:04.053650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7e6d832-8c87-40c6-b64b-1d3930b8bd6e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1544 microversion: 2.91 time: 0.318639 Oct 28 10:01:04.057072 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1318/2687] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:03 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1544 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:04.067574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09baff53-06f1-4f5f-b738-f3769cffe1d4 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca3284faf0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:04.596235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:04.613221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:04.621449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:04.626412 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7bcc6b49-0df7-46bb-a1d8-def6bf4606ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.837382 Oct 28 10:01:04.642222 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1370/2688] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:03 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:04.660178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40a066b5-ea37-4757-8ca8-62c9a52ef51f tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:04.719892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40a066b5-ea37-4757-8ca8-62c9a52ef51f tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.065714 Oct 28 10:01:04.721898 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1371/2689] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:01:04 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:04.739946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:04.740575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:04.768846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:04.770574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:04.771033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:04.771765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:04.776475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:04.778807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:04.972134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:04.984247 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2fd8a6e-960a-4832-a93e-54bddd1c68a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1282 microversion: 2.1 time: 0.259550 Oct 28 10:01:04.996932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1372/2690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:04 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:04.996932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:04.997377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:05.011137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:05.011954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:05.012588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:05.013634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:05.014167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:05.014590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:05.813907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09baff53-06f1-4f5f-b738-f3769cffe1d4 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 61 microversion: 2.1 time: 1.755322 Oct 28 10:01:05.819988 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1319/2691] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:01:04 2022] GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 61 bytes in 1762 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:05.825171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27ef376f-bce1-4dd6-86ab-7f53cffb141d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3284f4c0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:05.935585 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-27ef376f-bce1-4dd6-86ab-7f53cffb141d tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 0.114303 Oct 28 10:01:05.936847 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1320/2692] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:05 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:05.951134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a493765b-71bf-4bb7-8550-5b9a47884d1b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Action: 'create', calling method: .version_select at 0x7fca326fab80>, body: {"server_group": {"name": "tempest-server-group-1788566412", "policies": ["anti-affinity"]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:06.035864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a493765b-71bf-4bb7-8550-5b9a47884d1b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:06.056189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a493765b-71bf-4bb7-8550-5b9a47884d1b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:06.176749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a493765b-71bf-4bb7-8550-5b9a47884d1b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:06.186742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a493765b-71bf-4bb7-8550-5b9a47884d1b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_groups'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:06.203786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:06.206063 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a493765b-71bf-4bb7-8550-5b9a47884d1b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.265722 Oct 28 10:01:06.207906 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1321/2693] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 10:01:05 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:06.214292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:06.215252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:06.223269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:06.224066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:06.224728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:06.225687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:06.226353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:06.227051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:06.455585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:06.470512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:06.494678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:06.538608 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4dbc19d-ce06-458d-8e34-e6ded0763832 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1531 microversion: 2.91 time: 0.322724 Oct 28 10:01:06.558365 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1322/2694] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:06 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1531 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:06.619415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:06.622204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:06.661672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:06.667442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:06.667965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:06.671379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:06.671880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:06.674458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:06.816937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:06.839167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:06.841544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:06.844236 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-613021fb-1dc0-4208-b72f-a3d913381446 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1482 microversion: 2.25 time: 1.856547 Oct 28 10:01:06.846451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1373/2695] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:04 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1482 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:06.855049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83ef60c7-670e-4c47-8442-64421c5bee75 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update_all', calling method: .version_select at 0x7fca3b9899d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:06.976031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83ef60c7-670e-4c47-8442-64421c5bee75 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:06.993508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83ef60c7-670e-4c47-8442-64421c5bee75 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:07.184324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:07.203390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:07.205444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:07.218255 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb9a2ae3-fca0-4725-a3e4-41386d714967 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.648664 Oct 28 10:01:07.220896 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1323/2696] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:06 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:07.225834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:07.237537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:07.255838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:07.258891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:07.259548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:07.264286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:07.264787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:07.265315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:07.289133 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83ef60c7-670e-4c47-8442-64421c5bee75 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.441185 Oct 28 10:01:07.290979 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1374/2697] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:06 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 61 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:07.299166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5643677d-7821-4637-90de-b92f219e368a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:07.373057 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5643677d-7821-4637-90de-b92f219e368a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/503fc347-1d77-4563-a6bb-66f1334cd1a8" status: 204 len: 0 microversion: 2.1 time: 0.080711 Oct 28 10:01:07.373662 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1375/2698] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:07 2022] DELETE /compute/v2.1/os-server-groups/503fc347-1d77-4563-a6bb-66f1334cd1a8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:07.394060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:07.405981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:07.429273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:07.430149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:07.431205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:07.432834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:07.433614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:07.437872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:07.446757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:07.662395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:07.677004 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-61915a2c-2cec-406d-8f29-fa0249e113a4 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1324 microversion: 2.1 time: 0.454723 Oct 28 10:01:07.677615 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1324/2699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:07 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1324 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:07.804753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] Lazy-loading 'services' on Instance uuid 44005b9d-3f5a-4aab-919d-3c9072329bd6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:07.844885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a17890e-8699-4a2d-9b80-a41c1ac808d4 tempest-UnshelveToHostMultiNodesTest-968103743 tempest-UnshelveToHostMultiNodesTest-968103743-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1930 microversion: 2.91 time: 0.468452 Oct 28 10:01:07.851533 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1376/2700] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:07 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1930 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:07.863439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a68503f-a7ba-44ea-9082-390f958dd534 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b8fc700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:07.991323 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a68503f-a7ba-44ea-9082-390f958dd534 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1428 microversion: 2.1 time: 0.127391 Oct 28 10:01:07.996044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1377/2701] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:07 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1428 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:08.001594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05f0d994-4bf0-47f8-a51e-de1ef37a1b18 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update_all', calling method: .version_select at 0x7fca3b974e50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:08.160191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-05f0d994-4bf0-47f8-a51e-de1ef37a1b18 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:08.172115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-05f0d994-4bf0-47f8-a51e-de1ef37a1b18 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:08.201375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f1ff3d51-77c3-4128-bcb3-9ea7f478d4c4 req-a52dc364-9837-458e-b198-092368d2d375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab", "name": "network-vif-deleted", "tag": "fa96b0ac-478a-4896-b414-e05f78c6fcea"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:08.235406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f1ff3d51-77c3-4128-bcb3-9ea7f478d4c4 req-a52dc364-9837-458e-b198-092368d2d375 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:08.235911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f1ff3d51-77c3-4128-bcb3-9ea7f478d4c4 req-a52dc364-9837-458e-b198-092368d2d375 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:08.236345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f1ff3d51-77c3-4128-bcb3-9ea7f478d4c4 req-a52dc364-9837-458e-b198-092368d2d375 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:08.265892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f1ff3d51-77c3-4128-bcb3-9ea7f478d4c4 req-a52dc364-9837-458e-b198-092368d2d375 service nova] Creating event network-vif-deleted:fa96b0ac-478a-4896-b414-e05f78c6fcea for instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab on n-h2-zed-1 Oct 28 10:01:08.278874 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f1ff3d51-77c3-4128-bcb3-9ea7f478d4c4 req-a52dc364-9837-458e-b198-092368d2d375 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.593039 Oct 28 10:01:08.280701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1325/2702] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:08.296604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-607c3681-788e-4daa-ae3b-0b2bb21eda95 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:08.320389 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-607c3681-788e-4daa-ae3b-0b2bb21eda95 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.038059 Oct 28 10:01:08.321408 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1326/2703] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:01:08 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:08.342871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:08.345808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:08.357493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:08.358266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:08.359010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:08.359988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:08.360702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:08.361420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:08.439507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:08.448958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:08.452021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:08.453881 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-acbb09b4-d855-4e21-ad7b-ac27fbf09947 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1265 microversion: 2.25 time: 0.117935 Oct 28 10:01:08.456351 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1327/2704] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:08 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1265 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:08.466147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:08.467061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:08.474123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:08.474830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:08.475510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:08.476738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:08.477419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:08.478083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:08.512439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:01:08.587996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:08.626765 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c40dd00-5253-4881-b686-f8b1afd76b27 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "DELETE /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 204 len: 0 microversion: 2.91 time: 0.166741 Oct 28 10:01:08.627953 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1328/2705] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:08 2022] DELETE /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:01:08.643569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:08.645504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:08.661449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:08.662388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:08.664080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:08.665716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:08.666815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:08.667650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:08.822241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-05f0d994-4bf0-47f8-a51e-de1ef37a1b18 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 64 microversion: 2.1 time: 0.823490 Oct 28 10:01:08.823746 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1378/2706] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:07 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 64 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:08.893656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:08.906591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:08.908037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:08.909281 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab0fa855-7d81-4ae1-af80-861b672ff2bc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.272738 Oct 28 10:01:08.910170 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1329/2707] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:08 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:08.924078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1362191744", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "ac18d47d-b1c6-430d-b0f2-1db5f0affb90"}]}, "os:scheduler_hints": {"group": "9eac0381-947a-40b3-b9ab-a0d764d46b66"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:08.946356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1862969548", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:09.027991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] validate_networks() for [('ac18d47d-b1c6-430d-b0f2-1db5f0affb90', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:01:09.032131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:01:09.491588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:01:09.492149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:01:09.493125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:01:09.493546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:01:09.493969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:01:09.509518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.510141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.510518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.511305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.511771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.512200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.532668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:09.538609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:09.553361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:01:09.555907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:01:09.608593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128748) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 28 10:01:09.630115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_group_members'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:09.635856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_group_members'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:09.695006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_group_members'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:09.701590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Getting quotas for user 0db24bba973f4b52b0c1409fd80daf74 and project 9a1eb6ee53b0459b9ba5a61dec5108e0. Resources: {'server_group_members'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:09.710756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:01:09.712127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:01:09.713255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:01:09.713751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:01:09.714529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:01:09.726470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.728026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.728693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.729778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.730392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.731165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.731927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6275dc7f-7c7a-4a8c-a579-95714f2f27aa tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.820693 Oct 28 10:01:09.732757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1330/2708] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:01:09.744334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:09.745020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:09.754654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Getting quotas for project 6dcc2826ba6d4a1a9e5534cf94edd809. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:09.755816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.756328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.756985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.757528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.758025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.758471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.767735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Getting quotas for user 10535d8981ed4c3c908f2d3325052c6a and project 6dcc2826ba6d4a1a9e5534cf94edd809. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:09.785083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:01:09.787850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:01:09.802038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=9,nova_api:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:09.847149 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7c682c0-17c6-4ef4-acd0-2192457b221f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021618 Oct 28 10:01:09.855060 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1379/2709] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:01:09.861175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:09.862150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:09.870330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:09.871135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.871851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.872509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.873764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:09.874478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:09.875179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:09.881020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:09.882483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:09.892865 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-156e9039-cd82-48de-b6f4-f09294814f2e tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.159150 Oct 28 10:01:09.914711 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1331/2710] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:09 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:09.946601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-887be3e9-ac28-4969-8075-2424f230e9cf tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca32748280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.012811 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-887be3e9-ac28-4969-8075-2424f230e9cf tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 64 microversion: 2.1 time: 0.096894 Oct 28 10:01:10.013553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1332/2711] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:01:09 2022] GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 64 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:10.030914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5382205c-358a-4e70-bead-a632f932f49a tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3270c0d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.099384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.116497 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5382205c-358a-4e70-bead-a632f932f49a tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1437 microversion: 2.1 time: 0.101806 Oct 28 10:01:10.119668 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe5f1ec9-8a35-4048-aa32-9f36f3c4cf77 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1324 microversion: 2.1 time: 0.262532 Oct 28 10:01:10.120248 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1380/2712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:09 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1324 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:10.120654 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1333/2713] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:10 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1437 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:10.149005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.149968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0dc6f086-f921-493e-ab47-f6eda6c15d76 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.151566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0dc6f086-f921-493e-ab47-f6eda6c15d76 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:10.152003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:10.166568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:10.170405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:10.171256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:10.172344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:10.173705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:10.174610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:10.268211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.279533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.280254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0dc6f086-f921-493e-ab47-f6eda6c15d76 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.281518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.282856 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dbd86246-03f4-4f8b-952c-9094472666a3 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1265 microversion: 2.25 time: 0.159448 Oct 28 10:01:10.284338 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1381/2714] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:10 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:10.288867 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0dc6f086-f921-493e-ab47-f6eda6c15d76 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1213 microversion: 2.1 time: 0.166203 Oct 28 10:01:10.290828 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1334/2715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:10 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:10.294245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6bf5b1cf-b1eb-4005-9fbf-ee507056c895 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.295692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6bf5b1cf-b1eb-4005-9fbf-ee507056c895 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:10.310088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.311023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:10.319968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:10.320893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:10.321949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:10.323234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:10.323968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:10.324837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:10.387198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6bf5b1cf-b1eb-4005-9fbf-ee507056c895 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.396019 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6bf5b1cf-b1eb-4005-9fbf-ee507056c895 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1222 microversion: 2.1 time: 0.110321 Oct 28 10:01:10.397049 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1382/2716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:10 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:10.403044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a8bf06ed-6cc8-4591-8db5-970fd70f05d4 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update_all', calling method: .version_select at 0x7fca3b9740d0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:10.483792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a8bf06ed-6cc8-4591-8db5-970fd70f05d4 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:10.496500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a8bf06ed-6cc8-4591-8db5-970fd70f05d4 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:10.496838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.507277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.508935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:10.510895 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbced718-f74c-47f8-8012-13049a9adef5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.218591 Oct 28 10:01:10.511637 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1335/2717] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:10 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:10.516647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71689e1e-58d9-41d5-88f5-5e5dca3cdeae tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca32890ca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.571214 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71689e1e-58d9-41d5-88f5-5e5dca3cdeae tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 200 len: 1437 microversion: 2.1 time: 0.057936 Oct 28 10:01:10.572043 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1336/2718] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:01:10 2022] GET /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 1437 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:10.607902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fc93574f-b35d-48d1-b883-3ec02b36e647 req-5d7b84ea-3311-481d-b117-6d3f309e7af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cd3269-3458-442d-a68a-d2fcdfa8b1e9", "tag": "b30f7134-38e8-4c49-890e-7763e6d54708"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:10.631026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fc93574f-b35d-48d1-b883-3ec02b36e647 req-5d7b84ea-3311-481d-b117-6d3f309e7af9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:10.636720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fc93574f-b35d-48d1-b883-3ec02b36e647 req-5d7b84ea-3311-481d-b117-6d3f309e7af9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:10.637382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fc93574f-b35d-48d1-b883-3ec02b36e647 req-5d7b84ea-3311-481d-b117-6d3f309e7af9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:10.666514 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fc93574f-b35d-48d1-b883-3ec02b36e647 req-5d7b84ea-3311-481d-b117-6d3f309e7af9 service nova] Creating event network-changed:b30f7134-38e8-4c49-890e-7763e6d54708 for instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 on n-h1-zed-1 Oct 28 10:01:10.680261 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fc93574f-b35d-48d1-b883-3ec02b36e647 req-5d7b84ea-3311-481d-b117-6d3f309e7af9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085104 Oct 28 10:01:10.684887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1337/2719] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:10.697895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:10.698866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:10.709710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:10.710214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:10.710733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:10.712684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:10.713164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:10.713759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.028582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.037104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8c5f2d70-b163-4742-961d-2b7b7103426e tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1478 microversion: 2.1 time: 0.350901 Oct 28 10:01:11.039490 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1338/2720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:10 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1478 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:11.044573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:11.045492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:11.050230 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a8bf06ed-6cc8-4591-8db5-970fd70f05d4 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.651931 Oct 28 10:01:11.050832 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1383/2721] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:10 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 61 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:11.061070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-13f818af-f911-4395-a4a1-147adc35169a tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update', calling method: .version_select at 0x7fca3b94f700>, body: {"meta": {"os_version": "alt"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:11.063584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.064105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.064551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.065307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.065768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.066193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.129606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-13f818af-f911-4395-a4a1-147adc35169a tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:11.139605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-13f818af-f911-4395-a4a1-147adc35169a tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:11.206170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.218673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.227434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.243879 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12fdc1d6-411d-4999-87be-3282001ea2da tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1537 microversion: 2.91 time: 0.202996 Oct 28 10:01:11.244867 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1339/2722] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:11 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1537 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:11.263196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:11.264732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:11.272773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.273809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.275047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.276407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.277002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.278642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.520744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.527592 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-13f818af-f911-4395-a4a1-147adc35169a tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.470351 Oct 28 10:01:11.533590 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1384/2723] 10.222.0.16 () {60 vars in 1313 bytes} [Fri Oct 28 10:01:11 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata/os_version => generated 31 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:11.533722 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-741ba8da-4644-42d5-a834-cb4ce8d9a1b3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1324 microversion: 2.1 time: 0.287339 Oct 28 10:01:11.536660 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1340/2724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:11 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1324 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:11.538935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:11.540089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:11.548771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:11.549427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:11.559319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.559822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.560265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.561012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.561528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.561902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.567375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.567922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.568419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.569168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.569620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.570044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.684091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.695064 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67056d3e-fbae-4340-b9db-e85539d7f804 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1265 microversion: 2.1 time: 0.156988 Oct 28 10:01:11.696452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1341/2725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:11 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:11.719833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:11.724382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:11.733389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.739452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.742390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.743520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.745591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.746299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.746961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.748780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.752171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.763932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb28878b-c26f-461a-aba7-edd0024f11da tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1265 microversion: 2.25 time: 0.229145 Oct 28 10:01:11.765017 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1385/2726] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:11 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:11.787523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b9e64eb-68c8-41b1-b39c-e3ed5235489a tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca3b90e040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:11.850063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:11.854901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b9e64eb-68c8-41b1-b39c-e3ed5235489a tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 58 microversion: 2.1 time: 0.076567 Oct 28 10:01:11.855497 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1386/2727] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:01:11 2022] GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 58 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:11.860322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:11.860791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:11.863609 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-825553c3-5804-42e9-8308-cd9340d90118 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1218 microversion: 2.1 time: 0.165547 Oct 28 10:01:11.864949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1342/2728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:11 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:11.870243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce8acf02-086f-4eed-ac3b-4ee767037e8d tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'update_all', calling method: .version_select at 0x7fca3272c040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:11.880544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.881039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.881606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.882882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:11.883381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:11.883811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:11.926511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ce8acf02-086f-4eed-ac3b-4ee767037e8d tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:11.933482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ce8acf02-086f-4eed-ac3b-4ee767037e8d tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:11.943556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:12.083962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:12.096704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:12.099554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:12.101206 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-299241a1-bfa5-4642-9341-bbaf2b949e54 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.244561 Oct 28 10:01:12.102850 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1387/2729] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:11 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:12.110269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:12.111281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:12.132614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:12.134840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:12.135371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:12.136339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:12.137032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:12.137657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:12.392302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce8acf02-086f-4eed-ac3b-4ee767037e8d tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 61 microversion: 2.1 time: 0.525541 Oct 28 10:01:12.393209 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1343/2730] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:11 2022] PUT /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 61 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:12.400277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:12.401420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:12.408383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:12.409245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:12.409911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:12.410842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:12.412743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:12.413734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:12.465392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:12.465938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:12.466380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:12.466981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lazy-loading 'fault' on Instance uuid 44005b9d-3f5a-4aab-919d-3c9072329bd6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:12.495007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:12.505866 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-816c7059-a19b-4e78-a5fb-2d55dcecb0bc tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1465 microversion: 2.1 time: 0.401649 Oct 28 10:01:12.506726 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1388/2731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:12 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1465 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:12.511870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb4e739b-a8ec-4195-bf03-81b830459b50 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Action: 'create', calling method: .version_select at 0x7fca3323c820>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:12.516723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:12.527704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:12.529218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '679fbb3562d24d04af630ab8d37d35ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd46da14317314fe5ad7ee374b335891f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:12.535004 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85c95126-ee69-4fcd-a44c-4643a72fbdf9 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 200 len: 1542 microversion: 2.91 time: 0.139839 Oct 28 10:01:12.544742 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1344/2732] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:12 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 1542 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:12.544742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a1da9f1b-417f-4eea-b497-04c5ed674345 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca32840160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:12.590067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cb4e739b-a8ec-4195-bf03-81b830459b50 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:12.600208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cb4e739b-a8ec-4195-bf03-81b830459b50 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Getting quotas for user 62a9109807284f8eb460fbfd10695c6f and project 9a31338ba1ee4f9fa964ae11288bf7ef. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:13.155043 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb4e739b-a8ec-4195-bf03-81b830459b50 tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "POST /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 85 microversion: 2.1 time: 0.647344 Oct 28 10:01:13.157174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1389/2733] 10.222.0.16 () {60 vars in 1281 bytes} [Fri Oct 28 10:01:12 2022] POST /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 85 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:13.167807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:13.171224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:13.206903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.207311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.207771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.214008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.214517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.214967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.358371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a1da9f1b-417f-4eea-b497-04c5ed674345 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "DELETE /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306" status: 204 len: 0 microversion: 2.1 time: 0.821665 Oct 28 10:01:13.362025 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1345/2734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:12 2022] DELETE /compute/v2.1/images/a594144f-1d07-42d6-abda-70a3f4bed306 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:13.364847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:13.365724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:13.373012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.373600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.374046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.375016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.375961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.376557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.447734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.457108 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9e420f7-631f-4dd3-8b4a-39e4612b7ad1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1271 microversion: 2.1 time: 0.096776 Oct 28 10:01:13.457815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1346/2735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:13 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:13.465297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:13.466161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:13.474459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.475313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.476306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.477985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.478882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.479663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.514989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.527880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d83b5dd-0780-44c0-98e8-06ff504cb2a8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1324 microversion: 2.1 time: 0.368690 Oct 28 10:01:13.548402 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1390/2736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:13 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1324 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:13.567016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.575874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.579666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.581355 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-478a35eb-76ba-4a42-9782-512e0ce15f44 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1265 microversion: 2.25 time: 0.121846 Oct 28 10:01:13.594109 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1347/2737] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:13 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:13.606679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:13.609677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:13.615931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:13.616869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:13.625724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.628165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.628786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.632021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.634244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.634689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.642100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.644888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.645470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.646394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:13.660626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:13.661377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:13.885296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.894769 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7b00a64-d2f3-4cbe-bb6c-61760256261b tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1280 microversion: 2.1 time: 0.343682 Oct 28 10:01:13.897453 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1391/2738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:13 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1280 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:13.919123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31cd43b0-3bb3-47e5-a3ed-788c475dc1ea tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] Calling method '.version_select at 0x7fca3b90e0d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:13.962382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.972066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.974892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:13.976316 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef51a4ec-426e-471f-b4a2-191a268aa674 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.380935 Oct 28 10:01:13.981588 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31cd43b0-3bb3-47e5-a3ed-788c475dc1ea tempest-ImagesMetadataTestJSON-2022481331 tempest-ImagesMetadataTestJSON-2022481331-project] 10.222.0.16 "GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata" status: 200 len: 85 microversion: 2.1 time: 0.078045 Oct 28 10:01:13.982367 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1392/2739] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:01:13 2022] GET /compute/v2.1/images/4567344a-0a19-4777-9922-177de042c7ab/metadata => generated 85 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:01:13.994686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8bd4e4e4-11cb-4e65-b011-a7b545328dda tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '.version_select at 0x7fca3b974ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:14.006873 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1348/2740] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:13 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:14.018525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:14.024747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] [instance: 44005b9d-3f5a-4aab-919d-3c9072329bd6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:14.028489 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8bd4e4e4-11cb-4e65-b011-a7b545328dda tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] HTTP exception thrown: Image not found. Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8bd4e4e4-11cb-4e65-b011-a7b545328dda tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Request method failure captured: Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b HTTP/1.1 Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6f6MG6C8KLuWoomI-QRv3TD9z95Bsxs9x7V0er0u4YFcDeYEhm107lrs6AFJ5OvjCWN8mS857qeZ-4aSZv3nsObmJ2tVD7fw9ru-i4qG6YGukIGxI6-4i9tmuKHlv2XNFuOPIVu6Pk73S59teNaqzMLWsSWnXyEAPI3Oqlth81uwBQ Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: fd976570de164b69b58bfae7d4379e26 Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:01:14.030594 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd976570de164b69b58bfae7d4379e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd976570de164b69b58bfae7d4379e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd976570de164b69b58bfae7d4379e26", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd976570de164b69b58bfae7d4379e26"}]}] Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: fd976570de164b69b58bfae7d4379e26 Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerTestJSON-1675285825-project Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 4ec2ec5910404cc9aa621b4998b067bd Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerTestJSON-1675285825-project Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '8b02871a-2b4c-45bb-be7a-c8c93c07e67b'} Oct 28 10:01:14.032120 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8b02871a-2b4c-45bb-be7a-c8c93c07e67b to delete Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:14.033002 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8b02871a-2b4c-45bb-be7a-c8c93c07e67b could not be found. Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:14.034612 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8bd4e4e4-11cb-4e65-b011-a7b545328dda tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:14.035822 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8bd4e4e4-11cb-4e65-b011-a7b545328dda tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "DELETE /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b" status: 404 len: 62 microversion: 2.1 time: 0.048541 Oct 28 10:01:14.036821 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1393/2741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:13 2022] DELETE /compute/v2.1/images/8b02871a-2b4c-45bb-be7a-c8c93c07e67b => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:01:14.038350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-214cb7f7-ca67-4da6-a1f2-e5cd9551a461 req-693c55c4-4962-438c-80f3-0caa8a5d3d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cd3269-3458-442d-a68a-d2fcdfa8b1e9", "name": "network-vif-plugged", "status": "completed", "tag": "b30f7134-38e8-4c49-890e-7763e6d54708"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:14.050980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.052503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.054204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.058374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.059219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.059911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.086246 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] HTTP exception thrown: Instance 44005b9d-3f5a-4aab-919d-3c9072329bd6 could not be found. Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Request method failure captured: Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 HTTP/1.1 Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6elzYsjPMK0e3AQc-U1DNBPn6Iq5NDxKcQqEmk6NmODNqwAr7eiD3uLSSMeZzmsISKGXQDOLEhyOKHwtf788JmBqv-M6ha93ibkm8eT6OykSS0ajfayZ9l0S-mMmV4AqxL1qQ61sIpzG8YY_tn0pHC09HeJqhsZ7_3aOHRQF8nML5c Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.91 Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d46da14317314fe5ad7ee374b335891f Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1642261529 Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:14.088622 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d46da14317314fe5ad7ee374b335891f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d46da14317314fe5ad7ee374b335891f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d46da14317314fe5ad7ee374b335891f", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d46da14317314fe5ad7ee374b335891f"}]}] Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1642261529 Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d46da14317314fe5ad7ee374b335891f Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1642261529 Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-UnshelveToHostMultiNodesTest-1642261529-project Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 679fbb3562d24d04af630ab8d37d35ae Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1642261529-project Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 44005b9d-3f5a-4aab-919d-3c9072329bd6 could not be found. Oct 28 10:01:14.090201 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '44005b9d-3f5a-4aab-919d-3c9072329bd6'} Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44005b9d-3f5a-4aab-919d-3c9072329bd6 could not be found. Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:14.091034 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44005b9d-3f5a-4aab-919d-3c9072329bd6 could not be found. Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44005b9d-3f5a-4aab-919d-3c9072329bd6 could not be found. Oct 28 10:01:14.092383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:14.093572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-214cb7f7-ca67-4da6-a1f2-e5cd9551a461 req-693c55c4-4962-438c-80f3-0caa8a5d3d42 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.094443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-214cb7f7-ca67-4da6-a1f2-e5cd9551a461 req-693c55c4-4962-438c-80f3-0caa8a5d3d42 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.094780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] Returning 404 to user: Instance 44005b9d-3f5a-4aab-919d-3c9072329bd6 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:14.094894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-214cb7f7-ca67-4da6-a1f2-e5cd9551a461 req-693c55c4-4962-438c-80f3-0caa8a5d3d42 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.096290 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4dd9d6b-d435-4c0d-995d-e34a51947547 tempest-UnshelveToHostMultiNodesTest-1642261529 tempest-UnshelveToHostMultiNodesTest-1642261529-project] 10.222.0.16 "GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6" status: 404 len: 111 microversion: 2.91 time: 0.087804 Oct 28 10:01:14.097094 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1349/2742] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:14 2022] GET /compute/v2.1/servers/44005b9d-3f5a-4aab-919d-3c9072329bd6 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:14.103522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:14.104255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:14.111653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.112552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.113303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.114269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.114873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.115779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.149741 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-214cb7f7-ca67-4da6-a1f2-e5cd9551a461 req-693c55c4-4962-438c-80f3-0caa8a5d3d42 service nova] Creating event network-vif-plugged:b30f7134-38e8-4c49-890e-7763e6d54708 for instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 on n-h1-zed-1 Oct 28 10:01:14.156521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:01:14.178029 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-214cb7f7-ca67-4da6-a1f2-e5cd9551a461 req-693c55c4-4962-438c-80f3-0caa8a5d3d42 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139903 Oct 28 10:01:14.178812 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1394/2743] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:14.364361 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a70c5e0-bf12-4818-94df-844211e14dc5 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 204 len: 0 microversion: 2.1 time: 0.248282 Oct 28 10:01:14.366553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1350/2744] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:01:14 2022] DELETE /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:14.384082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:14.384817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:14.407691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.408184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.417352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.419780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.424703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.432346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.493572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:14.498172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:14.522126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.523097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.523583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.525689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.528612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.530866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.631173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:14.815372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:14.829505 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31a165a1-02a0-4f53-8db6-31fd5fc73a7c tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.345771 Oct 28 10:01:14.830594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1351/2745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:14 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:01:14.837720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:14.838611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:14.845113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.846007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.846628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:14.848151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:14.848808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:14.850556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.064802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.082066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b98c3241-4c80-43d1-ab63-f7afca8103cb tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1471 microversion: 2.1 time: 0.708923 Oct 28 10:01:15.082749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1395/2746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:14 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1471 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:15.088289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:15.089124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:15.101410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.104312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.105038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.105673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.106583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.107236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.107875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.112235 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67dd2479-73ff-442d-b0d3-7fc100926139 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1324 microversion: 2.1 time: 0.280077 Oct 28 10:01:15.125862 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1352/2747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:14 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1324 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:15.125862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:15.125862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:15.142340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.142822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.143275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.144043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.144499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.144943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.311548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.323662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d26679f7-c926-4511-a695-6325af7827f3 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1280 microversion: 2.1 time: 0.203115 Oct 28 10:01:15.325343 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1353/2748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:15 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1280 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:15.331778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:15.333206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:15.341592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.342660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.342915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.343746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.344237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.345285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.426551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.436742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.438652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.440034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad1bf2cb-9277-46cc-bb97-e61063870cef tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1265 microversion: 2.25 time: 0.356184 Oct 28 10:01:15.441206 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1396/2749] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:15 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1265 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:15.595308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.611472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.613915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:15.615426 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-076a7174-da56-4b5c-afc9-7c732ce53114 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.288411 Oct 28 10:01:15.616414 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1354/2750] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:15 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:15.866641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:15.867835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:15.894628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.896434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.899470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:15.901518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:15.905546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:15.906186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.111528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:16.112155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:16.123393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.123907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.127281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.128179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.128670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.129177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.403785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:16.415120 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e6913e03-5f3d-4564-844f-d863d1e9531c tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1471 microversion: 2.1 time: 0.307996 Oct 28 10:01:16.431103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1355/2751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:16 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1471 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:16.440152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:16.441531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:16.449267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.450655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.451777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.452751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.453837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.454497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.654143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:16.669214 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5face6f-ee34-4403-bd6f-43d5c4e953fc tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.815043 Oct 28 10:01:16.677386 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1397/2752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:15 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:16.686853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1b1eeec1-2cac-4573-baa7-55ea7485cfa6 req-801b2f3b-0c29-43ee-85e6-24591d2a558d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5baa6d-2dce-4a40-8e01-11209f47b532", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:16.719175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1b1eeec1-2cac-4573-baa7-55ea7485cfa6 req-801b2f3b-0c29-43ee-85e6-24591d2a558d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.720809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1b1eeec1-2cac-4573-baa7-55ea7485cfa6 req-801b2f3b-0c29-43ee-85e6-24591d2a558d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.722765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1b1eeec1-2cac-4573-baa7-55ea7485cfa6 req-801b2f3b-0c29-43ee-85e6-24591d2a558d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.747882 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1b1eeec1-2cac-4573-baa7-55ea7485cfa6 req-801b2f3b-0c29-43ee-85e6-24591d2a558d service nova] Creating event network-vif-unplugged:6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53 for instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 on n-h2-zed-1 Oct 28 10:01:16.758593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1b1eeec1-2cac-4573-baa7-55ea7485cfa6 req-801b2f3b-0c29-43ee-85e6-24591d2a558d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075837 Oct 28 10:01:16.759212 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1398/2753] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:16.768845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:16.769519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:16.790884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.791430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.801368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.802192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.802685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.803400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.907273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:16.920273 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef8f3cf6-c39e-4a8d-81e4-2db71e847a9b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1519 microversion: 2.1 time: 0.487501 Oct 28 10:01:16.920931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1356/2754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:16 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1519 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:16.926212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:16.927094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:16.934542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.935045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.935549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:16.936263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:16.937183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:16.937765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:17.013199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:17.014222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:17.015371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:17.017484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lazy-loading 'fault' on Instance uuid d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:17.168778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:17.182228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:17.184685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:17.185949 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7431839-09b6-4328-9749-98ef4268ab23 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 200 len: 1193 microversion: 2.25 time: 0.264061 Oct 28 10:01:17.204584 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1357/2755] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:16 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 1193 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:17.204584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:17.204584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:17.219837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:17.223389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:17.224121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:17.225519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:17.229853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:17.231561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:17.733286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:17.753776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:17.755348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:17.756570 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dbf83051-260f-4af2-8c1d-752885b203a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1753 microversion: 2.20 time: 0.563248 Oct 28 10:01:17.757713 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1358/2756] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:17 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1753 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:17.763107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c3f6d36f-8ba5-4590-aa7d-ac163d9121e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'create', calling method: .version_select at 0x7fca327b2f70>, body: {"pool": null} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:17.814299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:17.826570 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98773b24-a0ef-4e02-9718-ebb414022bc0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 1.066126 Oct 28 10:01:17.834326 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1399/2757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:16 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:17.846751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:17.847857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:17.861403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:17.861919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:17.862372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:17.863202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:17.863631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:17.864071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:18.420035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:18.442188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-18939978-b180-4b78-b69b-6acc1b11eb18 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1471 microversion: 2.1 time: 0.605184 Oct 28 10:01:18.454016 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1400/2758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:17 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1471 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:18.493470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:18.495994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:18.518797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:18.521769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:18.522159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:18.525175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:18.527849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:18.528313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:19.193094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:19.206848 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a4795a8-b5d3-4b6b-8bb2-873643a855e9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.751096 Oct 28 10:01:19.207916 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1401/2759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:18 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:19.231905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-41f9ecc0-4fa9-4d1d-bb9a-d75457ead147 req-3b90f907-d754-47d7-9426-14a9ebaf1500 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be367ea1-2cc8-405d-a64f-c7ae19bcaa8c", "tag": "7aa11287-96b2-4657-8c67-92a2535d301e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:19.280415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-41f9ecc0-4fa9-4d1d-bb9a-d75457ead147 req-3b90f907-d754-47d7-9426-14a9ebaf1500 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:19.280954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-41f9ecc0-4fa9-4d1d-bb9a-d75457ead147 req-3b90f907-d754-47d7-9426-14a9ebaf1500 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:19.281411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-41f9ecc0-4fa9-4d1d-bb9a-d75457ead147 req-3b90f907-d754-47d7-9426-14a9ebaf1500 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:19.312412 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-41f9ecc0-4fa9-4d1d-bb9a-d75457ead147 req-3b90f907-d754-47d7-9426-14a9ebaf1500 service nova] Creating event network-changed:7aa11287-96b2-4657-8c67-92a2535d301e for instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c on n-h2-zed-1 Oct 28 10:01:19.336572 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-41f9ecc0-4fa9-4d1d-bb9a-d75457ead147 req-3b90f907-d754-47d7-9426-14a9ebaf1500 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123828 Oct 28 10:01:19.338681 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1402/2760] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:19.352941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:19.353670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:19.371783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:19.373387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:19.374261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:19.377812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:19.378621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:19.380204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:19.411855 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] HTTP exception thrown: Instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab could not be found. Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Request method failure captured: Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab HTTP/1.1 Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6aBxox-a1sYLzK1ic4JO2gFdVF6VXTgEeILGMhiLxUXUUCIBWvsLMJ19LUOisCjPOyjWoQZ-2w9rM6l9h2D1JoFwNk4plf061vdYLT39O3iHjJa0na6eqJUtkDORyx-BaW0KVZDPsaUKAnCQqkSbayACWfmYLHNAWn8Vff5F51AXhw Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:01:19.421542 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a563769bd6e84594b3837db9d0fdafd4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a563769bd6e84594b3837db9d0fdafd4"}]}] Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 52e08cff441e4fb0b01886d81a7b5ad6 Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab could not be found. Oct 28 10:01:19.423122 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab'} Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab could not be found. Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:19.423952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab could not be found. Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab could not be found. Oct 28 10:01:19.425262 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:19.427204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Returning 404 to user: Instance d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:19.428510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29c15cb0-7071-49fb-a60f-973ed36bb59b tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab" status: 404 len: 111 microversion: 2.25 time: 0.086368 Oct 28 10:01:19.429708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1403/2761] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:19 2022] GET /compute/v2.1/servers/d0f7ce88-d6bf-412e-b1bd-fb4fbb42d8ab => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:19.450885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:19.451518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:19.460640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:19.461214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:19.461690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:19.462590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:19.464458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:19.465838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:19.522380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:19.743871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:19.900081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:19.904687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:19.913359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:19.916947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:19.918631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d606367f-5a74-4a44-b9bb-0fe1447d05ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.487178 Oct 28 10:01:19.920101 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1404/2762] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:19 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:19.941696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:19.942837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:19.960248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:19.960764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:19.964046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:19.966852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:19.967681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:19.968197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:20.335989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:20.349888 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0063b64b-11ab-4a05-bde8-e7f53ba384e6 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 0.427734 Oct 28 10:01:20.350968 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1405/2763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:19 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:20.566319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b886d485-8b57-4017-98f1-d18de07bcf6e req-2d047c07-275d-4665-9e97-7e6ab3611528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d5baa6d-2dce-4a40-8e01-11209f47b532", "name": "network-vif-deleted", "tag": "6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:20.579672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b886d485-8b57-4017-98f1-d18de07bcf6e req-2d047c07-275d-4665-9e97-7e6ab3611528 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:20.604147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b886d485-8b57-4017-98f1-d18de07bcf6e req-2d047c07-275d-4665-9e97-7e6ab3611528 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:20.604796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b886d485-8b57-4017-98f1-d18de07bcf6e req-2d047c07-275d-4665-9e97-7e6ab3611528 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:20.651537 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b886d485-8b57-4017-98f1-d18de07bcf6e req-2d047c07-275d-4665-9e97-7e6ab3611528 service nova] Creating event network-vif-deleted:6bd0ecfb-1f43-4a94-8bb2-5f6efd614d53 for instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 on n-h2-zed-1 Oct 28 10:01:20.667240 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b886d485-8b57-4017-98f1-d18de07bcf6e req-2d047c07-275d-4665-9e97-7e6ab3611528 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314986 Oct 28 10:01:20.668531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1406/2764] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:20.683932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:20.684874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:20.697735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:20.698568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:20.699223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:20.700134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:20.700787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:20.701788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:20.739683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:20.740680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:20.741386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:20.742076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lazy-loading 'fault' on Instance uuid 1d5baa6d-2dce-4a40-8e01-11209f47b532 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:20.909193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ec2ec5910404cc9aa621b4998b067bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd976570de164b69b58bfae7d4379e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:20.918209 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-abd7c953-b2d1-45d4-92db-2658fe39bcc2 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 200 len: 1306 microversion: 2.1 time: 0.248279 Oct 28 10:01:20.923984 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1407/2765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:20 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 1306 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:21.027540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Action: 'update', calling method: .version_select at 0x7fca3b950160>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:21.031353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.032573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.033202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.042780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.043621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.044277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.053249 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] HTTP exception thrown: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Request method failure captured: Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: request: PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81 HTTP/1.1 Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 56 Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hvsCZnfH_lpZkb3pfJ08XrXZjA0_8k57YElKGwZDIH-G_Z_Ah_7t3uBeArppf5BtKktvpaW8dsmNh_1lwyJs2KM1nzdQn2MyB-hIMaKoPEZCQvE3A-qWnqpgGSZRvqxFoLxlI5pJg4K0Jiw-fxnggDvPilGqEM87jyipKEPkkcwlQ Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 30430b6ef0b843d9a13a2d4df7d00a07 Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:01:21.056702 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30430b6ef0b843d9a13a2d4df7d00a07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30430b6ef0b843d9a13a2d4df7d00a07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30430b6ef0b843d9a13a2d4df7d00a07", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30430b6ef0b843d9a13a2d4df7d00a07"}]}] Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 30430b6ef0b843d9a13a2d4df7d00a07 Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8eb8460542534711a8f4453d55334cc4 Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:01:21.058040 n-d-zed-1 devstack@n-api.service[128747]: exception: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'ea3f4507-ac9d-4815-ae44-a58480ba4e81', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.058805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:21.059927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:21.061014 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:21.061014 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.061014 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.062979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Returning 404 to user: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:21.064117 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-20b477df-ee73-40df-a6b7-018b83ae9bc2 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81" status: 404 len: 110 microversion: 2.53 time: 0.138021 Oct 28 10:01:21.065266 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1408/2766] 10.222.0.16 () {62 vars in 1309 bytes} [Fri Oct 28 10:01:20 2022] PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81 => generated 110 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:21.072973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:21.074005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:21.080446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.081246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.081896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.084559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.085641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.086539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.131937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c3f6d36f-8ba5-4590-aa7d-ac163d9121e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.372302 Oct 28 10:01:21.133687 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1359/2767] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 10:01:17 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:21.139568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:21.141371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:21.169646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.170299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.170841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.171820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.172403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.174835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.334997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:21.346450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-090dd61f-b8b6-4dc2-84ee-9a71a34e3354 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.279755 Oct 28 10:01:21.361319 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1409/2768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:21 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:21.369823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Action: 'update', calling method: .version_select at 0x7fca3b8ff310>, body: {"status": "disabled"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:21.375357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.376155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.376945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.383513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.384335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.385477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.392462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] HTTP exception thrown: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Request method failure captured: Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: request: PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81 HTTP/1.1 Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 22 Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hvsCZnfH_lpZkb3pfJ08XrXZjA0_8k57YElKGwZDIH-G_Z_Ah_7t3uBeArppf5BtKktvpaW8dsmNh_1lwyJs2KM1nzdQn2MyB-hIMaKoPEZCQvE3A-qWnqpgGSZRvqxFoLxlI5pJg4K0Jiw-fxnggDvPilGqEM87jyipKEPkkcwlQ Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 30430b6ef0b843d9a13a2d4df7d00a07 Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:01:21.394392 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30430b6ef0b843d9a13a2d4df7d00a07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30430b6ef0b843d9a13a2d4df7d00a07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30430b6ef0b843d9a13a2d4df7d00a07", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30430b6ef0b843d9a13a2d4df7d00a07"}]}] Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 30430b6ef0b843d9a13a2d4df7d00a07 Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8eb8460542534711a8f4453d55334cc4 Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: {"status": "disabled"} Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: exception: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.395620 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'ea3f4507-ac9d-4815-ae44-a58480ba4e81', 'body': {'status': 'disabled'}} Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.396374 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:21.398058 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:21.399522 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:21.399522 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:21.400277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Returning 404 to user: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:21.401445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d8a5ad9-aefc-4224-a722-299a0b90854c tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81" status: 404 len: 110 microversion: 2.53 time: 0.050478 Oct 28 10:01:21.402563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1410/2769] 10.222.0.16 () {62 vars in 1309 bytes} [Fri Oct 28 10:01:21 2022] PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81 => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:21.411334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1432058958", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "5c66667c-6d75-4e82-a8a4-4669c43d1d73"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:21.506145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] validate_networks() for [('5c66667c-6d75-4e82-a8a4-4669c43d1d73', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:01:21.738974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:21.756999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:21.768481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:21.775596 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29265a90-6af8-4270-926c-b91f0aee660d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.639675 Oct 28 10:01:21.777756 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1360/2770] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:21 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:21.811121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d97b5953-b2c3-4a06-b523-782d5f641979 req-843b138a-94c7-4c7b-bf5d-70add61106d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15036a7f-b1b2-4ddc-ad24-03a31aa30e43", "tag": "999fb169-6be7-42c7-bbba-80d189096ad9"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:21.832972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d97b5953-b2c3-4a06-b523-782d5f641979 req-843b138a-94c7-4c7b-bf5d-70add61106d4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.833462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d97b5953-b2c3-4a06-b523-782d5f641979 req-843b138a-94c7-4c7b-bf5d-70add61106d4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.840967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d97b5953-b2c3-4a06-b523-782d5f641979 req-843b138a-94c7-4c7b-bf5d-70add61106d4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.882835 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d97b5953-b2c3-4a06-b523-782d5f641979 req-843b138a-94c7-4c7b-bf5d-70add61106d4 service nova] Creating event network-changed:999fb169-6be7-42c7-bbba-80d189096ad9 for instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 on n-h2-zed-1 Oct 28 10:01:21.906116 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d97b5953-b2c3-4a06-b523-782d5f641979 req-843b138a-94c7-4c7b-bf5d-70add61106d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110098 Oct 28 10:01:21.906815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1361/2771] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:21.920561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:21.924651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:21.933767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.936674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.937333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.942346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:21.942832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:21.943291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:21.943896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=44 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:22.605664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=58 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:22.816101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:22.824773 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-efde02c4-8d30-4e4e-9d66-73429d305ef2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 0.915784 Oct 28 10:01:22.833610 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1362/2772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:21 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:22.838922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Action: 'update', calling method: .version_select at 0x7fca3296c9d0>, body: {"status": "enabled"} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:22.861923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:22.862656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:22.863337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:22.893039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:22.893816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:22.894509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:22.925721 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] HTTP exception thrown: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Request method failure captured: Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81 HTTP/1.1 Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 21 Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hvsCZnfH_lpZkb3pfJ08XrXZjA0_8k57YElKGwZDIH-G_Z_Ah_7t3uBeArppf5BtKktvpaW8dsmNh_1lwyJs2KM1nzdQn2MyB-hIMaKoPEZCQvE3A-qWnqpgGSZRvqxFoLxlI5pJg4K0Jiw-fxnggDvPilGqEM87jyipKEPkkcwlQ Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 30430b6ef0b843d9a13a2d4df7d00a07 Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 10:01:22.945037 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30430b6ef0b843d9a13a2d4df7d00a07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/30430b6ef0b843d9a13a2d4df7d00a07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_30430b6ef0b843d9a13a2d4df7d00a07", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/30430b6ef0b843d9a13a2d4df7d00a07"}]}] Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 30430b6ef0b843d9a13a2d4df7d00a07 Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490 Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8eb8460542534711a8f4453d55334cc4 Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: {"status": "enabled"} Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: exception: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:22.946470 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ea3f4507-ac9d-4815-ae44-a58480ba4e81', 'body': {'status': 'enabled'}} Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:22.947851 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:22.949105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:22.950171 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. Oct 28 10:01:22.950171 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:22.950171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Returning 404 to user: Service ea3f4507-ac9d-4815-ae44-a58480ba4e81 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:22.951205 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f79eed4c-d2db-4175-b932-2db27cbcdb71 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81" status: 404 len: 110 microversion: 2.53 time: 0.114030 Oct 28 10:01:22.957833 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1363/2773] 10.222.0.16 () {62 vars in 1309 bytes} [Fri Oct 28 10:01:22 2022] PUT /compute/v2.1/os-services/ea3f4507-ac9d-4815-ae44-a58480ba4e81 => generated 110 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:22.969420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:22.970098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] [instance: 1d5baa6d-2dce-4a40-8e01-11209f47b532] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:23.019902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:23.020415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:23.020884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:23.035937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:23.041834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:23.048808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:23.118250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] HTTP exception thrown: Instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 could not be found. Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Request method failure captured: Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 HTTP/1.1 Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6f6MG6C8KLuWoomI-QRv3TD9z95Bsxs9x7V0er0u4YFcDeYEhm107lrs6AFJ5OvjCWN8mS857qeZ-4aSZv3nsObmJ2tVD7fw9ru-i4qG6YGukIGxI6-4i9tmuKHlv2XNFuOPIVu6Pk73S59teNaqzMLWsSWnXyEAPI3Oqlth81uwBQ Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: fd976570de164b69b58bfae7d4379e26 Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:23.122801 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd976570de164b69b58bfae7d4379e26"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fd976570de164b69b58bfae7d4379e26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fd976570de164b69b58bfae7d4379e26", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fd976570de164b69b58bfae7d4379e26"}]}] Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: fd976570de164b69b58bfae7d4379e26 Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1675285825 Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerTestJSON-1675285825-project Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 4ec2ec5910404cc9aa621b4998b067bd Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerTestJSON-1675285825-project Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 could not be found. Oct 28 10:01:23.124303 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1d5baa6d-2dce-4a40-8e01-11209f47b532'} Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 could not be found. Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:23.125160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 could not be found. Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 could not be found. Oct 28 10:01:23.126519 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:23.130565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] Returning 404 to user: Instance 1d5baa6d-2dce-4a40-8e01-11209f47b532 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:23.150961 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-051c3df9-762c-441e-bad9-0ba2c453c009 tempest-ImagesOneServerTestJSON-1675285825 tempest-ImagesOneServerTestJSON-1675285825-project] 10.222.0.16 "GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532" status: 404 len: 111 microversion: 2.1 time: 0.191806 Oct 28 10:01:23.164284 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1364/2774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:22 2022] GET /compute/v2.1/servers/1d5baa6d-2dce-4a40-8e01-11209f47b532 => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:23.174813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:23.175718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:23.195593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:23.197593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:23.199195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:23.201884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:23.203966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:23.204566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.362627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:24.373627 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-035e5b41-a73f-43cc-9cce-f94720b97d73 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 1.207378 Oct 28 10:01:24.382460 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1365/2775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:23 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:24.401184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:24.407051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:24.424752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.431317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.434767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.437818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.442911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.443589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.645719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:01:24.646268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:01:24.646859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:01:24.647888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:01:24.649357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:01:24.687782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.688592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.689385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.690306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.691059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.691650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.762712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Getting quotas for project 0c49ee1d5d5642749e3e90fb9d596636. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:24.769907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Getting quotas for user 854e41184e0f4b06aa85a150fec89fd4 and project 0c49ee1d5d5642749e3e90fb9d596636. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:24.788975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:01:24.791982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:01:24.884558 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a00f050-6e48-4f15-b3ff-0d2fbb1cd8b9 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.480372 Oct 28 10:01:24.889309 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1411/2776] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:01:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 3486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:01:24.898842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:24.909048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.910078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.910769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.911698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.912460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.913172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.955493 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d89b755-4ac6-4efc-9af1-52452f975170 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1224 microversion: 2.53 time: 0.064709 Oct 28 10:01:24.957238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1412/2777] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 10:01:24 2022] GET /compute/v2.1/os-services => generated 1224 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:24.964247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:24.966672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:24.975670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.977355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.978117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:24.979408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:24.980520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:24.981586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:25.094385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:25.104877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:25.114856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:25.116098 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca7c5449-f4e1-4a52-8fb5-dd4ba11ae3fc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.732362 Oct 28 10:01:25.134523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1366/2778] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:24 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:25.153889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dda27814-dd72-4c80-ab85-25841b9af652 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:25.158941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dda27814-dd72-4c80-ab85-25841b9af652 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:25.564332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dda27814-dd72-4c80-ab85-25841b9af652 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:25.571881 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dda27814-dd72-4c80-ab85-25841b9af652 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1224 microversion: 2.1 time: 0.435984 Oct 28 10:01:25.572479 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1367/2779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:25 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1224 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:25.595204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:25.606524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:25.625674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:25.626383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:25.627395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:25.628039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:25.628641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:25.723847 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-603555fd-0f3d-4bb7-94e9-9f07890e9f41 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1224 microversion: 2.53 time: 0.138281 Oct 28 10:01:25.724942 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1368/2780] 10.222.0.16 () {60 vars in 1211 bytes} [Fri Oct 28 10:01:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1224 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:25.738155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:25.739047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:25.765591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:25.768550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:25.769264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:25.770174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:25.773388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:25.774887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:25.808328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:25.818989 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bad98ce3-1cb2-4e81-b372-089a14abfa64 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 0.859581 Oct 28 10:01:25.831362 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1413/2781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:24 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:25.843485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:25.856143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:25.862938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:25.866814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:25.868785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:25.870884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:25.873467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:25.924193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:25.981871 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a007173-f588-432b-8ed4-6d3fdb29858e tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1224 microversion: 2.53 time: 0.149160 Oct 28 10:01:25.989714 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1414/2782] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 10:01:25 2022] GET /compute/v2.1/os-services => generated 1224 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:26.000217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:26.007246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.021803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.022270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.023107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.034408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.035191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.096735 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ab16bf3f-6b9a-436a-9664-c288e766f116 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-zed-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.100276 Oct 28 10:01:26.109722 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1415/2783] 10.222.0.16 () {60 vars in 1229 bytes} [Fri Oct 28 10:01:25 2022] GET /compute/v2.1/os-services?host=n-d-zed-1&binary=xxx => generated 16 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:26.113971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:26.124184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.125853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.127306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.130029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.131270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.132335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.201713 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d273047f-b8ad-482d-8101-33561ba54a1d tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1224 microversion: 2.53 time: 0.091534 Oct 28 10:01:26.202680 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1416/2784] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 10:01:26 2022] GET /compute/v2.1/os-services => generated 1224 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:01:26.208127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:26.210089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:26.224569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.225362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.225964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.226876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.229537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.230210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.311790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:26.356655 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb4a422d-76cc-4b93-8b15-48c2a84073ef tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.630382 Oct 28 10:01:26.381499 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1369/2785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:25 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:26.395136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:26.411483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.421212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.423085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.427189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.430662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.432187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.555809 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e2ae829b-bf42-4d48-aa86-a465fc069b06 tempest-ServicesAdminNegativeV253TestJSON-425035490 tempest-ServicesAdminNegativeV253TestJSON-425035490-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.168023 Oct 28 10:01:26.558610 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1370/2786] 10.222.0.16 () {60 vars in 1239 bytes} [Fri Oct 28 10:01:26 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:26.613831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:26.615172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:26.646041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.649436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.654732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.656460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:26.660248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:26.661020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:26.739669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:26.748777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:01:26.753034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:26.754613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:26.755855 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4951f82-c3c5-450c-b4e4-cf86e43d7dd5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.551785 Oct 28 10:01:26.764676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1417/2787] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:26 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:26.923693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:27.067268 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53b46c29-4f7e-487d-bc85-980ddb5cd8cb tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 204 len: 0 microversion: 2.25 time: 0.506908 Oct 28 10:01:27.073250 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1371/2788] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:26 2022] DELETE /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:01:27.084952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:27.092634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:27.115874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.118504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.119071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:27.119929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.122578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.133647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:27.302992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d0f8efc-c84d-4284-87ea-a0e391ddaf6e tempest-ServicesAdminNegativeV253TestJSON-2138293906 tempest-ServicesAdminNegativeV253TestJSON-2138293906-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:27.308020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d0f8efc-c84d-4284-87ea-a0e391ddaf6e tempest-ServicesAdminNegativeV253TestJSON-2138293906 tempest-ServicesAdminNegativeV253TestJSON-2138293906-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'debe6f28a9304322a95fa91f62e6663f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d393e04ca84c6085aaec0188815d7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d0f8efc-c84d-4284-87ea-a0e391ddaf6e tempest-ServicesAdminNegativeV253TestJSON-2138293906 tempest-ServicesAdminNegativeV253TestJSON-2138293906-project] Request method failure captured: Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hubeWxc_EBOwYmYG0-WNiU5zUaPXCs2X7c4T60x-X9GSyhedlBOeVSsiYn47Yu27TeqVkacKOAIyZz5k5EEoEgjPWl01VUvl3rnqOZ8kmu3HM676-2FVLJZErshKq1pUkGDpfgaN3YO11PgW1YCGmtUxzaVF5d2DDgj80FX_IY2us Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.53 Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: d9d393e04ca84c6085aaec0188815d7b Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-2138293906 Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:01:27.309726 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9d393e04ca84c6085aaec0188815d7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d9d393e04ca84c6085aaec0188815d7b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d9d393e04ca84c6085aaec0188815d7b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d9d393e04ca84c6085aaec0188815d7b"}]}] Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-2138293906 Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: d9d393e04ca84c6085aaec0188815d7b Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-2138293906 Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServicesAdminNegativeV253TestJSON-2138293906-project Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: debe6f28a9304322a95fa91f62e6663f Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-2138293906-project Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 10:01:27.311419 n-d-zed-1 devstack@n-api.service[128747]: action_args: {} Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 10:01:27.312383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 28 10:01:27.313802 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:27.316058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d0f8efc-c84d-4284-87ea-a0e391ddaf6e tempest-ServicesAdminNegativeV253TestJSON-2138293906 tempest-ServicesAdminNegativeV253TestJSON-2138293906-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:27.317281 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d0f8efc-c84d-4284-87ea-a0e391ddaf6e tempest-ServicesAdminNegativeV253TestJSON-2138293906 tempest-ServicesAdminNegativeV253TestJSON-2138293906-project] 10.222.0.16 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.547469 Oct 28 10:01:27.318335 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1418/2789] 10.222.0.16 () {60 vars in 1178 bytes} [Fri Oct 28 10:01:26 2022] GET /compute/v2.1/os-services => generated 112 bytes in 553 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:27.340047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:27.348233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:27.389925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.391176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.391997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:27.394843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.404363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.409763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:27.705268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:27.713720 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-425e86fc-a372-4712-ad77-870e6f1e7fdf tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1276 microversion: 2.1 time: 0.639051 Oct 28 10:01:27.714311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1372/2790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:27 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1276 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:27.739814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:27.740451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:27.760832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.764231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.764710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:27.765486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.765958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.766481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:27.850390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:27.865014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba369d31-de02-4bf4-b0ba-8a3ec96608e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 0.545373 Oct 28 10:01:27.876943 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1419/2791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:27 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:27.876943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:27.885265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:27.896713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.897336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.897796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:27.898573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:27.899049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:27.899486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:28.290961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:28.300460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-47c80954-077c-4ff1-8d1f-3c0f18bd0ad4 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.431196 Oct 28 10:01:28.302657 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1420/2792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:27 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:28.319401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:28.320867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:28.339679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:28.342136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:28.342594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:28.343341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:28.343787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:28.344311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:28.380118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:28.397765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:28.400023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:28.420928 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39c24af3-17fd-4d88-b603-aaae57ccf1ee tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1731 microversion: 2.25 time: 0.705498 Oct 28 10:01:28.426405 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1373/2793] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:27 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1731 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:28.744538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:28.745943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:28.766525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:28.767389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:28.769587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:28.773387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:28.775206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:28.782281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:29.224424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:29.246488 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b553dda4-6547-4899-80f9-10969c293a7e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1276 microversion: 2.1 time: 0.501277 Oct 28 10:01:29.249901 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1374/2794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:28 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1276 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:01:29.265386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:29.270326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:29.271161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:29.284658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:29.300323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:29.303478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:29.305847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:29.307017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:29.308331 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c535d510-031b-4694-b503-4d8636de86f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.996516 Oct 28 10:01:29.309418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:29.313358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:29.314204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:29.314644 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1421/2795] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:28 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:29.637427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7c04a633-25a5-41a7-8c10-9c35d9719cc2 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Action: 'create', calling method: .version_select at 0x7fca3b8fc700>, body: {"keypair": {"name": "tempest-keypair-1617596574", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+WHnQtbanYRhBWKXXv/yi4Y1z0xLvt7krJuRK45EtrqZ6d6sUaVHoDBiD9GiCH/+ihuoxgzkF2ORQFCv2dZ/SDmW4lnEayUB5sE3S0yFRL+0kbH6YaXjPZHQnYBRe06Q=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:29.678402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-7c04a633-25a5-41a7-8c10-9c35d9719cc2 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:29.693608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-7c04a633-25a5-41a7-8c10-9c35d9719cc2 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for user 6f37af6296ca45f98272703bc7d38fc6 and project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:29.772569 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7c04a633-25a5-41a7-8c10-9c35d9719cc2 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.456129 Oct 28 10:01:29.775663 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1422/2796] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:01:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:29.783647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:29.793444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:29.800001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:29.813742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:29.814490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:29.815427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:29.816055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:29.816657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:30.308931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:30.321321 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f168edda-30aa-485d-8111-776f7771fec9 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.543571 Oct 28 10:01:30.322151 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1423/2797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:29 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:30.340170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:30.343339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:30.363486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:30.372438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:30.373839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:30.377354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:30.378102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:30.378780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:30.450195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:30.458885 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b24a691-dab5-4948-b119-28c825ae2e01 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 1.204093 Oct 28 10:01:30.471279 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1375/2798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:29 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:30.478911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-682eecdf-2476-41ee-bbc2-e2662de2e2ba req-c03a6fdf-d41b-4dd9-9bb6-5213cbe5155f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be367ea1-2cc8-405d-a64f-c7ae19bcaa8c", "name": "network-vif-plugged", "status": "completed", "tag": "7aa11287-96b2-4657-8c67-92a2535d301e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:30.496629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-682eecdf-2476-41ee-bbc2-e2662de2e2ba req-c03a6fdf-d41b-4dd9-9bb6-5213cbe5155f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:30.505435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-682eecdf-2476-41ee-bbc2-e2662de2e2ba req-c03a6fdf-d41b-4dd9-9bb6-5213cbe5155f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:30.506339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-682eecdf-2476-41ee-bbc2-e2662de2e2ba req-c03a6fdf-d41b-4dd9-9bb6-5213cbe5155f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:30.545200 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-682eecdf-2476-41ee-bbc2-e2662de2e2ba req-c03a6fdf-d41b-4dd9-9bb6-5213cbe5155f service nova] Creating event network-vif-plugged:7aa11287-96b2-4657-8c67-92a2535d301e for instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c on n-h2-zed-1 Oct 28 10:01:30.579300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-682eecdf-2476-41ee-bbc2-e2662de2e2ba req-c03a6fdf-d41b-4dd9-9bb6-5213cbe5155f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106306 Oct 28 10:01:30.585015 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1376/2799] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:30.616081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-278e5e8e-3592-49b6-8a1d-8e85974a7a8f tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca328faca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:30.636198 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-278e5e8e-3592-49b6-8a1d-8e85974a7a8f tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs/tempest-keypair-1617596574" status: 200 len: 498 microversion: 2.1 time: 0.049004 Oct 28 10:01:30.651213 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1377/2800] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:01:30 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1617596574 => generated 498 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:30.656440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:30.665984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:30.691830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:30.701710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:30.702522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:30.703549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:30.713683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:30.714484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:30.910957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:30.945061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:30.947359 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1f44e4a1-f748-4326-bce5-e77ff58071e0 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1294 microversion: 2.1 time: 0.285946 Oct 28 10:01:30.961729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:30.961729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:30.962201 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c97be121-dec7-491f-8cb0-3ab735640661 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1731 microversion: 2.25 time: 0.638847 Oct 28 10:01:30.962711 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1424/2801] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:30 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1731 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:30.965097 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1378/2802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:30 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1294 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:30.970968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23edfe16-5efb-47c8-8983-fbc72ab701df tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca3270c790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:30.987451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:30.991769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:31.011244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:31.011754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:31.012193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:31.016701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:31.026150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:31.026920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:31.043406 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-23edfe16-5efb-47c8-8983-fbc72ab701df tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617596574" status: 202 len: 0 microversion: 2.1 time: 0.075693 Oct 28 10:01:31.045817 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1379/2803] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:01:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617596574 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:31.069476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75ddfc66-67ae-461c-afc8-ea51b4ce04b6 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Action: 'create', calling method: .version_select at 0x7fca328faf70>, body: {"keypair": {"name": "tempest-keypair-1610168974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8I8/hWOMqzYVv6aSOUta9Fz787ycKR2pO04w9aO8I/wQFYQ8oybQ6g3FaKiBZwS6AkTiSbNRhRUAn4lwmVbLmoDhFTr5Im6MUhTbUcJSwaVvQlK9Z7Q5Humlqw9eWYig=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:31.115523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-75ddfc66-67ae-461c-afc8-ea51b4ce04b6 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:31.130133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-75ddfc66-67ae-461c-afc8-ea51b4ce04b6 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for user 6f37af6296ca45f98272703bc7d38fc6 and project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:31.133538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:31.184336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75ddfc66-67ae-461c-afc8-ea51b4ce04b6 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125598 Oct 28 10:01:31.191070 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1380/2804] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:01:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:31.212242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b19ccab4-5d01-4290-bf6a-5d646a749285 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca3296b9d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:31.253915 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b19ccab4-5d01-4290-bf6a-5d646a749285 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610168974" status: 202 len: 0 microversion: 2.1 time: 0.058609 Oct 28 10:01:31.254909 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1381/2805] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:01:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1610168974 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:31.269428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b71ff60d-c5dd-42a2-a438-d496e0c42a0a tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Action: 'create', calling method: .version_select at 0x7fca328fa430>, body: {"keypair": {"name": "tempest-keypair-1841467059", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:31.303417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b71ff60d-c5dd-42a2-a438-d496e0c42a0a tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:31.325586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b71ff60d-c5dd-42a2-a438-d496e0c42a0a tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for user 6f37af6296ca45f98272703bc7d38fc6 and project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:31.397731 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b71ff60d-c5dd-42a2-a438-d496e0c42a0a tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.133507 Oct 28 10:01:31.405095 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1382/2806] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:01:31 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:31.417162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:31.417805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:31.452125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:31.453664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:31.457882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:31.464290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:31.469019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:31.471186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:31.766809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:31.783006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:31.784881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:31.786416 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83d7e995-2310-48ab-add2-634361d8741d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.822757 Oct 28 10:01:31.807747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1425/2807] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:30 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:31.829119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e953e8c-ea6a-49a4-96a8-dc91162f44e2 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca3b8ff1f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:31.877131 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e953e8c-ea6a-49a4-96a8-dc91162f44e2 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841467059" status: 202 len: 0 microversion: 2.1 time: 0.065599 Oct 28 10:01:31.887955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1426/2808] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:01:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1841467059 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:31.901814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:31.905848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:31.922436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:31.923183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:31.923863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:31.925476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:31.927301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:31.928375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:31.993615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:32.010725 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c4ad531a-a965-4609-9e50-f8de2add87f1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1313 microversion: 2.1 time: 0.605825 Oct 28 10:01:32.014692 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1383/2809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:31 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1313 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:32.038407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84d02fa0-e185-4e0e-a048-51fdc9f729bd tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Action: 'create', calling method: .version_select at 0x7fca3814d3a0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-458959473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLf6maC2Vo3DNvqaEiyS6sP/IDXYW/siXnno5ZsCV3JG+Ixv15sxDKKfnqQAhVvLmizf+hWdA52Ya4oHy6FQUPIv0uC616UDAadYwb6gJ6MXEVXwtCoha0kQOu1cBTyB5w=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:32.094870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-84d02fa0-e185-4e0e-a048-51fdc9f729bd tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:32.113550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-84d02fa0-e185-4e0e-a048-51fdc9f729bd tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for user 6f37af6296ca45f98272703bc7d38fc6 and project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:32.202443 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84d02fa0-e185-4e0e-a048-51fdc9f729bd tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.185036 Oct 28 10:01:32.218661 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1384/2810] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:01:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:32.231390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:32.233106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:32.256226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:32.257378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:32.258762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:32.259940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:32.260550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:32.261213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:32.506069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:32.519118 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d31421d6-544b-45d1-9cc9-ce9a9afc48c6 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1282 microversion: 2.1 time: 0.296415 Oct 28 10:01:32.519724 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1385/2811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:32 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1282 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:32.524766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:32.525419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:32.556201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:32.557229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:32.557857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:32.566703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:32.567450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:32.568053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:32.923572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:32.945977 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a16e96b-b24e-4127-8331-47d8cdb27948 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 1.055298 Oct 28 10:01:32.950082 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1427/2812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:31 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:33.003392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb528484-0618-42db-b098-7a3d61846a47 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Action: 'create', calling method: .version_select at 0x7fca3b950820>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-467962080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdMAO4CIOiD/QvuO9Dxr89CfEZCrXhh1R1RcoI+n/14DBFPbi3y+ehnBJJg8t0Wu9USYxEMb/P3v53HmxrDOzqiP7Gf4Ll+SLLvKQ2KlqgldIZobZ2SAwwOJDcVCBxn3g=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:33.084999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-eb528484-0618-42db-b098-7a3d61846a47 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:33.121993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-eb528484-0618-42db-b098-7a3d61846a47 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for user 6f37af6296ca45f98272703bc7d38fc6 and project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:33.230260 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb528484-0618-42db-b098-7a3d61846a47 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.273337 Oct 28 10:01:33.232128 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1428/2813] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:01:32 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:33.247831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:33.248665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:33.283289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:33.285795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:33.289475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:33.294110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:33.297960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:33.300146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:33.335401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:33.362556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:33.364026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:33.365334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09ad60a7-8fa0-4ca3-a25f-c26628dd62bc tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1664 microversion: 2.25 time: 0.844586 Oct 28 10:01:33.365928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1386/2814] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:32 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1664 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:33.387045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:33.387677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:33.460463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:33.462044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:33.465380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:33.466851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:33.469542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:33.470439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:33.681546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:33.727681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:33.736251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:33.744683 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b14073fb-326a-4847-b7c3-19efb3d07170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.511060 Oct 28 10:01:33.757598 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1429/2815] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:33 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:33.773538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d4b51553-25da-4732-aeed-b2c0553e6d2f req-c482580e-551d-49dc-987e-b522f5d9a86b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6255ec55-f11e-457b-b949-b17da3834864", "name": "network-vif-deleted", "tag": "dedd9f55-4ec9-4fd5-bc71-af4596ace404"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:33.788279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d4b51553-25da-4732-aeed-b2c0553e6d2f req-c482580e-551d-49dc-987e-b522f5d9a86b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:33.789762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d4b51553-25da-4732-aeed-b2c0553e6d2f req-c482580e-551d-49dc-987e-b522f5d9a86b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:33.790433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d4b51553-25da-4732-aeed-b2c0553e6d2f req-c482580e-551d-49dc-987e-b522f5d9a86b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:33.808300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d4b51553-25da-4732-aeed-b2c0553e6d2f req-c482580e-551d-49dc-987e-b522f5d9a86b service nova] Creating event network-vif-deleted:dedd9f55-4ec9-4fd5-bc71-af4596ace404 for instance 6255ec55-f11e-457b-b949-b17da3834864 on n-h1-zed-1 Oct 28 10:01:33.815964 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d4b51553-25da-4732-aeed-b2c0553e6d2f req-c482580e-551d-49dc-987e-b522f5d9a86b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046224 Oct 28 10:01:33.817303 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1430/2816] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:33.828371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6dcdfe9b-9b2e-4b6d-8001-de64b90e441c tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Action: 'create', calling method: .version_select at 0x7fca3b9c0d30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1658851938", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzX+Wh9+fPyBD5rCksY4NnKTsEBtmMlivmivOnwM9KWRsj1TvwNW9DRehJoSFFvFQxbRYsJG8btUtJOOH9EaLig4oei7kV/w+OKR852U66Hxeig6IfH08k6DiiL+zIAQg=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:33.886581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-6dcdfe9b-9b2e-4b6d-8001-de64b90e441c tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:33.910796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-6dcdfe9b-9b2e-4b6d-8001-de64b90e441c tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Getting quotas for user 6f37af6296ca45f98272703bc7d38fc6 and project 36e12e5f8a5f4c32a72e14ca507993cd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:33.977590 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6dcdfe9b-9b2e-4b6d-8001-de64b90e441c tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.158187 Oct 28 10:01:33.978606 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1431/2817] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:01:33 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:33.984036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:33.984984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:33.997726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.000067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.003351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.003762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.012126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.012765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.072208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:34.153348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:34.186308 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ece2f62-681c-45c8-8593-9acbe2286bc8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1282 microversion: 2.1 time: 0.206361 Oct 28 10:01:34.187268 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1432/2818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:33 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:34.193284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:34.193971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:34.213133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.213133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.213133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.213133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.223617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.224082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.460430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:34.471497 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af84ae3f-e141-40bc-ac30-732612547f0a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1497 microversion: 2.1 time: 1.097120 Oct 28 10:01:34.493627 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1387/2819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:33 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1497 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:34.504591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95d99a6e-20b5-4ee7-96bd-a69cf992e3da tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca32931ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:34.517156 n-d-zed-1 devstack@n-api.service[128748]: WARNING oslo_db.sqlalchemy.utils [None req-95d99a6e-20b5-4ee7-96bd-a69cf992e3da tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 10:01:34.544857 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-95d99a6e-20b5-4ee7-96bd-a69cf992e3da tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.049955 Oct 28 10:01:34.552521 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1388/2820] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:01:34 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:34.566362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:34.567015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:34.612628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.614124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.614613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.615464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.615975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.622672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.640055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:34.688806 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b78d737b-0f4f-429d-ab70-1c4387f33448 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 0.500335 Oct 28 10:01:34.719013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1433/2821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:34 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:34.726092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c9b6b2bf-851a-4317-b9b3-3166accb2bf1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:34.797504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.800489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.801282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.802487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.server_groups [None req-c9b6b2bf-851a-4317-b9b3-3166accb2bf1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Querying cell 308273ef-dc1c-40ee-a51c-31916410c877(cell1) for 1 instances {{(pid=128747) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 10:01:34.802978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lazy-loading 'fault' on Instance uuid 6255ec55-f11e-457b-b949-b17da3834864 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:34.803698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2bf-851a-4317-b9b3-3166accb2bf1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:34.804370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2bf-851a-4317-b9b3-3166accb2bf1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:34.808673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b6b2bf-851a-4317-b9b3-3166accb2bf1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:34.929635 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c9b6b2bf-851a-4317-b9b3-3166accb2bf1 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/9eac0381-947a-40b3-b9ab-a0d764d46b66" status: 200 len: 222 microversion: 2.1 time: 0.205129 Oct 28 10:01:34.933323 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1434/2822] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:01:34 2022] GET /compute/v2.1/os-server-groups/9eac0381-947a-40b3-b9ab-a0d764d46b66 => generated 222 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:34.945942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-27420b4f-9405-4c69-8a82-f9a9471fa367 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca3b90f8b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:35.014569 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-27420b4f-9405-4c69-8a82-f9a9471fa367 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1658851938" status: 202 len: 0 microversion: 2.1 time: 0.078169 Oct 28 10:01:35.017800 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1435/2823] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 10:01:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1658851938 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:35.034401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:35.036265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:35.058495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:35.059071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:35.060954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:35.061802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:35.062273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:35.065951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:35.490055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:35.505498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:35.510254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:35.527886 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0748274-ccf2-4e3a-930b-4b9fef311a17 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.508473 Oct 28 10:01:35.531547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1436/2824] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:35 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:35.552372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:35.553021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:35.578208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:35.578804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:35.579386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:35.580305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:35.580853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:35.581977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:35.683205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:01:35.839300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:35.850021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:35.861214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:35.865913 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-182ae312-d86f-46c2-98e5-1ad136ab760f tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 200 len: 1375 microversion: 2.25 time: 1.303504 Oct 28 10:01:35.866774 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1389/2825] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:34 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 1375 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:35.880760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-970eea5c-9ece-4c63-9f99-f0b62222d647 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca3288fee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:35.965622 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-970eea5c-9ece-4c63-9f99-f0b62222d647 tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-467962080" status: 202 len: 0 microversion: 2.1 time: 0.085416 Oct 28 10:01:35.971995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1390/2826] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:01:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-467962080 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:36.013324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:36.014111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:36.042626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.043159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.053101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.054171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.054741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.055314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.069565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e0b9fd8-5d83-443a-b427-3795804cd89e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 204 len: 0 microversion: 2.1 time: 0.529968 Oct 28 10:01:36.071483 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1437/2827] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:01:35 2022] DELETE /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:36.097066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-2954dc56-69e5-4023-8bc4-b0172e68fe3b req-a3d8f1e6-05bf-4bde-ba81-4b5cbbeb416c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15036a7f-b1b2-4ddc-ad24-03a31aa30e43", "name": "network-vif-plugged", "status": "completed", "tag": "999fb169-6be7-42c7-bbba-80d189096ad9"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:36.156556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2954dc56-69e5-4023-8bc4-b0172e68fe3b req-a3d8f1e6-05bf-4bde-ba81-4b5cbbeb416c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.157098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2954dc56-69e5-4023-8bc4-b0172e68fe3b req-a3d8f1e6-05bf-4bde-ba81-4b5cbbeb416c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.157499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2954dc56-69e5-4023-8bc4-b0172e68fe3b req-a3d8f1e6-05bf-4bde-ba81-4b5cbbeb416c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.176748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=14 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:36.193784 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-2954dc56-69e5-4023-8bc4-b0172e68fe3b req-a3d8f1e6-05bf-4bde-ba81-4b5cbbeb416c service nova] Creating event network-vif-plugged:999fb169-6be7-42c7-bbba-80d189096ad9 for instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 on n-h2-zed-1 Oct 28 10:01:36.225307 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-2954dc56-69e5-4023-8bc4-b0172e68fe3b req-a3d8f1e6-05bf-4bde-ba81-4b5cbbeb416c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152311 Oct 28 10:01:36.226211 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1438/2828] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:36.238044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:36.244511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:36.252894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.253427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.253869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.254658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.255060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.255476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.465916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:36.515065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:36.525652 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc831a91-4231-4597-ac68-2a402202352f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 0.292747 Oct 28 10:01:36.528275 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1439/2829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:36 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:36.545772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-346635ef-f8f0-40d1-9763-c701bac54bfa tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] Calling method '.version_select at 0x7fca3b9c0d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:36.586392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:36.595248 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-346635ef-f8f0-40d1-9763-c701bac54bfa tempest-KeyPairsV2TestJSON-393068903 tempest-KeyPairsV2TestJSON-393068903-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-458959473" status: 202 len: 0 microversion: 2.1 time: 0.065830 Oct 28 10:01:36.606052 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1440/2830] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:01:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-458959473 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:01:36.623278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:36.624725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:36.646343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.646855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.649268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.650076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.650549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.650986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.823089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:36.837073 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97461650-cd4e-49b3-a098-8c0af3581600 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 0.861102 Oct 28 10:01:36.855284 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1391/2831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:35 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:36.871022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:36.874040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:36.898274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.900877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.901475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:36.902130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:36.904840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:36.906423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:37.078731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:37.088237 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba4b4d6e-5a74-4c13-ba7e-367ea91b7a46 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1503 microversion: 2.1 time: 0.480757 Oct 28 10:01:37.088834 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1441/2832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:36 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1503 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:37.106840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:37.112417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 6255ec55-f11e-457b-b949-b17da3834864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:37.134521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:37.135224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:37.136699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:37.137507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:37.137985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:37.140573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:37.192185 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] HTTP exception thrown: Instance 6255ec55-f11e-457b-b949-b17da3834864 could not be found. Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Request method failure captured: Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 HTTP/1.1 Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6aBxox-a1sYLzK1ic4JO2gFdVF6VXTgEeILGMhiLxUXUUCIBWvsLMJ19LUOisCjPOyjWoQZ-2w9rM6l9h2D1JoFwNk4plf061vdYLT39O3iHjJa0na6eqJUtkDORyx-BaW0KVZDPsaUKAnCQqkSbayACWfmYLHNAWn8Vff5F51AXhw Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:01:37.196113 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a563769bd6e84594b3837db9d0fdafd4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a563769bd6e84594b3837db9d0fdafd4"}]}] Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 52e08cff441e4fb0b01886d81a7b5ad6 Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 6255ec55-f11e-457b-b949-b17da3834864 could not be found. Oct 28 10:01:37.197852 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '6255ec55-f11e-457b-b949-b17da3834864'} Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6255ec55-f11e-457b-b949-b17da3834864 could not be found. Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:37.198738 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6255ec55-f11e-457b-b949-b17da3834864 could not be found. Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6255ec55-f11e-457b-b949-b17da3834864 could not be found. Oct 28 10:01:37.200169 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:37.210371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Returning 404 to user: Instance 6255ec55-f11e-457b-b949-b17da3834864 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:37.212014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c2405f5-9eb6-4038-8750-a75dc4ffea80 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864" status: 404 len: 111 microversion: 2.25 time: 0.115393 Oct 28 10:01:37.215201 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1442/2833] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:37 2022] GET /compute/v2.1/servers/6255ec55-f11e-457b-b949-b17da3834864 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:37.224807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-baca32d4-3aff-4036-921a-90ae29389026 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '.version_select at 0x7fca3b9578b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:37.255199 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-baca32d4-3aff-4036-921a-90ae29389026 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-393075797" status: 204 len: 0 microversion: 2.25 time: 0.034854 Oct 28 10:01:37.257429 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1443/2834] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 10:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-393075797 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:01:37.338550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:37.348851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:37.350700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:37.353032 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-65a51087-2cca-4e25-b83a-eab092594c1d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.495890 Oct 28 10:01:37.354221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1392/2835] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:36 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:37.542521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1822880688", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "43667df7-fc7f-4fd7-8495-77da094fb553"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:37.557874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:37.558856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:37.574504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:37.575310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:37.575930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:37.577520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:37.582537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:37.583435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:37.961783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] validate_networks() for [('43667df7-fc7f-4fd7-8495-77da094fb553', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:01:38.069169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:38.083227 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a4818a69-171b-417c-9d7b-2554b53ebbbc tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1322 microversion: 2.1 time: 0.532986 Oct 28 10:01:38.084395 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1393/2836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:37 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1322 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:38.092872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:38.093780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:38.106401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:38.107160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:38.107803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:38.109428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:38.110081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:38.110701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:38.443561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:38.468382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-afd8a6d1-ddb4-4a10-baa0-2a6394805eb1 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 0.379554 Oct 28 10:01:38.492862 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1394/2837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:38 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:38.499686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:38.500603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:38.511013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:38.511900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:38.513040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:38.514167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:38.515390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:38.516000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:39.064767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:39.075105 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-35b07141-ec36-43ea-9787-685852045a8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1503 microversion: 2.1 time: 0.579067 Oct 28 10:01:39.077376 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1395/2838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:38 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1503 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:39.084589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:39.085240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:39.097832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:39.098328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:39.098771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:39.099483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:39.099922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:39.100354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:39.155663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:39.687345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:39.704677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:39.706713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:39.720603 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffcc873e-45ab-43ec-84f3-d533c46e2633 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.641526 Oct 28 10:01:39.725980 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1396/2839] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:39 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:39.741808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:39.749744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:39.759156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:39.761075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:39.766480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:39.767507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:39.769338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:39.769912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:39.824265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:01:39.825283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:01:39.825961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:01:39.826545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:01:39.827324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:01:39.848939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:39.849509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:39.849965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:39.850731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:39.851200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:39.855187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:39.919848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:39.942251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for user 28313b7c89184dd683e3479d23be489d and project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:39.990024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:01:40.000964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:01:40.146381 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c589c678-adec-46ca-b1ca-c494c9313476 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.879786 Oct 28 10:01:40.155227 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1444/2840] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:01:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:01:40.169968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8b9988a3-033a-4912-89fd-3b7c85bdb5c3 req-e95f1cbf-6d85-4ac1-9d97-89bf4597d2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11921705-654f-4224-b9b2-55157e647230", "tag": "f5105d67-baf4-4443-877a-953ed3b3316d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:40.233756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b9988a3-033a-4912-89fd-3b7c85bdb5c3 req-e95f1cbf-6d85-4ac1-9d97-89bf4597d2aa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.234568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b9988a3-033a-4912-89fd-3b7c85bdb5c3 req-e95f1cbf-6d85-4ac1-9d97-89bf4597d2aa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.235236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b9988a3-033a-4912-89fd-3b7c85bdb5c3 req-e95f1cbf-6d85-4ac1-9d97-89bf4597d2aa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.270485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8b9988a3-033a-4912-89fd-3b7c85bdb5c3 req-e95f1cbf-6d85-4ac1-9d97-89bf4597d2aa service nova] Creating event network-changed:f5105d67-baf4-4443-877a-953ed3b3316d for instance 11921705-654f-4224-b9b2-55157e647230 on n-h1-zed-1 Oct 28 10:01:40.277540 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8b9988a3-033a-4912-89fd-3b7c85bdb5c3 req-e95f1cbf-6d85-4ac1-9d97-89bf4597d2aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120243 Oct 28 10:01:40.280290 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1445/2841] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:40.303876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:40.307627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:40.331739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.340053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.341068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.343000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.347380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.348480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.638947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:40.652950 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bfd2a475-254a-4f02-a183-5a9775455247 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 0.361998 Oct 28 10:01:40.665263 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1446/2842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:40 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:40.674904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-48b0ecc9-91f6-4d9b-980b-ae7b7b8b0e4f req-6397377b-e55f-47ab-91b0-afe59d38787b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be367ea1-2cc8-405d-a64f-c7ae19bcaa8c", "name": "network-vif-deleted", "tag": "7aa11287-96b2-4657-8c67-92a2535d301e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:40.697798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48b0ecc9-91f6-4d9b-980b-ae7b7b8b0e4f req-6397377b-e55f-47ab-91b0-afe59d38787b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.698551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48b0ecc9-91f6-4d9b-980b-ae7b7b8b0e4f req-6397377b-e55f-47ab-91b0-afe59d38787b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.699146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48b0ecc9-91f6-4d9b-980b-ae7b7b8b0e4f req-6397377b-e55f-47ab-91b0-afe59d38787b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.716943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-48b0ecc9-91f6-4d9b-980b-ae7b7b8b0e4f req-6397377b-e55f-47ab-91b0-afe59d38787b service nova] Creating event network-vif-deleted:7aa11287-96b2-4657-8c67-92a2535d301e for instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c on n-h2-zed-1 Oct 28 10:01:40.737835 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-48b0ecc9-91f6-4d9b-980b-ae7b7b8b0e4f req-6397377b-e55f-47ab-91b0-afe59d38787b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068536 Oct 28 10:01:40.739189 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1447/2843] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:40.750452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:40.751463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:40.759215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.760701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.761449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.762535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.763118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:40.763899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.764565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.781781 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4a217fc-15fa-4d0c-bae4-00be92423245 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1472 microversion: 2.1 time: 1.053138 Oct 28 10:01:40.784807 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1397/2844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:39 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1472 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:40.810021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2de81b95-5d99-45ee-812f-7abca534b24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:40.812137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2de81b95-5d99-45ee-812f-7abca534b24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:40.816849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.817909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.818951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.819642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lazy-loading 'fault' on Instance uuid be367ea1-2cc8-405d-a64f-c7ae19bcaa8c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:40.919404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0db24bba973f4b52b0c1409fd80daf74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a1eb6ee53b0459b9ba5a61dec5108e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:40.935587 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cff84b30-696c-4fa6-84ce-bbfc0ddaa75b tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 200 len: 1303 microversion: 2.1 time: 0.194931 Oct 28 10:01:40.945032 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1448/2845] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:40 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 1303 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:40.956847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:40.960351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:40.974952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.976265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.978422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:40.989414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:40.990292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:40.991468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:41.020282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2de81b95-5d99-45ee-812f-7abca534b24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:41.030348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2de81b95-5d99-45ee-812f-7abca534b24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1225 microversion: 2.1 time: 0.242556 Oct 28 10:01:41.058005 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1398/2846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:40 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1225 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:41.065739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:41.068162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:01:41.068850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:41.082003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:41.082892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:41.083698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:41.084985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:41.085611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:41.086727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:41.398403 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22797df7-b660-41d3-a1d1-f3f658157a46 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 204 len: 0 microversion: 2.25 time: 0.449467 Oct 28 10:01:41.400549 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1449/2847] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:40 2022] DELETE /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:01:41.762435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-142aa0a3-d68b-4285-82a0-87a362ef211d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:41.764023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-142aa0a3-d68b-4285-82a0-87a362ef211d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] [instance: 517d5a39-a4ea-4ae3-9535-5becb849e712] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:41.775898 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-142aa0a3-d68b-4285-82a0-87a362ef211d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] HTTP exception thrown: Instance 517d5a39-a4ea-4ae3-9535-5becb849e712 could not be found. Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-142aa0a3-d68b-4285-82a0-87a362ef211d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Request method failure captured: Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/517d5a39-a4ea-4ae3-9535-5becb849e712/action HTTP/1.1 Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 15 Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hjkTxB1tm5lOQz2FV9JvoMhxuoaOg8xUKwXNJDktWv4SFNGY5hpMfTgYqd71qPVlZ_LsnX_N1I3sZRoliWEDyNpTYWpUaxH4f2jQk__yVEDZ1oYetPTL-RHeEdmxfUNUUsPvpsD8pPVYLBuJzlaYjStSPxKPTsy45McencksuuL78 Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:01:41.779162 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3807951fd06940f4aeb74425c22415a2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3807951fd06940f4aeb74425c22415a2"}]}] Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 3522ce5a8a9b4eb68f5323342fb96c28 Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: {"migrate": {}} Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:01:41.780538 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 517d5a39-a4ea-4ae3-9535-5becb849e712 could not be found. Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '517d5a39-a4ea-4ae3-9535-5becb849e712', 'body': {'migrate': {}}} Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 517d5a39-a4ea-4ae3-9535-5becb849e712 could not be found. Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:41.781402 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 517d5a39-a4ea-4ae3-9535-5becb849e712 could not be found. Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 517d5a39-a4ea-4ae3-9535-5becb849e712 could not be found. Oct 28 10:01:41.782584 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:41.786567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-142aa0a3-d68b-4285-82a0-87a362ef211d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Returning 404 to user: Instance 517d5a39-a4ea-4ae3-9535-5becb849e712 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:41.788010 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-142aa0a3-d68b-4285-82a0-87a362ef211d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/517d5a39-a4ea-4ae3-9535-5becb849e712/action" status: 404 len: 111 microversion: 2.1 time: 0.384339 Oct 28 10:01:41.788874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1450/2848] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:01:41 2022] POST /compute/v2.1/servers/517d5a39-a4ea-4ae3-9535-5becb849e712/action => generated 111 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:41.832039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:41.832739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:41.839423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:41.839935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:41.840382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:41.841161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:41.841578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:41.842011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.150706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.167869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.168340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.172836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.175339 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-03008be6-d353-4e52-8f8a-2539cc9364dc tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 1.115619 Oct 28 10:01:42.177164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.181100 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1399/2849] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:41 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:42.184806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:42.185674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:42.192577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.193226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.193958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.195511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.195812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.196203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.196732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.202092 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aea20e0d-aa95-43fc-986f-9010a016fd4e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1550 microversion: 2.25 time: 0.406656 Oct 28 10:01:42.202756 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1451/2850] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:41 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1550 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:42.225784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1339774977", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:42.300177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:01:42.571471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.581868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39d4a628-7ee7-4294-b4ba-ae0d07bf75eb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 0.401971 Oct 28 10:01:42.585593 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1400/2851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:42 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:42.593661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:42.594744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:42.603718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.604943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.605631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.606836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.607496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.608785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.624334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] HTTP exception thrown: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Request method failure captured: Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c HTTP/1.1 Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hSB-GGGnF7cpT3ZnfVWybFgNynyF7GgHrY-8AG76nii33OVev5ZmYw8hHpG2opMWdxLnIDS8mOU6SIAoLC7H_4ySB4jF2lbteq1TOVu1RemPh8-DDeWkfyYWMjBcePvKhZxF_uax5ZL-8Te6Ap9_ct5pTAoxj_FLVRN8n2IJZDNbM Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:42.626704 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a1eb6ee53b0459b9ba5a61dec5108e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}] Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0db24bba973f4b52b0c1409fd80daf74 Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.628352 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'be367ea1-2cc8-405d-a64f-c7ae19bcaa8c'} Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:42.629142 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.630289 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.637016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Returning 404 to user: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:42.638489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f268c959-2155-4ef2-b315-c36abbdcfb8e tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 404 len: 111 microversion: 2.1 time: 0.050302 Oct 28 10:01:42.639331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1401/2852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:42 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:42.645724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:42.646670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:42.653949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.654811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.655623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.656573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.657379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.658172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.798538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:42.810785 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9fd21f3-ecb3-4bfb-b106-523e0901a41a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1285 microversion: 2.1 time: 0.169070 Oct 28 10:01:42.811720 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1402/2853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:42 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:42.816686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0f168ab-9670-4028-8269-49dcf57eb2d0 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:42.835823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.server_groups [None req-d0f168ab-9670-4028-8269-49dcf57eb2d0 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Querying cell 308273ef-dc1c-40ee-a51c-31916410c877(cell1) for 1 instances {{(pid=128748) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 10:01:42.836834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f168ab-9670-4028-8269-49dcf57eb2d0 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.837961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f168ab-9670-4028-8269-49dcf57eb2d0 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.838595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f168ab-9670-4028-8269-49dcf57eb2d0 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.853450 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0f168ab-9670-4028-8269-49dcf57eb2d0 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.040434 Oct 28 10:01:42.862474 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1403/2854] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:01:42 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:42.873725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c1ccd37f-ff07-4668-bc93-2bb22c2040ae tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:42.909903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.server_groups [None req-c1ccd37f-ff07-4668-bc93-2bb22c2040ae tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Querying cell 308273ef-dc1c-40ee-a51c-31916410c877(cell1) for 1 instances {{(pid=128748) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 28 10:01:42.910637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ccd37f-ff07-4668-bc93-2bb22c2040ae tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.911207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ccd37f-ff07-4668-bc93-2bb22c2040ae tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.911648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ccd37f-ff07-4668-bc93-2bb22c2040ae tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.928882 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c1ccd37f-ff07-4668-bc93-2bb22c2040ae tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/9eac0381-947a-40b3-b9ab-a0d764d46b66" status: 200 len: 184 microversion: 2.1 time: 0.059441 Oct 28 10:01:42.930687 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1404/2855] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:01:42 2022] GET /compute/v2.1/os-server-groups/9eac0381-947a-40b3-b9ab-a0d764d46b66 => generated 184 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:42.947239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:42.948139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:42.960318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.960835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.961448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.962230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:42.963443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:42.963892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:42.989261 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] HTTP exception thrown: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Request method failure captured: Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c HTTP/1.1 Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hSB-GGGnF7cpT3ZnfVWybFgNynyF7GgHrY-8AG76nii33OVev5ZmYw8hHpG2opMWdxLnIDS8mOU6SIAoLC7H_4ySB4jF2lbteq1TOVu1RemPh8-DDeWkfyYWMjBcePvKhZxF_uax5ZL-8Te6Ap9_ct5pTAoxj_FLVRN8n2IJZDNbM Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:42.991033 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a1eb6ee53b0459b9ba5a61dec5108e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}] Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0db24bba973f4b52b0c1409fd80daf74 Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.993149 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'be367ea1-2cc8-405d-a64f-c7ae19bcaa8c'} Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:42.997062 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:42.998406 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:42.999761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Returning 404 to user: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:42.999761 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5d3685f-d96e-4091-80a6-2780d7736dc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 404 len: 111 microversion: 2.1 time: 0.051406 Oct 28 10:01:42.999761 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1405/2856] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:01:42 2022] DELETE /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:43.002124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.002739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] [instance: be367ea1-2cc8-405d-a64f-c7ae19bcaa8c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:43.009633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.010876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.011560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.012367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.012795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.013254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.032559 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] HTTP exception thrown: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Request method failure captured: Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c HTTP/1.1 Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hSB-GGGnF7cpT3ZnfVWybFgNynyF7GgHrY-8AG76nii33OVev5ZmYw8hHpG2opMWdxLnIDS8mOU6SIAoLC7H_4ySB4jF2lbteq1TOVu1RemPh8-DDeWkfyYWMjBcePvKhZxF_uax5ZL-8Te6Ap9_ct5pTAoxj_FLVRN8n2IJZDNbM Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:43.034164 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a1eb6ee53b0459b9ba5a61dec5108e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}] Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0db24bba973f4b52b0c1409fd80daf74 Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:43.035539 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'be367ea1-2cc8-405d-a64f-c7ae19bcaa8c'} Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:43.037213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. Oct 28 10:01:43.038581 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.040330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Returning 404 to user: Instance be367ea1-2cc8-405d-a64f-c7ae19bcaa8c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:43.040330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1512acd4-3a70-4d3c-8caf-cff2af247427 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c" status: 404 len: 111 microversion: 2.1 time: 0.037621 Oct 28 10:01:43.040330 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1406/2857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:42 2022] GET /compute/v2.1/servers/be367ea1-2cc8-405d-a64f-c7ae19bcaa8c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:43.047704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a0b27e8f-a508-405b-b4e8-4b5e9a0ebaac tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.057801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a0b27e8f-a508-405b-b4e8-4b5e9a0ebaac tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] HTTP exception thrown: Instance group 503fc347-1d77-4563-a6bb-66f1334cd1a8 could not be found. Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a0b27e8f-a508-405b-b4e8-4b5e9a0ebaac tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Request method failure captured: Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-server-groups/503fc347-1d77-4563-a6bb-66f1334cd1a8 HTTP/1.1 Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hSB-GGGnF7cpT3ZnfVWybFgNynyF7GgHrY-8AG76nii33OVev5ZmYw8hHpG2opMWdxLnIDS8mOU6SIAoLC7H_4ySB4jF2lbteq1TOVu1RemPh8-DDeWkfyYWMjBcePvKhZxF_uax5ZL-8Te6Ap9_ct5pTAoxj_FLVRN8n2IJZDNbM Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:43.064462 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a1eb6ee53b0459b9ba5a61dec5108e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}] Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0db24bba973f4b52b0c1409fd80daf74 Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance group 503fc347-1d77-4563-a6bb-66f1334cd1a8 could not be found. Oct 28 10:01:43.066037 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '503fc347-1d77-4563-a6bb-66f1334cd1a8'} Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 503fc347-1d77-4563-a6bb-66f1334cd1a8 could not be found. Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.066833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 503fc347-1d77-4563-a6bb-66f1334cd1a8 could not be found. Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 503fc347-1d77-4563-a6bb-66f1334cd1a8 could not be found. Oct 28 10:01:43.068146 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.072134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a0b27e8f-a508-405b-b4e8-4b5e9a0ebaac tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Returning 404 to user: Instance group 503fc347-1d77-4563-a6bb-66f1334cd1a8 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:43.074787 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a0b27e8f-a508-405b-b4e8-4b5e9a0ebaac tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/503fc347-1d77-4563-a6bb-66f1334cd1a8" status: 404 len: 117 microversion: 2.1 time: 0.032499 Oct 28 10:01:43.076285 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1407/2858] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:43 2022] DELETE /compute/v2.1/os-server-groups/503fc347-1d77-4563-a6bb-66f1334cd1a8 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:43.088185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a7a63fe-5fb6-4fb0-bef9-319e97a12bc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.097787 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-2a7a63fe-5fb6-4fb0-bef9-319e97a12bc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] HTTP exception thrown: Instance group fe258c01-28ab-45f8-b1b0-80d7de35ec73 could not be found. Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a7a63fe-5fb6-4fb0-bef9-319e97a12bc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Request method failure captured: Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-server-groups/fe258c01-28ab-45f8-b1b0-80d7de35ec73 HTTP/1.1 Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hSB-GGGnF7cpT3ZnfVWybFgNynyF7GgHrY-8AG76nii33OVev5ZmYw8hHpG2opMWdxLnIDS8mOU6SIAoLC7H_4ySB4jF2lbteq1TOVu1RemPh8-DDeWkfyYWMjBcePvKhZxF_uax5ZL-8Te6Ap9_ct5pTAoxj_FLVRN8n2IJZDNbM Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:43.100251 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a1eb6ee53b0459b9ba5a61dec5108e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}] Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0db24bba973f4b52b0c1409fd80daf74 Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance group fe258c01-28ab-45f8-b1b0-80d7de35ec73 could not be found. Oct 28 10:01:43.102206 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'fe258c01-28ab-45f8-b1b0-80d7de35ec73'} Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group fe258c01-28ab-45f8-b1b0-80d7de35ec73 could not be found. Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.103049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group fe258c01-28ab-45f8-b1b0-80d7de35ec73 could not be found. Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group fe258c01-28ab-45f8-b1b0-80d7de35ec73 could not be found. Oct 28 10:01:43.104452 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.112487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a7a63fe-5fb6-4fb0-bef9-319e97a12bc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Returning 404 to user: Instance group fe258c01-28ab-45f8-b1b0-80d7de35ec73 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:43.113522 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a7a63fe-5fb6-4fb0-bef9-319e97a12bc7 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/fe258c01-28ab-45f8-b1b0-80d7de35ec73" status: 404 len: 117 microversion: 2.1 time: 0.031475 Oct 28 10:01:43.114716 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1408/2859] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:43 2022] DELETE /compute/v2.1/os-server-groups/fe258c01-28ab-45f8-b1b0-80d7de35ec73 => generated 117 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:01:43.126025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b22c8317-0dd6-4cdc-8cba-dc9967e02882 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.142854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b22c8317-0dd6-4cdc-8cba-dc9967e02882 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] HTTP exception thrown: Instance group e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 could not be found. Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b22c8317-0dd6-4cdc-8cba-dc9967e02882 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Request method failure captured: Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-server-groups/e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 HTTP/1.1 Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hSB-GGGnF7cpT3ZnfVWybFgNynyF7GgHrY-8AG76nii33OVev5ZmYw8hHpG2opMWdxLnIDS8mOU6SIAoLC7H_4ySB4jF2lbteq1TOVu1RemPh8-DDeWkfyYWMjBcePvKhZxF_uax5ZL-8Te6Ap9_ct5pTAoxj_FLVRN8n2IJZDNbM Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:43.144829 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a1eb6ee53b0459b9ba5a61dec5108e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}] Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0db24bba973f4b52b0c1409fd80daf74 Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance group e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 could not be found. Oct 28 10:01:43.146143 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7'} Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 could not be found. Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.146803 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 could not be found. Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 could not be found. Oct 28 10:01:43.147992 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.152316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b22c8317-0dd6-4cdc-8cba-dc9967e02882 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Returning 404 to user: Instance group e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:43.154524 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b22c8317-0dd6-4cdc-8cba-dc9967e02882 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7" status: 404 len: 117 microversion: 2.1 time: 0.035022 Oct 28 10:01:43.155756 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1409/2860] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:43 2022] DELETE /compute/v2.1/os-server-groups/e5d7ba88-5704-4f28-a9ed-cf9716ab1cf7 => generated 117 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:43.182177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-335b5ac0-6e8f-4d6d-98c8-a460b0da0548 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.195724 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-335b5ac0-6e8f-4d6d-98c8-a460b0da0548 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] HTTP exception thrown: Instance group 5084b0ec-bec6-4a66-915a-9d0293b6cccc could not be found. Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-335b5ac0-6e8f-4d6d-98c8-a460b0da0548 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Request method failure captured: Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-server-groups/5084b0ec-bec6-4a66-915a-9d0293b6cccc HTTP/1.1 Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hSB-GGGnF7cpT3ZnfVWybFgNynyF7GgHrY-8AG76nii33OVev5ZmYw8hHpG2opMWdxLnIDS8mOU6SIAoLC7H_4ySB4jF2lbteq1TOVu1RemPh8-DDeWkfyYWMjBcePvKhZxF_uax5ZL-8Te6Ap9_ct5pTAoxj_FLVRN8n2IJZDNbM Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:43.197791 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9a1eb6ee53b0459b9ba5a61dec5108e0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9a1eb6ee53b0459b9ba5a61dec5108e0"}]}] Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9a1eb6ee53b0459b9ba5a61dec5108e0 Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroupTestJSON-926302085 Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0db24bba973f4b52b0c1409fd80daf74 Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroupTestJSON-926302085-project Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance group 5084b0ec-bec6-4a66-915a-9d0293b6cccc could not be found. Oct 28 10:01:43.199249 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5084b0ec-bec6-4a66-915a-9d0293b6cccc'} Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5084b0ec-bec6-4a66-915a-9d0293b6cccc could not be found. Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.200075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5084b0ec-bec6-4a66-915a-9d0293b6cccc could not be found. Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5084b0ec-bec6-4a66-915a-9d0293b6cccc could not be found. Oct 28 10:01:43.201363 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:43.203598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-335b5ac0-6e8f-4d6d-98c8-a460b0da0548 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Returning 404 to user: Instance group 5084b0ec-bec6-4a66-915a-9d0293b6cccc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:43.205049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-335b5ac0-6e8f-4d6d-98c8-a460b0da0548 tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/5084b0ec-bec6-4a66-915a-9d0293b6cccc" status: 404 len: 117 microversion: 2.1 time: 0.044864 Oct 28 10:01:43.208642 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1410/2861] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:43 2022] DELETE /compute/v2.1/os-server-groups/5084b0ec-bec6-4a66-915a-9d0293b6cccc => generated 117 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:43.211967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.212586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:43.221936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.222433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.223204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.224608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.225262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.225844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.312211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:01:43.312710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:01:43.313119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:01:43.313851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:01:43.314275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:01:43.325797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.326866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.327637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.328964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.329852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.330603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.353128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Getting quotas for project 6dcc2826ba6d4a1a9e5534cf94edd809. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:01:43.360321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Getting quotas for user 10535d8981ed4c3c908f2d3325052c6a and project 6dcc2826ba6d4a1a9e5534cf94edd809. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:01:43.376797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:01:43.379873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:01:43.438682 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4cff2e87-3514-4510-8a40-9cbdf44c72cd tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.227429 Oct 28 10:01:43.447405 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1452/2862] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:01:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:01:43.454712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fc93fee-a4ed-4c36-8c4b-b60c3be8792a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.488696 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fc93fee-a4ed-4c36-8c4b-b60c3be8792a tempest-ServerGroupTestJSON-926302085 tempest-ServerGroupTestJSON-926302085-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/9eac0381-947a-40b3-b9ab-a0d764d46b66" status: 204 len: 0 microversion: 2.1 time: 0.039257 Oct 28 10:01:43.490388 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1453/2863] 10.222.0.16 () {58 vars in 1266 bytes} [Fri Oct 28 10:01:43 2022] DELETE /compute/v2.1/os-server-groups/9eac0381-947a-40b3-b9ab-a0d764d46b66 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:01:43.498312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.499213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:43.507380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.508601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.509339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.510413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.511750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.512335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.536976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:43.540739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:43.555091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:43.560771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:43.562267 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-320ed5e5-9c7a-4ee4-a92b-6c5f62f2cb42 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.355216 Oct 28 10:01:43.566379 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1411/2864] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:43 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:43.582558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-581755a3-38da-4158-a4d3-09dd8eae7495 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.590961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-581755a3-38da-4158-a4d3-09dd8eae7495 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:43.593108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:43.854784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-581755a3-38da-4158-a4d3-09dd8eae7495 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:43.862892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-581755a3-38da-4158-a4d3-09dd8eae7495 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1222 microversion: 2.1 time: 0.294884 Oct 28 10:01:43.868200 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1412/2865] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:43 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1222 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:43.883854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:43.884703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:43.899402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.900149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.900766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:43.901705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:43.902350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:43.902941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:44.324705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:44.341241 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd133cf3-6f8b-4136-9b91-515533ec4550 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 0.471464 Oct 28 10:01:44.342293 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1413/2866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:43 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:44.347943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:44.348448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:44.356720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:44.363410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:44.365781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:44.375793 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-736e9863-b751-48c3-b491-f9f08df255a7 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1550 microversion: 2.25 time: 0.884000 Oct 28 10:01:44.377696 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1454/2867] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:43 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1550 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:44.382891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:44.386899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:44.387425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:44.388189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:44.388660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:44.389179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:44.597079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:44.598063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:44.610975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:44.616462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:44.622054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:44.623464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:44.624838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:44.625563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:44.928501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:44.946608 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-79f9df80-8617-4836-84a6-67779f180ede tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.601827 Oct 28 10:01:44.947214 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1414/2868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:44 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:44.967629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6572cdc5-b6f9-4440-9b87-d227ef5fe94a req-e5c64386-6dcb-4207-a588-01865a9238db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fc7662d-f778-4cd9-8b6f-4f29a6954ce4", "name": "network-vif-deleted", "tag": "8cb76f58-dfbc-420d-b4ac-b6ed3360ea99"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:44.996373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6572cdc5-b6f9-4440-9b87-d227ef5fe94a req-e5c64386-6dcb-4207-a588-01865a9238db service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:44.996773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6572cdc5-b6f9-4440-9b87-d227ef5fe94a req-e5c64386-6dcb-4207-a588-01865a9238db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:44.997483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6572cdc5-b6f9-4440-9b87-d227ef5fe94a req-e5c64386-6dcb-4207-a588-01865a9238db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.017780 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6572cdc5-b6f9-4440-9b87-d227ef5fe94a req-e5c64386-6dcb-4207-a588-01865a9238db service nova] Creating event network-vif-deleted:8cb76f58-dfbc-420d-b4ac-b6ed3360ea99 for instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 on n-h2-zed-1 Oct 28 10:01:45.029759 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6572cdc5-b6f9-4440-9b87-d227ef5fe94a req-e5c64386-6dcb-4207-a588-01865a9238db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067171 Oct 28 10:01:45.031254 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1415/2869] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:45.038175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:45.040529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:45.052555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.053532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.054434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.056154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.059229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.061168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.142483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:45.158629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:45.165379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:45.172319 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d19b59b-d230-4da8-a8ef-321220db726c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.587601 Oct 28 10:01:45.174810 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1455/2870] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:44 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:01:45.367563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:45.368328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:45.403539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.410299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.412668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.413570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.416043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.416749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.651582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:45.671889 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-422cbf3f-5d05-4411-80f4-9a9f7c69cbae tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1274 microversion: 2.1 time: 0.638412 Oct 28 10:01:45.673290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1416/2871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:45 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1274 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:45.684220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:45.686425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:45.693969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.694688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.695443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.696402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.697046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.697639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.740681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.741466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.742851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.744073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lazy-loading 'fault' on Instance uuid 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:45.817667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:45.834264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:45.837844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:45.840456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-68c19461-e823-4269-90a9-c585607f28db tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 200 len: 1352 microversion: 2.25 time: 0.165678 Oct 28 10:01:45.842283 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1417/2872] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:45 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 1352 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:45.973549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:45.974179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:45.994640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.995377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.995934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:45.997549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:45.998438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:45.999076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.019522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:46.038031 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b47d5419-f5b2-47fc-a8b9-3f5e9acd75df tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 0.674984 Oct 28 10:01:46.048942 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1456/2873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:45 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:46.209823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:46.210460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:46.218531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.219667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.220367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.221558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.222554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.223199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.408505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:46.429571 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9e455c74-d39f-44b1-9216-d828248af3e4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.447974 Oct 28 10:01:46.444968 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1418/2874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:45 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:46.676746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:46.703196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:46.708142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:46.712679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:46.719894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:46.723792 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-330acda9-cade-44da-aeb6-e0b6af4e5381 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.518620 Oct 28 10:01:46.729465 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1457/2875] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:46 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:01:46.732718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.733572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.734185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.735191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.735805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.736535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.866288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:46.867900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:46.868941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:46.876616 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ae711db-e974-4ae5-b295-0d0c81194f9c tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1280 microversion: 2.1 time: 0.180809 Oct 28 10:01:46.878832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.881175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.881809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.884614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.885277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.885809 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1419/2876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:46 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:46.887780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.917912 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] HTTP exception thrown: Instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 could not be found. Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Request method failure captured: Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 HTTP/1.1 Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6aBxox-a1sYLzK1ic4JO2gFdVF6VXTgEeILGMhiLxUXUUCIBWvsLMJ19LUOisCjPOyjWoQZ-2w9rM6l9h2D1JoFwNk4plf061vdYLT39O3iHjJa0na6eqJUtkDORyx-BaW0KVZDPsaUKAnCQqkSbayACWfmYLHNAWn8Vff5F51AXhw Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:01:46.919723 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a563769bd6e84594b3837db9d0fdafd4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a563769bd6e84594b3837db9d0fdafd4"}]}] Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 52e08cff441e4fb0b01886d81a7b5ad6 Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 could not be found. Oct 28 10:01:46.921278 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '9fc7662d-f778-4cd9-8b6f-4f29a6954ce4'} Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 could not be found. Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:46.922148 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 could not be found. Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 could not be found. Oct 28 10:01:46.923493 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:01:46.924687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Returning 404 to user: Instance 9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:46.924687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a61441a9-2dd6-4b24-a943-37168e23a234 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4" status: 404 len: 111 microversion: 2.25 time: 0.059066 Oct 28 10:01:46.925422 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1458/2877] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:46 2022] GET /compute/v2.1/servers/9fc7662d-f778-4cd9-8b6f-4f29a6954ce4 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:46.930979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:46.931490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:46.943970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.944478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.944978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:46.945746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:46.946213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:46.946643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.016201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:01:47.074224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:47.075021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:47.081951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.084317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.085001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.087838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.088469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.089553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.244510 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-98160fca-bf13-4da6-911d-3b5bfe17162c tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "DELETE /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 204 len: 0 microversion: 2.25 time: 0.317736 Oct 28 10:01:47.251234 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1420/2878] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:01:46 2022] DELETE /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:01:47.266352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:47.267038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:47.284005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.284768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.285401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.286427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.287110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.287698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.303206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:47.670388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:47.680044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:47.690265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:47.691553 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb5362c2-cda8-4488-90e9-529058c19081 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1564 microversion: 2.25 time: 0.436092 Oct 28 10:01:47.692578 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1421/2879] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:47 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1564 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:47.698123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:47.704322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:47.719158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.719934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.720616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.721598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.722291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.722937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.837366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:47.853693 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ae2bc06-6716-42f9-a44e-cf3c3a643d98 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 0.791309 Oct 28 10:01:47.855611 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1459/2880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:47 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:47.872271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:47.874151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:47.886316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.887121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.888054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:47.890041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:47.891131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:47.892067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:48.234376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:48.257475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1a0d12d-bd18-485c-b303-90ae21e622ff tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.563456 Oct 28 10:01:48.259537 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1422/2881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:47 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:48.264674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:48.266537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:48.281215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:48.282660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:48.284208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:48.285448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:48.290787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:48.292187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:48.377326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:48.387782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:48.389622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:48.391032 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f031261-0572-461b-abb1-4b9bb64e1d98 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.534132 Oct 28 10:01:48.391766 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1460/2882] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:47 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:48.452697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:48.469204 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b1e0264-6b9a-4a34-9c49-62ebd6577a88 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1280 microversion: 2.1 time: 0.206769 Oct 28 10:01:48.485913 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1423/2883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:48 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1280 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:48.599398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e34f6709-b720-4f6d-98bd-457f9b634f49 req-b90e359d-05b5-4214-94dd-0122a648c841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11921705-654f-4224-b9b2-55157e647230", "name": "network-vif-plugged", "status": "completed", "tag": "f5105d67-baf4-4443-877a-953ed3b3316d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:48.623873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e34f6709-b720-4f6d-98bd-457f9b634f49 req-b90e359d-05b5-4214-94dd-0122a648c841 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:48.624673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e34f6709-b720-4f6d-98bd-457f9b634f49 req-b90e359d-05b5-4214-94dd-0122a648c841 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:48.625315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e34f6709-b720-4f6d-98bd-457f9b634f49 req-b90e359d-05b5-4214-94dd-0122a648c841 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:48.655523 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e34f6709-b720-4f6d-98bd-457f9b634f49 req-b90e359d-05b5-4214-94dd-0122a648c841 service nova] Creating event network-vif-plugged:f5105d67-baf4-4443-877a-953ed3b3316d for instance 11921705-654f-4224-b9b2-55157e647230 on n-h1-zed-1 Oct 28 10:01:48.665598 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e34f6709-b720-4f6d-98bd-457f9b634f49 req-b90e359d-05b5-4214-94dd-0122a648c841 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070278 Oct 28 10:01:48.666238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1461/2884] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:48.723070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:48.724330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:48.734156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:48.739604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:48.740626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:48.741639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:48.742875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:48.745664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:48.883758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:48.903021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:48.925924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:48.928714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:48.931820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:48.933860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:48.942819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:48.943539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:49.881081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:49.894241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:49.895708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:49.896929 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-560cb55e-c2b4-475d-ba67-bef5b6055dd1 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1564 microversion: 2.25 time: 1.181567 Oct 28 10:01:49.897518 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1424/2885] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:48 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1564 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:49.920507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f0c67aa7-b7ad-4dca-8754-204631bacdc6 req-2444aef0-ed52-4498-98b6-eff2310c6a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0210ec12-d8b3-4557-8b38-a57d74f96fd0", "tag": "7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:49.931566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f0c67aa7-b7ad-4dca-8754-204631bacdc6 req-2444aef0-ed52-4498-98b6-eff2310c6a50 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:49.932623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f0c67aa7-b7ad-4dca-8754-204631bacdc6 req-2444aef0-ed52-4498-98b6-eff2310c6a50 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:49.933311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f0c67aa7-b7ad-4dca-8754-204631bacdc6 req-2444aef0-ed52-4498-98b6-eff2310c6a50 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:49.947188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f0c67aa7-b7ad-4dca-8754-204631bacdc6 req-2444aef0-ed52-4498-98b6-eff2310c6a50 service nova] Creating event network-changed:7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e for instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 on n-h2-zed-1 Oct 28 10:01:49.954123 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f0c67aa7-b7ad-4dca-8754-204631bacdc6 req-2444aef0-ed52-4498-98b6-eff2310c6a50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039659 Oct 28 10:01:49.954957 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1425/2886] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:49.960595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:49.962240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:49.969452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:49.970369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:49.971038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:49.971983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:49.972668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:49.973458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:50.266609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:50.318728 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45caf7f1-ee64-41dd-943b-0bc0748311cb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1324 microversion: 2.1 time: 1.439034 Oct 28 10:01:50.320237 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1462/2887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:48 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1324 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:50.329971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:50.330951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:50.360533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:50.362234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:50.364581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:50.365052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:50.366101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:50.367792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:50.377046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:50.379750 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4644cdea-c966-4a5f-b9c3-a4cfa892d3ee tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.416888 Oct 28 10:01:50.398862 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1426/2888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:49 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:50.405320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:50.417073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:50.432570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:50.433536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:50.434242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:50.435222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:50.435913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:50.436558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:50.892618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:50.903796 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8f1e4795-d727-4a1b-b766-9b6f05695c06 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.503462 Oct 28 10:01:50.904746 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1427/2889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:50 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:50.909635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0d5cd7ad-3fc4-48ae-a6b2-f8b77c29aa6f req-f7687bb8-206a-48ef-9c38-53fb54b4ce4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "439c52f5-ba7c-4756-916f-ac9323d6303d", "name": "network-vif-deleted", "tag": "e03e33d3-7264-4573-b3db-caf9a93bd750"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:50.939719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0d5cd7ad-3fc4-48ae-a6b2-f8b77c29aa6f req-f7687bb8-206a-48ef-9c38-53fb54b4ce4d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:50.940564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0d5cd7ad-3fc4-48ae-a6b2-f8b77c29aa6f req-f7687bb8-206a-48ef-9c38-53fb54b4ce4d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:50.941295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0d5cd7ad-3fc4-48ae-a6b2-f8b77c29aa6f req-f7687bb8-206a-48ef-9c38-53fb54b4ce4d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:50.965954 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0d5cd7ad-3fc4-48ae-a6b2-f8b77c29aa6f req-f7687bb8-206a-48ef-9c38-53fb54b4ce4d service nova] Creating event network-vif-deleted:e03e33d3-7264-4573-b3db-caf9a93bd750 for instance 439c52f5-ba7c-4756-916f-ac9323d6303d on n-h1-zed-1 Oct 28 10:01:50.975287 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0d5cd7ad-3fc4-48ae-a6b2-f8b77c29aa6f req-f7687bb8-206a-48ef-9c38-53fb54b4ce4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068934 Oct 28 10:01:50.976529 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1428/2890] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:51.074150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-542bb197-0204-4124-8764-6f99fd398bcf tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Calling method '.version_select at 0x7fca328fa9d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:51.156812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-542bb197-0204-4124-8764-6f99fd398bcf tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:01:51.157987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-542bb197-0204-4124-8764-6f99fd398bcf tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Neutron security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c not found {{(pid=128748) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 10:01:51.159491 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-542bb197-0204-4124-8764-6f99fd398bcf tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] HTTP exception thrown: Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist Oct 28 10:01:51.159491 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-44730975-0063-4627-ab46-7aa0c9456598'] Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-542bb197-0204-4124-8764-6f99fd398bcf tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Request method failure captured: Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-security-groups/1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c HTTP/1.1 Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iOKNubNTFjeRnBU2ssoiIQeIkVs4XWpOsL_1o5hWNNM5by2YKBReUZf67x_cb0a6XIHgb9vhW47YGFdp9cwZdz7g5GKk1lW-PleHmsRujravh2J7lrz_a-FR9uELCxHFQpYPYcIpwpU1rcs8_tPVU56m8YvE-8hh2e2IEZZXtKBqs Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:51.163938 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e46a2770ac60460a80d864c3509993c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e46a2770ac60460a80d864c3509993c7"}]}] Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6c9c810e151c4260813d98f0d679fa58 Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-44730975-0063-4627-ab46-7aa0c9456598'] Oct 28 10:01:51.165646 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c'} Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:51.166531 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44730975-0063-4627-ab46-7aa0c9456598'] Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 10:01:51.167660 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44730975-0063-4627-ab46-7aa0c9456598'] Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44730975-0063-4627-ab46-7aa0c9456598'] Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:51.171787 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:51.174226 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:51.174226 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:51.174226 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:51.174226 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:51.174226 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist Oct 28 10:01:51.174226 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-44730975-0063-4627-ab46-7aa0c9456598'] Oct 28 10:01:51.174226 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:51.181313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:51.186126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-542bb197-0204-4124-8764-6f99fd398bcf tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Returning 404 to user: Security group 1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c does not exist Oct 28 10:01:51.186126 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-44730975-0063-4627-ab46-7aa0c9456598'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:51.191868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-542bb197-0204-4124-8764-6f99fd398bcf tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c" status: 404 len: 194 microversion: 2.1 time: 0.211620 Oct 28 10:01:51.195200 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1429/2891] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:01:50 2022] DELETE /compute/v2.1/os-security-groups/1b7d13cd-82ca-42f3-9879-6bdb7ebd3e1c => generated 194 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:51.213281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4eed013f-1aa2-41ff-976b-1c11a19bab74 req-9fa40c29-872d-4f5b-848b-07738597bfb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7831b2e-dc40-4e1b-981b-94cb7d1736f0", "name": "network-vif-plugged", "status": "completed", "tag": "a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:51.215642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:51.222771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:51.226459 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d25cd7a-bccc-4847-822a-b5cf46cc9865 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.901469 Oct 28 10:01:51.232088 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1463/2892] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:50 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:51.248124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:51.249570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4eed013f-1aa2-41ff-976b-1c11a19bab74 req-9fa40c29-872d-4f5b-848b-07738597bfb2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.250164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:51.254628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4eed013f-1aa2-41ff-976b-1c11a19bab74 req-9fa40c29-872d-4f5b-848b-07738597bfb2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.255399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4eed013f-1aa2-41ff-976b-1c11a19bab74 req-9fa40c29-872d-4f5b-848b-07738597bfb2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:51.266632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.283997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.284702 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4eed013f-1aa2-41ff-976b-1c11a19bab74 req-9fa40c29-872d-4f5b-848b-07738597bfb2 service nova] Creating event network-vif-plugged:a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a for instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 on n-h1-zed-1 Oct 28 10:01:51.285639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:51.288709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.290054 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4eed013f-1aa2-41ff-976b-1c11a19bab74 req-9fa40c29-872d-4f5b-848b-07738597bfb2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092829 Oct 28 10:01:51.290793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.291040 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1430/2893] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:51.291734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:51.296667 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9459ebdc-aa8a-4261-b446-53e2e72a4592 tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004214 Oct 28 10:01:51.302567 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1431/2894] 10.222.0.16 () {58 vars in 1164 bytes} [Fri Oct 28 10:01:51 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 10:01:51.315632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-deea13fb-351d-46ae-9d05-5e034334bcfe tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Calling method '.version_select at 0x7fca3399c430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:51.395064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.399097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.400638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:51.401577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lazy-loading 'fault' on Instance uuid 439c52f5-ba7c-4756-916f-ac9323d6303d {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:01:51.505849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:51.518808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:51.521244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52e08cff441e4fb0b01886d81a7b5ad6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a563769bd6e84594b3837db9d0fdafd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:51.526603 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a20dd81-8410-46a7-ac81-bd694733a70e tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 200 len: 1351 microversion: 2.25 time: 0.293172 Oct 28 10:01:51.527284 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1464/2895] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:51 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 1351 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:51.565921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:51.569213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:51.585640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.589717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.590188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:51.590963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.594529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.596227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:51.945535 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-deea13fb-351d-46ae-9d05-5e034334bcfe tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.641592 Oct 28 10:01:51.946271 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1432/2896] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 10:01:51 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:51.963136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:51.963889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:51.975234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.975752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.976201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:51.980192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:51.984752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:51.985424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:52.037700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:52.052761 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5758cc8-0992-4353-a533-76814ad9ee8e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 200 len: 1519 microversion: 2.1 time: 0.522659 Oct 28 10:01:52.069587 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1465/2897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:51 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 1519 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:52.083680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:52.084516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:52.102443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:52.103195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:52.103836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:52.104936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:52.107483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:52.108262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:52.446617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:52.455775 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71e47e7b-b4db-4e83-8949-62d20e50fad9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.507512 Oct 28 10:01:52.472090 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1433/2898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:51 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:52.488035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:52.490235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d818c95a-5594-457d-95ca-c6d11651aace tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Calling method '.version_select at 0x7fca3270c8b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:52.502052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f97ea5e7-bd64-4ef9-8f60-c7c518ee4dd8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.431248 Oct 28 10:01:52.503933 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1466/2899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:52 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:52.510108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'action', calling method: .version_select at 0x7fca399c0c10>, body: {"addFloatingIp": {"address": "172.35.7.147"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:52.513483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:52.520288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:DELETE=5,nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:52.523239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:52.524631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:52.525397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:52.526290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:52.526915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:52.527513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:52.641495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:01:52.642155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquired lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:01:52.894004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-d818c95a-5594-457d-95ca-c6d11651aace tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:01:52.894711 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-d818c95a-5594-457d-95ca-c6d11651aace tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 28 10:01:52.894711 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-1ea9478c-38cb-40f6-a41e-8ec9162bd389'] Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d818c95a-5594-457d-95ca-c6d11651aace tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Request method failure captured: Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-security-groups/aa309061-fab2-484a-979b-c0bdcca03cba HTTP/1.1 Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iOKNubNTFjeRnBU2ssoiIQeIkVs4XWpOsL_1o5hWNNM5by2YKBReUZf67x_cb0a6XIHgb9vhW47YGFdp9cwZdz7g5GKk1lW-PleHmsRujravh2J7lrz_a-FR9uELCxHFQpYPYcIpwpU1rcs8_tPVU56m8YvE-8hh2e2IEZZXtKBqs Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:52.896692 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e46a2770ac60460a80d864c3509993c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e46a2770ac60460a80d864c3509993c7"}]}] Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6c9c810e151c4260813d98f0d679fa58 Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: exception: Insufficient rights for removing default security group. Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-1ea9478c-38cb-40f6-a41e-8ec9162bd389'] Oct 28 10:01:52.898169 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'aa309061-fab2-484a-979b-c0bdcca03cba'} Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:52.899639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea9478c-38cb-40f6-a41e-8ec9162bd389'] Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 28 10:01:52.900948 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea9478c-38cb-40f6-a41e-8ec9162bd389'] Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea9478c-38cb-40f6-a41e-8ec9162bd389'] Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:52.902256 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1ea9478c-38cb-40f6-a41e-8ec9162bd389'] Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d818c95a-5594-457d-95ca-c6d11651aace tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-1ea9478c-38cb-40f6-a41e-8ec9162bd389'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d818c95a-5594-457d-95ca-c6d11651aace tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/aa309061-fab2-484a-979b-c0bdcca03cba" status: 400 len: 182 microversion: 2.1 time: 0.417148 Oct 28 10:01:52.903677 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1434/2900] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:01:52 2022] DELETE /compute/v2.1/os-security-groups/aa309061-fab2-484a-979b-c0bdcca03cba => generated 182 bytes in 419 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:52.910521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:52.911173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:52.930568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:52.931042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:52.931490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:52.932486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:52.933011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:52.933451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:53.343170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:53.351344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:53.362892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:53.364347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:53.370725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=30 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:53.388124 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-846b8b07-8cd1-431f-899d-ac54352b1708 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.467551 Oct 28 10:01:53.402571 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1435/2901] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:52 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:53.429156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c5e8ee4e-4108-4a33-8e8f-2e081d10d382 req-c099b4b9-060c-49fd-8bc6-19c509e1bc73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df9ba748-ea1c-44fd-ae9a-02d1972e3e8f", "tag": "d7734317-29c3-4f6b-b8df-9df0094bce86"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:53.451396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5e8ee4e-4108-4a33-8e8f-2e081d10d382 req-c099b4b9-060c-49fd-8bc6-19c509e1bc73 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:53.457782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5e8ee4e-4108-4a33-8e8f-2e081d10d382 req-c099b4b9-060c-49fd-8bc6-19c509e1bc73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:53.459449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5e8ee4e-4108-4a33-8e8f-2e081d10d382 req-c099b4b9-060c-49fd-8bc6-19c509e1bc73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:53.494830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c5e8ee4e-4108-4a33-8e8f-2e081d10d382 req-c099b4b9-060c-49fd-8bc6-19c509e1bc73 service nova] Creating event network-changed:d7734317-29c3-4f6b-b8df-9df0094bce86 for instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f on n-h2-zed-1 Oct 28 10:01:53.503059 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c5e8ee4e-4108-4a33-8e8f-2e081d10d382 req-c099b4b9-060c-49fd-8bc6-19c509e1bc73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089116 Oct 28 10:01:53.504520 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1436/2902] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:53.510920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:53.512040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] [instance: 439c52f5-ba7c-4756-916f-ac9323d6303d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:53.519832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:53.520798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:53.521699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:53.522796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:53.523690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:53.524317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:53.541732 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] HTTP exception thrown: Instance 439c52f5-ba7c-4756-916f-ac9323d6303d could not be found. Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Request method failure captured: Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d HTTP/1.1 Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6aBxox-a1sYLzK1ic4JO2gFdVF6VXTgEeILGMhiLxUXUUCIBWvsLMJ19LUOisCjPOyjWoQZ-2w9rM6l9h2D1JoFwNk4plf061vdYLT39O3iHjJa0na6eqJUtkDORyx-BaW0KVZDPsaUKAnCQqkSbayACWfmYLHNAWn8Vff5F51AXhw Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.25 Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:53.543828 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a563769bd6e84594b3837db9d0fdafd4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a563769bd6e84594b3837db9d0fdafd4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a563769bd6e84594b3837db9d0fdafd4"}]}] Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: a563769bd6e84594b3837db9d0fdafd4 Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657 Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52e08cff441e4fb0b01886d81a7b5ad6 Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1105147657-project Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 439c52f5-ba7c-4756-916f-ac9323d6303d could not be found. Oct 28 10:01:53.545157 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '439c52f5-ba7c-4756-916f-ac9323d6303d'} Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 439c52f5-ba7c-4756-916f-ac9323d6303d could not be found. Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:53.545832 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 439c52f5-ba7c-4756-916f-ac9323d6303d could not be found. Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 439c52f5-ba7c-4756-916f-ac9323d6303d could not be found. Oct 28 10:01:53.548138 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.552586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] Returning 404 to user: Instance 439c52f5-ba7c-4756-916f-ac9323d6303d could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:53.553796 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-68292fcb-362b-4a65-a79a-365cd0e2d6e2 tempest-LiveAutoBlockMigrationV225Test-1105147657 tempest-LiveAutoBlockMigrationV225Test-1105147657-project] 10.222.0.16 "GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d" status: 404 len: 111 microversion: 2.25 time: 0.047907 Oct 28 10:01:53.566771 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1437/2903] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:53 2022] GET /compute/v2.1/servers/439c52f5-ba7c-4756-916f-ac9323d6303d => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:01:53.576227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b13df307-0c92-46a4-86a7-c1eacca4514b tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Calling method '.version_select at 0x7fca32a24b80>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:53.683786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-b13df307-0c92-46a4-86a7-c1eacca4514b tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:01:53.684517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-b13df307-0c92-46a4-86a7-c1eacca4514b tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Neutron security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 not found {{(pid=128748) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 10:01:53.685206 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b13df307-0c92-46a4-86a7-c1eacca4514b tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] HTTP exception thrown: Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist Oct 28 10:01:53.685206 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-6cc1eb8c-90ee-4a12-af02-5d626fceb98e'] Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b13df307-0c92-46a4-86a7-c1eacca4514b tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Request method failure captured: Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-security-groups/0c9ba344-efb7-4e71-9ae7-19baaf245219 HTTP/1.1 Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iOKNubNTFjeRnBU2ssoiIQeIkVs4XWpOsL_1o5hWNNM5by2YKBReUZf67x_cb0a6XIHgb9vhW47YGFdp9cwZdz7g5GKk1lW-PleHmsRujravh2J7lrz_a-FR9uELCxHFQpYPYcIpwpU1rcs8_tPVU56m8YvE-8hh2e2IEZZXtKBqs Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:53.688937 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e46a2770ac60460a80d864c3509993c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e46a2770ac60460a80d864c3509993c7"}]}] Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6c9c810e151c4260813d98f0d679fa58 Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-6cc1eb8c-90ee-4a12-af02-5d626fceb98e'] Oct 28 10:01:53.690584 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '0c9ba344-efb7-4e71-9ae7-19baaf245219'} Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:53.691523 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cc1eb8c-90ee-4a12-af02-5d626fceb98e'] Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 10:01:53.692998 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cc1eb8c-90ee-4a12-af02-5d626fceb98e'] Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cc1eb8c-90ee-4a12-af02-5d626fceb98e'] Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.694325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6cc1eb8c-90ee-4a12-af02-5d626fceb98e'] Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b13df307-0c92-46a4-86a7-c1eacca4514b tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Returning 404 to user: Security group 0c9ba344-efb7-4e71-9ae7-19baaf245219 does not exist Oct 28 10:01:53.695911 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-6cc1eb8c-90ee-4a12-af02-5d626fceb98e'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:53.697496 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b13df307-0c92-46a4-86a7-c1eacca4514b tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/0c9ba344-efb7-4e71-9ae7-19baaf245219" status: 404 len: 194 microversion: 2.1 time: 0.125571 Oct 28 10:01:53.698198 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1438/2904] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:01:53 2022] GET /compute/v2.1/os-security-groups/0c9ba344-efb7-4e71-9ae7-19baaf245219 => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:53.705924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:53.709338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:53.738135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:53.738839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:53.739690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:53.741846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:53.743829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:53.744407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:53.883753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=18 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:54.164088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:54.178564 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec764456-5562-4157-b0f0-91a57a2f1168 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.478756 Oct 28 10:01:54.179177 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1439/2905] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:53 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:54.216348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:54.217205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:54.247666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:54.248784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:54.249264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:54.249996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:54.250462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:54.250894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:54.737307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:54.757050 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-374153f3-fb5f-45a3-84b3-206b18ee5ed8 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.576646 Oct 28 10:01:54.757674 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1440/2906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:54 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:54.768467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82f1f5bf-d591-4939-a76b-acb9b22f775a tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Action: 'update', calling method: .version_select at 0x7fca32985dc0>, body: {"security_group": {"name": "tempest-sg-1797972680", "description": "tempest-description-853097967"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:54.896399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-82f1f5bf-d591-4939-a76b-acb9b22f775a tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:01:54.897338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-82f1f5bf-d591-4939-a76b-acb9b22f775a tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Neutron security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 not found {{(pid=128748) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 10:01:54.898029 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-82f1f5bf-d591-4939-a76b-acb9b22f775a tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] HTTP exception thrown: Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist Oct 28 10:01:54.898029 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-d2da17b7-89d8-41c7-ac72-1cfbbf5f1b0f'] Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82f1f5bf-d591-4939-a76b-acb9b22f775a tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Request method failure captured: Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/os-security-groups/f6f48f6c-7179-4f45-8db7-e7d12727cd96 HTTP/1.1 Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 101 Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iOKNubNTFjeRnBU2ssoiIQeIkVs4XWpOsL_1o5hWNNM5by2YKBReUZf67x_cb0a6XIHgb9vhW47YGFdp9cwZdz7g5GKk1lW-PleHmsRujravh2J7lrz_a-FR9uELCxHFQpYPYcIpwpU1rcs8_tPVU56m8YvE-8hh2e2IEZZXtKBqs Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:01:54.900308 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e46a2770ac60460a80d864c3509993c7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e46a2770ac60460a80d864c3509993c7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e46a2770ac60460a80d864c3509993c7"}]}] Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e46a2770ac60460a80d864c3509993c7 Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-227962548 Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6c9c810e151c4260813d98f0d679fa58 Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-227962548-project Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: {"security_group": {"name": "tempest-sg-1797972680", "description": "tempest-description-853097967"}} Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:01:54.902020 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-d2da17b7-89d8-41c7-ac72-1cfbbf5f1b0f'] Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f6f48f6c-7179-4f45-8db7-e7d12727cd96', 'body': {'security_group': {'name': 'tempest-sg-1797972680', 'description': 'tempest-description-853097967'}}} Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:01:54.903621 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2da17b7-89d8-41c7-ac72-1cfbbf5f1b0f'] Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 10:01:54.904670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2da17b7-89d8-41c7-ac72-1cfbbf5f1b0f'] Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2da17b7-89d8-41c7-ac72-1cfbbf5f1b0f'] Oct 28 10:01:54.905855 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d2da17b7-89d8-41c7-ac72-1cfbbf5f1b0f'] Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82f1f5bf-d591-4939-a76b-acb9b22f775a tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] Returning 404 to user: Security group f6f48f6c-7179-4f45-8db7-e7d12727cd96 does not exist Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-d2da17b7-89d8-41c7-ac72-1cfbbf5f1b0f'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:01:54.908796 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82f1f5bf-d591-4939-a76b-acb9b22f775a tempest-SecurityGroupsNegativeTestJSON-227962548 tempest-SecurityGroupsNegativeTestJSON-227962548-project] 10.222.0.16 "PUT /compute/v2.1/os-security-groups/f6f48f6c-7179-4f45-8db7-e7d12727cd96" status: 404 len: 194 microversion: 2.1 time: 0.139902 Oct 28 10:01:54.911211 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1441/2907] 10.222.0.16 () {60 vars in 1290 bytes} [Fri Oct 28 10:01:54 2022] PUT /compute/v2.1/os-security-groups/f6f48f6c-7179-4f45-8db7-e7d12727cd96 => generated 194 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:01:54.911211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:54.911211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:54.939440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:54.939971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:54.944114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:54.944961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:54.949729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:54.950178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:55.347246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:55.414547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:55.418876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:55.426808 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e2ea917-d6f4-4f45-b56f-735951faeaa4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1809 microversion: 2.20 time: 0.521776 Oct 28 10:01:55.428480 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1442/2908] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:54 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1809 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:55.435186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:55.436559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:55.444555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:55.445898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:55.446534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:55.448143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:55.448774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:55.449394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:55.799832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:55.811267 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a769682-f777-4a36-86a3-ef65fddf2c8f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.381376 Oct 28 10:01:55.812519 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1443/2909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:55 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:55.830837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:55.831329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:55.838053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:55.839522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:55.840245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:55.841160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:55.841773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:55.842358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:56.323978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:56.333934 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1a69cf82-aba3-479e-aa4d-9fc40f299058 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.518942 Oct 28 10:01:56.354625 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1444/2910] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:55 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:56.459448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:56.461531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:56.489308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:56.490809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:56.504071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:56.509259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:56.510364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:56.511157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:56.821854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:56.840391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:56.842459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:56.844700 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28e127b4-e820-4e71-84f8-00429ed5ddd0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1796 microversion: 2.20 time: 0.391094 Oct 28 10:01:56.846056 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1445/2911] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:01:56 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1796 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:01:56.853694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:56.854492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:56.861521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:56.862285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:56.862920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:56.863794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:56.864625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:56.865235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:57.222324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:57.233762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-120aa4a7-4f93-441e-8680-0ffff00405c0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.386328 Oct 28 10:01:57.250656 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1446/2912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:56 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:57.359648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:57.360437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:57.367975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:57.369559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:57.370110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:57.370936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:57.371646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:57.372192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:57.377688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:01:58.048513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:58.060996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d94224a8-c800-44f9-bf35-eac092cde1ad tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.705369 Oct 28 10:01:58.077778 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1447/2913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:57 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:01:58.173584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Building network info cache for instance {{(pid=128747) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:01:58.187317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c0ab38fd-9fde-43f8-a5a1-e732f7fc6a38 req-3bd3ca55-6e69-4f22-a653-625aa8306115 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cd3269-3458-442d-a68a-d2fcdfa8b1e9", "tag": "b30f7134-38e8-4c49-890e-7763e6d54708"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:58.201932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c0ab38fd-9fde-43f8-a5a1-e732f7fc6a38 req-3bd3ca55-6e69-4f22-a653-625aa8306115 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:58.202919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c0ab38fd-9fde-43f8-a5a1-e732f7fc6a38 req-3bd3ca55-6e69-4f22-a653-625aa8306115 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:58.203576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c0ab38fd-9fde-43f8-a5a1-e732f7fc6a38 req-3bd3ca55-6e69-4f22-a653-625aa8306115 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:58.225717 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c0ab38fd-9fde-43f8-a5a1-e732f7fc6a38 req-3bd3ca55-6e69-4f22-a653-625aa8306115 service nova] Creating event network-changed:b30f7134-38e8-4c49-890e-7763e6d54708 for instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 on n-h1-zed-1 Oct 28 10:01:58.233815 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c0ab38fd-9fde-43f8-a5a1-e732f7fc6a38 req-3bd3ca55-6e69-4f22-a653-625aa8306115 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051645 Oct 28 10:01:58.235188 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1448/2914] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:01:58.264686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:58.270651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:01:58.310906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:58.312309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:58.313123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:58.314173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:58.314904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:58.315923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:58.883395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:01:58.894380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ac1c4bd-1dc0-4e88-bc1e-8f0490c61d47 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.637217 Oct 28 10:01:58.902216 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1449/2915] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:58 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:01:59.144337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d8b6445f-53a8-4f3e-9275-45a3eb82175f tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca327b2040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1026526714", "description": "tempest-description-641375227"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:59.895115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d8b6445f-53a8-4f3e-9275-45a3eb82175f tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.991285 Oct 28 10:01:59.895732 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1450/2916] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:01:58 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:59.910440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c5b85b37-53d5-451e-862f-9e68b7e65628 req-6b21f0b0-d0fb-4595-a7eb-056eee9417f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0210ec12-d8b3-4557-8b38-a57d74f96fd0", "name": "network-vif-plugged", "status": "completed", "tag": "7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:01:59.935842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5b85b37-53d5-451e-862f-9e68b7e65628 req-6b21f0b0-d0fb-4595-a7eb-056eee9417f4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:01:59.936340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5b85b37-53d5-451e-862f-9e68b7e65628 req-6b21f0b0-d0fb-4595-a7eb-056eee9417f4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:01:59.936778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5b85b37-53d5-451e-862f-9e68b7e65628 req-6b21f0b0-d0fb-4595-a7eb-056eee9417f4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:01:59.954918 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c5b85b37-53d5-451e-862f-9e68b7e65628 req-6b21f0b0-d0fb-4595-a7eb-056eee9417f4 service nova] Creating event network-vif-plugged:7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e for instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 on n-h2-zed-1 Oct 28 10:01:59.972560 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c5b85b37-53d5-451e-862f-9e68b7e65628 req-6b21f0b0-d0fb-4595-a7eb-056eee9417f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075383 Oct 28 10:01:59.973209 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1451/2917] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:01:59.979056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:01:59.986003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:00.001129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:00.001647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:00.002516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:00.003218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:00.003678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:00.004111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:00.362478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:00.375820 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7f893b7-9841-4a14-a406-58f2f692c90f tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.398519 Oct 28 10:02:00.376493 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1452/2918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:01:59 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:00.377822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Updating instance_info_cache with network_info: [{"id": "b30f7134-38e8-4c49-890e-7763e6d54708", "address": "fa:16:3e:d6:a6:c9", "network": {"id": "5c66667c-6d75-4e82-a8a4-4669c43d1d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-588246644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0c49ee1d5d5642749e3e90fb9d596636", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb30f7134-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128747) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:02:00.390367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Releasing lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:02:00.391331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-252366f1-aee5-436b-bc4e-014162c54a4e tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3288f9d0>, body: {"security_group_rule": {"parent_group_id": "8ec43962-f51e-4946-881a-d7d76f5cbf36", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:00.393021 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-770c5568-3fbe-4e34-a133-4e08e22a0db3 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action" status: 202 len: 0 microversion: 2.1 time: 7.886931 Oct 28 10:02:00.395702 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1467/2919] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:01:52 2022] POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action => generated 0 bytes in 7891 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:02:00.405317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:00.412560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:00.419952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:00.420804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:00.421551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:00.422492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:00.427208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:00.428297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:00.940106 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-252366f1-aee5-436b-bc4e-014162c54a4e tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.562460 Oct 28 10:02:00.940716 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1453/2920] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:02:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:00.955326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'action', calling method: .version_select at 0x7fca399c0c10>, body: {"addFloatingIp": {"address": "172.35.7.147"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:00.957955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:00.971008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:00.972605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:00.973395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:00.976009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:00.976354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:00.977729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:00.979383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:00.986971 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04739955-882e-4eb1-adbe-4b64e21aed39 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1325 microversion: 2.1 time: 0.589364 Oct 28 10:02:00.988389 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1468/2921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:00 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1325 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:00.997756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6c54cdcd-838c-440e-aba3-b326b42e2122 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3b93f8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1828822739", "description": "tempest-description-163313917"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:01.072355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "refresh_cache-11921705-654f-4224-b9b2-55157e647230" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:02:01.073307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquired lock "refresh_cache-11921705-654f-4224-b9b2-55157e647230" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:02:02.533962 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6c54cdcd-838c-440e-aba3-b326b42e2122 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.543173 Oct 28 10:02:02.535647 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1469/2922] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:02:00 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:02.552012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:02.553486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:02.565449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:02.568641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:02.570039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:02.573702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:02.574677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:02.575442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:03.620888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:03.641598 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d427ea2b-8ae1-4c0e-8ea8-9fde345663de tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 1.104381 Oct 28 10:02:03.642980 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1470/2923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:02 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:03.649620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:03.650627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:03.658315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:03.659742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:03.660434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:03.661565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:03.662236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:03.662882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:04.404009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:04.416125 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46913540-314a-4497-a630-f71bb2adc24c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.771775 Oct 28 10:02:04.430119 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1471/2924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:03 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:04.447172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1674e225-8acc-41a3-be7d-c366e2f3886a tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3b9d3ee0>, body: {"security_group_rule": {"parent_group_id": "01353d01-0981-4c7d-9d15-6fb61b245da8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:05.183757 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1674e225-8acc-41a3-be7d-c366e2f3886a tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.751913 Oct 28 10:02:05.184631 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1472/2925] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:02:04 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:05.199604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:05.200239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:05.217916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:05.218427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:05.218867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:05.219593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:05.220232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:05.220835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:05.248646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:05.436579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:05.453113 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7ab01ab0-1513-44e0-bcdd-9bbda76adabd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.257552 Oct 28 10:02:05.453725 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1473/2926] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:05 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:05.477453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:05.478137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:05.485465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:05.486251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:05.486866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:05.487750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:05.488374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:05.488997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:05.947288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:05.958693 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-773b96c5-9d53-4a17-b4f8-aa7c65f0b6b2 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.486306 Oct 28 10:02:05.961431 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1474/2927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:05 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:05.972710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3461286b-e608-4964-8ee1-b9e06dd66aa0 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3b93f430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-358409133", "description": "tempest-description-1592034923"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:06.360585 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3461286b-e608-4964-8ee1-b9e06dd66aa0 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.397785 Oct 28 10:02:06.361686 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1475/2928] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:02:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:06.366803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7ead680-de7c-4690-8be2-95c9690644e0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1983944076", "metadata": {"": ""}}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7ead680-de7c-4690-8be2-95c9690644e0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action HTTP/1.1 Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 107 Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:06.376401 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1983944076", "metadata": {"": ""}}} Oct 28 10:02:06.377910 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0210ec12-d8b3-4557-8b38-a57d74f96fd0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1983944076', 'metadata': {'': ''}}}} Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'': ''} Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:06.378638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:06.379870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:06.381015 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:06.381015 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:06.381015 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:06.381015 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:06.381015 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:06.381015 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:06.381015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7ead680-de7c-4690-8be2-95c9690644e0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:06.381464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b7ead680-de7c-4690-8be2-95c9690644e0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action" status: 400 len: 170 microversion: 2.1 time: 0.015387 Oct 28 10:02:06.385605 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1476/2929] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 10:02:06 2022] POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action => generated 170 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:06.390652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1839bda5-554c-40a3-95a7-ffc738f8e02b tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3b8ddf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-477807", "description": "tempest-description-647116451"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:07.300284 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1839bda5-554c-40a3-95a7-ffc738f8e02b tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.912820 Oct 28 10:02:07.301708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1477/2930] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:02:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:07.309219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:07.312470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:07.321953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:07.322753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:07.323611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:07.324689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:07.325481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:07.326156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:07.361218 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.network.neutron [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] re-assign floating IP 172.35.7.147 from instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 Oct 28 10:02:07.443688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Building network info cache for instance {{(pid=128748) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:02:07.682723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:07.699535 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-713791d0-b0f4-44a6-9aee-ea5daf227019 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.395211 Oct 28 10:02:07.700601 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1478/2931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:07 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:07.706785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-08e9d6e4-cd46-4456-96f6-070d99397e51 req-cfbeedfb-722e-4004-adda-7c0116cccd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9ba748-ea1c-44fd-ae9a-02d1972e3e8f", "name": "network-vif-plugged", "status": "completed", "tag": "d7734317-29c3-4f6b-b8df-9df0094bce86"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:07.736179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-08e9d6e4-cd46-4456-96f6-070d99397e51 req-cfbeedfb-722e-4004-adda-7c0116cccd4d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:07.736513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-08e9d6e4-cd46-4456-96f6-070d99397e51 req-cfbeedfb-722e-4004-adda-7c0116cccd4d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:07.742259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-08e9d6e4-cd46-4456-96f6-070d99397e51 req-cfbeedfb-722e-4004-adda-7c0116cccd4d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:07.772867 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-08e9d6e4-cd46-4456-96f6-070d99397e51 req-cfbeedfb-722e-4004-adda-7c0116cccd4d service nova] Creating event network-vif-plugged:d7734317-29c3-4f6b-b8df-9df0094bce86 for instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f on n-h2-zed-1 Oct 28 10:02:07.784151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-08e9d6e4-cd46-4456-96f6-070d99397e51 req-cfbeedfb-722e-4004-adda-7c0116cccd4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080803 Oct 28 10:02:07.785572 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1479/2932] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:07.793822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:07.794995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:07.805304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:07.806291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:07.823025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:07.824276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:07.825188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:07.825896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:08.291037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:08.308225 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7af30a2e-0604-4690-8444-7d0a7ce5d824 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1322 microversion: 2.1 time: 0.520259 Oct 28 10:02:08.309165 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1480/2933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:07 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1322 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:08.334656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f991fad9-246a-4d0b-81f1-ae15643178a3 req-a443f9d4-9b62-48a7-90ee-0ce16619ca40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cd3269-3458-442d-a68a-d2fcdfa8b1e9", "tag": "b30f7134-38e8-4c49-890e-7763e6d54708"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:08.346427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f991fad9-246a-4d0b-81f1-ae15643178a3 req-a443f9d4-9b62-48a7-90ee-0ce16619ca40 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:08.347304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f991fad9-246a-4d0b-81f1-ae15643178a3 req-a443f9d4-9b62-48a7-90ee-0ce16619ca40 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:08.347995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f991fad9-246a-4d0b-81f1-ae15643178a3 req-a443f9d4-9b62-48a7-90ee-0ce16619ca40 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:08.371012 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f991fad9-246a-4d0b-81f1-ae15643178a3 req-a443f9d4-9b62-48a7-90ee-0ce16619ca40 service nova] Creating event network-changed:b30f7134-38e8-4c49-890e-7763e6d54708 for instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 on n-h1-zed-1 Oct 28 10:02:08.385876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f991fad9-246a-4d0b-81f1-ae15643178a3 req-a443f9d4-9b62-48a7-90ee-0ce16619ca40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054420 Oct 28 10:02:08.387215 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1481/2934] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:08.394588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-613bb321-d0ea-4212-81b8-1ac58706319a tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3b943a60>, body: {"security_group_rule": {"parent_group_id": "b7200f5d-48e9-4eca-b223-b560d8b0e22c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "eec83056-cad1-473a-a899-fdfed4c6edeb"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:09.154517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Updating instance_info_cache with network_info: [{"id": "b30f7134-38e8-4c49-890e-7763e6d54708", "address": "fa:16:3e:d6:a6:c9", "network": {"id": "5c66667c-6d75-4e82-a8a4-4669c43d1d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-588246644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0c49ee1d5d5642749e3e90fb9d596636", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb30f7134-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:02:09.180374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Building network info cache for instance {{(pid=128748) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:02:09.757094 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-613bb321-d0ea-4212-81b8-1ac58706319a tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 327 microversion: 2.1 time: 1.368304 Oct 28 10:02:09.758775 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1482/2935] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:02:08 2022] POST /compute/v2.1/os-security-group-rules => generated 327 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:09.763737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:09.764674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:09.789969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:09.793674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:09.794175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:09.794975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:09.795485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:09.796023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:10.316223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:10.334084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9adb5dbf-cf4e-4ab2-9353-cd5e4509bcb9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.573884 Oct 28 10:02:10.337967 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1483/2936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:09 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:10.349285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:10.350167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:10.359226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:10.359989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:10.360642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:10.361586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:10.362236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:10.362983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:10.700593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:10.709697 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d5ee1838-95a0-4a63-b07d-c7307c9029e0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1472 microversion: 2.1 time: 0.367468 Oct 28 10:02:10.711236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1484/2937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:10 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1472 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:10.716179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8a4586d-fc23-4b8b-b4ba-c8417798c541 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3b8dd0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-230118201", "description": "tempest-description-1068739880"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:10.961766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:11.091485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Updating instance_info_cache with network_info: [{"id": "f5105d67-baf4-4443-877a-953ed3b3316d", "address": "fa:16:3e:24:73:da", "network": {"id": "5c66667c-6d75-4e82-a8a4-4669c43d1d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-588246644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0c49ee1d5d5642749e3e90fb9d596636", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf5105d67-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:02:11.112247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Releasing lock "refresh_cache-11921705-654f-4224-b9b2-55157e647230" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:02:11.113583 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e12155cf-e725-406d-8bc3-da76814fbe6e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230/action" status: 202 len: 0 microversion: 2.1 time: 10.171635 Oct 28 10:02:11.116087 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8a4586d-fc23-4b8b-b4ba-c8417798c541 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.403519 Oct 28 10:02:11.117718 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1485/2938] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:02:10 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:11.124184 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1454/2939] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:00 2022] POST /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230/action => generated 0 bytes in 10183 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:02:11.151780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-461958e0-5c25-4417-a54c-d51bee3c22d4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-324727555", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-461958e0-5c25-4417-a54c-d51bee3c22d4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action HTTP/1.1 Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 618 Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:11.159238 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:11.161033 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:02:11.161817 n-d-zed-1 devstack@n-api.service[128748]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-324727555", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 28 10:02:11.161817 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:11.161817 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '0210ec12-d8b3-4557-8b38-a57d74f96fd0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-324727555', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 28 10:02:11.162197 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:11.163074 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:11.165513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:11.166383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:11.166383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:11.166383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:11.166383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:11.166383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:11.166383 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:11.166846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-461958e0-5c25-4417-a54c-d51bee3c22d4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:11.166958 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-461958e0-5c25-4417-a54c-d51bee3c22d4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action" status: 400 len: 938 microversion: 2.1 time: 0.038764 Oct 28 10:02:11.173892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1455/2940] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 10:02:11 2022] POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action => generated 938 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:11.180684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-421547c8-01d1-4ca4-8acd-b79571a2e92c req-0bd3ad78-7db6-4e01-bafc-59c8328153eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11921705-654f-4224-b9b2-55157e647230", "tag": "f5105d67-baf4-4443-877a-953ed3b3316d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:11.243419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-421547c8-01d1-4ca4-8acd-b79571a2e92c req-0bd3ad78-7db6-4e01-bafc-59c8328153eb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:11.246892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-421547c8-01d1-4ca4-8acd-b79571a2e92c req-0bd3ad78-7db6-4e01-bafc-59c8328153eb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:11.247515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-421547c8-01d1-4ca4-8acd-b79571a2e92c req-0bd3ad78-7db6-4e01-bafc-59c8328153eb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:11.272106 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-421547c8-01d1-4ca4-8acd-b79571a2e92c req-0bd3ad78-7db6-4e01-bafc-59c8328153eb service nova] Creating event network-changed:f5105d67-baf4-4443-877a-953ed3b3316d for instance 11921705-654f-4224-b9b2-55157e647230 on n-h1-zed-1 Oct 28 10:02:11.300544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-421547c8-01d1-4ca4-8acd-b79571a2e92c req-0bd3ad78-7db6-4e01-bafc-59c8328153eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125168 Oct 28 10:02:11.303772 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1456/2941] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:11.320460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:11.323352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:11.360658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:11.365270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:11.367531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:11.371667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:11.372683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:11.375398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:11.454875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lazy-loading 'flavor' on Instance uuid df9ba748-ea1c-44fd-ae9a-02d1972e3e8f {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:11.474233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2035267223", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:11.662517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] validate_networks() for [('2031f50a-5ac8-45aa-8ce1-247435554ba6', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:02:11.686539 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b06aa5d-d1e2-41b9-81c3-27d5e773c5b5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f/action" status: 202 len: 0 microversion: 2.1 time: 0.380052 Oct 28 10:02:11.691393 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1457/2942] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:11 2022] POST /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f/action => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:11.698756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'action', calling method: .version_select at 0x7fca39445f70>, body: {"removeFloatingIp": {"address": "172.35.7.147"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:12.055719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:12.062979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:12.065664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:12.075296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:12.076643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:12.077501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:12.079242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:12.542145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] HTTP exception thrown: Floating IP 172.35.7.147 is not associated with instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9. Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Request method failure captured: Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action HTTP/1.1 Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 49 Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hbCI5V1WuWydRPTJq9sR_bXhiF5bhtJYIDEMdzqJCPw8UTJvbG5pSs4kpQREvb-OaWD0jBvaW0N4I0dGuIizGrCLtvlrwlf08Zt8DySYf_UdMQW2rpPByJ4L4IFMAYLg_y6j4eef63qCLJEL5vcqlXGZ35uuZ_iIeh0gVZLKfW6Aw Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:12.545790 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c49ee1d5d5642749e3e90fb9d596636", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c49ee1d5d5642749e3e90fb9d596636"}]}] Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 854e41184e0f4b06aa85a150fec89fd4 Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: {"removeFloatingIp": {"address": "172.35.7.147"}} Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:02:12.547329 n-d-zed-1 devstack@n-api.service[128748]: exception: Floating IP 172.35.7.147 is not associated with instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9. Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '75cd3269-3458-442d-a68a-d2fcdfa8b1e9', 'body': {'removeFloatingIp': {'address': '172.35.7.147'}}} Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.35.7.147 is not associated with instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9. Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:12.548159 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:12.549507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:12.549507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:12.549507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:12.549507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:12.549507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.35.7.147 is not associated with instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9. Oct 28 10:02:12.549507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:12.552627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Returning 409 to user: Floating IP 172.35.7.147 is not associated with instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:12.555324 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fbe99a09-1914-43a3-be78-e045ed8a6d4f tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action" status: 409 len: 146 microversion: 2.1 time: 0.861696 Oct 28 10:02:12.556657 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1458/2943] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:11 2022] POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action => generated 146 bytes in 864 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:02:12.598785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e9b48f9b-fb5c-40e0-9d3b-a662437c9d7c tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca32a24c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-677728400", "description": "tempest-description-809661495"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:12.816096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:12.816594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:12.817041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:12.818073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:12.818679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:12.830195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:12.830976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:12.831871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:12.833102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:12.833771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:12.834534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:12.867695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Getting quotas for project 1389c5372a9a42faa7aae2d03ea2787b. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:12.874505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Getting quotas for user 52459d9276c94241ba4dd63403ce3a13 and project 1389c5372a9a42faa7aae2d03ea2787b. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:12.892833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:02:12.896400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:02:13.004246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b204d764-c6e8-4aa1-8249-3f3a62cfac12 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.885026 Oct 28 10:02:13.005542 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1486/2944] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:02:13.011430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:13.012042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:13.018630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.019147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.019592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:13.020318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.020779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.021239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:13.310059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:13.318877 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-91b76ffc-190f-4b61-a170-0f4f6a6a0d92 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.312060 Oct 28 10:02:13.335448 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1487/2945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:13 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:13.345090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:13.346002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:13.353122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.356104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.356822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:13.358962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.359727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.361580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:13.598202 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e9b48f9b-fb5c-40e0-9d3b-a662437c9d7c tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.039382 Oct 28 10:02:13.607063 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1459/2946] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:02:12 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:13.609972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.147"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:13.913835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:13.922813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.923641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.924320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:13.926254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:13.928076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:13.928738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:14.087570 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-938aa23f-209e-4203-8512-6c7a546b753e tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1608 microversion: 2.1 time: 0.750180 Oct 28 10:02:14.088159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1488/2947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:13 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1608 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:14.104677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:14.109585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:14.123646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:14.124163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:14.129623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:14.132158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:14.132727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:14.135217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:14.356948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:14.368694 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dc99d14-e015-4ec8-a4b3-50ae5ea3e479 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1220 microversion: 2.1 time: 0.276178 Oct 28 10:02:14.381047 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1489/2948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:14 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1220 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:14.386961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:14.387763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:14.399017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:14.400310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:14.400875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:14.401736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:14.402456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:14.403139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:14.550043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "refresh_cache-11921705-654f-4224-b9b2-55157e647230" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:02:14.550461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquired lock "refresh_cache-11921705-654f-4224-b9b2-55157e647230" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:02:14.801138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:14.811090 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5510848b-30ac-4bd6-83a7-b2a9704db06a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.434829 Oct 28 10:02:14.828955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1490/2949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:14 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:14.828955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f7d37998-6650-4d3f-9821-2bdebda327b3 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3b9baaf0>, body: {"security_group_rule": {"parent_group_id": "b442224a-de16-407d-a550-c734dd20ebd8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "13348687-8c37-4e3a-b026-314f7b6f3fe4"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:15.499768 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f7d37998-6650-4d3f-9821-2bdebda327b3 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.680469 Oct 28 10:02:15.500397 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1491/2950] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:02:14 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:15.512376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:15.512998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:15.535191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:15.535352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:15.537075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:15.541595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:15.543189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:15.543654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:15.660219 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] HTTP exception thrown: Cannot 'migrate' instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f while it is in vm_state suspended Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Request method failure captured: Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f/action HTTP/1.1 Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 15 Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hjkTxB1tm5lOQz2FV9JvoMhxuoaOg8xUKwXNJDktWv4SFNGY5hpMfTgYqd71qPVlZ_LsnX_N1I3sZRoliWEDyNpTYWpUaxH4f2jQk__yVEDZ1oYetPTL-RHeEdmxfUNUUsPvpsD8pPVYLBuJzlaYjStSPxKPTsy45McencksuuL78 Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:02:15.664498 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3807951fd06940f4aeb74425c22415a2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3807951fd06940f4aeb74425c22415a2"}]}] Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 3522ce5a8a9b4eb68f5323342fb96c28 Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: {"migrate": {}} Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:15.666147 n-d-zed-1 devstack@n-api.service[128747]: exception: Cannot 'migrate' instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f while it is in vm_state suspended Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'df9ba748-ea1c-44fd-ae9a-02d1972e3e8f', 'body': {'migrate': {}}} Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f in vm_state suspended. Cannot resize while the instance is in this state. Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.667129 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f while it is in vm_state suspended Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:15.668681 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:15.670059 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:15.670059 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:15.670059 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f while it is in vm_state suspended Oct 28 10:02:15.670059 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.694706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Returning 409 to user: Cannot 'migrate' instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f while it is in vm_state suspended {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:15.695687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5401d6c4-0278-4495-af53-6e9c6e4a3c5d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f/action" status: 409 len: 148 microversion: 2.1 time: 0.187135 Oct 28 10:02:15.702695 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1492/2951] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:15 2022] POST /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f/action => generated 148 bytes in 201 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:02:15.721866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-108f523e-450d-424a-a26f-1f8b3a20f5f5 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-108f523e-450d-424a-a26f-1f8b3a20f5f5 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action HTTP/1.1 Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 285 Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:15.730063 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:02:15.731669 n-d-zed-1 devstack@n-api.service[128747]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0210ec12-d8b3-4557-8b38-a57d74f96fd0', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:15.732461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:15.733177 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:15.734608 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:15.735566 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:02:15.735566 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:15.747376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-108f523e-450d-424a-a26f-1f8b3a20f5f5 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:15.750633 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-108f523e-450d-424a-a26f-1f8b3a20f5f5 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action" status: 400 len: 619 microversion: 2.1 time: 0.046532 Oct 28 10:02:15.757050 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1493/2952] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 10:02:15 2022] POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action => generated 619 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:15.766479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:15.772973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:15.790492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:15.793642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:15.796800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:15.797927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:15.798565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:15.799355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:16.025032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:16.074099 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15b00bf1-29e7-4b44-91a7-113b8e97993b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1276 microversion: 2.1 time: 0.306816 Oct 28 10:02:16.075278 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1494/2953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:15 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1276 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:16.099684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-de705c0d-defd-4328-8cc0-6a8e74f5a645 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b9bae50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:16.440114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Building network info cache for instance {{(pid=128748) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:02:16.966157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-de705c0d-defd-4328-8cc0-6a8e74f5a645 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/13348687-8c37-4e3a-b026-314f7b6f3fe4" status: 202 len: 0 microversion: 2.1 time: 0.886866 Oct 28 10:02:16.967512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1495/2954] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:16 2022] DELETE /compute/v2.1/os-security-groups/13348687-8c37-4e3a-b026-314f7b6f3fe4 => generated 0 bytes in 889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:16.972871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6788b6ee-7d2a-4cf7-97d5-7856870dc4e6 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6788b6ee-7d2a-4cf7-97d5-7856870dc4e6 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Request method failure captured: Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43/action HTTP/1.1 Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 39 Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hjkTxB1tm5lOQz2FV9JvoMhxuoaOg8xUKwXNJDktWv4SFNGY5hpMfTgYqd71qPVlZ_LsnX_N1I3sZRoliWEDyNpTYWpUaxH4f2jQk__yVEDZ1oYetPTL-RHeEdmxfUNUUsPvpsD8pPVYLBuJzlaYjStSPxKPTsy45McencksuuL78 Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:02:16.994334 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3807951fd06940f4aeb74425c22415a2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3807951fd06940f4aeb74425c22415a2"}]}] Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 3522ce5a8a9b4eb68f5323342fb96c28 Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: {"os-resetState": {"state": "invalid"}} Oct 28 10:02:16.995946 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '15036a7f-b1b2-4ddc-ad24-03a31aa30e43', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:16.996751 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:16.998228 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 28 10:02:16.999496 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:17.000617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6788b6ee-7d2a-4cf7-97d5-7856870dc4e6 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:17.004679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6788b6ee-7d2a-4cf7-97d5-7856870dc4e6 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43/action" status: 400 len: 144 microversion: 2.1 time: 0.035908 Oct 28 10:02:17.010595 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1496/2955] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:16 2022] POST /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43/action => generated 144 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:17.017535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:17.022370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:17.041527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:17.047585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:17.048563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:17.052349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:17.053342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:17.056461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.077761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Updating instance_info_cache with network_info: [{"id": "f5105d67-baf4-4443-877a-953ed3b3316d", "address": "fa:16:3e:24:73:da", "network": {"id": "5c66667c-6d75-4e82-a8a4-4669c43d1d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-588246644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0c49ee1d5d5642749e3e90fb9d596636", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapf5105d67-ba", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:02:18.103584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Releasing lock "refresh_cache-11921705-654f-4224-b9b2-55157e647230" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:02:18.104870 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-89952ec3-a0ba-48b9-97da-b40667ea6bed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230/action" status: 202 len: 0 microversion: 2.1 time: 4.500041 Oct 28 10:02:18.108836 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1460/2956] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:13 2022] POST /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230/action => generated 0 bytes in 4502 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:02:18.124336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0e50f18b-79aa-43fe-8697-213508adda4f req-fbb91726-6cb0-4edd-88ed-03317258b32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11921705-654f-4224-b9b2-55157e647230", "tag": "f5105d67-baf4-4443-877a-953ed3b3316d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:18.194721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0e50f18b-79aa-43fe-8697-213508adda4f req-fbb91726-6cb0-4edd-88ed-03317258b32c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.195596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0e50f18b-79aa-43fe-8697-213508adda4f req-fbb91726-6cb0-4edd-88ed-03317258b32c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.196379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0e50f18b-79aa-43fe-8697-213508adda4f req-fbb91726-6cb0-4edd-88ed-03317258b32c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.223715 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0e50f18b-79aa-43fe-8697-213508adda4f req-fbb91726-6cb0-4edd-88ed-03317258b32c service nova] Creating event network-changed:f5105d67-baf4-4443-877a-953ed3b3316d for instance 11921705-654f-4224-b9b2-55157e647230 on n-h1-zed-1 Oct 28 10:02:18.235973 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0e50f18b-79aa-43fe-8697-213508adda4f req-fbb91726-6cb0-4edd-88ed-03317258b32c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128527 Oct 28 10:02:18.238333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1461/2957] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:18.251093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd54ab01-c422-46b4-a8db-bfb5001a1d82 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca32b38160>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:18.334661 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd54ab01-c422-46b4-a8db-bfb5001a1d82 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/b442224a-de16-407d-a550-c734dd20ebd8" status: 200 len: 247 microversion: 2.1 time: 0.094610 Oct 28 10:02:18.335286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1462/2958] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:02:18 2022] GET /compute/v2.1/os-security-groups/b442224a-de16-407d-a550-c734dd20ebd8 => generated 247 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:18.344001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f33f60b2-ee3f-4b9e-aa24-b868523bf28d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f33f60b2-ee3f-4b9e-aa24-b868523bf28d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Request method failure captured: Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43/action HTTP/1.1 Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 31 Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hjkTxB1tm5lOQz2FV9JvoMhxuoaOg8xUKwXNJDktWv4SFNGY5hpMfTgYqd71qPVlZ_LsnX_N1I3sZRoliWEDyNpTYWpUaxH4f2jQk__yVEDZ1oYetPTL-RHeEdmxfUNUUsPvpsD8pPVYLBuJzlaYjStSPxKPTsy45McencksuuL78 Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 10:02:18.356526 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3807951fd06940f4aeb74425c22415a2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3807951fd06940f4aeb74425c22415a2"}]}] Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 3522ce5a8a9b4eb68f5323342fb96c28 Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: {"os-resetState": {"state": 1}} Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:18.358060 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '15036a7f-b1b2-4ddc-ad24-03a31aa30e43', 'body': {'os-resetState': {'state': 1}}} Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 1 Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:18.358945 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 28 10:02:18.360337 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:18.363050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f33f60b2-ee3f-4b9e-aa24-b868523bf28d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:18.368599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f33f60b2-ee3f-4b9e-aa24-b868523bf28d tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43/action" status: 400 len: 120 microversion: 2.1 time: 0.031947 Oct 28 10:02:18.369722 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1463/2959] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:18 2022] POST /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43/action => generated 120 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:18.383589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:18.384540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:18.402595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.403103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.405711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.406516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.406999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.407444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.663711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:18.690427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e59f319e-5e09-4688-b794-ee94ebceacc0 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 1.674468 Oct 28 10:02:18.699279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1497/2960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:17 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:18.718559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:18.721516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:18.726312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:18.748173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.748384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.748790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.751787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:18.752288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:18.752737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:18.757638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90b33364-c235-49a0-a492-5c3e01df322f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1324 microversion: 2.1 time: 0.368457 Oct 28 10:02:18.758321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1464/2961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:18 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1324 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:18.783804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5a934d0-e83b-40ee-913c-ab4d71900fbf tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3296caf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-299790198", "description": "tempest-description-1565299291"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:18.828753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:18.963648 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-709f650b-8773-4aa9-89ec-890d6108b026 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 204 len: 0 microversion: 2.1 time: 0.261736 Oct 28 10:02:18.965646 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1498/2962] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:18 2022] DELETE /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:18.999402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf93ef07-4d57-407b-81c7-c050298e3ae5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:19.002628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf93ef07-4d57-407b-81c7-c050298e3ae5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Failed to fetch instance by id 999 {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 10:02:19.004056 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-bf93ef07-4d57-407b-81c7-c050298e3ae5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf93ef07-4d57-407b-81c7-c050298e3ae5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Request method failure captured: Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 37 Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hjkTxB1tm5lOQz2FV9JvoMhxuoaOg8xUKwXNJDktWv4SFNGY5hpMfTgYqd71qPVlZ_LsnX_N1I3sZRoliWEDyNpTYWpUaxH4f2jQk__yVEDZ1oYetPTL-RHeEdmxfUNUUsPvpsD8pPVYLBuJzlaYjStSPxKPTsy45McencksuuL78 Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:02:19.012607 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3807951fd06940f4aeb74425c22415a2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3807951fd06940f4aeb74425c22415a2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3807951fd06940f4aeb74425c22415a2"}]}] Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3807951fd06940f4aeb74425c22415a2 Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-884676158 Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 3522ce5a8a9b4eb68f5323342fb96c28 Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminNegativeTestJSON-884676158-project-admin Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: {"os-resetState": {"state": "error"}} Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:19.014402 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 999 could not be found. Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:19.015469 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 10:02:19.017126 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:19.019602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf93ef07-4d57-407b-81c7-c050298e3ae5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:19.020963 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf93ef07-4d57-407b-81c7-c050298e3ae5 tempest-ServersAdminNegativeTestJSON-884676158 tempest-ServersAdminNegativeTestJSON-884676158-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.032369 Oct 28 10:02:19.022180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1499/2963] 10.222.0.16 () {60 vars in 1179 bytes} [Fri Oct 28 10:02:18 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:02:19.031992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:19.036269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:19.050165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:19.051537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:19.053545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:19.056553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:19.057275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:19.060228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:19.358670 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a5a934d0-e83b-40ee-913c-ab4d71900fbf tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.578839 Oct 28 10:02:19.359390 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1465/2964] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:02:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:19.369386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.147"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:19.378814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:19.389812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:19.390657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:19.391300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:19.392218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:19.395749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:19.396546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:19.437268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:02:19.439018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquired lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:02:19.598667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:19.602780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:19.608557 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e165ecc6-380c-45b4-be4c-dd980089e2c3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.585045 Oct 28 10:02:19.626325 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1500/2965] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:19 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:19.629239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:19.629702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:19.650435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:19.651195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:19.651810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:19.652756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:19.653406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:19.654524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:19.707042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:19.839536 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-41dd50b9-dcf0-4baa-879a-eb2f5a2c602e tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "DELETE /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 204 len: 0 microversion: 2.1 time: 0.220463 Oct 28 10:02:19.841544 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1501/2966] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:19 2022] DELETE /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:19.847979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dcb5c67b-6b14-45ee-a6df-47f4a9adbc82 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca3ba08160>, body: {"security_group_rule": {"parent_group_id": "092e3a9f-f0f4-4c34-9f4f-d03750663afb", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:20.746181 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dcb5c67b-6b14-45ee-a6df-47f4a9adbc82 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.902902 Oct 28 10:02:20.748768 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1502/2967] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:02:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:20.758863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1495081280"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:20.763374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:20.774205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:20.775557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:20.776205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:20.777318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:20.778324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:20.779112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:21.186391 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-41b58b1c-dcc1-4daa-a0be-dc9c495fb83c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action" status: 202 len: 0 microversion: 2.1 time: 0.435046 Oct 28 10:02:21.188305 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1503/2968] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:20 2022] POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action => generated 0 bytes in 439 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:02:21.199443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:21.200436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:21.210520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:21.211055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:21.221205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:21.222287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:21.223629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:21.224088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:21.962600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:21.978647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Building network info cache for instance {{(pid=128748) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:02:21.979433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d37f3783-753b-43e1-bfa3-c854ff7eb61e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1324 microversion: 2.1 time: 0.787272 Oct 28 10:02:21.992470 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1504/2969] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:21 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1324 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:22.010649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:22.015030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:22.051319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:22.052927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:22.053468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:22.055319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:22.056358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:22.060132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:22.575526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:22.587102 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-493b77ff-e75c-4ac6-ba31-d1d1530c2b39 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1469 microversion: 2.1 time: 0.590310 Oct 28 10:02:22.592288 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1505/2970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:21 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1469 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:22.849441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:22.885535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:23.223976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef2e8400-ea8d-479f-9206-d527cc0e9b89 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Action: 'create', calling method: .version_select at 0x7fca3b943550>, body: {"keypair": {"name": "tempest-keypair-441107403", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDdwtIwDyHQhf0/aU278pE0ceRM1sdmemqlF1x7+qK64lm2aVq/WdgtqXWgE67mSop8UZCUokiE/P9qs5y6HB5zl5x1Lx5a/Zk80q2/b9Sejxnx6dYLjEa3D46MtOth5tw=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:23.233949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Updating instance_info_cache with network_info: [{"id": "b30f7134-38e8-4c49-890e-7763e6d54708", "address": "fa:16:3e:d6:a6:c9", "network": {"id": "5c66667c-6d75-4e82-a8a4-4669c43d1d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-588246644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0c49ee1d5d5642749e3e90fb9d596636", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb30f7134-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:02:23.243046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:23.251993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Releasing lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:02:23.253777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a0a87c7-2e01-41eb-89ef-565f10d5cee7 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action" status: 202 len: 0 microversion: 2.1 time: 3.892455 Oct 28 10:02:23.255759 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1466/2971] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:19 2022] POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action => generated 0 bytes in 3895 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:02:23.269074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f529bf79-d2ca-4b85-b1e7-4aacd3fa1deb req-564991db-e36f-48a3-91a8-4ba1b1487cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c110c4a5-2759-4e37-b90f-479b6b927d10", "tag": "6c7c0bf7-9615-441c-bdb1-60ab738debe7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:23.293864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f529bf79-d2ca-4b85-b1e7-4aacd3fa1deb req-564991db-e36f-48a3-91a8-4ba1b1487cf9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:23.294356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f529bf79-d2ca-4b85-b1e7-4aacd3fa1deb req-564991db-e36f-48a3-91a8-4ba1b1487cf9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:23.297574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f529bf79-d2ca-4b85-b1e7-4aacd3fa1deb req-564991db-e36f-48a3-91a8-4ba1b1487cf9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:23.304865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ef2e8400-ea8d-479f-9206-d527cc0e9b89 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Getting quotas for project 2fc42ddeb5cd4170a5d01683e0605a87. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:23.322275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ef2e8400-ea8d-479f-9206-d527cc0e9b89 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Getting quotas for user 78e6fe2e79b54462b20619cf36ffadf0 and project 2fc42ddeb5cd4170a5d01683e0605a87. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:23.323543 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f529bf79-d2ca-4b85-b1e7-4aacd3fa1deb req-564991db-e36f-48a3-91a8-4ba1b1487cf9 service nova] Creating event network-changed:6c7c0bf7-9615-441c-bdb1-60ab738debe7 for instance c110c4a5-2759-4e37-b90f-479b6b927d10 on n-h1-zed-1 Oct 28 10:02:23.346068 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f529bf79-d2ca-4b85-b1e7-4aacd3fa1deb req-564991db-e36f-48a3-91a8-4ba1b1487cf9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088844 Oct 28 10:02:23.348174 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1467/2972] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:23.362324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7faeb8b6-ce27-4912-ae58-ac631a36e4c1 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Action: 'create', calling method: .version_select at 0x7fca329ca670>, body: {"security_group_rule": {"parent_group_id": "092e3a9f-f0f4-4c34-9f4f-d03750663afb", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:23.404135 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef2e8400-ea8d-479f-9206-d527cc0e9b89 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.810343 Oct 28 10:02:23.404772 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1506/2973] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:02:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:23.427549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-622906057"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:23.449827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:23.464288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:23.468514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:23.475477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:23.476763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:23.479812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:23.480789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:23.601629 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Cannot 'createImage' instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 while it is in task_state image_snapshot Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action HTTP/1.1 Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 84 Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:23.608860 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-622906057"}} Oct 28 10:02:23.610254 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: exception: Cannot 'createImage' instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 while it is in task_state image_snapshot Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0210ec12-d8b3-4557-8b38-a57d74f96fd0', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-622906057'}}} Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:23.610956 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 while it is in task_state image_snapshot Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 while it is in task_state image_snapshot Oct 28 10:02:23.612084 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:23.619502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 409 to user: Cannot 'createImage' instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 while it is in task_state image_snapshot {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:23.623052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5885cf76-2eb6-4509-a17f-5037d26def3b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action" status: 409 len: 159 microversion: 2.1 time: 0.212662 Oct 28 10:02:23.626971 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1507/2974] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:23 2022] POST /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0/action => generated 159 bytes in 220 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:02:23.649878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8b18e0d3-f32d-4134-a8a8-42ca36eb88b6 req-67745e8d-092d-4d04-a0bb-f66aa9b5d439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11921705-654f-4224-b9b2-55157e647230", "name": "network-vif-deleted", "tag": "f5105d67-baf4-4443-877a-953ed3b3316d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:23.692846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b18e0d3-f32d-4134-a8a8-42ca36eb88b6 req-67745e8d-092d-4d04-a0bb-f66aa9b5d439 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:23.699336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b18e0d3-f32d-4134-a8a8-42ca36eb88b6 req-67745e8d-092d-4d04-a0bb-f66aa9b5d439 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:23.702952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b18e0d3-f32d-4134-a8a8-42ca36eb88b6 req-67745e8d-092d-4d04-a0bb-f66aa9b5d439 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:23.771979 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8b18e0d3-f32d-4134-a8a8-42ca36eb88b6 req-67745e8d-092d-4d04-a0bb-f66aa9b5d439 service nova] Creating event network-vif-deleted:f5105d67-baf4-4443-877a-953ed3b3316d for instance 11921705-654f-4224-b9b2-55157e647230 on n-h1-zed-1 Oct 28 10:02:23.799531 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8b18e0d3-f32d-4134-a8a8-42ca36eb88b6 req-67745e8d-092d-4d04-a0bb-f66aa9b5d439 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170825 Oct 28 10:02:23.806074 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1508/2975] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:23.812523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:23.826003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:23.850952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:23.851947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:23.856511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:23.858317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:23.864825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:23.867514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:24.056594 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7faeb8b6-ce27-4912-ae58-ac631a36e4c1 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.705566 Oct 28 10:02:24.065663 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1468/2976] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:02:23 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:24.077349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8621e4d3-0501-4988-bfbf-dde0a8ccce96 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '.version_select at 0x7fca336030d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:24.524879 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8621e4d3-0501-4988-bfbf-dde0a8ccce96 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/os-floating-ips/fbf6792b-45dd-487d-8243-46ad6a11ff2c" status: 200 len: 184 microversion: 2.1 time: 0.458030 Oct 28 10:02:24.532844 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1469/2977] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:02:24 2022] GET /compute/v2.1/os-floating-ips/fbf6792b-45dd-487d-8243-46ad6a11ff2c => generated 184 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:24.533176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:24.533619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:24.533619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:24.548705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:24.549636 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eacc536c-baaa-49cf-ba28-d2fb8b2fad8d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1324 microversion: 2.1 time: 0.741899 Oct 28 10:02:24.550241 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1509/2978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:23 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1324 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:24.559383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:24.560196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aba5292f-0e98-4434-ac1c-8362cfee2bc2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '.version_select at 0x7fca3b9d38b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:24.561605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:24.564788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:24.568075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:24.569332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:24.681673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:24.683151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:24.684697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:24.685530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lazy-loading 'fault' on Instance uuid df9ba748-ea1c-44fd-ae9a-02d1972e3e8f {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:24.695456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=85,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=6,nova_cell1:RELEASE=4,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:24.865014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:24.872024 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aba5292f-0e98-4434-ac1c-8362cfee2bc2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/images/06f3b20c-fd8b-4120-965e-71d26cfe6136" status: 204 len: 0 microversion: 2.1 time: 0.319819 Oct 28 10:02:24.872501 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1510/2979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:24 2022] DELETE /compute/v2.1/images/06f3b20c-fd8b-4120-965e-71d26cfe6136 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:24.879699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af188c31-7c7e-4ed6-876a-74739b1e2e87 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b9500d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:24.880029 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a7e5c54-6e92-49a9-99e1-c7263dfa43f4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 200 len: 1312 microversion: 2.1 time: 0.352676 Oct 28 10:02:24.892990 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1470/2980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:24 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 1312 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:24.892990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.147"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:25.157957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:25.164295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:25.164797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:25.165614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:25.166541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:25.170651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:25.171406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:25.171929 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af188c31-7c7e-4ed6-876a-74739b1e2e87 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "GET /compute/v2.1/os-security-groups/092e3a9f-f0f4-4c34-9f4f-d03750663afb" status: 200 len: 664 microversion: 2.1 time: 0.297594 Oct 28 10:02:25.175209 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1511/2981] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:02:24 2022] GET /compute/v2.1/os-security-groups/092e3a9f-f0f4-4c34-9f4f-d03750663afb => generated 664 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:25.182434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:25.184813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:25.194703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:25.196718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:25.197455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:25.200031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:25.201591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:25.202945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:25.478641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:25.490967 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d80c3e90-893d-4b95-a513-474e8f0e3d1d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1541 microversion: 2.1 time: 0.313818 Oct 28 10:02:25.495209 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1512/2982] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:25 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1541 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:25.501677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-576c2254-8860-40f3-8c7d-916b0daad2e5 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b9baf70>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:25.648112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:02:25.649260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquired lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:02:25.718544 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-576c2254-8860-40f3-8c7d-916b0daad2e5 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/fab59139-02fa-4f60-afd5-38ef92f29dfb" status: 202 len: 0 microversion: 2.1 time: 0.221952 Oct 28 10:02:25.719399 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1513/2983] 10.222.0.16 () {58 vars in 1287 bytes} [Fri Oct 28 10:02:25 2022] DELETE /compute/v2.1/os-security-group-rules/fab59139-02fa-4f60-afd5-38ef92f29dfb => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:25.727722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e5d38ec8-4c53-44cc-9787-d57b0421c555 req-93a83860-71bf-4f6e-8d5d-97f2bdd17434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cd3269-3458-442d-a68a-d2fcdfa8b1e9", "tag": "b30f7134-38e8-4c49-890e-7763e6d54708"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:25.758183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5d38ec8-4c53-44cc-9787-d57b0421c555 req-93a83860-71bf-4f6e-8d5d-97f2bdd17434 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:25.760815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5d38ec8-4c53-44cc-9787-d57b0421c555 req-93a83860-71bf-4f6e-8d5d-97f2bdd17434 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:25.762558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5d38ec8-4c53-44cc-9787-d57b0421c555 req-93a83860-71bf-4f6e-8d5d-97f2bdd17434 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:25.778090 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e5d38ec8-4c53-44cc-9787-d57b0421c555 req-93a83860-71bf-4f6e-8d5d-97f2bdd17434 service nova] Creating event network-changed:b30f7134-38e8-4c49-890e-7763e6d54708 for instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 on n-h1-zed-1 Oct 28 10:02:25.784885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e5d38ec8-4c53-44cc-9787-d57b0421c555 req-93a83860-71bf-4f6e-8d5d-97f2bdd17434 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064010 Oct 28 10:02:25.786240 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1514/2984] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:25.793548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:25.794781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:25.803333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:25.804199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:25.805494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:25.806487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:25.807584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:25.808510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:26.159760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:26.173313 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-552f98fc-a360-4e4e-9c37-735dba1604ba tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1324 microversion: 2.1 time: 0.385441 Oct 28 10:02:26.174238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1515/2985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:25 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1324 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:26.181960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-21855069-5545-45cd-9e51-92a3c22f3099 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b9baf70>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:26.614763 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-21855069-5545-45cd-9e51-92a3c22f3099 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/092e3a9f-f0f4-4c34-9f4f-d03750663afb" status: 202 len: 0 microversion: 2.1 time: 0.438927 Oct 28 10:02:26.615853 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1516/2986] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:26 2022] DELETE /compute/v2.1/os-security-groups/092e3a9f-f0f4-4c34-9f4f-d03750663afb => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:26.622684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:26.623307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: df9ba748-ea1c-44fd-ae9a-02d1972e3e8f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:26.639833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:26.640419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:26.640885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:26.641669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:26.642135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:26.642570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:26.678381 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] HTTP exception thrown: Instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f could not be found. Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Request method failure captured: Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f HTTP/1.1 Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hiWc1zZKCCXULy-sxg6owMP_yeeWZWFJECSFBq8XmO7OBFUhzXo5Fy5dI_sbyESGR4QaKHwB6pcdLIGE8vN70tUaCENrMLYdc9loCKPHmwifcP-aLuTxFumvFRKGoPLzu0OnnqbQ4o-f975g-9sRFm30-elVzZ2LFH4wC79DASAhc Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 6dcc2826ba6d4a1a9e5534cf94edd809 Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1472334769 Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:26.683972 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcc2826ba6d4a1a9e5534cf94edd809"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcc2826ba6d4a1a9e5534cf94edd809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcc2826ba6d4a1a9e5534cf94edd809", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcc2826ba6d4a1a9e5534cf94edd809"}]}] Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1472334769 Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 6dcc2826ba6d4a1a9e5534cf94edd809 Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1472334769 Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminNegativeTestJSON-1472334769-project Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 10535d8981ed4c3c908f2d3325052c6a Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1472334769-project Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f could not be found. Oct 28 10:02:26.685574 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'df9ba748-ea1c-44fd-ae9a-02d1972e3e8f'} Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f could not be found. Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:26.686467 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f could not be found. Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f could not be found. Oct 28 10:02:26.687805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:26.690747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Returning 404 to user: Instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:26.694055 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-33d113fb-e2db-4505-afe8-eea1be6eae85 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f" status: 404 len: 111 microversion: 2.1 time: 0.076329 Oct 28 10:02:26.697254 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1517/2987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:26 2022] GET /compute/v2.1/servers/df9ba748-ea1c-44fd-ae9a-02d1972e3e8f => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:26.713040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f2d5c366-1994-40cd-a260-4a636535d832 req-772290e5-c37d-4b51-841e-0f32348006ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df9ba748-ea1c-44fd-ae9a-02d1972e3e8f", "name": "network-vif-deleted", "tag": "d7734317-29c3-4f6b-b8df-9df0094bce86"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:26.739461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f2d5c366-1994-40cd-a260-4a636535d832 req-772290e5-c37d-4b51-841e-0f32348006ef service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:26.739461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f2d5c366-1994-40cd-a260-4a636535d832 req-772290e5-c37d-4b51-841e-0f32348006ef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:26.739461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f2d5c366-1994-40cd-a260-4a636535d832 req-772290e5-c37d-4b51-841e-0f32348006ef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:26.770694 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f2d5c366-1994-40cd-a260-4a636535d832 req-772290e5-c37d-4b51-841e-0f32348006ef service nova] Creating event network-vif-deleted:d7734317-29c3-4f6b-b8df-9df0094bce86 for instance df9ba748-ea1c-44fd-ae9a-02d1972e3e8f on n-h2-zed-1 Oct 28 10:02:26.776714 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f2d5c366-1994-40cd-a260-4a636535d832 req-772290e5-c37d-4b51-841e-0f32348006ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077478 Oct 28 10:02:26.777714 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1518/2988] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:26.783036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:26.783753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:26.792298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:26.792807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:26.793282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:26.794006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:26.794605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:26.795040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:26.969895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:26.979894 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-db1daee2-82de-4bac-aa64-247cbbdda101 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1541 microversion: 2.1 time: 0.200938 Oct 28 10:02:26.982863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1519/2989] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:26 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1541 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:26.986257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b68f79bd-1385-4521-aa4f-e5b0ef446e75 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b97a4c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:27.009765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-b68f79bd-1385-4521-aa4f-e5b0ef446e75 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:02:27.010502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.security_group_api [None req-b68f79bd-1385-4521-aa4f-e5b0ef446e75 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Neutron security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 not found {{(pid=128747) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 10:02:27.011057 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b68f79bd-1385-4521-aa4f-e5b0ef446e75 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] HTTP exception thrown: Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist Oct 28 10:02:27.011057 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-38aa5c54-685c-4ca2-8ce4-623fc51ab44a'] Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b68f79bd-1385-4521-aa4f-e5b0ef446e75 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Request method failure captured: Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-security-groups/13348687-8c37-4e3a-b026-314f7b6f3fe4 HTTP/1.1 Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iWhDj8TocUsIJJ74tVezHOM6wEv4vSVI9WwTEGGYXH3PD41RGxnmOfWCncQnPvqC4pcUsjtOp0LRjxW7EVWEX24gHG8QTyev2ZncPPoroBXoPZ5Rvc6FjtZtF2nsAoyGUabo33PgfzngeaNDWz3-WWUIlKkIYJOXADv5WgROy_I2o Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: df53541958e04236a8562ae864611a5e Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-227434304 Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:27.013529 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df53541958e04236a8562ae864611a5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/df53541958e04236a8562ae864611a5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_df53541958e04236a8562ae864611a5e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/df53541958e04236a8562ae864611a5e"}]}] Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupRulesTestJSON-227434304 Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: df53541958e04236a8562ae864611a5e Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-227434304 Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupRulesTestJSON-227434304-project Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 3a0bd464585c4dab92c840bc3893b027 Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupRulesTestJSON-227434304-project Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-38aa5c54-685c-4ca2-8ce4-623fc51ab44a'] Oct 28 10:02:27.015046 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '13348687-8c37-4e3a-b026-314f7b6f3fe4'} Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:02:27.016331 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38aa5c54-685c-4ca2-8ce4-623fc51ab44a'] Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 10:02:27.017568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38aa5c54-685c-4ca2-8ce4-623fc51ab44a'] Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38aa5c54-685c-4ca2-8ce4-623fc51ab44a'] Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:27.018803 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-38aa5c54-685c-4ca2-8ce4-623fc51ab44a'] Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b68f79bd-1385-4521-aa4f-e5b0ef446e75 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Returning 404 to user: Security group 13348687-8c37-4e3a-b026-314f7b6f3fe4 does not exist Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-38aa5c54-685c-4ca2-8ce4-623fc51ab44a'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b68f79bd-1385-4521-aa4f-e5b0ef446e75 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/13348687-8c37-4e3a-b026-314f7b6f3fe4" status: 404 len: 194 microversion: 2.1 time: 0.033534 Oct 28 10:02:27.020293 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1520/2990] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:26 2022] DELETE /compute/v2.1/os-security-groups/13348687-8c37-4e3a-b026-314f7b6f3fe4 => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:27.022809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:27.023927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:27.035014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:27.035605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:27.036177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:27.037222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:27.037804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:27.038148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:27.067172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:27.150017 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f591a705-d216-4ec4-b096-44639326c249 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 204 len: 0 microversion: 2.1 time: 0.131850 Oct 28 10:02:27.150831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1521/2991] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:27 2022] DELETE /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:27.280503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Building network info cache for instance {{(pid=128748) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:02:27.323288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-11867962", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:27.401962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:02:27.642989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:27.643437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:27.644504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:27.645025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:27.645629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:27.656686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:27.657218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:27.657664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:27.658405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:27.659052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:27.659491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:27.679123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Getting quotas for project 2414b143e25042a19c8645b96235f985. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:27.686162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Getting quotas for user 72141a19aa484ad9b466792ab782ec52 and project 2414b143e25042a19c8645b96235f985. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:27.699939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:02:27.702464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:02:27.751670 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d8737c8-c421-418b-b1fc-c2de2724fcc6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599410 Oct 28 10:02:27.753071 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1522/2992] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:02:27.765179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-71f295f3-60b5-4d36-be7d-c9ec733edb3b tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b943670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:28.089902 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-71f295f3-60b5-4d36-be7d-c9ec733edb3b tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b442224a-de16-407d-a550-c734dd20ebd8" status: 202 len: 0 microversion: 2.1 time: 0.335550 Oct 28 10:02:28.090512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1523/2993] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:27 2022] DELETE /compute/v2.1/os-security-groups/b442224a-de16-407d-a550-c734dd20ebd8 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:28.095440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:28.096285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:28.114614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:28.115949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:28.116417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:28.119305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:28.119766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:28.120223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:28.124558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Updating instance_info_cache with network_info: [{"id": "b30f7134-38e8-4c49-890e-7763e6d54708", "address": "fa:16:3e:d6:a6:c9", "network": {"id": "5c66667c-6d75-4e82-a8a4-4669c43d1d73", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-588246644-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "0c49ee1d5d5642749e3e90fb9d596636", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb30f7134-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:02:28.130593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:28.139365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Releasing lock "refresh_cache-75cd3269-3458-442d-a68a-d2fcdfa8b1e9" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:02:28.143216 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dc50be73-5f61-4c39-8d0e-db7e3b9d7eeb tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action" status: 202 len: 0 microversion: 2.1 time: 3.258524 Oct 28 10:02:28.143864 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1471/2994] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:02:24 2022] POST /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9/action => generated 0 bytes in 3262 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:02:28.159897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:28.163557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:28.195280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:28.195673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:28.201122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:28.204470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:28.205745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:28.207939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:28.361493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:28.379749 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4754f36-2bf2-4a32-bd35-52c91d2d2cd0 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1478 microversion: 2.1 time: 0.284704 Oct 28 10:02:28.381199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1524/2995] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:28 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1478 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:28.394166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8fcdb350-dd95-4d3f-b465-fd7ac28a3536 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:28.397046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8fcdb350-dd95-4d3f-b465-fd7ac28a3536 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:28.470598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:28.484840 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-713e2ff6-7cfa-43f2-9bdb-c8b53531c555 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1324 microversion: 2.1 time: 0.338508 Oct 28 10:02:28.489761 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1472/2996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:28 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1324 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:28.496245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1a7c02ab-b39c-452f-9b2d-adb2e9e63fdf req-9b073ed4-e836-4803-b279-92a66fe60325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75cd3269-3458-442d-a68a-d2fcdfa8b1e9", "tag": "b30f7134-38e8-4c49-890e-7763e6d54708"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:28.511467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8fcdb350-dd95-4d3f-b465-fd7ac28a3536 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:28.519480 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8fcdb350-dd95-4d3f-b465-fd7ac28a3536 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1221 microversion: 2.1 time: 0.136888 Oct 28 10:02:28.519901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1a7c02ab-b39c-452f-9b2d-adb2e9e63fdf req-9b073ed4-e836-4803-b279-92a66fe60325 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:28.520393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1a7c02ab-b39c-452f-9b2d-adb2e9e63fdf req-9b073ed4-e836-4803-b279-92a66fe60325 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:28.520837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1a7c02ab-b39c-452f-9b2d-adb2e9e63fdf req-9b073ed4-e836-4803-b279-92a66fe60325 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:28.534107 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1525/2997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:28 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:28.543067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:28.543468 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1a7c02ab-b39c-452f-9b2d-adb2e9e63fdf req-9b073ed4-e836-4803-b279-92a66fe60325 service nova] Creating event network-changed:b30f7134-38e8-4c49-890e-7763e6d54708 for instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 on n-h1-zed-1 Oct 28 10:02:28.544265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:28.548952 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1a7c02ab-b39c-452f-9b2d-adb2e9e63fdf req-9b073ed4-e836-4803-b279-92a66fe60325 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057145 Oct 28 10:02:28.550541 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1473/2998] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:28.551951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:28.552822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:28.553760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:28.554901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:28.555510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:28.556038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:28.569451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "365be066-4fc8-4e43-b1b4-207213dbdbcc"}], "security_groups": [{"name": "tempest-securitygroup--1244694760"}], "key_name": "tempest-keypair-441107403", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:28.774692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] validate_networks() for [('365be066-4fc8-4e43-b1b4-207213dbdbcc', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:02:28.806571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:28.814843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd41447e-5451-4e65-8534-a26b53294981 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1541 microversion: 2.1 time: 0.279978 Oct 28 10:02:28.821211 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1526/2999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:28 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1541 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:28.828520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c5e192a-72fc-4c9d-a055-79b8ea94cc9a tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b8da670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.227246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:29.227674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:29.228185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:29.228611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:29.229072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:29.239786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.240283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.240992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.241897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.243414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.244259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.267610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Getting quotas for project 2fc42ddeb5cd4170a5d01683e0605a87. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:29.273779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Getting quotas for user 78e6fe2e79b54462b20619cf36ffadf0 and project 2fc42ddeb5cd4170a5d01683e0605a87. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:29.280698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c5e192a-72fc-4c9d-a055-79b8ea94cc9a tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/eec83056-cad1-473a-a899-fdfed4c6edeb" status: 202 len: 0 microversion: 2.1 time: 0.458154 Oct 28 10:02:29.281951 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1527/3000] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:28 2022] DELETE /compute/v2.1/os-security-groups/eec83056-cad1-473a-a899-fdfed4c6edeb => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:29.287590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:02:29.288128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.289006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:29.290873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:02:29.297587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.298381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.299035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.300067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.300846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.301634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.335274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] HTTP exception thrown: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Request method failure captured: Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 HTTP/1.1 Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6hbCI5V1WuWydRPTJq9sR_bXhiF5bhtJYIDEMdzqJCPw8UTJvbG5pSs4kpQREvb-OaWD0jBvaW0N4I0dGuIizGrCLtvlrwlf08Zt8DySYf_UdMQW2rpPByJ4L4IFMAYLg_y6j4eef63qCLJEL5vcqlXGZ35uuZ_iIeh0gVZLKfW6Aw Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:29.343153 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c49ee1d5d5642749e3e90fb9d596636", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c49ee1d5d5642749e3e90fb9d596636"}]}] Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 854e41184e0f4b06aa85a150fec89fd4 Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.345018 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '11921705-654f-4224-b9b2-55157e647230'} Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:29.345994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.347677 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.354798 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84307625-3290-4a0b-ae0d-7a7037d4ac11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.802591 Oct 28 10:02:29.356063 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1474/3001] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:28 2022] POST /compute/v2.1/servers => generated 409 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:02:29.359653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Returning 404 to user: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:29.361354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0b9229cc-39ba-48bc-822d-a7a764fc1789 req-b210f66a-7d04-4ecb-a1c7-4665e7621c01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c110c4a5-2759-4e37-b90f-479b6b927d10", "name": "network-vif-plugged", "status": "completed", "tag": "6c7c0bf7-9615-441c-bdb1-60ab738debe7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:29.364195 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-987d4f12-675f-41ec-beae-350d9854de6d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 404 len: 111 microversion: 2.1 time: 0.080680 Oct 28 10:02:29.370119 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1528/3002] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:29 2022] DELETE /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:29.374843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0b9229cc-39ba-48bc-822d-a7a764fc1789 req-b210f66a-7d04-4ecb-a1c7-4665e7621c01 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.375595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0b9229cc-39ba-48bc-822d-a7a764fc1789 req-b210f66a-7d04-4ecb-a1c7-4665e7621c01 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.376327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0b9229cc-39ba-48bc-822d-a7a764fc1789 req-b210f66a-7d04-4ecb-a1c7-4665e7621c01 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.381058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7e516033-161b-4e5d-904a-090f27725bab tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3b9c03a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.392417 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0b9229cc-39ba-48bc-822d-a7a764fc1789 req-b210f66a-7d04-4ecb-a1c7-4665e7621c01 service nova] Creating event network-vif-plugged:6c7c0bf7-9615-441c-bdb1-60ab738debe7 for instance c110c4a5-2759-4e37-b90f-479b6b927d10 on n-h1-zed-1 Oct 28 10:02:29.397678 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0b9229cc-39ba-48bc-822d-a7a764fc1789 req-b210f66a-7d04-4ecb-a1c7-4665e7621c01 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040209 Oct 28 10:02:29.398876 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1475/3003] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:29.405576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-831579e3-f247-4f79-a6f4-ba38a76cc545 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.406916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-831579e3-f247-4f79-a6f4-ba38a76cc545 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:29.475969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-831579e3-f247-4f79-a6f4-ba38a76cc545 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:29.493484 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-831579e3-f247-4f79-a6f4-ba38a76cc545 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1225 microversion: 2.1 time: 0.092196 Oct 28 10:02:29.495130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1476/3004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:29 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:29.506790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.513846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 11921705-654f-4224-b9b2-55157e647230] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:29.521705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.523830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.524295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.525503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.526598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.527133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.547556 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] HTTP exception thrown: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Request method failure captured: Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 HTTP/1.1 Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hbCI5V1WuWydRPTJq9sR_bXhiF5bhtJYIDEMdzqJCPw8UTJvbG5pSs4kpQREvb-OaWD0jBvaW0N4I0dGuIizGrCLtvlrwlf08Zt8DySYf_UdMQW2rpPByJ4L4IFMAYLg_y6j4eef63qCLJEL5vcqlXGZ35uuZ_iIeh0gVZLKfW6Aw Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:29.549415 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c49ee1d5d5642749e3e90fb9d596636", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c49ee1d5d5642749e3e90fb9d596636"}]}] Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 854e41184e0f4b06aa85a150fec89fd4 Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.550990 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '11921705-654f-4224-b9b2-55157e647230'} Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:29.551893 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. Oct 28 10:02:29.553361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:29.555705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Returning 404 to user: Instance 11921705-654f-4224-b9b2-55157e647230 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:29.555705 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73808e7d-0379-4e95-9057-47bbdd0f651d tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230" status: 404 len: 111 microversion: 2.1 time: 0.055187 Oct 28 10:02:29.555705 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1477/3005] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:29 2022] GET /compute/v2.1/servers/11921705-654f-4224-b9b2-55157e647230 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:29.557198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.557820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:29.565116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.565618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.566064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.566803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.567267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.567705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.741420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:29.757996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c8711b8-76b7-4bbd-a5b3-2fe4078fd3e9 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1478 microversion: 2.1 time: 0.204905 Oct 28 10:02:29.769832 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1478/3006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:29 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1478 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:29.775912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.776793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:29.783721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.784445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.784950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.785884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:29.786516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:29.787103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:29.974486 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7e516033-161b-4e5d-904a-090f27725bab tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/b7200f5d-48e9-4eca-b223-b560d8b0e22c" status: 202 len: 0 microversion: 2.1 time: 0.603163 Oct 28 10:02:29.975083 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1529/3007] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:29 2022] DELETE /compute/v2.1/os-security-groups/b7200f5d-48e9-4eca-b223-b560d8b0e22c => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:29.982162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:29.983554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:29.984367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:29.993601 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad4f4113-67ee-48f4-b321-80de48bf7b98 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1324 microversion: 2.1 time: 0.221799 Oct 28 10:02:29.994622 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1479/3008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:29 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:30.001436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a74eb080-ec74-4d36-93e7-c56902961a8b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '.version_select at 0x7fca32b38310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:30.002498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.003016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.003469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:30.004192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.004660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.008178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:30.169557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:30.179903 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-36357551-1369-4bd6-96cc-509bb725e91a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1281 microversion: 2.1 time: 0.199900 Oct 28 10:02:30.180800 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1530/3009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:29 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:30.191078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:30.192858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:30.202307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.203159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.203882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:30.205682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.206483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.206983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:30.576815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:30.607321 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15679efa-6c79-4cd7-8dd2-cb1b82241b93 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1541 microversion: 2.1 time: 0.424273 Oct 28 10:02:30.620937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1531/3010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:30 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1541 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:30.620937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b15c3d92-f114-48af-9009-2c5121675887 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca3ba0b3a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:30.899258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a74eb080-ec74-4d36-93e7-c56902961a8b tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/fbf6792b-45dd-487d-8243-46ad6a11ff2c" status: 202 len: 0 microversion: 2.1 time: 0.903110 Oct 28 10:02:30.900491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1480/3011] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:02:29 2022] DELETE /compute/v2.1/os-floating-ips/fbf6792b-45dd-487d-8243-46ad6a11ff2c => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:30.907904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:30.908431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:30.919244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.920057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.920820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:30.921798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.922511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.923123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:30.961657 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ba280ba-0820-4fdf-ab4a-bea80f28d981 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments/f580faf6-9f9b-4c81-aae9-e23b72630b69" status: 200 len: 194 microversion: 2.20 time: 0.059551 Oct 28 10:02:30.962994 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1481/3012] 10.222.0.16 () {60 vars in 1454 bytes} [Fri Oct 28 10:02:30 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments/f580faf6-9f9b-4c81-aae9-e23b72630b69 => generated 194 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:30.968671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:30.969725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:30.979001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.979809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.980417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:30.981523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:30.982282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:30.982886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.097040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:31.106759 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-98f5f2c1-3005-4fa7-a75e-412a5b5ec688 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1277 microversion: 2.1 time: 0.142428 Oct 28 10:02:31.107685 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1482/3013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:30 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1277 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:31.118790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a4e558fa-49cb-4347-8658-92ad6d26d6f5 req-221eeeb9-27b9-41ca-947f-3bdb57657e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15036a7f-b1b2-4ddc-ad24-03a31aa30e43", "name": "network-vif-deleted", "tag": "999fb169-6be7-42c7-bbba-80d189096ad9"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:31.132885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a4e558fa-49cb-4347-8658-92ad6d26d6f5 req-221eeeb9-27b9-41ca-947f-3bdb57657e9a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.133435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a4e558fa-49cb-4347-8658-92ad6d26d6f5 req-221eeeb9-27b9-41ca-947f-3bdb57657e9a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.134151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a4e558fa-49cb-4347-8658-92ad6d26d6f5 req-221eeeb9-27b9-41ca-947f-3bdb57657e9a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.146064 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a4e558fa-49cb-4347-8658-92ad6d26d6f5 req-221eeeb9-27b9-41ca-947f-3bdb57657e9a service nova] Creating event network-vif-deleted:999fb169-6be7-42c7-bbba-80d189096ad9 for instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 on n-h2-zed-1 Oct 28 10:02:31.151432 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a4e558fa-49cb-4347-8658-92ad6d26d6f5 req-221eeeb9-27b9-41ca-947f-3bdb57657e9a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042279 Oct 28 10:02:31.152314 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1483/3014] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:31.157905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.158629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:31.161107 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b15c3d92-f114-48af-9009-2c5121675887 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/01353d01-0981-4c7d-9d15-6fb61b245da8" status: 202 len: 0 microversion: 2.1 time: 0.548414 Oct 28 10:02:31.163717 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1532/3015] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:30 2022] DELETE /compute/v2.1/os-security-groups/01353d01-0981-4c7d-9d15-6fb61b245da8 => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:31.165886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.166393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.166841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.167571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.168179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.168619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.169690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.170505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:31.177019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.177511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.178135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.178863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.179316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.180361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.213357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:31.225476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.233053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.234236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.234653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lazy-loading 'fault' on Instance uuid 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:31.294444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10535d8981ed4c3c908f2d3325052c6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6dcc2826ba6d4a1a9e5534cf94edd809', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:31.304231 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b38d17d6-21b4-4e5d-83a5-eeeac03b39e4 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 200 len: 1312 microversion: 2.1 time: 0.150349 Oct 28 10:02:31.306664 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1484/3016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:31 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:31.314345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.315399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:31.322262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.322939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.323579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.324634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.325239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.326036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.361711 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d95c26d8-af3e-410d-99d8-b1d4da7ded45 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "DELETE /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 204 len: 0 microversion: 2.1 time: 0.195439 Oct 28 10:02:31.366396 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1533/3017] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:31 2022] DELETE /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:31.381564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.382593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:31.389677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.390706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.391451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.392227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.392707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.393209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.519373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lazy-loading 'services' on Instance uuid f7831b2e-dc40-4e1b-981b-94cb7d1736f0 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:31.533815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:31.543931 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74d7cdea-1965-4423-9618-0fed41f84d96 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1520 microversion: 2.1 time: 0.235481 Oct 28 10:02:31.553213 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1485/3018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:31 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:31.553213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c818e982-2b1a-44a1-a4ab-925b399f72b2 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] Calling method '.version_select at 0x7fca329ede50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.632151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-06c2413d-3242-4eb4-a7bc-022bc8067f7f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments/f580faf6-9f9b-4c81-aae9-e23b72630b69" status: 202 len: 0 microversion: 2.20 time: 0.260095 Oct 28 10:02:31.633932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1534/3019] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Oct 28 10:02:31 2022] DELETE /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments/f580faf6-9f9b-4c81-aae9-e23b72630b69 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:31.647605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.649281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:31.657014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.658023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.658703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.660434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.661177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.662504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.788601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:31.797976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5472b34f-56c6-4a28-852f-9404bcb4a4d7 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1279 microversion: 2.1 time: 0.159246 Oct 28 10:02:31.798638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c818e982-2b1a-44a1-a4ab-925b399f72b2 tempest-SecurityGroupRulesTestJSON-227434304 tempest-SecurityGroupRulesTestJSON-227434304-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/8ec43962-f51e-4946-881a-d7d76f5cbf36" status: 202 len: 0 microversion: 2.1 time: 0.252364 Oct 28 10:02:31.799363 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1486/3020] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:31 2022] DELETE /compute/v2.1/os-security-groups/8ec43962-f51e-4946-881a-d7d76f5cbf36 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:02:31.804184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.805611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:31.812500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.813249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.813876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.814747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.815537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.816123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.817066 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1535/3021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:31 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:31.831733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-61b19e4f-31c1-4c14-8ebe-6ecae292907d req-162e6b7f-4a1e-44e5-bb5e-d1a535f29d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0210ec12-d8b3-4557-8b38-a57d74f96fd0", "name": "network-vif-plugged", "status": "completed", "tag": "7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:31.844054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-61b19e4f-31c1-4c14-8ebe-6ecae292907d req-162e6b7f-4a1e-44e5-bb5e-d1a535f29d4b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.850694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-61b19e4f-31c1-4c14-8ebe-6ecae292907d req-162e6b7f-4a1e-44e5-bb5e-d1a535f29d4b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.851138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-61b19e4f-31c1-4c14-8ebe-6ecae292907d req-162e6b7f-4a1e-44e5-bb5e-d1a535f29d4b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.865217 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-61b19e4f-31c1-4c14-8ebe-6ecae292907d req-162e6b7f-4a1e-44e5-bb5e-d1a535f29d4b service nova] Creating event network-vif-plugged:7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e for instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 on n-h2-zed-1 Oct 28 10:02:31.871854 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-61b19e4f-31c1-4c14-8ebe-6ecae292907d req-162e6b7f-4a1e-44e5-bb5e-d1a535f29d4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053473 Oct 28 10:02:31.873062 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1536/3022] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:31.878595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:31.879514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:31.888204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.888987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.889616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:31.890502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:31.891172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:31.891763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.008792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:32.017245 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-366210e3-0ba5-41a3-a3ce-89210b295735 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1525 microversion: 2.1 time: 0.216585 Oct 28 10:02:32.017835 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1487/3023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:31 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1525 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:32.029298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.032308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.039641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.040413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.040853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.041640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.042097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.042525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.084551 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b534e061-bd53-4172-b6b5-dc168669569f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064827 Oct 28 10:02:32.090663 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1488/3024] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:32 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:32.092317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96a937f7-d831-4717-bdaf-a158ae2076b3 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2109974582", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96a937f7-d831-4717-bdaf-a158ae2076b3 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 243 Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:32.098158 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:02:32.099540 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2109974582", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2109974582', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '2031f50a-5ac8-45aa-8ce1-247435554ba6'}]}}} Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:02:32.100834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.106723 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.109738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.112108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96a937f7-d831-4717-bdaf-a158ae2076b3 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.113417 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96a937f7-d831-4717-bdaf-a158ae2076b3 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.025976 Oct 28 10:02:32.114432 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1489/3025] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:32 2022] POST /compute/v2.1/servers => generated 175 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:32.127533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-431417dd-75f5-4617-9119-79b62936a54e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.128257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-431417dd-75f5-4617-9119-79b62936a54e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: ce5921a0-0924-4bad-ba3f-1eb415dce6cc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.137121 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-431417dd-75f5-4617-9119-79b62936a54e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] HTTP exception thrown: Instance ce5921a0-0924-4bad-ba3f-1eb415dce6cc could not be found. Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-431417dd-75f5-4617-9119-79b62936a54e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ce5921a0-0924-4bad-ba3f-1eb415dce6cc/metadata HTTP/1.1 Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:32.144550 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:32.146067 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ce5921a0-0924-4bad-ba3f-1eb415dce6cc could not be found. Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': 'ce5921a0-0924-4bad-ba3f-1eb415dce6cc'} Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5921a0-0924-4bad-ba3f-1eb415dce6cc could not be found. Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.146977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5921a0-0924-4bad-ba3f-1eb415dce6cc could not be found. Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5921a0-0924-4bad-ba3f-1eb415dce6cc could not be found. Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.148740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-431417dd-75f5-4617-9119-79b62936a54e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 404 to user: Instance ce5921a0-0924-4bad-ba3f-1eb415dce6cc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.168531 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-431417dd-75f5-4617-9119-79b62936a54e tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/ce5921a0-0924-4bad-ba3f-1eb415dce6cc/metadata" status: 404 len: 111 microversion: 2.1 time: 0.024690 Oct 28 10:02:32.168531 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1490/3026] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:02:32 2022] GET /compute/v2.1/servers/ce5921a0-0924-4bad-ba3f-1eb415dce6cc/metadata => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:32.177612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.179060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.190698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.194552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.195035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.195826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.196266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.196690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.325514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:32.334892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-988af70d-431b-4770-8102-533dcc0080f4 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1283 microversion: 2.1 time: 0.184385 Oct 28 10:02:32.335478 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1491/3027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:32 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1283 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:32.341245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb1809db-f741-4f2d-b508-3acf3f7ce733 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1408275387", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb1809db-f741-4f2d-b508-3acf3f7ce733 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 499 Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:32.345635 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.346925 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:02:32.347550 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1408275387", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} Oct 28 10:02:32.347550 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:32.347550 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.347550 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1408275387', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2031f50a-5ac8-45aa-8ce1-247435554ba6'}]}}} Oct 28 10:02:32.347550 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.347550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.348578 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:32.349622 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:32.352549 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:32.353869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.353869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.353869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb1809db-f741-4f2d-b508-3acf3f7ce733 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.354342 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bb1809db-f741-4f2d-b508-3acf3f7ce733 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.009822 Oct 28 10:02:32.354342 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1492/3028] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:32 2022] POST /compute/v2.1/servers => generated 687 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:32.354342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.354765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] [instance: 15036a7f-b1b2-4ddc-ad24-03a31aa30e43] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.363926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.365197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.365652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.367388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.369134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.369592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.390199 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] HTTP exception thrown: Instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 could not be found. Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Request method failure captured: Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 HTTP/1.1 Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hiWc1zZKCCXULy-sxg6owMP_yeeWZWFJECSFBq8XmO7OBFUhzXo5Fy5dI_sbyESGR4QaKHwB6pcdLIGE8vN70tUaCENrMLYdc9loCKPHmwifcP-aLuTxFumvFRKGoPLzu0OnnqbQ4o-f975g-9sRFm30-elVzZ2LFH4wC79DASAhc Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 6dcc2826ba6d4a1a9e5534cf94edd809 Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1472334769 Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:32.392946 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcc2826ba6d4a1a9e5534cf94edd809"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6dcc2826ba6d4a1a9e5534cf94edd809"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6dcc2826ba6d4a1a9e5534cf94edd809", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6dcc2826ba6d4a1a9e5534cf94edd809"}]}] Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1472334769 Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 6dcc2826ba6d4a1a9e5534cf94edd809 Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1472334769 Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersAdminNegativeTestJSON-1472334769-project Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 10535d8981ed4c3c908f2d3325052c6a Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1472334769-project Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 could not be found. Oct 28 10:02:32.394309 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '15036a7f-b1b2-4ddc-ad24-03a31aa30e43'} Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 could not be found. Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.395107 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 could not be found. Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 could not be found. Oct 28 10:02:32.396356 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.397467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] Returning 404 to user: Instance 15036a7f-b1b2-4ddc-ad24-03a31aa30e43 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.397467 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc2f1e37-df52-48a7-91f4-7be66c084696 tempest-ServersAdminNegativeTestJSON-1472334769 tempest-ServersAdminNegativeTestJSON-1472334769-project] 10.222.0.16 "GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43" status: 404 len: 111 microversion: 2.1 time: 0.046523 Oct 28 10:02:32.397467 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1493/3029] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:32 2022] GET /compute/v2.1/servers/15036a7f-b1b2-4ddc-ad24-03a31aa30e43 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:32.421271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c02b4b5-0f23-4e68-8f6a-e800b177679b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1071340823", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c02b4b5-0f23-4e68-8f6a-e800b177679b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 500 Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:32.426572 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.428067 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:02:32.428783 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1071340823", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} Oct 28 10:02:32.428783 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:32.428783 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.428783 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1071340823', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2031f50a-5ac8-45aa-8ce1-247435554ba6'}]}}} Oct 28 10:02:32.428783 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.428783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.429206 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:32.430454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:32.431401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:32.432016 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.432016 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.435025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c02b4b5-0f23-4e68-8f6a-e800b177679b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.435907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c02b4b5-0f23-4e68-8f6a-e800b177679b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.019313 Oct 28 10:02:32.446266 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1494/3030] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:32 2022] POST /compute/v2.1/servers => generated 689 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 10:02:32.460285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:32.473540 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a9a70f8b-57f6-44ac-85c8-2c2e2d248987 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1541 microversion: 2.1 time: 0.598737 Oct 28 10:02:32.474024 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1537/3031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:31 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1541 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:32.515162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-889d1f81-9e46-4ce5-9102-61efe7b0c86f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-709032580", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-889d1f81-9e46-4ce5-9102-61efe7b0c86f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 753 Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:32.521156 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.522692 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:02:32.523997 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-709032580", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} Oct 28 10:02:32.523997 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:32.523997 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-709032580', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2031f50a-5ac8-45aa-8ce1-247435554ba6'}]}}} Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:32.524245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.524860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:32.526113 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:32.526825 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:32.527493 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.527493 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.528930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-889d1f81-9e46-4ce5-9102-61efe7b0c86f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.530192 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-889d1f81-9e46-4ce5-9102-61efe7b0c86f tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.022469 Oct 28 10:02:32.531623 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1495/3032] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:32 2022] POST /compute/v2.1/servers => generated 1197 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 10:02:32.585806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-104d99b5-7615-436a-aedd-c67044839392 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1870439258", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-104d99b5-7615-436a-aedd-c67044839392 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 1266 Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:32.589162 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.590471 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:02:32.591276 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1870439258", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "2031f50a-5ac8-45aa-8ce1-247435554ba6"}]}} Oct 28 10:02:32.591276 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1870439258', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '2031f50a-5ac8-45aa-8ce1-247435554ba6'}]}}} Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.591454 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:02:32.593205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:02:32.594872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 28 10:02:32.594872 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.594872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-104d99b5-7615-436a-aedd-c67044839392 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.594872 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-104d99b5-7615-436a-aedd-c67044839392 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.011830 Oct 28 10:02:32.596775 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1538/3033] 10.222.0.16 () {60 vars in 1148 bytes} [Fri Oct 28 10:02:32 2022] POST /compute/v2.1/servers => generated 2221 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 28 10:02:32.604486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40ab7772-6a31-4378-9d7c-73745b9e256c tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.605013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-40ab7772-6a31-4378-9d7c-73745b9e256c tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: 1dab7b5d-8f02-4df8-8dca-c63e8aae090d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.610945 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-40ab7772-6a31-4378-9d7c-73745b9e256c tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] HTTP exception thrown: Instance 1dab7b5d-8f02-4df8-8dca-c63e8aae090d could not be found. Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40ab7772-6a31-4378-9d7c-73745b9e256c tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/1dab7b5d-8f02-4df8-8dca-c63e8aae090d/metadata/test2 HTTP/1.1 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 1dab7b5d-8f02-4df8-8dca-c63e8aae090d could not be found. Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '1dab7b5d-8f02-4df8-8dca-c63e8aae090d', 'id': 'test2'} Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dab7b5d-8f02-4df8-8dca-c63e8aae090d could not be found. Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dab7b5d-8f02-4df8-8dca-c63e8aae090d could not be found. Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:32.612863 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:32.620123 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:32.620123 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:32.620123 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dab7b5d-8f02-4df8-8dca-c63e8aae090d could not be found. Oct 28 10:02:32.620123 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:32.620123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40ab7772-6a31-4378-9d7c-73745b9e256c tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 404 to user: Instance 1dab7b5d-8f02-4df8-8dca-c63e8aae090d could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:32.620123 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-40ab7772-6a31-4378-9d7c-73745b9e256c tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/1dab7b5d-8f02-4df8-8dca-c63e8aae090d/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.015872 Oct 28 10:02:32.620123 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1496/3034] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 10:02:32 2022] GET /compute/v2.1/servers/1dab7b5d-8f02-4df8-8dca-c63e8aae090d/metadata/test2 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:32.632839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.633603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.644300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.645055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.646398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.647320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.648597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.649228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.683379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:32.786969 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f7ffd56f-2820-4654-be88-e5594058fe8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 204 len: 0 microversion: 2.1 time: 0.156873 Oct 28 10:02:32.788583 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1539/3035] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:32 2022] DELETE /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:32.797081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.797705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.809676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.810785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.811579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.814997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.816203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.817113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.840062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:32.841090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:32.847584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.848353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.849309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.850267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:32.850908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:32.852142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:32.994447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:33.005311 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d9cd785-0d86-45a6-b11c-ddea296fe552 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1526 microversion: 2.1 time: 0.211514 Oct 28 10:02:33.021708 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1497/3036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:32 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1526 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:33.043786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:33.045035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:33.051317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.052147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.052674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.054488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.054488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.054777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.233343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:33.243055 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-631978d7-b99c-412c-a84e-a6e441bd9e4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1525 microversion: 2.1 time: 0.205010 Oct 28 10:02:33.243753 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1498/3037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:33 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1525 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:33.249061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:33.251686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:33.265847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.266653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.267257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.268054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.268592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.269158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.274730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:33.306391 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52a05c55-7b51-41e4-a61e-587ec67af08c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061335 Oct 28 10:02:33.307053 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1499/3038] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:33 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:33.366193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:33.366715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:33.374020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.374510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.374950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.375669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.376123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.376547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.433938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:33.446562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-20069eff-3d34-44e8-908b-e76d6aaaa929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.614022 Oct 28 10:02:33.447436 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1540/3039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:32 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:33.471393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:33.488517 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e33714c3-f13e-4758-846d-538b861ea1a0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1283 microversion: 2.1 time: 0.126325 Oct 28 10:02:33.489326 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1500/3040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:33 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1283 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:33.502581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:33.503377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:33.510394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.511124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.511770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.512668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:33.513312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:33.513899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:33.948830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:33.958074 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d791075-e157-4a38-89ac-88427ede19aa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1523 microversion: 2.1 time: 0.463389 Oct 28 10:02:33.958889 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1541/3041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:33 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1523 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:33.989313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:33.991236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:34.003803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.004512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.006316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.007869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.008550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.009271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.027883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:34.028604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:34.042420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.042999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.043513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.044745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.045656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.047609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:34.049219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.186299 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-018d51c5-e16e-47d7-bd53-b34413735939 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 204 len: 0 microversion: 2.1 time: 0.204035 Oct 28 10:02:34.188981 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1501/3042] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:33 2022] DELETE /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:34.197058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:34.197760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:34.205185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.205513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.205973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.206680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.207289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.207853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.437606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:34.447333 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3780c866-81c6-4f37-bfe3-4303360aa831 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1529 microversion: 2.1 time: 0.254958 Oct 28 10:02:34.463774 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1502/3043] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:34 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1529 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:34.472615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:34.476034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:34.486283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:34.488524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.489130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.489824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.490699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.491328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.491862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:34.940621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:34.954093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1fdd850-d2c1-43d8-965e-aab5aff211d8 tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1525 microversion: 2.1 time: 0.488833 Oct 28 10:02:34.955684 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1503/3044] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:34 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1525 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:34.970156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:34.973447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:34.993658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:34.995076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:34.997911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.002027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.002556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.003226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.052081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dbd8853c-5ddd-4f1a-be3a-86e0b41e3c87 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094352 Oct 28 10:02:35.059133 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1504/3045] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:34 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:35.065337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:35.066189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:35.075344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.076194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.076851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.077803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.078471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.079297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.119627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:35.132267 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-06284fe2-6a23-4787-a53f-039c35bf9c0d tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1526 microversion: 2.1 time: 1.108436 Oct 28 10:02:35.133471 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1542/3046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:34 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1526 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:35.153206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:35.158947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:35.173073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.173969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.175944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.177806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.184213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.184897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.189811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:35.281189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:35.291075 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b8e5da1-47e7-4c9a-9944-72950c5bfca9 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.230130 Oct 28 10:02:35.307195 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1505/3047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:35 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:35.471999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:35.472934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:35.482166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.486395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.487049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.488769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.489622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.490232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.759089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:35.772418 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-72ee2241-34ad-46b4-8316-2322a13aa1ec tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1529 microversion: 2.1 time: 0.304145 Oct 28 10:02:35.789446 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1506/3048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:35 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1529 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:35.789446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5bae6a64-10ec-4b95-b81a-d79efb18fc94 req-4cd206d0-cd85-4eca-a26e-3d507f67ac22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c110c4a5-2759-4e37-b90f-479b6b927d10", "name": "network-vif-deleted", "tag": "6c7c0bf7-9615-441c-bdb1-60ab738debe7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:35.795504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5bae6a64-10ec-4b95-b81a-d79efb18fc94 req-4cd206d0-cd85-4eca-a26e-3d507f67ac22 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.796585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5bae6a64-10ec-4b95-b81a-d79efb18fc94 req-4cd206d0-cd85-4eca-a26e-3d507f67ac22 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.797220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5bae6a64-10ec-4b95-b81a-d79efb18fc94 req-4cd206d0-cd85-4eca-a26e-3d507f67ac22 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.812844 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5bae6a64-10ec-4b95-b81a-d79efb18fc94 req-4cd206d0-cd85-4eca-a26e-3d507f67ac22 service nova] Creating event network-vif-deleted:6c7c0bf7-9615-441c-bdb1-60ab738debe7 for instance c110c4a5-2759-4e37-b90f-479b6b927d10 on n-h1-zed-1 Oct 28 10:02:35.822973 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5bae6a64-10ec-4b95-b81a-d79efb18fc94 req-4cd206d0-cd85-4eca-a26e-3d507f67ac22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047467 Oct 28 10:02:35.823840 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1507/3049] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:35.885782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-750531b4-b128-48a2-bc17-cf5e60f04346 req-1d31babf-a5b2-4f92-ac41-844595cda3f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb2abd3e-b15e-4086-8361-ecbd4445c0ac", "tag": "402c5e41-0016-4cd2-8e32-f4b32cc27e54"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:35.901016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-750531b4-b128-48a2-bc17-cf5e60f04346 req-1d31babf-a5b2-4f92-ac41-844595cda3f5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.902956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-750531b4-b128-48a2-bc17-cf5e60f04346 req-1d31babf-a5b2-4f92-ac41-844595cda3f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.903444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-750531b4-b128-48a2-bc17-cf5e60f04346 req-1d31babf-a5b2-4f92-ac41-844595cda3f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.918359 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-750531b4-b128-48a2-bc17-cf5e60f04346 req-1d31babf-a5b2-4f92-ac41-844595cda3f5 service nova] Creating event network-changed:402c5e41-0016-4cd2-8e32-f4b32cc27e54 for instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac on n-h2-zed-1 Oct 28 10:02:35.923893 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-750531b4-b128-48a2-bc17-cf5e60f04346 req-1d31babf-a5b2-4f92-ac41-844595cda3f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042545 Oct 28 10:02:35.925584 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1508/3050] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:02:35.956137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:35.971634 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b73d5af-259d-40ff-9cf2-40675eec09c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.831944 Oct 28 10:02:35.972932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1543/3051] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:35 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:35.980490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:35.981231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:35.993521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.994453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.994910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:35.996331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:35.998439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:35.998889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.066090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:36.077735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:36.085372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:36.087762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.088474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.089228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.090171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.090847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.091493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.172700 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bdadca77-defd-425c-bc7e-e9ffa366181c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109117 Oct 28 10:02:36.184481 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1544/3052] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:36 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:36.190821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:36.191779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:36.211740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.213295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.249423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.253280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.255301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.255937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.301264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '854e41184e0f4b06aa85a150fec89fd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c49ee1d5d5642749e3e90fb9d596636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:36.316646 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-259ccc43-8c8c-4be4-9cf6-227d13a15fed tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 200 len: 1525 microversion: 2.1 time: 0.336483 Oct 28 10:02:36.339597 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1509/3053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:35 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 1525 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:36.345797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.346299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.346749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.347211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lazy-loading 'fault' on Instance uuid c110c4a5-2759-4e37-b90f-479b6b927d10 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:36.359928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:36.361026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:36.371633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.372417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.373159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.374222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.374912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.375577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.770529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52459d9276c94241ba4dd63403ce3a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1389c5372a9a42faa7aae2d03ea2787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:36.783612 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8933de1b-e91d-490f-8da3-650fdb0d2368 tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 200 len: 1314 microversion: 2.1 time: 0.597740 Oct 28 10:02:36.801277 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1545/3054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:36 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 1314 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:36.833756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:36.847247 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-40265e1b-f015-470e-8dd7-975aff13ef76 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.504652 Oct 28 10:02:36.848246 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1510/3055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:36 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:36.861387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-007127aa-b9c6-47ed-8508-3966cdd0b91f req-1511249f-b83f-4e37-b927-60eb653de3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0210ec12-d8b3-4557-8b38-a57d74f96fd0", "name": "network-vif-unplugged", "status": "completed", "tag": "7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:36.892852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-007127aa-b9c6-47ed-8508-3966cdd0b91f req-1511249f-b83f-4e37-b927-60eb653de3f7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.893373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-007127aa-b9c6-47ed-8508-3966cdd0b91f req-1511249f-b83f-4e37-b927-60eb653de3f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.893800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-007127aa-b9c6-47ed-8508-3966cdd0b91f req-1511249f-b83f-4e37-b927-60eb653de3f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.921773 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-007127aa-b9c6-47ed-8508-3966cdd0b91f req-1511249f-b83f-4e37-b927-60eb653de3f7 service nova] Creating event network-vif-unplugged:7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e for instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 on n-h2-zed-1 Oct 28 10:02:36.943475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-007127aa-b9c6-47ed-8508-3966cdd0b91f req-1511249f-b83f-4e37-b927-60eb653de3f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093859 Oct 28 10:02:36.945039 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1511/3056] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:36.950640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:36.951529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:36.958760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.959438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.964810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.965740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:36.966292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:36.966823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:36.995889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.002858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.005554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.013480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.014929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.015425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.015866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.049806 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef056c95-017a-4709-aaaf-11f8f65f9e5a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 929 microversion: 2.1 time: 0.247197 Oct 28 10:02:37.059685 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1546/3057] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:02:36 2022] GET /compute/v2.1/os-services => generated 929 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:37.064972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.065890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:37.073528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.074677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.075327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.076270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.076970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.077606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.516516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:37.530274 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b046ab30-b926-4299-b527-7e28f3ddd7ed tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1529 microversion: 2.1 time: 0.583807 Oct 28 10:02:37.549853 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1512/3058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:36 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1529 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:37.556766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.563138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.563956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.564658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.565751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.566914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.567809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.647551 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ff6fc26-95c0-4494-9098-96c77829afcc tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?host=n-d-zed-1" status: 200 len: 569 microversion: 2.1 time: 0.096155 Oct 28 10:02:37.660403 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1513/3059] 10.222.0.16 () {58 vars in 1166 bytes} [Fri Oct 28 10:02:37 2022] GET /compute/v2.1/os-services?host=n-d-zed-1 => generated 569 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:37.666219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.668636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:37.675390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.676716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.685560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.697692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.698680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.699302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.772445 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bdaaf125-ace8-4415-b3b2-5da5293a6db8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.110433 Oct 28 10:02:37.777257 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1514/3060] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:37 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:37.779139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.779840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] [instance: 75cd3269-3458-442d-a68a-d2fcdfa8b1e9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:37.787784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.788285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.789333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.792667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.793317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.793845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.818028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] HTTP exception thrown: Instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 could not be found. Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Request method failure captured: Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 HTTP/1.1 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6hbCI5V1WuWydRPTJq9sR_bXhiF5bhtJYIDEMdzqJCPw8UTJvbG5pSs4kpQREvb-OaWD0jBvaW0N4I0dGuIizGrCLtvlrwlf08Zt8DySYf_UdMQW2rpPByJ4L4IFMAYLg_y6j4eef63qCLJEL5vcqlXGZ35uuZ_iIeh0gVZLKfW6Aw Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0c49ee1d5d5642749e3e90fb9d596636"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0c49ee1d5d5642749e3e90fb9d596636", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0c49ee1d5d5642749e3e90fb9d596636"}]}] Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 0c49ee1d5d5642749e3e90fb9d596636 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-816280356 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 854e41184e0f4b06aa85a150fec89fd4 Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-816280356-project Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 could not be found. Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '75cd3269-3458-442d-a68a-d2fcdfa8b1e9'} Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 could not be found. Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 could not be found. Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.820734 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 could not be found. Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] Returning 404 to user: Instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:37.825952 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e24255a-4b0b-4a47-98f6-99bfa90a5d4e tempest-FloatingIPsAssociationTestJSON-816280356 tempest-FloatingIPsAssociationTestJSON-816280356-project] 10.222.0.16 "GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9" status: 404 len: 111 microversion: 2.1 time: 0.047935 Oct 28 10:02:37.827185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1515/3061] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:37 2022] GET /compute/v2.1/servers/75cd3269-3458-442d-a68a-d2fcdfa8b1e9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:37.832517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.836422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.836833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.837315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.838106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.838576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.839012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.874980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d399b41e-68ff-47ce-8e7e-177f1d4302da tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 0.047183 Oct 28 10:02:37.882903 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1516/3062] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 10:02:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:37.890001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.891997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] [instance: c110c4a5-2759-4e37-b90f-479b6b927d10] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:37.900777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.901782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.902391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.903279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.904610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.904989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.926458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] HTTP exception thrown: Instance c110c4a5-2759-4e37-b90f-479b6b927d10 could not be found. Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Request method failure captured: Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 HTTP/1.1 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ii2v_E9aa21Or-AGHmbXugNKM-sOS7thKJ68-JX6LpV7vlNb5-KnbNqADRBWZf5dWWGEYPePEL5gzc44-VDS9fBjLvZV2V4n9MlF8vGHGnFlaTrzGVeRcWig0MNKH6oMd2wdEUP0zDxrQQzqtxTIU4V1YSoYJfbmrlr4YEyIIvVRY Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1389c5372a9a42faa7aae2d03ea2787b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1389c5372a9a42faa7aae2d03ea2787b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1389c5372a9a42faa7aae2d03ea2787b"}]}] Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1389c5372a9a42faa7aae2d03ea2787b Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1515649593 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 52459d9276c94241ba4dd63403ce3a13 Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1515649593-project Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance c110c4a5-2759-4e37-b90f-479b6b927d10 could not be found. Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'c110c4a5-2759-4e37-b90f-479b6b927d10'} Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c110c4a5-2759-4e37-b90f-479b6b927d10 could not be found. Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c110c4a5-2759-4e37-b90f-479b6b927d10 could not be found. Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.928568 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c110c4a5-2759-4e37-b90f-479b6b927d10 could not be found. Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] Returning 404 to user: Instance c110c4a5-2759-4e37-b90f-479b6b927d10 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c93a6b62-d6b8-49a9-9566-a41696c8ea8b tempest-ServerMetadataNegativeTestJSON-1515649593 tempest-ServerMetadataNegativeTestJSON-1515649593-project] 10.222.0.16 "GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10" status: 404 len: 111 microversion: 2.1 time: 0.049039 Oct 28 10:02:37.936266 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1517/3063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:37 2022] GET /compute/v2.1/servers/c110c4a5-2759-4e37-b90f-479b6b927d10 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:37.942261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:37.943215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:37.951097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.952448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.952976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:37.954071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:37.954206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:37.954594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.059886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:38.075157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee995758-2517-4a8c-81b3-c6de9dcc6b11 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 1.013883 Oct 28 10:02:38.077377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1547/3064] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:37 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:38.087328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:38.092083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:38.092873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:38.094018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.095301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:38.095962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:38.096597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.146170 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4744657a-1b09-48a0-9c9b-f89600a8ab8a tempest-ServicesAdminTestJSON-533835917 tempest-ServicesAdminTestJSON-533835917-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 929 microversion: 2.1 time: 0.063384 Oct 28 10:02:38.147894 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1548/3065] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:02:38 2022] GET /compute/v2.1/os-services => generated 929 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:38.160219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-bf9c4ede-1884-4c7a-b224-0fb425238cec req-cd170d3b-0ab8-406e-aba2-8fb8605c4666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75cd3269-3458-442d-a68a-d2fcdfa8b1e9", "name": "network-vif-deleted", "tag": "b30f7134-38e8-4c49-890e-7763e6d54708"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:38.181826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bf9c4ede-1884-4c7a-b224-0fb425238cec req-cd170d3b-0ab8-406e-aba2-8fb8605c4666 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:38.183775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bf9c4ede-1884-4c7a-b224-0fb425238cec req-cd170d3b-0ab8-406e-aba2-8fb8605c4666 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:38.184469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bf9c4ede-1884-4c7a-b224-0fb425238cec req-cd170d3b-0ab8-406e-aba2-8fb8605c4666 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.203634 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-bf9c4ede-1884-4c7a-b224-0fb425238cec req-cd170d3b-0ab8-406e-aba2-8fb8605c4666 service nova] Creating event network-vif-deleted:b30f7134-38e8-4c49-890e-7763e6d54708 for instance 75cd3269-3458-442d-a68a-d2fcdfa8b1e9 on n-h1-zed-1 Oct 28 10:02:38.210939 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-bf9c4ede-1884-4c7a-b224-0fb425238cec req-cd170d3b-0ab8-406e-aba2-8fb8605c4666 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060457 Oct 28 10:02:38.212648 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1549/3066] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:38.433987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:38.440951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:38.446973 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06109c6a-8fca-4352-b246-e46b4f4af929 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.509910 Oct 28 10:02:38.467757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1518/3067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:37 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:38.565569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:38.569771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:38.610154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:38.612426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:38.612951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:38.613411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.614487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:38.615141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:38.616196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.787365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:38.790550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:38.823601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:38.827341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:38.830853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.831670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:38.834441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:38.836792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:38.929826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aff9f140-b86e-4999-b864-a7ac6ef67170 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147980 Oct 28 10:02:38.933467 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1519/3068] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:38 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:39.114720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:39.119041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:39.134159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:39.134676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:39.135124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:39.136205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:39.136668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:39.137125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:39.172817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:39.193652 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a7d8508-68d8-4e80-a1c1-3f43085795a1 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1487 microversion: 2.1 time: 0.633935 Oct 28 10:02:39.194849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1550/3069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:38 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1487 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:39.477777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:39.478869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:39.486623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:39.490912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:39.493496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:39.495945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:39.497240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:39.499429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:39.500086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:39.656565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:39.670431 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b0a6576-0d5b-4530-b281-1ae3ebe9e1ed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.570724 Oct 28 10:02:39.672633 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1520/3070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:39 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:39.767945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:39.779184 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f660c03-a4ca-4247-94f4-494ee282ed2c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.307354 Oct 28 10:02:39.787478 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1551/3071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:39 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:39.943026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:39.945460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:39.952858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:39.953728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:39.954546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:39.955485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:39.956207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:39.956838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.000169 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-51131e59-dedf-45cc-b778-6f3679d0fa90 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060746 Oct 28 10:02:40.009598 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1521/3072] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:39 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:02:40.222106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:40.222834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:40.241370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-18adc6f5-1610-491f-9c0d-1745b28a4f90 req-491b9ff3-fbd3-4a98-beda-e70b22b6922c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0210ec12-d8b3-4557-8b38-a57d74f96fd0", "name": "network-vif-deleted", "tag": "7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e"}, {"name": "network-changed", "server_uuid": "490b9884-a435-48a0-8744-d3dbe924ae9f", "tag": "f8185e36-de99-4fbc-ab9d-a8fa2d3354c1"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:40.256708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.257578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.258247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.259529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.260204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.260801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.284772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-18adc6f5-1610-491f-9c0d-1745b28a4f90 req-491b9ff3-fbd3-4a98-beda-e70b22b6922c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.286536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-18adc6f5-1610-491f-9c0d-1745b28a4f90 req-491b9ff3-fbd3-4a98-beda-e70b22b6922c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.288892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-18adc6f5-1610-491f-9c0d-1745b28a4f90 req-491b9ff3-fbd3-4a98-beda-e70b22b6922c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.350914 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-18adc6f5-1610-491f-9c0d-1745b28a4f90 req-491b9ff3-fbd3-4a98-beda-e70b22b6922c service nova] Creating event network-vif-deleted:7b06758e-5b50-4e4e-9ee9-3bc9b61bf12e for instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 on n-h2-zed-1 Oct 28 10:02:40.352883 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-18adc6f5-1610-491f-9c0d-1745b28a4f90 req-491b9ff3-fbd3-4a98-beda-e70b22b6922c service nova] Creating event network-changed:f8185e36-de99-4fbc-ab9d-a8fa2d3354c1 for instance 490b9884-a435-48a0-8744-d3dbe924ae9f on n-h2-zed-1 Oct 28 10:02:40.372431 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-18adc6f5-1610-491f-9c0d-1745b28a4f90 req-491b9ff3-fbd3-4a98-beda-e70b22b6922c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.137380 Oct 28 10:02:40.375246 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1522/3073] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:40.382783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.383311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.383735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.384196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lazy-loading 'fault' on Instance uuid 0210ec12-d8b3-4557-8b38-a57d74f96fd0 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:40.530204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:40.565717 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-afa92f06-6e3d-401c-a537-928124f6bcef tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 200 len: 1315 microversion: 2.1 time: 0.347476 Oct 28 10:02:40.586333 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1552/3074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:40 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:40.712392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:40.713470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:40.755572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.756085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.756543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.764722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.765436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.765875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.804166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:40.805720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:40.832284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.836594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.838646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:40.841124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:40.845093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:40.854438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.465606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:41.482273 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfb67664-e1b7-436e-bf79-431311757c8c tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.681336 Oct 28 10:02:41.501626 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1553/3075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:40 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:41.507088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:41.510594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:41.519365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.520312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.521006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.522973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.524793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.525549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.579024 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5198309-fdb8-4875-9182-4fd2a53f5a61 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.075881 Oct 28 10:02:41.585556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1554/3076] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:02:41 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:41.603622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:41.605234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:41.619866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.622544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.623468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.625257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.629394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.632150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.667069 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 HTTP/1.1 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0210ec12-d8b3-4557-8b38-a57d74f96fd0'} Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:41.669383 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:02:41.674205 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:41.691733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:41.698011 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29aba84c-9ea6-4d06-9928-1f6b7c5a9e20 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 404 len: 111 microversion: 2.1 time: 0.109734 Oct 28 10:02:41.698888 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1555/3077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:41 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:41.713042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:41.714050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:41.721963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.729128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.730255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.731483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.732172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.733289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.770005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:41.772807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:41.785720 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc212de2-cc19-4baa-aa6c-8519d4c31697 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 1.086562 Oct 28 10:02:41.786622 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1523/3078] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:40 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:41.792836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-365e7168-a921-4b81-9d0a-69ea0bd50854 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'create', calling method: .version_select at 0x7fca336e78b0>, body: {"keypair": {"name": "tempest-keypair-868516986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCiXjD4JexKud73f8voTA7+R8WW3NdIlxW3GnoJgpkDlted5SfNy1fOAf9TpjatdxNVb2TXNl077eT4NFLvfKkOiOYkoPvm+MuB/cmhuAsbjgCqpxlFfs4+N35pG/2pS7Q=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:41.814600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-365e7168-a921-4b81-9d0a-69ea0bd50854 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:41.826625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-365e7168-a921-4b81-9d0a-69ea0bd50854 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for user 28313b7c89184dd683e3479d23be489d and project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:41.873894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-365e7168-a921-4b81-9d0a-69ea0bd50854 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.085991 Oct 28 10:02:41.874918 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1524/3079] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:02:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:41.900680 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6638bed3-488e-4c9b-a0e5-83e8529049d8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 204 len: 0 microversion: 2.20 time: 0.195369 Oct 28 10:02:41.904516 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1556/3080] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:02:41 2022] DELETE /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:02:41.911732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:41.912361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:41.920679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.921038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.921911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:41.925574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:41.926077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:41.926542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:42.443662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:42.459247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:42.462986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:42.465581 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d23ebaa-e099-415b-89c8-71e22507f7d4 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.559648 Oct 28 10:02:42.466759 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1525/3081] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:41 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:42.509153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:42.509551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:42.515999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:42.517438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:42.518143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:42.519080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:42.519833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:42.520463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:42.811157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:42.812408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:42.822760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:42.824054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:42.825893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:42.830374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:42.833345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:42.833838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:42.876884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:42.907189 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78263225-ef7a-4f95-8747-357b5b13d5e4 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.401038 Oct 28 10:02:42.916257 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1557/3082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:42 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:43.221809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:43.233226 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-394a2020-ade5-4965-8063-1c8dc4c9e13c tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.427917 Oct 28 10:02:43.234616 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1526/3083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:42 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:43.497635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:43.498807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:43.512790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:43.516154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:43.517421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:43.519173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:43.519790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:43.520193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:43.932264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:43.933883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:43.962757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:43.963280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:43.963732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:43.964667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:43.965320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:43.965987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:44.331533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:44.353529 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f397b365-c349-4735-a102-06b7a0dbd63f tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 0.424856 Oct 28 10:02:44.370640 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1527/3084] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:43 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:44.384251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:44.386528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:44.406895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:44.410663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:44.411759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:44.412726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:44.417633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:44.418329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:44.749485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:44.763876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:44.765356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:44.769656 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ccc7ad1-93ef-4d89-8c5c-bde1b896b0f8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 1.281434 Oct 28 10:02:44.781706 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1558/3085] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:43 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:44.801240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c40b2151-5ff3-4113-aa0e-c91e7f447f41 req-a7758f03-f2b1-4648-a322-d7cd3c13f056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2abd3e-b15e-4086-8361-ecbd4445c0ac", "name": "network-vif-plugged", "status": "completed", "tag": "402c5e41-0016-4cd2-8e32-f4b32cc27e54"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:44.812868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c40b2151-5ff3-4113-aa0e-c91e7f447f41 req-a7758f03-f2b1-4648-a322-d7cd3c13f056 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:44.813573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c40b2151-5ff3-4113-aa0e-c91e7f447f41 req-a7758f03-f2b1-4648-a322-d7cd3c13f056 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:44.814161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c40b2151-5ff3-4113-aa0e-c91e7f447f41 req-a7758f03-f2b1-4648-a322-d7cd3c13f056 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:44.840085 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c40b2151-5ff3-4113-aa0e-c91e7f447f41 req-a7758f03-f2b1-4648-a322-d7cd3c13f056 service nova] Creating event network-vif-plugged:402c5e41-0016-4cd2-8e32-f4b32cc27e54 for instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac on n-h2-zed-1 Oct 28 10:02:44.845983 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c40b2151-5ff3-4113-aa0e-c91e7f447f41 req-a7758f03-f2b1-4648-a322-d7cd3c13f056 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062680 Oct 28 10:02:44.848170 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1559/3086] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:45.014389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:45.025535 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e934dfdb-eb06-402f-9a49-036338f498af tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.653290 Oct 28 10:02:45.042814 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1528/3087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:44 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:45.384290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:45.385059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:45.392203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:45.393304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:45.394098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:45.395030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:45.395668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:45.396273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:45.822222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:45.823906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:45.837325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:45.840176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:45.840919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:45.841935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:45.842678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:45.843344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:46.225460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:46.260337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:46.262561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:46.265260 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2ed1491-a710-4c24-a8a5-1041c63df211 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1724 microversion: 2.20 time: 0.454258 Oct 28 10:02:46.266779 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1529/3088] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:45 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:46.288488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:46.289396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:46.297188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:46.298146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:46.299472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:46.300531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:46.302421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:46.303130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:46.426165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:46.431146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:46.436944 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c632f865-ee15-4b4a-b4d5-1af85427a3b6 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1321 microversion: 2.1 time: 1.057450 Oct 28 10:02:46.444739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1560/3089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:45 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1321 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:46.745130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:46.758751 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-424ed615-e781-4513-b35f-d1793492648b tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.488808 Oct 28 10:02:46.762838 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1530/3090] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:46 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:47.293758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:47.294392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:47.310500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:47.311020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:47.311466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:47.312387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:47.313387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:47.314043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:47.439622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-150443031", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:47.526025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] validate_networks() for [('43667df7-fc7f-4fd7-8495-77da094fb553', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:02:47.614137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:47.640339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:47.648137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:47.653845 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3713a4e0-ee1b-4976-8169-4ee272c83b36 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 200 len: 1657 microversion: 2.20 time: 0.362297 Oct 28 10:02:47.657642 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1561/3091] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:47 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 1657 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:47.680827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:47.682314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:47.705177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:47.713515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:47.714197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:47.717731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:47.718434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:47.719263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:47.848573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:48.102777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:48.185643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:48.205163 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b44f1fd2-49de-47cf-ac15-cffc6b0a8d20 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1470 microversion: 2.1 time: 0.544807 Oct 28 10:02:48.206461 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1562/3092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:47 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1470 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:48.213174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:48.216265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:48.232058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.233790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.235090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.237067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.238050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.239503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.502046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:48.512574 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24f6972d-4421-4693-89b4-b00213b466eb tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.304321 Oct 28 10:02:48.513604 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1563/3093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:48 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:48.518702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-cbd7c911-c710-47d4-a5bb-75b35f4579d3 req-0e38b195-cc46-4d51-8547-f619814665a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7831b2e-dc40-4e1b-981b-94cb7d1736f0", "name": "network-vif-deleted", "tag": "a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:48.529876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cbd7c911-c710-47d4-a5bb-75b35f4579d3 req-0e38b195-cc46-4d51-8547-f619814665a5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.530676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cbd7c911-c710-47d4-a5bb-75b35f4579d3 req-0e38b195-cc46-4d51-8547-f619814665a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.531383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cbd7c911-c710-47d4-a5bb-75b35f4579d3 req-0e38b195-cc46-4d51-8547-f619814665a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.552061 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-cbd7c911-c710-47d4-a5bb-75b35f4579d3 req-0e38b195-cc46-4d51-8547-f619814665a5 service nova] Creating event network-vif-deleted:a95dd9ac-d6e1-4c37-aa40-b05a0d05db7a for instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 on n-h1-zed-1 Oct 28 10:02:48.559843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-cbd7c911-c710-47d4-a5bb-75b35f4579d3 req-0e38b195-cc46-4d51-8547-f619814665a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043687 Oct 28 10:02:48.561153 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1564/3094] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:48.567199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:48.568684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:48.575454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.576335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.577164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.578097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.578735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.579448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.633450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Request method failure captured: Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac/diagnostics HTTP/1.1 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ixW7gX10_Hyz78eD3An6To2VEOlUVaV10MfaEoAb3FbY-Jf4Yluyk0cHoi1Yh-fstAYMuJvgK-0Rx3zkJjflg98ARBEIetfpNHyB1ejnS91ung9otF1F5di2bdH938SRlN1OFmZMRaOndxto1B1PLrAxmvCIxIIBtX0l3VFrF_WfY Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2414b143e25042a19c8645b96235f985 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-772537635 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2414b143e25042a19c8645b96235f985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2414b143e25042a19c8645b96235f985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2414b143e25042a19c8645b96235f985", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2414b143e25042a19c8645b96235f985"}]}] Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-772537635 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2414b143e25042a19c8645b96235f985 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-772537635 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiagnosticsNegativeTest-772537635-project Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 72141a19aa484ad9b466792ab782ec52 Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-772537635-project Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': 'cb2abd3e-b15e-4086-8361-ecbd4445c0ac'} Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.649624 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:48.654405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:48.654405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:48.654405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 28 10:02:48.654405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 28 10:02:48.654405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 28 10:02:48.654405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.655889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:48.657804 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfedaee4-6fa0-4421-872e-4e82980efc1d tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.095315 Oct 28 10:02:48.672645 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1565/3095] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:02:48 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac/diagnostics => generated 117 bytes in 101 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:48.682419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:48.684213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:48.692821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.693708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.694482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.695433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.696942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.697652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.732808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:02:48.895200 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee27d101-faf7-441d-bf60-01764eb63d9a tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 204 len: 0 microversion: 2.1 time: 0.213364 Oct 28 10:02:48.897823 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1566/3096] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:02:48 2022] DELETE /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:02:48.924057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:48.924963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:48.934466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.935399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.936028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.937086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:48.937707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:48.938433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:48.958446 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] HTTP exception thrown: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Request method failure captured: Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 HTTP/1.1 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fRMSM5ASEI6EmvF59pD4BS4INOGoweBlK-75gOf0wUUfOCsGaXxHQmThsIFE5ochsGej21hlubUrWSd9JFaCWVe_XTex6Orye1ah9Pb-FuPM6Rqt_Zn_4UnPMSXoj_7am0mwvm8UWa0KUAQwgqFm5ZnOL9Qif4TAOX9Bmr-xVga9A Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71a60b6f0d084d349f2cd19041175d4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71a60b6f0d084d349f2cd19041175d4b"}]}] Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f864f72343c84ff4a54ef0467bf34c04 Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f7831b2e-dc40-4e1b-981b-94cb7d1736f0'} Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.962519 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:48.967277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Returning 404 to user: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:48.976302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e51a5bcf-0c00-44e2-9a87-2fa84612bb7a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 404 len: 111 microversion: 2.20 time: 0.062108 Oct 28 10:02:48.980695 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1567/3097] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:48 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:02:49.002006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:49.002909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:49.021411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:49.022662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:49.023924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:49.025848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:49.026649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:49.027285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:49.358237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:49.371611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a5a7d16-6f46-441f-b46c-67461b85a0d0 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1476 microversion: 2.1 time: 0.389022 Oct 28 10:02:49.372802 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1568/3098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:48 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1476 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:49.378032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f520ff4a-e6c9-49c5-ab03-a22e9f7887d5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '.version_select at 0x7fca3b9c0820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:49.407481 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f520ff4a-e6c9-49c5-ab03-a22e9f7887d5 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626393128" status: 204 len: 0 microversion: 2.20 time: 0.033125 Oct 28 10:02:49.408389 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1569/3099] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 10:02:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1626393128 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:02:49.478541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:49.479603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:49.480299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:49.480878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:49.481523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:49.503750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:49.504244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:49.504678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:49.505436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:49.505881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:49.506492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:49.542665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:49.543305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:49.555091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:49.556275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:49.563325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:49.563814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:49.564895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:49.568518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:49.570826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:49.572651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for user 28313b7c89184dd683e3479d23be489d and project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:49.609885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:02:49.613126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:02:49.710210 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0fc9971c-ecbb-482f-9164-78ba1d43b7b6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.277806 Oct 28 10:02:49.711248 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1531/3100] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:02:49.723063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-42b42dad-64f3-4f6f-a41f-d0bc444d1c71 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:49.723859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-42b42dad-64f3-4f6f-a41f-d0bc444d1c71 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:49.876195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-42b42dad-64f3-4f6f-a41f-d0bc444d1c71 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:49.884807 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-42b42dad-64f3-4f6f-a41f-d0bc444d1c71 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1224 microversion: 2.1 time: 0.166442 Oct 28 10:02:49.890333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1532/3101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:49 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1224 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:50.400511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:50.400738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:50.413643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:50.414567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:50.430238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:50.431480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:50.432114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:50.441582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:50.483918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:50.499310 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-644d6457-91ef-4df8-9284-02755ce14dec tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.964622 Oct 28 10:02:50.499913 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1570/3102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:49 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:50.922010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:50.922729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:50.938249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:50.942832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:50.944102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:50.945184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:50.952345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:50.953493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:50.953971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:50.976709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ff8ed2f7-0328-458a-b00b-e0ac6162e390 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1476 microversion: 2.1 time: 0.580944 Oct 28 10:02:50.977370 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1533/3103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:50 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1476 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:51.356426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:51.364482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b5446fb3-717b-41aa-a80d-28edd2dae465 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1220 microversion: 2.1 time: 0.446730 Oct 28 10:02:51.365704 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1571/3104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:50 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1220 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:51.533963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:51.535763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:51.569956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:51.576783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:51.604828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:51.607318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:51.608415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:51.622169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:51.981736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:51.992564 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-69d0ff64-9113-4e49-8067-e0e9fbda969d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.470085 Oct 28 10:02:52.009188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:52.009888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:52.010444 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1534/3105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:51 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:52.020400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:52.020932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:52.024861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:52.026633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:52.031482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:52.032222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:52.155924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5a9f4ee5-532d-4e12-beb1-8cc549e1fdb1 req-03aab7c0-c7c1-4d50-859f-87b2f6022efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490b9884-a435-48a0-8744-d3dbe924ae9f", "name": "network-vif-plugged", "status": "completed", "tag": "f8185e36-de99-4fbc-ab9d-a8fa2d3354c1"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:52.168561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5a9f4ee5-532d-4e12-beb1-8cc549e1fdb1 req-03aab7c0-c7c1-4d50-859f-87b2f6022efd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:52.169322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5a9f4ee5-532d-4e12-beb1-8cc549e1fdb1 req-03aab7c0-c7c1-4d50-859f-87b2f6022efd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:52.170042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5a9f4ee5-532d-4e12-beb1-8cc549e1fdb1 req-03aab7c0-c7c1-4d50-859f-87b2f6022efd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:52.185300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5a9f4ee5-532d-4e12-beb1-8cc549e1fdb1 req-03aab7c0-c7c1-4d50-859f-87b2f6022efd service nova] Creating event network-vif-plugged:f8185e36-de99-4fbc-ab9d-a8fa2d3354c1 for instance 490b9884-a435-48a0-8744-d3dbe924ae9f on n-h2-zed-1 Oct 28 10:02:52.191952 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5a9f4ee5-532d-4e12-beb1-8cc549e1fdb1 req-03aab7c0-c7c1-4d50-859f-87b2f6022efd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046395 Oct 28 10:02:52.193183 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1535/3106] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:52.525925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-540131223", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": "none"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:52.621467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:52.622231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:52.623643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:52.624327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:52.625030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:52.642422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:52.643017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:52.643722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:52.644641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:52.645279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:52.645917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:52.664281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:52.675282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Getting quotas for project 07385b489b9140dc89df96c1f3edf670. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:52.684620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Getting quotas for user ab81cb775afb4c4a9da03d28e6a0e155 and project 07385b489b9140dc89df96c1f3edf670. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:52.706446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:02:52.709287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:02:52.823010 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c575c89c-de9e-4bd7-a342-df25a6c9f19b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.466443 Oct 28 10:02:52.826221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1536/3107] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 10:02:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:02:52.838885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:52.841710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:52.850472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:52.851118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:52.852327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:52.853232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:52.854399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:52.854955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:52.909355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:52.924969 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-775b21c9-ed84-479a-900a-f550b7f4c6e3 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1476 microversion: 2.1 time: 0.920925 Oct 28 10:02:52.925954 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1572/3108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:52 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1476 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:52.934600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc464517-db51-4015-8a9e-0c9c8e892016 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:52.935570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc464517-db51-4015-8a9e-0c9c8e892016 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:53.160932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:53.184232 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90a9aaa7-bad4-4287-adff-3c137a00f1b9 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1282 microversion: 2.1 time: 0.350860 Oct 28 10:02:53.190716 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1537/3109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:52 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1282 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:53.198236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:53.198910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:53.205264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:53.206084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:53.206531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:53.208109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:53.208337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:53.208772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:53.243077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc464517-db51-4015-8a9e-0c9c8e892016 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:53.269676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc464517-db51-4015-8a9e-0c9c8e892016 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:53.274371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc464517-db51-4015-8a9e-0c9c8e892016 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:53.279798 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc464517-db51-4015-8a9e-0c9c8e892016 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1277 microversion: 2.54 time: 0.350943 Oct 28 10:02:53.291632 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1573/3110] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:52 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:53.903807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ae4c8d64-f336-44ea-b4d6-7b0e55377a38 req-4ea959a8-2267-4579-9c36-9e2ecf53aebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb2abd3e-b15e-4086-8361-ecbd4445c0ac", "name": "network-vif-deleted", "tag": "402c5e41-0016-4cd2-8e32-f4b32cc27e54"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:53.922385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ae4c8d64-f336-44ea-b4d6-7b0e55377a38 req-4ea959a8-2267-4579-9c36-9e2ecf53aebd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:53.934101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ae4c8d64-f336-44ea-b4d6-7b0e55377a38 req-4ea959a8-2267-4579-9c36-9e2ecf53aebd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:53.935486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ae4c8d64-f336-44ea-b4d6-7b0e55377a38 req-4ea959a8-2267-4579-9c36-9e2ecf53aebd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:53.963825 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ae4c8d64-f336-44ea-b4d6-7b0e55377a38 req-4ea959a8-2267-4579-9c36-9e2ecf53aebd service nova] Creating event network-vif-deleted:402c5e41-0016-4cd2-8e32-f4b32cc27e54 for instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac on n-h2-zed-1 Oct 28 10:02:53.970298 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ae4c8d64-f336-44ea-b4d6-7b0e55377a38 req-4ea959a8-2267-4579-9c36-9e2ecf53aebd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069967 Oct 28 10:02:53.971276 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1574/3111] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:53.984136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:53.985761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:54.015303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:54.020349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:54.020989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:54.021600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:54.022069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:54.022508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:54.157755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:54.166686 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-192e5f85-6161-4763-8fa3-860e4f59056f tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1351 microversion: 2.1 time: 0.974803 Oct 28 10:02:54.167659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:54.176584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1583590c-c7f5-4bdb-9874-6950c6406000 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1434 microversion: 2.1 time: 0.198991 Oct 28 10:02:54.178312 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1538/3112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:53 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1351 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:54.186845 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1575/3113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:53 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1434 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:54.192124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72e6a6e5-d2ba-4f08-a1af-f81bdab9462e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'create', calling method: .version_select at 0x7fca3b97a9d0>, body: {"keypair": {"name": "tempest-keypair-1378745262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6WjCoNXM0zXM4vwUvE8GZjcDOt0u4U14RZKiNY/MdA2sB21cESsRl191pgN7zt4DS0IZ+AAZXxmme45FctEqWsEtJKR8ZN9KXoMTJxS97AbVQHhrfP/eHtUiaFz3vu/Q=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:54.219330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-72e6a6e5-d2ba-4f08-a1af-f81bdab9462e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:54.222569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:54.223194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:54.235416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-72e6a6e5-d2ba-4f08-a1af-f81bdab9462e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for user f864f72343c84ff4a54ef0467bf34c04 and project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:54.263114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:54.263114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:54.271637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:54.272843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:54.274279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:54.274921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:54.302599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72e6a6e5-d2ba-4f08-a1af-f81bdab9462e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.113782 Oct 28 10:02:54.311947 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1576/3114] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 10:02:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 10:02:54.325093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:54.326364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:54.355932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:54.357486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:54.357998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:54.358450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:54.359352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:54.359978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:54.360425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:54.454734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:54.486978 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-750c5dc5-c55c-4c7c-8693-385b230f1068 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1282 microversion: 2.1 time: 0.270676 Oct 28 10:02:54.488875 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1539/3115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:54 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1282 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:54.561407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:54.578181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:54.580130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:54.581581 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-319e0902-0f14-4146-b299-f1de61852d78 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1329 microversion: 2.54 time: 0.268098 Oct 28 10:02:54.582700 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1577/3116] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:54 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1329 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:55.214398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:55.215039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:55.218646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:55.219078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:55.248940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.249444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.249895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.263485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.264000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.264441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.265210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.265672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.266102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.274132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.274754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.275217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.284374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:55.404345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.404848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.412739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.414355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lazy-loading 'fault' on Instance uuid cb2abd3e-b15e-4086-8361-ecbd4445c0ac {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:02:55.540018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72141a19aa484ad9b466792ab782ec52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2414b143e25042a19c8645b96235f985', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:55.547529 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00f182e3-2ac0-4e6a-aafa-1f0e75b1a777 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 200 len: 1311 microversion: 2.1 time: 0.342275 Oct 28 10:02:55.547953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1578/3117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:55 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 1311 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:55.560174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:55.563345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:55.577378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.579558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.587781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.588922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.589650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.590328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.784501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:55.793825 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1bc8eef2-5dfe-40b3-8a0f-df7eedd40aed tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1541 microversion: 2.1 time: 0.595468 Oct 28 10:02:55.814653 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1540/3118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:55 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1541 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:55.821436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:55.822384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:55.829560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.830263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.830920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.832011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.832629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.834306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.939434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:55.951364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:55.953214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:55.954634 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2183eea6-2df1-4090-884c-b045d1c0a5ea tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1335 microversion: 2.54 time: 0.137864 Oct 28 10:02:55.955396 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1541/3119] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:55 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1335 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:55.961931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:55.962692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:55.976999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.978136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.978747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:55.979905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:55.980704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:55.981569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:56.107665 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8104145-f933-49d3-aba7-08b52ac2599d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150980 Oct 28 10:02:56.112952 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1542/3120] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:02:55 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:02:56.294014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1870958695", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "45686d45-32d3-4f1d-8e21-3603ff1239dd"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:56.384500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] validate_networks() for [('45686d45-32d3-4f1d-8e21-3603ff1239dd', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:02:56.542702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:56.553034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15357dc0-c14f-4159-a73d-d27349b66973 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 1.001830 Oct 28 10:02:56.554130 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1579/3121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:55 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:56.577745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:56.579294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] [instance: cb2abd3e-b15e-4086-8361-ecbd4445c0ac] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:56.604610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:56.605442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:56.606084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:56.607554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:56.608223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:56.608848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:56.637252 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] HTTP exception thrown: Instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac could not be found. Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Request method failure captured: Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac HTTP/1.1 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ixW7gX10_Hyz78eD3An6To2VEOlUVaV10MfaEoAb3FbY-Jf4Yluyk0cHoi1Yh-fstAYMuJvgK-0Rx3zkJjflg98ARBEIetfpNHyB1ejnS91ung9otF1F5di2bdH938SRlN1OFmZMRaOndxto1B1PLrAxmvCIxIIBtX0l3VFrF_WfY Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2414b143e25042a19c8645b96235f985 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-772537635 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2414b143e25042a19c8645b96235f985"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2414b143e25042a19c8645b96235f985"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2414b143e25042a19c8645b96235f985", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2414b143e25042a19c8645b96235f985"}]}] Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-772537635 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2414b143e25042a19c8645b96235f985 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-772537635 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiagnosticsNegativeTest-772537635-project Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 72141a19aa484ad9b466792ab782ec52 Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-772537635-project Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac could not be found. Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'cb2abd3e-b15e-4086-8361-ecbd4445c0ac'} Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac could not be found. Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac could not be found. Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:56.639223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac could not be found. Oct 28 10:02:56.644390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:02:56.646072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] Returning 404 to user: Instance cb2abd3e-b15e-4086-8361-ecbd4445c0ac could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:02:56.647125 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-551d8260-e401-4b8b-97eb-c0e19133d969 tempest-ServerDiagnosticsNegativeTest-772537635 tempest-ServerDiagnosticsNegativeTest-772537635-project] 10.222.0.16 "GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac" status: 404 len: 111 microversion: 2.1 time: 0.076751 Oct 28 10:02:56.648255 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1580/3122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:56 2022] GET /compute/v2.1/servers/cb2abd3e-b15e-4086-8361-ecbd4445c0ac => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:02:56.994823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:56.995546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:57.005799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:57.008740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:57.010686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:57.011646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:57.014010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:57.015918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:57.065351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:02:57.229534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:57.248718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:57.250614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:57.251989 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57245346-6beb-4923-af59-efadb69a3a0c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1335 microversion: 2.54 time: 0.267040 Oct 28 10:02:57.252719 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1581/3123] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:56 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1335 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:57.584080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:57.584792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:57.602823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:57.604750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:57.605405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:57.608777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:57.609455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:57.610058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:57.941319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:57.942283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:57.943023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:57.943605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:57.944173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:57.962127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:57.962918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:57.963580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:57.964501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:57.965214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:57.967629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:58.004647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Getting quotas for project 74485b211f854132b59f02e4decdf998. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:58.012225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Getting quotas for user 67ece33b583c4baeb46ac278aa60ae4f and project 74485b211f854132b59f02e4decdf998. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:58.035589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:02:58.044060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:02:58.146908 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-783c6f1f-fc11-41ee-8973-9856cc2886d7 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.935053 Oct 28 10:02:58.148214 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1543/3124] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:02:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:02:58.159537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3bcec184-99dd-4693-a945-001b8a098fb8 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:58.161493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3bcec184-99dd-4693-a945-001b8a098fb8 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:58.194509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:58.208856 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf2226fa-5c29-4fa6-955c-95b837cf875a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 0.632877 Oct 28 10:02:58.210374 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1582/3125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:57 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:58.283732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:58.284767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:58.293722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:58.294590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:58.300255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:58.301376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:58.302072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:58.302714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:58.328824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3bcec184-99dd-4693-a945-001b8a098fb8 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:58.343456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3bcec184-99dd-4693-a945-001b8a098fb8 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1216 microversion: 2.1 time: 0.187693 Oct 28 10:02:58.344146 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1544/3126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:58 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1216 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:02:58.730730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:58.743243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:58.746605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:58.748124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a3ae5e2-4fec-4d75-9bdf-a9e0790f9452 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1356 microversion: 2.54 time: 0.472679 Oct 28 10:02:58.765413 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1583/3127] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:58 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1356 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:58.784802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3859a810-1bd2-4fb8-9b4e-e12161e1597d tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Action: 'create', calling method: .version_select at 0x7fca3346ef70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-471275590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNE/sk2dP4H7bs+EKJ//zCYTPMX7lcakBg9U1RADknImz1SW4yBdwRZj7dT0x/nZJ8OL9FMPkiiE8MrzxHfEZZ8xeDzt1y5M+1jFjAJ5VdzrBC109x5mE3sR4xwEmZdOzQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:58.856521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3859a810-1bd2-4fb8-9b4e-e12161e1597d tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Getting quotas for project 07385b489b9140dc89df96c1f3edf670. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:02:58.866294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3859a810-1bd2-4fb8-9b4e-e12161e1597d tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Getting quotas for user ab81cb775afb4c4a9da03d28e6a0e155 and project 07385b489b9140dc89df96c1f3edf670. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:02:58.967622 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3859a810-1bd2-4fb8-9b4e-e12161e1597d tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.192211 Oct 28 10:02:58.970209 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1545/3128] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 10:02:58 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 10:02:58.981686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-471275590", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:02:58.985152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:58.992648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:58.993427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:58.994055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:58.994952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:58.995579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:58.996173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.144629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:02:59.145557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:02:59.146229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:02:59.146818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:02:59.147397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:02:59.236567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:59.240944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:59.262283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.262769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.263301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.263919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.264386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.264814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.419237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:59.449606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.455167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.455897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.457474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.462568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.465255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.558599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65d16c91-74d3-4ec4-ae11-0ce4fccb5d97 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "POST /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4/action" status: 202 len: 1138 microversion: 2.54 time: 0.580492 Oct 28 10:02:59.576254 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1584/3129] 10.222.0.16 () {62 vars in 1320 bytes} [Fri Oct 28 10:02:58 2022] POST /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4/action => generated 1138 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 10:02:59.602456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:59.604548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:59.633165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.634377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.636281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.638140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.641661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.642139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.700059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:59.708859 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e34e6a71-0572-4279-8baf-bd4e3a79aa3d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 0.476033 Oct 28 10:02:59.709488 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1546/3130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:59 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:02:59.741342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:02:59.746181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:02:59.772080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.772617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.781021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.781981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:02:59.782477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:02:59.782924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:02:59.930384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:59.951485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:59.953064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:02:59.954313 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0eb015c4-2be0-4144-aa80-da630c380859 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.229506 Oct 28 10:02:59.986730 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1547/3131] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:02:59 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:02:59.994591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e0f4d3e7-aa22-48f3-98c5-24f04ff27198 req-2c98c76f-5bf4-45d1-9b31-9530bac0fb75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "490b9884-a435-48a0-8744-d3dbe924ae9f", "tag": "f8185e36-de99-4fbc-ab9d-a8fa2d3354c1"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:00.021255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e0f4d3e7-aa22-48f3-98c5-24f04ff27198 req-2c98c76f-5bf4-45d1-9b31-9530bac0fb75 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:00.021963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e0f4d3e7-aa22-48f3-98c5-24f04ff27198 req-2c98c76f-5bf4-45d1-9b31-9530bac0fb75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:00.022814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e0f4d3e7-aa22-48f3-98c5-24f04ff27198 req-2c98c76f-5bf4-45d1-9b31-9530bac0fb75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:00.055509 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e0f4d3e7-aa22-48f3-98c5-24f04ff27198 req-2c98c76f-5bf4-45d1-9b31-9530bac0fb75 service nova] Creating event network-changed:f8185e36-de99-4fbc-ab9d-a8fa2d3354c1 for instance 490b9884-a435-48a0-8744-d3dbe924ae9f on n-h2-zed-1 Oct 28 10:03:00.071384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e0f4d3e7-aa22-48f3-98c5-24f04ff27198 req-2c98c76f-5bf4-45d1-9b31-9530bac0fb75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082088 Oct 28 10:03:00.072311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1548/3132] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:00.363954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:00.372653 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d2d3abc-f699-4b57-a702-d03974266eb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1212 microversion: 2.1 time: 0.791238 Oct 28 10:03:00.373208 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1585/3133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:02:59 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1212 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:00.394823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5cfc66d8-c149-47a2-bc55-7eaab93a4b01 req-ee0ba22b-35ec-4d1b-97e3-c657837aa11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e129b38a-00a7-4bc9-8c47-64b85413622a", "tag": "77c1d492-5cac-4b17-97c1-8074ddd25afc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:00.425332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5cfc66d8-c149-47a2-bc55-7eaab93a4b01 req-ee0ba22b-35ec-4d1b-97e3-c657837aa11e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:00.425829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5cfc66d8-c149-47a2-bc55-7eaab93a4b01 req-ee0ba22b-35ec-4d1b-97e3-c657837aa11e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:00.428693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5cfc66d8-c149-47a2-bc55-7eaab93a4b01 req-ee0ba22b-35ec-4d1b-97e3-c657837aa11e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:00.456967 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5cfc66d8-c149-47a2-bc55-7eaab93a4b01 req-ee0ba22b-35ec-4d1b-97e3-c657837aa11e service nova] Creating event network-changed:77c1d492-5cac-4b17-97c1-8074ddd25afc for instance e129b38a-00a7-4bc9-8c47-64b85413622a on n-h1-zed-1 Oct 28 10:03:00.473415 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5cfc66d8-c149-47a2-bc55-7eaab93a4b01 req-ee0ba22b-35ec-4d1b-97e3-c657837aa11e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077336 Oct 28 10:03:00.474558 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1549/3134] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:00.736164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:00.736797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:00.757554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:00.761340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:00.762292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:00.763487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:00.766202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:00.768629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:00.986097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:00.987084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:00.999977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:01.002548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:01.003286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:01.004200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:01.004832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:01.005497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:01.150342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:01.159762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:01.163080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:01.165297 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3daeea90-28f7-46fe-ac74-7f50c9f4605a tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.183396 Oct 28 10:03:01.169519 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1550/3135] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:00 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:01.175237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1002926193", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "76f7baad-2e8f-4d15-a3ea-3b38c1dbbcd6"}], "security_groups": [{"name": "tempest-securitygroup--1248071770"}], "key_name": "tempest-keypair-1378745262", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:01.327331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] validate_networks() for [('76f7baad-2e8f-4d15-a3ea-3b38c1dbbcd6', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:03:01.910719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:01.922481 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31911e5a-0b54-4a3a-9d1f-d66c53202cb2 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 1.190509 Oct 28 10:03:01.927248 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1586/3136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:00 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:01.937642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:01.942200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:01.957634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:01.958055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:01.958594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:01.959368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:01.959832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:01.960261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:02.242958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:03:02.245118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:03:02.245874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:03:02.246516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:03:02.247198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:03:02.272660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:02.275861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:02.276657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:02.277773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:02.281885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:02.284420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:02.309799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:02.318321 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07c7c6bd-f240-49e6-9d62-6b084ebcdbc6 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1274 microversion: 2.1 time: 0.389636 Oct 28 10:03:02.321648 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1587/3137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:01 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1274 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:02.329771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:03:02.339238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Getting quotas for user f864f72343c84ff4a54ef0467bf34c04 and project 71a60b6f0d084d349f2cd19041175d4b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:03:02.341118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:02.341728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:02.360933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:03:02.366998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:02.367474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:02.367921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:02.368313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:03:02.368644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:02.369141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:02.369634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:02.457979 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-612770d1-41ee-4674-9dc1-09d912d6f559 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.282824 Oct 28 10:03:02.466775 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1551/3138] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 10:03:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:03:02.484147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cba2f803-08a3-47e2-a7ef-768e908afcad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:02.502365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cba2f803-08a3-47e2-a7ef-768e908afcad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:02.612039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cba2f803-08a3-47e2-a7ef-768e908afcad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:02.621585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cba2f803-08a3-47e2-a7ef-768e908afcad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:02.625032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cba2f803-08a3-47e2-a7ef-768e908afcad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:02.626713 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cba2f803-08a3-47e2-a7ef-768e908afcad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1282 microversion: 2.20 time: 0.156532 Oct 28 10:03:02.627626 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1552/3139] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:02 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:02.955269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:02.955899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:02.965506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:02.966012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:02.966459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:02.972102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:02.972799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:02.973297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:03.138904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.148934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.160460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.163532 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5769e329-903a-48eb-b160-33c349ea4d50 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.837457 Oct 28 10:03:03.166127 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1588/3140] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:02 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:03.349281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:03.351979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:03.368083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:03.369585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:03.370049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:03.372972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:03.374964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:03.377120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:03.383539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.395968 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-290f50b0-8a07-4b76-bb5e-b47ebdfac32d tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 0.443412 Oct 28 10:03:03.401427 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1553/3141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:02 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:03.670541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:03.675912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:03.697096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:03.698874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:03.713811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:03.716480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:03.720347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:03.722793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:03.887131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.899062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.913410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.914723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:03.915904 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90b6445f-2862-4fbd-beb0-897548c87759 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1278 microversion: 2.20 time: 0.262488 Oct 28 10:03:03.916477 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1554/3142] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:03 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1278 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:03.917046 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2fe9be9d-3ace-4a39-8cdf-b13651cd15b9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1274 microversion: 2.1 time: 0.567554 Oct 28 10:03:03.920300 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1589/3143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:03 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1274 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:04.203334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:04.204627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:04.218249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.220244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.226759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:04.228071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.238610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.241004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:04.258357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:04.427529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:04.428721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:04.443412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.447312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.449296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:04.451182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.452623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.454697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:04.523518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:04.546525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:04.550089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:04.554018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-993cf9bb-3b04-405d-a88f-5999942eb9e1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.355683 Oct 28 10:03:04.555969 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1590/3144] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:04 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:04.780802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:04.796330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dd835e89-ef0a-49e9-83d0-762670b2dbdf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 0.368752 Oct 28 10:03:04.798361 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1555/3145] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:04 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:04.943429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:04.943717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:04.944061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:04.944497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:04.956026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.956530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.956996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:04.957771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.958459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.959287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:04.959412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.959822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.960335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:04.964147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:04.965003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:04.965554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:05.116486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:05.129236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:05.129604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:05.130920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:05.132101 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-724b624c-f49e-4da3-872d-a15fba5f9e3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1340 microversion: 2.20 time: 0.192729 Oct 28 10:03:05.132710 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1556/3146] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:04 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:05.149400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dd3ef14-f331-42e7-a5e8-056b49244049 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1274 microversion: 2.1 time: 0.200644 Oct 28 10:03:05.155657 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1591/3147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:04 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1274 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:05.589045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:05.592017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:05.603993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:05.605025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:05.605630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:05.607818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:05.608500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:05.609201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:05.773672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:05.782944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:05.787228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:05.792204 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1be0ed56-b04e-46ad-8f7d-db3c80541cca tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.210429 Oct 28 10:03:05.806215 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1557/3148] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:05 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:05.830532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:05.831240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:05.847631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:05.848143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:05.848593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:05.849342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:05.849801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:05.850230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:06.169784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:06.170438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:06.187258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:06.187808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:06.188270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:06.192649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:06.193304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:06.193769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:06.402252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:06.412524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:06.421327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:06.424346 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-963beca0-d014-407d-9143-efb8cb5de9cf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1340 microversion: 2.20 time: 0.266664 Oct 28 10:03:06.428234 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1558/3149] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:06 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1340 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:06.436893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:06.442880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:06.452543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:06.484683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:06.488837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:06.489953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:06.492455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:06.495275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:06.495969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:06.763998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:06.781502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-053af8e3-126d-4378-9200-d250ebdf2293 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 0.954665 Oct 28 10:03:06.782114 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1592/3150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:05 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:06.824864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:06.825780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:06.839579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:06.842551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:06.846640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:06.847668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:06.848163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:06.848607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:06.876118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:06.889230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ea1ba1c-8685-44e9-86d4-f3b13cff4b4d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.457381 Oct 28 10:03:06.890555 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1559/3151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:06 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:07.389407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:07.401207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:07.405288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:07.409697 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d835c57a-cad2-4297-bd12-f053e020d403 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.590781 Oct 28 10:03:07.428947 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1593/3152] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:06 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:07.457437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:07.458235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:07.471861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:07.472511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:07.473198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:07.473923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:07.474617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:07.475268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:07.667399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:07.682332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:07.684186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:07.685383 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3da1be0c-f459-4195-bd12-f6797158bb57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1340 microversion: 2.20 time: 0.231919 Oct 28 10:03:07.685954 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1560/3153] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:07 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1340 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:07.812785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:07.813595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:07.825483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:07.826754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:07.827589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:07.828645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:07.829643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:07.831307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:07.919064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:07.920405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:07.955498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:07.956463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:07.957002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:07.957671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:07.969082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:07.969775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:08.385311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.401838 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9e39ba20-59d6-4de5-9997-b27538198f7b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.485554 Oct 28 10:03:08.402901 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1561/3154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:07 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:08.440105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:08.440849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:08.453382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:08.454135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:08.454763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:08.455563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:08.456137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:08.456664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:08.562057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.564373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:08.574553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.576339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.584834 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-509e4d82-bbbc-44b6-899b-83094afa97aa tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.148573 Oct 28 10:03:08.593363 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1562/3155] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:08 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:08.712573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:08.713211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:08.730656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:08.731155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:08.731600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:08.732311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:08.732983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:08.733557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:08.818083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.827477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.828941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.830038 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3e66bd6c-9db8-48c3-a039-aa8dfe2cc19f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1340 microversion: 2.20 time: 0.122329 Oct 28 10:03:08.844840 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1563/3156] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:08 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1340 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:08.898172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:08.909884 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5a8224c8-18bb-4ea7-814c-047a08e44a1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 1.105945 Oct 28 10:03:08.910625 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1594/3157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:07 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:09.251796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1956d601-1100-48e0-b19f-76c92c81ad50 req-fce085e2-0c87-4d75-9b7d-b2a41bc797d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e129b38a-00a7-4bc9-8c47-64b85413622a", "name": "network-vif-plugged", "status": "completed", "tag": "77c1d492-5cac-4b17-97c1-8074ddd25afc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:09.262282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1956d601-1100-48e0-b19f-76c92c81ad50 req-fce085e2-0c87-4d75-9b7d-b2a41bc797d1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:09.263086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1956d601-1100-48e0-b19f-76c92c81ad50 req-fce085e2-0c87-4d75-9b7d-b2a41bc797d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:09.263527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1956d601-1100-48e0-b19f-76c92c81ad50 req-fce085e2-0c87-4d75-9b7d-b2a41bc797d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:09.275763 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1956d601-1100-48e0-b19f-76c92c81ad50 req-fce085e2-0c87-4d75-9b7d-b2a41bc797d1 service nova] Creating event network-vif-plugged:77c1d492-5cac-4b17-97c1-8074ddd25afc for instance e129b38a-00a7-4bc9-8c47-64b85413622a on n-h1-zed-1 Oct 28 10:03:09.281415 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1956d601-1100-48e0-b19f-76c92c81ad50 req-fce085e2-0c87-4d75-9b7d-b2a41bc797d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Oct 28 10:03:09.281895 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1564/3158] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:09.437523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:09.438471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:09.446080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:09.446331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:09.446646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:09.447386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:09.447850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:09.448290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:09.613401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:09.614107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:09.620507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:09.621261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:09.621892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:09.622598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:09.623047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:09.623664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:09.698914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:09.708201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:09.709548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:09.711278 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16068705-86ae-4c81-8182-216e624a3c4b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.102091 Oct 28 10:03:09.713484 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1565/3159] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:09 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:09.862775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:09.866621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:09.886288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:09.886667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:09.887112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:09.887832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:09.888511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:09.889169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:10.010794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:10.020537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:10.034856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:10.036863 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd8c3455-448e-4e87-90fd-f2758573b5be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1340 microversion: 2.20 time: 0.181031 Oct 28 10:03:10.038021 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1566/3160] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:09 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1340 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:10.043928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:10.045190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:10.061065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:10.061960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:10.065485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:10.066276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:10.066762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:10.067211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:10.345846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:10.355909 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a1e2c3dd-9d7c-4d42-bbe6-e30656b68ded tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1324 microversion: 2.1 time: 0.316316 Oct 28 10:03:10.356616 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1567/3161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:10 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1324 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:10.400797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:10.412884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:10.422740 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a9404f2-dfd8-47e0-a5cc-89eae45ed747 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.987729 Oct 28 10:03:10.445901 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1595/3162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:09 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:10.518996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1870022267", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa47211-0e93-41b2-a356-031426d3c83c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:10.647620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] validate_networks() for [('afa47211-0e93-41b2-a356-031426d3c83c', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:03:10.740528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:10.741322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:10.753002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:10.753782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:10.755400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:10.756528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:10.758408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:10.759042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.115003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:11.141444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:11.143455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:11.145464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e322083b-c83e-4d91-ba2a-859d37f18fd2 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.408858 Oct 28 10:03:11.153535 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1596/3163] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:10 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:11.183332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:11.184551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:11.196262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.197030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.197663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.198680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.199334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.199951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.345729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:03:11.346539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:03:11.347687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:03:11.348327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:03:11.349043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:03:11.362618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=39 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:11.384742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.385386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.385898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.387082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.387654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.388232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.424395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:03:11.433669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for user 6859db32b98f4caba7379962eaef9de3 and project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:03:11.463417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:03:11.470471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:03:11.577372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62b25e0f-a198-4d9d-8825-24f5a51ef0f8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.219246 Oct 28 10:03:11.581474 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1568/3164] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:03:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:03:11.587576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:11.593995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:11.612310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.613582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.614555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.615525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.617870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.618597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.848877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:11.859156 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2aa13076-9a70-410a-9a4b-e51d84bc9d65 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1521 microversion: 2.1 time: 0.276174 Oct 28 10:03:11.859744 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1569/3165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:11 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:11.874376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:11.893785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:11.904738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.909930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.910635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:11.914457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:11.915389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:11.916214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:12.119153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.143864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.155922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.170919 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d1b318df-5dc7-4f2d-a18a-09cfc8366bf1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 1.002717 Oct 28 10:03:12.183408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1597/3166] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:11 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:12.198970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b75aca8-265b-43a3-9cdc-720ff3a1a8ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:12.201316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b75aca8-265b-43a3-9cdc-720ff3a1a8ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:12.202393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.215895 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41cb7b29-827a-4d2e-8f77-986517b6707b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.350010 Oct 28 10:03:12.217096 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1570/3167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:11 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:12.229571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:12.230448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:12.238245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:12.239119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:12.239849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:12.240915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:12.241600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:12.256883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:12.505430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.517455 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0caa991a-3b7c-4c2c-b348-f20d4eee1d17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1521 microversion: 2.1 time: 0.298970 Oct 28 10:03:12.543214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b75aca8-265b-43a3-9cdc-720ff3a1a8ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.547163 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1571/3168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:12 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:12.550954 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b75aca8-265b-43a3-9cdc-720ff3a1a8ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1215 microversion: 2.1 time: 0.361791 Oct 28 10:03:12.551547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1598/3169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:12 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1215 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:12.556261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2077240778"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:12.559488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:12.567985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:12.568224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:12.568716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:12.569283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:12.570035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:12.571020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:12.571701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:12.572547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:12.577840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:12.578621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:12.579313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:12.580228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:12.580871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:12.581526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:12.684793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.697812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.701498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:12.703013 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d5ea4c4a-dc53-4da3-9de6-6b5cf8da48c9 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.154514 Oct 28 10:03:12.704139 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1572/3170] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:12 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:12.988166 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a26c93d-def4-4bd0-84dc-b66973680fcd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a/action" status: 202 len: 0 microversion: 2.1 time: 0.430507 Oct 28 10:03:12.997716 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1599/3171] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:03:12 2022] POST /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a/action => generated 0 bytes in 445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:03:12.999967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47177461-e12d-40af-8e88-6d710b81ce56 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '.version_select at 0x7fca32b78820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:13.178287 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47177461-e12d-40af-8e88-6d710b81ce56 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a" status: 204 len: 0 microversion: 2.1 time: 0.182101 Oct 28 10:03:13.178971 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1573/3172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:12 2022] DELETE /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:03:13.188526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8ef08b5-e0ee-4458-b8d7-d17e4a687496 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '.version_select at 0x7fca3367d820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:13.210476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:13.211718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:13.224981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.225568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.226116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.229302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b8ef08b5-e0ee-4458-b8d7-d17e4a687496 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Image not found. Oct 28 10:03:13.230141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.230886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.231494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8ef08b5-e0ee-4458-b8d7-d17e4a687496 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a HTTP/1.1 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '04bc87d4-62ef-4d03-a4f2-6fba45d4a14a'} Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 04bc87d4-62ef-4d03-a4f2-6fba45d4a14a Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 10:03:13.233604 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04bc87d4-62ef-4d03-a4f2-6fba45d4a14a could not be found. Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:03:13.237693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:13.247130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8ef08b5-e0ee-4458-b8d7-d17e4a687496 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:13.247130 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8ef08b5-e0ee-4458-b8d7-d17e4a687496 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a" status: 404 len: 62 microversion: 2.1 time: 0.061508 Oct 28 10:03:13.247130 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1600/3173] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:13 2022] GET /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:03:13.256245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:13.259191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:13.273898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.275243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.275846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.276656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.277165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.277752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.419100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.430387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.432520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.434930 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9dfc6d4d-e9d7-4041-8cbe-1627984c85d0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.227329 Oct 28 10:03:13.435916 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1574/3174] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:13 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:13.441071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:13.441990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:13.449640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.450780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.451461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.452409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.453161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.454105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.684042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.693458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a9450c8d-9a7f-40a5-a4af-0624d04471af tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1533 microversion: 2.1 time: 0.256082 Oct 28 10:03:13.710600 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1575/3175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:13 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1533 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:13.716395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:13.717529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:13.724239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.724738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.725219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.725948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.727084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.727512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.803070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.817105 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-debf403d-3371-435a-a0f4-900163397f4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1275 microversion: 2.1 time: 0.104688 Oct 28 10:03:13.817972 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1576/3176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:13 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1275 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:13.823151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:13.823780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:13.830978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.831820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.832877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.834085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:13.834724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:13.836119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:13.925367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.935036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.936471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:13.937727 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd624e82-2f47-439c-97ac-ea0c0d73fc48 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.118661 Oct 28 10:03:13.938311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1577/3177] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:13 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:14.079814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-2066120a-c009-4465-85cd-230ad958f45b req-98ea1667-bcaa-4c07-a5a9-5fd005c9e51d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcb34008-bfc6-4422-b1fa-31695c007531", "tag": "234568f8-18c4-470d-90ed-0f4b69ca83ec"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:14.103345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2066120a-c009-4465-85cd-230ad958f45b req-98ea1667-bcaa-4c07-a5a9-5fd005c9e51d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.103708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2066120a-c009-4465-85cd-230ad958f45b req-98ea1667-bcaa-4c07-a5a9-5fd005c9e51d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.104685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2066120a-c009-4465-85cd-230ad958f45b req-98ea1667-bcaa-4c07-a5a9-5fd005c9e51d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.130734 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-2066120a-c009-4465-85cd-230ad958f45b req-98ea1667-bcaa-4c07-a5a9-5fd005c9e51d service nova] Creating event network-changed:234568f8-18c4-470d-90ed-0f4b69ca83ec for instance bcb34008-bfc6-4422-b1fa-31695c007531 on n-h2-zed-1 Oct 28 10:03:14.136117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-2066120a-c009-4465-85cd-230ad958f45b req-98ea1667-bcaa-4c07-a5a9-5fd005c9e51d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060054 Oct 28 10:03:14.137130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1578/3178] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:03:14.432357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:14.441850 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cd29e0e-c538-4221-ac39-129d681cc2ed tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 1.193403 Oct 28 10:03:14.442441 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1601/3179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:13 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:14.468356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:14.469468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:14.479033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.479801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.480505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.481504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.482187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.482842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.694498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:14.707615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:14.709941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:14.718233 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c3cadb5-a204-4b02-9da4-f9400cee8365 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.255649 Oct 28 10:03:14.719504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:14.723501 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1579/3180] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:14 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:14.735729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:14.747163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.747884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.748659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.749761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.750415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.751013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.840945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:14.841816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:14.848307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.849110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.849739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.850654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.851138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.851561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.936973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:14.947704 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fc31dac6-e104-43a3-a38b-b274aef980cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1273 microversion: 2.1 time: 0.110432 Oct 28 10:03:14.951753 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1580/3181] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:14 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1273 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:14.965785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:14.966657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:14.974400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.975153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.975808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:14.976734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:14.977405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:14.978117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:15.061862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:15.077279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:15.079836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:15.082117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d7859e3-95be-4083-9b09-4dd6112c1ec1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.121904 Oct 28 10:03:15.084996 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1581/3182] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:14 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:15.328084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:15.336746 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f38b0136-72cb-4855-9a88-036e11b6e440 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1539 microversion: 2.1 time: 0.623817 Oct 28 10:03:15.337361 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1602/3183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:14 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1539 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:15.466740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:15.467469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:15.474538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:15.475333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:15.475769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:15.476479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:15.476974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:15.477381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:15.498892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:15.646649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:15.655171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d38e6c47-4f64-4c4e-ad6e-bed35999d4b2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.192226 Oct 28 10:03:15.668930 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1582/3184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:15 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:15.752563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:15.753464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:15.762367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:15.762874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:15.763348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:15.764064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:15.764524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:15.765180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:15.974574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:15.975199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:15.981857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:15.982371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:15.982791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:15.983494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:15.983954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:15.984385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.056306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.067532 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-21dfd186-5872-457c-8e8f-1df3fd3b8b24 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1273 microversion: 2.1 time: 0.096406 Oct 28 10:03:16.081853 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1583/3185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:15 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1273 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:16.114426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:16.115057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:16.122176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.122688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.123135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.123864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.124324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.126409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.197821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.207215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.208668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.209904 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-120de376-b3af-4944-9625-908e45fa4835 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.100849 Oct 28 10:03:16.220974 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1584/3186] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:16 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:16.360858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:16.361504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:16.370248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.370752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.371185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.371883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.372518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.373147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.546336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.554492 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da3213a1-3284-490b-b47b-046663af327c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1539 microversion: 2.1 time: 0.197364 Oct 28 10:03:16.555294 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1585/3187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:16 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1539 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:16.560411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e7523fa2-9191-44a4-af42-802c344ff61a req-fb8ea636-47c2-4d27-b8df-12ca009d41c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:16.570195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e7523fa2-9191-44a4-af42-802c344ff61a req-fb8ea636-47c2-4d27-b8df-12ca009d41c1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.570683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e7523fa2-9191-44a4-af42-802c344ff61a req-fb8ea636-47c2-4d27-b8df-12ca009d41c1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.571122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e7523fa2-9191-44a4-af42-802c344ff61a req-fb8ea636-47c2-4d27-b8df-12ca009d41c1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.584065 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e7523fa2-9191-44a4-af42-802c344ff61a req-fb8ea636-47c2-4d27-b8df-12ca009d41c1 service nova] Creating event network-changed:56677974-42d3-4fca-a764-dca3e5226c74 for instance 635cb96d-039d-4c62-9784-aa89b4b879d1 on n-h2-zed-1 Oct 28 10:03:16.589691 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e7523fa2-9191-44a4-af42-802c344ff61a req-fb8ea636-47c2-4d27-b8df-12ca009d41c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033160 Oct 28 10:03:16.590632 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1586/3188] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:16.595560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6181069d-f200-49d4-8785-fb146b501483 req-795f9d41-cd21-4d79-b746-12a555f099a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e129b38a-00a7-4bc9-8c47-64b85413622a", "name": "network-vif-plugged", "status": "completed", "tag": "77c1d492-5cac-4b17-97c1-8074ddd25afc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:16.606598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6181069d-f200-49d4-8785-fb146b501483 req-795f9d41-cd21-4d79-b746-12a555f099a4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.607087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6181069d-f200-49d4-8785-fb146b501483 req-795f9d41-cd21-4d79-b746-12a555f099a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.607524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6181069d-f200-49d4-8785-fb146b501483 req-795f9d41-cd21-4d79-b746-12a555f099a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.619565 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6181069d-f200-49d4-8785-fb146b501483 req-795f9d41-cd21-4d79-b746-12a555f099a4 service nova] Creating event network-vif-plugged:77c1d492-5cac-4b17-97c1-8074ddd25afc for instance e129b38a-00a7-4bc9-8c47-64b85413622a on n-h1-zed-1 Oct 28 10:03:16.624622 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6181069d-f200-49d4-8785-fb146b501483 req-795f9d41-cd21-4d79-b746-12a555f099a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032858 Oct 28 10:03:16.625281 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1587/3189] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:16.629833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.638974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.640490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.642296 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4653981f-9366-4634-99e8-dc752c219b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.894573 Oct 28 10:03:16.642876 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1603/3190] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:15 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:16.680456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:16.681444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:16.688719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.689426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.690037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.690975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:16.691540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:16.692185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:16.834415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:16.844463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17689bba-855f-41e1-9895-6ac31efc129b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.169275 Oct 28 10:03:16.846438 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1588/3191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:16 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:17.090988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:17.091596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:17.104223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.104731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.105198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:17.105924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.106388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.106818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:17.150356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-2041751322", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "9ac107bd-0d69-41cf-a8fd-73f28562cf8d"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:17.293802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] validate_networks() for [('9ac107bd-0d69-41cf-a8fd-73f28562cf8d', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:03:17.330104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:17.341420 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f46f5af-71bb-48d2-84fc-faac8259253b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1315 microversion: 2.1 time: 0.254184 Oct 28 10:03:17.342901 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1589/3192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:17 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:17.361997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:17.363220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:17.383174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.383673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.384105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:17.384808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.385289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.385744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:17.468823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:17.479072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:17.480404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:17.481607 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0676767c-6113-4b87-8dc6-0483f3e4a162 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.137603 Oct 28 10:03:17.497286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1590/3193] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:17 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:17.581153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:17.582084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:17.597871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.598707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.601114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:17.603633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.605444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.607309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:17.922913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:17.935767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c150fda3-1f69-4f0a-99eb-de003959a0a4 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1521 microversion: 2.1 time: 0.361355 Oct 28 10:03:17.950527 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1591/3194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:17 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:17.962129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:17.963037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:17.972079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.973358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.973964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:17.974842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:17.975477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:17.976132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:18.238984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:18.255488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:18.257247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:18.259880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d7f49d04-0de3-4830-9a92-e3a3a4466cad tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.307592 Oct 28 10:03:18.273009 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1592/3195] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:17 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:18.300751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:03:18.301283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:03:18.301719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:03:18.302139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:03:18.302564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:03:18.320691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:18.321227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:18.325061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:18.326390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:18.326390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:18.326841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:18.386803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1348431493", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "153b4feb-5f46-4862-85be-edb054eb6bc9"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:18.407535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Getting quotas for project cb09627a84e44334b45c8828d00f255a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:03:18.421316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Getting quotas for user 7d34514faf454e7996cb87e2bc6847a2 and project cb09627a84e44334b45c8828d00f255a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:03:18.445275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:03:18.447495 n-d-zed-1 devstack@n-api.service[128747]: WARNING nova.utils [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-2041751322 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-204175132 Oct 28 10:03:18.448365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:03:18.486725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] validate_networks() for [('153b4feb-5f46-4862-85be-edb054eb6bc9', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:03:18.547006 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-77bbdca0-285b-4bf6-961a-bd7119c84140 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.486553 Oct 28 10:03:18.557873 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1604/3196] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:03:18.580019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:18.582570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:18.596946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:18.600839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:18.602246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:18.603310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:18.604102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:18.604833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.315790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:19.325215 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-287d9aad-44e3-4bdf-b142-d377f85988ad tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.765828 Oct 28 10:03:19.330504 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1605/3197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:18 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:19.347322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:19.347940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:19.364589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.365466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.368719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.369615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.370161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.370670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.421687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:03:19.422396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:03:19.423119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:03:19.423725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:03:19.424248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:03:19.424782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:03:19.448869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.449610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.452139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.453539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.454311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.455035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.473607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=11 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:19.495089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:03:19.503868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for user 90aefa22b02749e8a6b03d16378a0a6c and project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:03:19.531040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:03:19.538486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:03:19.539358 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-145c301f-a314-47e5-82eb-18d8aa8d7150 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 204 len: 0 microversion: 2.1 time: 0.206817 Oct 28 10:03:19.540504 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1606/3198] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:19 2022] DELETE /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:03:19.546920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:19.548181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:19.557956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.558798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.559670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.562048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.562762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.566903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.625322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1ea98a7-b6d3-4340-b505-3f697cbc0749 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361305 Oct 28 10:03:19.626908 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1593/3199] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:03:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1365 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:03:19.634817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:19.635777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:19.643939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.645009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.646479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.647459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.650983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.651605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.767149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:19.779421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:19.780878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:19.782106 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94e99c9e-961e-41f2-9b41-03f6b6f47971 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.154004 Oct 28 10:03:19.782682 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1594/3200] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:19 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:19.808651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:19.809567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:19.819861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.821273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.833595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.834709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.835199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.835818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.925078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:19.935863 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb5dc49b-e4e4-4ec7-ad50-d4f888a3d606 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1228 microversion: 2.1 time: 0.135323 Oct 28 10:03:19.937295 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1595/3201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:19 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1228 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:19.942091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7cac807a-67ff-4a5d-bac3-64d00965ac8a req-7635ff45-a5c1-4bca-9506-8c6311355437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b89ee9-c206-400e-8c38-fea96f43859f", "tag": "38af1972-062f-46da-84ae-eefada1fda7c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:19.952815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:19.956141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7cac807a-67ff-4a5d-bac3-64d00965ac8a req-7635ff45-a5c1-4bca-9506-8c6311355437 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:19.956609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7cac807a-67ff-4a5d-bac3-64d00965ac8a req-7635ff45-a5c1-4bca-9506-8c6311355437 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:19.957290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7cac807a-67ff-4a5d-bac3-64d00965ac8a req-7635ff45-a5c1-4bca-9506-8c6311355437 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:19.978533 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7cac807a-67ff-4a5d-bac3-64d00965ac8a req-7635ff45-a5c1-4bca-9506-8c6311355437 service nova] Creating event network-changed:38af1972-062f-46da-84ae-eefada1fda7c for instance a8b89ee9-c206-400e-8c38-fea96f43859f on n-h1-zed-1 Oct 28 10:03:19.986906 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7cac807a-67ff-4a5d-bac3-64d00965ac8a req-7635ff45-a5c1-4bca-9506-8c6311355437 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048210 Oct 28 10:03:19.987521 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1596/3202] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:20.002142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:20.003165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:20.013247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.014065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.014979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.016520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.017246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.017846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.149310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.165245 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63de34b6-e33a-48aa-96b6-2d82474d548a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1315 microversion: 2.1 time: 0.618532 Oct 28 10:03:20.182955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1607/3203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:19 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1315 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:20.192972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:20.196334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:20.204135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.206017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.206790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.208128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.209167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.210001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.359607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.385048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.386687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.388239 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5db23806-853b-44de-add4-4708657f1c31 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.395294 Oct 28 10:03:20.392609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.405651 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1597/3204] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:19 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:20.405853 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f49c66b4-7c21-4853-a401-76cf07652853 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1527 microversion: 2.1 time: 0.217890 Oct 28 10:03:20.406305 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1608/3205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:20 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1527 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:20.411121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:20.413212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a1b66cca-873c-424a-8966-3557f88406c5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:20.413815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a1b66cca-873c-424a-8966-3557f88406c5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:20.422380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:20.435152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.436310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.437384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.438361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.438979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.439930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.489321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a1b66cca-873c-424a-8966-3557f88406c5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.498223 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a1b66cca-873c-424a-8966-3557f88406c5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1208 microversion: 2.1 time: 0.090836 Oct 28 10:03:20.499188 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1598/3206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:20 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1208 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:20.617880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.628373 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0bf0cb7d-ae06-468f-a33b-f9eafec8b4cd tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.220782 Oct 28 10:03:20.629863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1609/3207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:20 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:20.751841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e85a9676-0c69-41a3-be09-492c538d1649 req-dd2f44be-68fa-4f7e-9d50-307290d50d87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e129b38a-00a7-4bc9-8c47-64b85413622a", "name": "network-vif-unplugged", "status": "completed", "tag": "77c1d492-5cac-4b17-97c1-8074ddd25afc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:20.769090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e85a9676-0c69-41a3-be09-492c538d1649 req-dd2f44be-68fa-4f7e-9d50-307290d50d87 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.770131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e85a9676-0c69-41a3-be09-492c538d1649 req-dd2f44be-68fa-4f7e-9d50-307290d50d87 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.770854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e85a9676-0c69-41a3-be09-492c538d1649 req-dd2f44be-68fa-4f7e-9d50-307290d50d87 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.787537 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e85a9676-0c69-41a3-be09-492c538d1649 req-dd2f44be-68fa-4f7e-9d50-307290d50d87 service nova] Creating event network-vif-unplugged:77c1d492-5cac-4b17-97c1-8074ddd25afc for instance e129b38a-00a7-4bc9-8c47-64b85413622a on n-h1-zed-1 Oct 28 10:03:20.794638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e85a9676-0c69-41a3-be09-492c538d1649 req-dd2f44be-68fa-4f7e-9d50-307290d50d87 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046391 Oct 28 10:03:20.795346 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1599/3208] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:03:20.814704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:20.815437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:20.822758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.823355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.823870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.825010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.825737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.826550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.896083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.904647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.906112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:20.907307 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40f3b966-c7bb-46ce-85de-c6871b0d797e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.097323 Oct 28 10:03:20.907906 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1610/3209] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:20 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:20.960809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:20.962014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:20.969074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.979118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.979621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:20.980398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:20.980877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:20.981345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.044308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:21.069019 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-078f0d4b-241e-4a3e-86a1-c66d9df9de1e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1228 microversion: 2.1 time: 0.112805 Oct 28 10:03:21.075486 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1600/3210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:20 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1228 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:21.191170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:21.191722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:21.198525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.199308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.199980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.201556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.202229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.202861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.384667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:21.395652 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65dd6d1a-18bd-45e7-81cb-20204f83e99e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1315 microversion: 2.1 time: 0.208315 Oct 28 10:03:21.396651 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1611/3211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:21 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:21.432889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:21.441340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:21.461896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.462504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.463016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.463491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:21.464897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.465428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:21.465968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.468315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.484898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.485624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.486271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.489553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.490245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.490702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.505480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:21.698206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:21.707494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:21.708994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:21.710108 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-675631b9-eb35-4bff-a57d-670688fa1b7e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.255495 Oct 28 10:03:21.712524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1612/3212] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:21 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:21.727886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:21.728589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:21.730579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:21.731680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:21.735893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.737009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.737670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.738618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.739288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.739868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2cd321f0-3f6c-45a5-ae72-48c77cd2dbe3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1527 microversion: 2.1 time: 0.311954 Oct 28 10:03:21.740006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.749121 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1601/3213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:21 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1527 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:21.762998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:21.763969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:21.771010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.771845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.772352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.773348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.773886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.774410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.809698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:21.817772 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-591a2ef8-ab04-4eb7-b5ea-73c510691787 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1204 microversion: 2.1 time: 0.103786 Oct 28 10:03:21.818625 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1613/3214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:21 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1204 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:21.934019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:21.935026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:21.941123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.941704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.942223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.942999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:21.943564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:21.944071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:21.993021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:22.001165 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62567f9e-d4a6-4d8b-9b0f-ed71a8698157 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.250614 Oct 28 10:03:22.001741 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1602/3215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:21 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:22.009563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:22.018069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:22.019551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:22.020733 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3aa76850-b9c7-4521-b51a-d961066d4ebd tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.091334 Oct 28 10:03:22.021509 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1614/3216] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:21 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:22.093206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:22.094212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:22.101900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.102819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.103515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.104387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.105067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.105903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.128048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:22.223433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:22.225504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3c87e7d2-b92b-48a4-a52c-b56deac44ee4 req-8edf1b22-dfc8-4a4a-9241-f277df6b6024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e129b38a-00a7-4bc9-8c47-64b85413622a", "name": "network-vif-deleted", "tag": "77c1d492-5cac-4b17-97c1-8074ddd25afc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:22.234364 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b1ad1a1-558e-4faa-9b88-694f1c8be414 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1284 microversion: 2.1 time: 0.144506 Oct 28 10:03:22.235987 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1603/3217] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:22 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1284 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:22.245757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3c87e7d2-b92b-48a4-a52c-b56deac44ee4 req-8edf1b22-dfc8-4a4a-9241-f277df6b6024 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.246335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3c87e7d2-b92b-48a4-a52c-b56deac44ee4 req-8edf1b22-dfc8-4a4a-9241-f277df6b6024 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.247058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3c87e7d2-b92b-48a4-a52c-b56deac44ee4 req-8edf1b22-dfc8-4a4a-9241-f277df6b6024 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.260774 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3c87e7d2-b92b-48a4-a52c-b56deac44ee4 req-8edf1b22-dfc8-4a4a-9241-f277df6b6024 service nova] Creating event network-vif-deleted:77c1d492-5cac-4b17-97c1-8074ddd25afc for instance e129b38a-00a7-4bc9-8c47-64b85413622a on n-h1-zed-1 Oct 28 10:03:22.266702 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3c87e7d2-b92b-48a4-a52c-b56deac44ee4 req-8edf1b22-dfc8-4a4a-9241-f277df6b6024 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044743 Oct 28 10:03:22.267494 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1615/3218] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:22.421924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:22.422627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:22.445587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.446080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.449055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.450027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.450698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.451290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.737060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:22.737776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:22.754062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.758651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.759135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.763639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.764575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.765363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.807250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:22.817464 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b6bcf34-cdae-4076-85b1-9150ee52657c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1315 microversion: 2.1 time: 0.399960 Oct 28 10:03:22.818680 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1604/3219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:22 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:22.827455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:22.828169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:22.843358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.844242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.844932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.846088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.846910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.847551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.928839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:22.929414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:22.929865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:22.930334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lazy-loading 'fault' on Instance uuid e129b38a-00a7-4bc9-8c47-64b85413622a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:03:23.031842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.048998 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-feba45dc-c3b6-435a-8e2c-142a02dadc28 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1314 microversion: 2.1 time: 0.227236 Oct 28 10:03:23.061848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1605/3220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:22 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:23.079081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:23.079969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:23.094721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.095399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.096005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.099455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.100136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.100732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.392503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.404112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2cd58991-cff0-456d-a222-48be67947bff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1204 microversion: 2.1 time: 0.339211 Oct 28 10:03:23.420519 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1606/3221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:23 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1204 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:23.420519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6eff3fb4-2273-4846-ac08-16314ceb2526 req-3adffae1-cbfa-47d6-b575-cf789265720e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcb34008-bfc6-4422-b1fa-31695c007531", "name": "network-vif-plugged", "status": "completed", "tag": "234568f8-18c4-470d-90ed-0f4b69ca83ec"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:23.446465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6eff3fb4-2273-4846-ac08-16314ceb2526 req-3adffae1-cbfa-47d6-b575-cf789265720e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.447515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6eff3fb4-2273-4846-ac08-16314ceb2526 req-3adffae1-cbfa-47d6-b575-cf789265720e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.448055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6eff3fb4-2273-4846-ac08-16314ceb2526 req-3adffae1-cbfa-47d6-b575-cf789265720e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.485783 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6eff3fb4-2273-4846-ac08-16314ceb2526 req-3adffae1-cbfa-47d6-b575-cf789265720e service nova] Creating event network-vif-plugged:234568f8-18c4-470d-90ed-0f4b69ca83ec for instance bcb34008-bfc6-4422-b1fa-31695c007531 on n-h2-zed-1 Oct 28 10:03:23.501223 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6eff3fb4-2273-4846-ac08-16314ceb2526 req-3adffae1-cbfa-47d6-b575-cf789265720e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092420 Oct 28 10:03:23.502166 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1607/3222] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:23.517490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:23.519718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:23.535315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.536546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.537362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.537504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.541319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.542166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.543663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.550312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.555302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.562583 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c8c5ce3e-1180-4eac-973c-818734390d89 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.829934 Oct 28 10:03:23.563848 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1616/3223] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:22 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:23.574191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:23.580070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:23.606160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.607019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.607783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.608838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.609564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.610675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.790960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.803242 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f51d6d3c-c36f-4f5a-b6ba-3176360f24fe tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.298792 Oct 28 10:03:23.807757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1608/3224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:23 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:23.820789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:23.822050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:23.838700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.842353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.842720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.846065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.847470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.847918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.856727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.870780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.880644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.884783 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dd41c3a3-1e58-4910-a1bc-1c41b997d34b tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.316581 Oct 28 10:03:23.890034 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1617/3225] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:23 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:23.901794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:23.908434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:23.921234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.921745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.922190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.923388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:23.928332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:23.928870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:23.974913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:23.987835 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31001562-fdb7-41e3-951c-ac11f9284d53 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1290 microversion: 2.1 time: 0.177996 Oct 28 10:03:23.989259 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1609/3226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:23 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1290 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:24.078485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:24.083011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:24.113177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.114123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.119398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.120283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.120768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.121232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.207723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.208329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.208820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.209361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lazy-loading 'fault' on Instance uuid e129b38a-00a7-4bc9-8c47-64b85413622a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:03:24.307776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:24.324279 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-369982b7-9636-4a7f-8f10-4073d122ef17 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 200 len: 1314 microversion: 2.1 time: 0.250844 Oct 28 10:03:24.326651 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1610/3227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:24 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:24.434186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:24.435069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:24.450935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.451439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.452071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.453254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.453864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.454425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.543457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:24.552821 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a41aa7b-bd5b-4f58-9d55-a3fa4fe716f6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1266 microversion: 2.1 time: 0.122433 Oct 28 10:03:24.555268 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1611/3228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:24 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:24.595930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:24.597128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:24.602061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:24.604482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.605061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.605500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.606302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.606758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.607236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.615999 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-436cee0b-f05a-492f-ad59-cd5747f57f7a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1315 microversion: 2.1 time: 0.724342 Oct 28 10:03:24.617237 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1618/3229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:23 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1315 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:24.834373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:24.835250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:24.845357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.849578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.850402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.851589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.852286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.856697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.903705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:24.913416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:24.916014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:24.917414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4614b0da-7f9b-4f33-b21d-a2c5653e6b01 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.330348 Oct 28 10:03:24.918483 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1612/3230] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:24 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:24.923286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:24.924129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:24.931212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.931931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.932579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:24.933491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:24.934129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:24.935208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.086218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:25.095401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:25.096866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:25.098113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d5e4a4a-d740-41cd-846d-849d97144d5e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.178428 Oct 28 10:03:25.099002 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1613/3231] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:24 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:25.104364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:25.105002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:25.111405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.111909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.112351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.113254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.113542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.113972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.180632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:25.188763 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eab20a7c-5c05-477e-9920-d8d055bf8213 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1290 microversion: 2.1 time: 0.088485 Oct 28 10:03:25.189380 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1614/3232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:25 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:25.245141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:25.253401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e64bcb3b-a7b2-440a-a567-811ff96e25ab tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1316 microversion: 2.1 time: 0.423226 Oct 28 10:03:25.253985 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1619/3233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:24 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:25.357498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:25.358516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:25.368985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.369409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.369849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.370564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.371083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.371511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.386590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a HTTP/1.1 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e129b38a-00a7-4bc9-8c47-64b85413622a'} Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:25.388276 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e64c48ad-5f5f-4c73-a67d-1377ce2a3628 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 404 len: 111 microversion: 2.1 time: 0.043090 Oct 28 10:03:25.402248 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1615/3234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:25 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:25.519630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1942452330", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:25.581561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:25.582633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:25.604272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.604764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.605442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.606165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.606462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] validate_networks() for [('43667df7-fc7f-4fd7-8495-77da094fb553', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:03:25.607079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.607575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.692654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:25.706416 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e123be9-98d3-405a-a492-0c80cae11dff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1266 microversion: 2.1 time: 0.129514 Oct 28 10:03:25.707587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1616/3235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:25 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:25.713892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:25.714780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:25.722792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.723564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.724191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:25.725100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:25.725736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:25.726211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.108226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.116811 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8efb9ea-785f-4c7d-8d53-22913df30e0d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1315 microversion: 2.1 time: 0.407594 Oct 28 10:03:26.117446 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1617/3236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:25 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:26.122017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:26.123111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:26.138377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.138886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.139332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.140187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.140646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.141162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.296860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.306059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.307685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.309061 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8a1b026-8959-4da9-9664-224f5e190e8f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.190548 Oct 28 10:03:26.309785 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1618/3237] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:26 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:26.314711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:26.315372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:26.321948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.322371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.322816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.323508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.323967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.324396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.411138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.429224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.430684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.432567 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a471b16b-f89d-4450-8729-3f6ea074465c tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.121825 Oct 28 10:03:26.433950 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1619/3238] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:26 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:26.439866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:26.440492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:26.452948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.453511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.453957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.454841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.455306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.455750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.644132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.646460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:26.670084 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1301490a-288f-420a-a13a-b01754475538 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.235189 Oct 28 10:03:26.672001 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1620/3239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:26 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:26.696808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:26.701986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:26.710048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.711290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.712053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.712837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.713487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.714748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.902718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:26.911932 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d7672a0a-7257-4f53-ae8a-bfa7d1a1619e tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1505 microversion: 2.1 time: 0.238535 Oct 28 10:03:26.912865 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1621/3240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:26 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:26.924448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d12114f4-d884-4ae7-b915-fe8a0c39e996 req-1f333952-85bc-4710-8bd3-c6e592018a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b89ee9-c206-400e-8c38-fea96f43859f", "name": "network-vif-plugged", "status": "completed", "tag": "38af1972-062f-46da-84ae-eefada1fda7c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:26.947585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d12114f4-d884-4ae7-b915-fe8a0c39e996 req-1f333952-85bc-4710-8bd3-c6e592018a78 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.948495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d12114f4-d884-4ae7-b915-fe8a0c39e996 req-1f333952-85bc-4710-8bd3-c6e592018a78 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.950586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d12114f4-d884-4ae7-b915-fe8a0c39e996 req-1f333952-85bc-4710-8bd3-c6e592018a78 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.965917 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d12114f4-d884-4ae7-b915-fe8a0c39e996 req-1f333952-85bc-4710-8bd3-c6e592018a78 service nova] Creating event network-vif-plugged:38af1972-062f-46da-84ae-eefada1fda7c for instance a8b89ee9-c206-400e-8c38-fea96f43859f on n-h1-zed-1 Oct 28 10:03:26.971198 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d12114f4-d884-4ae7-b915-fe8a0c39e996 req-1f333952-85bc-4710-8bd3-c6e592018a78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056784 Oct 28 10:03:26.973068 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1622/3241] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:26.981401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:26.982574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:26.989229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.989791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.990300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:26.991091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:26.992256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:26.992882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.057551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:03:27.060503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:03:27.061053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:03:27.062206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:03:27.062206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:03:27.077471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.077968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.078406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.079131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.079802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.080403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.100608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:03:27.107233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Getting quotas for user 28313b7c89184dd683e3479d23be489d and project 3be0ab02a95a48628dd5f9f1ac2f4596. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:03:27.122599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:03:27.125076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:03:27.177425 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfb3fb57-82d1-4ca6-afba-77d37e456882 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.662149 Oct 28 10:03:27.177989 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1620/3242] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:03:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:03:27.185268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:27.186083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:27.195121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.195792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.196432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.197348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.197983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.198742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.239247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:03:27.243609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.253392 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8c981993-6e2c-4a27-a3e8-f77616672967 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.276438 Oct 28 10:03:27.259603 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1623/3243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:26 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:27.260092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:27.260811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:27.267746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.268608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.269067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.269869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.270453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.270985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.378040 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49949371-b830-455f-8d94-2d82b650d2d2 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 204 len: 0 microversion: 2.1 time: 0.198501 Oct 28 10:03:27.379116 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1621/3244] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:27 2022] DELETE /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:03:27.385982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-90461fa0-7d1e-4aea-8a16-80cefdb5e181 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:27.387291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-90461fa0-7d1e-4aea-8a16-80cefdb5e181 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:27.458052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.467659 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-21973bfd-8f68-4341-9c30-42e9a60afc80 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1315 microversion: 2.1 time: 0.212165 Oct 28 10:03:27.480929 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1624/3245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:27 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:27.480929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:27.480929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:27.482308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.482308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.482893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.485090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.485090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.485090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.507097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-90461fa0-7d1e-4aea-8a16-80cefdb5e181 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.521299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-90461fa0-7d1e-4aea-8a16-80cefdb5e181 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1225 microversion: 2.1 time: 0.136640 Oct 28 10:03:27.524063 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1622/3246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:27 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:27.531578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:27.532414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:27.541956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.542942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.544199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.545552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.546574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.547458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.669641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.678740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.680170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.681560 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6545e06e-242d-4656-9638-1e8c103e1839 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.212244 Oct 28 10:03:27.693061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1625/3247] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:27 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:27.698263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:27.698887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:27.704939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.705644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.706129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.706974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.707594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.708175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.790693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.801540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.803044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.804262 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae6c2341-abf1-41dd-8ace-75f80163b5db tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.109845 Oct 28 10:03:27.804998 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1626/3248] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:27 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:27.810174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:27.810786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:27.816879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.817408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.817851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.818560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.819009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.819435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.870355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.878208 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f29e7297-2fb4-4b2c-9eb8-f5a106daa738 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1511 microversion: 2.1 time: 0.352952 Oct 28 10:03:27.888924 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1623/3249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:27 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1511 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:27.899560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-cca6f51d-d436-48f2-b0ae-63d1716712b8 req-4dfe4828-a4ff-4ba9-ad38-1823f07b847e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6", "tag": "0ee719de-862d-4e3a-82a8-3b41475f5b2f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:27.913527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cca6f51d-d436-48f2-b0ae-63d1716712b8 req-4dfe4828-a4ff-4ba9-ad38-1823f07b847e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:27.914683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cca6f51d-d436-48f2-b0ae-63d1716712b8 req-4dfe4828-a4ff-4ba9-ad38-1823f07b847e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:27.915353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cca6f51d-d436-48f2-b0ae-63d1716712b8 req-4dfe4828-a4ff-4ba9-ad38-1823f07b847e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:27.931588 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-cca6f51d-d436-48f2-b0ae-63d1716712b8 req-4dfe4828-a4ff-4ba9-ad38-1823f07b847e service nova] Creating event network-changed:0ee719de-862d-4e3a-82a8-3b41475f5b2f for instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 on n-h1-zed-1 Oct 28 10:03:27.937779 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-cca6f51d-d436-48f2-b0ae-63d1716712b8 req-4dfe4828-a4ff-4ba9-ad38-1823f07b847e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057097 Oct 28 10:03:27.938382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1624/3250] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:27.972825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:27.980888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82e91c01-166a-4f7c-b442-9ef5f1df6369 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.174476 Oct 28 10:03:27.981576 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1627/3251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:27 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:28.278949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:28.279669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:28.286948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.287426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.287947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.288639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.289124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.289548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.495270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:28.495898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:28.502859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.503351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.503792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.504505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.504995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.507317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.633948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:28.644081 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fcda683-83f6-4d00-81c9-932bcf0a46ae tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.369210 Oct 28 10:03:28.653266 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1625/3252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:28 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:28.658234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:28.659106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:28.666857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:28.667886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.668423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.668871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.669621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.670112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.670727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.688118 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1abd46a-d380-497c-985c-be1e1424d889 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1502 microversion: 2.1 time: 0.197348 Oct 28 10:03:28.689092 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1628/3253] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:28 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:28.710754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:28.711499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:28.718220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.719633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.720282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.721287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.721968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.722654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.754159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:03:28.794010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:28.802614 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23cfcc18-2299-45e0-bb45-4916719d7584 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1221 microversion: 2.1 time: 0.148349 Oct 28 10:03:28.803205 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1626/3254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:28 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:28.808943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:28.809844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:28.816502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.817016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.817643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.818519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.819225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.819887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.845184 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ddac9774-b5a2-4a09-b0bb-7a6cc8a62542 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 204 len: 0 microversion: 2.1 time: 0.137798 Oct 28 10:03:28.849668 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1629/3255] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:28 2022] DELETE /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:03:28.854426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:28.855137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:28.861144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.861742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.862195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.862912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.863368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.864009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.936509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:28.945086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:28.946558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:28.947774 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a42e41d-f2d8-4241-b986-917275090202 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.100133 Oct 28 10:03:28.948321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1630/3256] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:28 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:28.953028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:28.954415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:28.961799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.962494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.963100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:28.963980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:28.964601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:28.965217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.114317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.120107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.125123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.126939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.128534 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-53204068-e508-49d1-8287-144d735e74e1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.324091 Oct 28 10:03:29.141240 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1627/3257] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:28 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:29.141443 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e9403af5-d9ee-4c20-ae89-e058869fe3fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1508 microversion: 2.1 time: 0.181072 Oct 28 10:03:29.141443 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1631/3258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:28 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:29.141600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:29.141600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:29.142141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e1fea3b6-55dc-412c-951e-fa8ebe1b7e01 req-80e6a938-9411-4d21-a0a5-5a18f9efe37a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "name": "network-vif-plugged", "status": "completed", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:29.142236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.142495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.145137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.145137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.145137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.145137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.155804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e1fea3b6-55dc-412c-951e-fa8ebe1b7e01 req-80e6a938-9411-4d21-a0a5-5a18f9efe37a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.156298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e1fea3b6-55dc-412c-951e-fa8ebe1b7e01 req-80e6a938-9411-4d21-a0a5-5a18f9efe37a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.156749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e1fea3b6-55dc-412c-951e-fa8ebe1b7e01 req-80e6a938-9411-4d21-a0a5-5a18f9efe37a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.169681 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e1fea3b6-55dc-412c-951e-fa8ebe1b7e01 req-80e6a938-9411-4d21-a0a5-5a18f9efe37a service nova] Creating event network-vif-plugged:56677974-42d3-4fca-a764-dca3e5226c74 for instance 635cb96d-039d-4c62-9784-aa89b4b879d1 on n-h2-zed-1 Oct 28 10:03:29.175278 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e1fea3b6-55dc-412c-951e-fa8ebe1b7e01 req-80e6a938-9411-4d21-a0a5-5a18f9efe37a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043164 Oct 28 10:03:29.176059 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1632/3259] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:29.181033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:29.181740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:29.188337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.188824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.189290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.189995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.190452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.190879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.326792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.334818 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f70d29a6-4d16-48fa-9f24-82b6b7b229dc tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.157691 Oct 28 10:03:29.336133 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1633/3260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:29 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:29.365710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.374462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0fe5b32-ebe6-447b-9a33-5d68b849b847 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1511 microversion: 2.1 time: 0.244273 Oct 28 10:03:29.375624 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1628/3261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:29 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1511 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:29.668760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:29.669555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:29.671470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:29.682146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.691946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.693242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.694183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.695097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.695559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.831713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:29.833034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:29.839810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.840306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.841127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.841850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.842500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.842931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.916164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.924261 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07ee24fc-2cc4-4204-b74b-a331b41f84bf tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1283 microversion: 2.1 time: 0.096592 Oct 28 10:03:29.924877 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1629/3262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:29 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1283 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:29.930196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:29.939897 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e7428ba-ffa5-4a30-9925-3ff34531a754 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.274996 Oct 28 10:03:29.941045 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1634/3263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:29 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:29.964428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0063685d-c3a6-428b-a490-072f6e49b03c req-5a278e5e-d723-4ea5-aaf9-76e3c9cecad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d06442d-74eb-4207-9362-555ed34ffa32", "tag": "5ecd48d6-f790-43eb-81b4-e47d04989e7d"}, {"server_uuid": "bcb34008-bfc6-4422-b1fa-31695c007531", "name": "network-vif-deleted", "tag": "234568f8-18c4-470d-90ed-0f4b69ca83ec"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:29.976059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0063685d-c3a6-428b-a490-072f6e49b03c req-5a278e5e-d723-4ea5-aaf9-76e3c9cecad5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.977708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0063685d-c3a6-428b-a490-072f6e49b03c req-5a278e5e-d723-4ea5-aaf9-76e3c9cecad5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.978375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0063685d-c3a6-428b-a490-072f6e49b03c req-5a278e5e-d723-4ea5-aaf9-76e3c9cecad5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.978581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:29.979467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:29.983481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:29.988148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.988660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.989193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.989995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:29.990454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:29.990937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:29.996474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0063685d-c3a6-428b-a490-072f6e49b03c req-5a278e5e-d723-4ea5-aaf9-76e3c9cecad5 service nova] Creating event network-changed:5ecd48d6-f790-43eb-81b4-e47d04989e7d for instance 2d06442d-74eb-4207-9362-555ed34ffa32 on n-h1-zed-1 Oct 28 10:03:29.997234 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0063685d-c3a6-428b-a490-072f6e49b03c req-5a278e5e-d723-4ea5-aaf9-76e3c9cecad5 service nova] Creating event network-vif-deleted:234568f8-18c4-470d-90ed-0f4b69ca83ec for instance bcb34008-bfc6-4422-b1fa-31695c007531 on n-h2-zed-1 Oct 28 10:03:30.007752 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0063685d-c3a6-428b-a490-072f6e49b03c req-5a278e5e-d723-4ea5-aaf9-76e3c9cecad5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.046527 Oct 28 10:03:30.008382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1630/3264] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:30.079120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.088446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.090032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.091602 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49232b6c-e331-4a80-9e6b-1a8f4a37b7c5 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.120956 Oct 28 10:03:30.092422 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1635/3265] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:29 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:30.157356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:30.158103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:30.165224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.165727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.166100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:30.166228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.166719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:30.166892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.167334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.167770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.173109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.173507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.173945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.174642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.175093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.175514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.324636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.333296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.334972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.336935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf2c4949-65e9-4b7b-a208-d9cd96ae23a6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1408 microversion: 2.20 time: 0.184680 Oct 28 10:03:30.338117 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1631/3266] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:30 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:30.357748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:30.358409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:30.364505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.365033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.365482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.366182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.366745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.367092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.390847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.400998 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-35f54998-44f3-489a-9a45-03e4aff984e4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1508 microversion: 2.1 time: 0.240625 Oct 28 10:03:30.401585 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1636/3267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:30 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:30.406286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:30.406903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:30.417316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.417842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.418614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.419352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.419816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.420481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.425620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:30.458858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.459729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.460182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.461261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lazy-loading 'fault' on Instance uuid bcb34008-bfc6-4422-b1fa-31695c007531 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:03:30.494605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=13 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:30.517881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.526810 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78307ac0-6cbd-49fc-abf2-98e54c01369f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.172935 Oct 28 10:03:30.539988 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1632/3268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:30 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:30.547463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67ece33b583c4baeb46ac278aa60ae4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74485b211f854132b59f02e4decdf998', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:30.559411 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3746943f-0ed1-4629-8b67-cf551db5ddb4 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 200 len: 1306 microversion: 2.1 time: 0.156615 Oct 28 10:03:30.560626 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1637/3269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:30 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:30.951142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:30.951787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:30.958506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.959031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.959480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.960190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.960655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.961125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.964317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:30.965710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:30.973260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.973764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.974240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:30.975118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:30.975809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:30.976787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.109412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.119441 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-77855b63-356f-421e-9959-b43de70e21f3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.172170 Oct 28 10:03:31.120044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1633/3270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:30 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:31.124889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.125761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.144367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.144883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.145399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.146107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.146602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.147027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.190205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.203310 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-269516e5-4c83-4832-af4f-62c2375f2abb tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.241387 Oct 28 10:03:31.213793 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1638/3271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:30 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:31.217668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.226376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.227830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.229063 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9f0929a-22a4-4a22-84e4-ae8ecd14e59e tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.108036 Oct 28 10:03:31.229785 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1634/3272] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:31 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:31.361044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.361661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.364670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:31.369175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.369665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.370643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.370950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.371389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.371846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.423942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.424565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.433233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.433734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.434167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.435137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.435592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.436019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.612635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.619383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.627519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.628638 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b34c7f8-05c9-49a1-b472-0d19063443f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1508 microversion: 2.1 time: 0.208551 Oct 28 10:03:31.629065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.640928 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1635/3273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:31 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:31.641132 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8c8573a4-eaaa-4006-9a4b-306a1bd168f7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1600 microversion: 2.20 time: 0.273326 Oct 28 10:03:31.641220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.641220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.645939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.645939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.645939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.646256 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1639/3274] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:31 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1600 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:31.646338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.646514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.646871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.656044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c5309413-7f1b-4f2f-b2c4-2f820955e645 req-63e9d4c1-e899-4023-84e4-66ea95b08042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdebd876-8db0-419a-a3b6-34959a10e80b", "tag": "5f9534b7-7e21-4ad7-afcb-260c0f973c13"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:31.666888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5309413-7f1b-4f2f-b2c4-2f820955e645 req-63e9d4c1-e899-4023-84e4-66ea95b08042 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.667379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5309413-7f1b-4f2f-b2c4-2f820955e645 req-63e9d4c1-e899-4023-84e4-66ea95b08042 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.667811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c5309413-7f1b-4f2f-b2c4-2f820955e645 req-63e9d4c1-e899-4023-84e4-66ea95b08042 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.680265 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c5309413-7f1b-4f2f-b2c4-2f820955e645 req-63e9d4c1-e899-4023-84e4-66ea95b08042 service nova] Creating event network-changed:5f9534b7-7e21-4ad7-afcb-260c0f973c13 for instance fdebd876-8db0-419a-a3b6-34959a10e80b on n-h2-zed-1 Oct 28 10:03:31.685564 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c5309413-7f1b-4f2f-b2c4-2f820955e645 req-63e9d4c1-e899-4023-84e4-66ea95b08042 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038445 Oct 28 10:03:31.686176 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1640/3275] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:31.691363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.692335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.698551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.699046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.699485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.700204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.700658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.701119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.717920 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] HTTP exception thrown: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Request method failure captured: Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 HTTP/1.1 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jPtORfjYqexCYhouomDu3763VnsHptxUGwk9gI3Z_Aj1y52ex6nEdKstta7llKcxWs1g-DVJrGsd6sv8bmmGolLjOgqWu8YmgGHE5F5-viQaLXewmYvLmrTJx-9HuOK2ZVISTUxZWmri5cjEMIJVjlBfGGV2gYoFwzFrCVyo6JIo0 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74485b211f854132b59f02e4decdf998", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74485b211f854132b59f02e4decdf998"}]}] Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 67ece33b583c4baeb46ac278aa60ae4f Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'bcb34008-bfc6-4422-b1fa-31695c007531'} Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.719596 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Returning 404 to user: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12ea3545-562a-426b-a0ae-100950837617 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 404 len: 111 microversion: 2.1 time: 0.033700 Oct 28 10:03:31.723845 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1641/3276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:31 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:31.728145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.728647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.734850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.735369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.736954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.736954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.736954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.737394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.800741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:31.809854 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63ea2bfd-ee72-4aff-8b87-0d5ddca5f847 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.178901 Oct 28 10:03:31.810483 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1636/3277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:31 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:31.815830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-850552834", "metadata": {"image_type": "test"}}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:31.818406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.824733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.825305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.825772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.826478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.826945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.827383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.842492 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] HTTP exception thrown: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Request method failure captured: Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531/action HTTP/1.1 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 111 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jPtORfjYqexCYhouomDu3763VnsHptxUGwk9gI3Z_Aj1y52ex6nEdKstta7llKcxWs1g-DVJrGsd6sv8bmmGolLjOgqWu8YmgGHE5F5-viQaLXewmYvLmrTJx-9HuOK2ZVISTUxZWmri5cjEMIJVjlBfGGV2gYoFwzFrCVyo6JIo0 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74485b211f854132b59f02e4decdf998", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74485b211f854132b59f02e4decdf998"}]}] Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 67ece33b583c4baeb46ac278aa60ae4f Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-850552834", "metadata": {"image_type": "test"}}} Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'bcb34008-bfc6-4422-b1fa-31695c007531', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-850552834', 'metadata': {'image_type': 'test'}}}} Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:03:31.844214 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Returning 404 to user: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4636660-62da-446c-b950-1edcad8646c1 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "POST /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531/action" status: 404 len: 111 microversion: 2.1 time: 0.034250 Oct 28 10:03:31.849425 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1637/3278] 10.222.0.16 () {60 vars in 1279 bytes} [Fri Oct 28 10:03:31 2022] POST /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:31.857859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e6f78e1-b345-488c-9d2f-ad6bc051911d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1004016625", "metadata": {"image_type": "test"}}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:31.860761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e6f78e1-b345-488c-9d2f-ad6bc051911d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Failed to fetch instance by id tempest-invalid-479189014 {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 10:03:31.861505 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-0e6f78e1-b345-488c-9d2f-ad6bc051911d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] HTTP exception thrown: Instance tempest-invalid-479189014 could not be found. Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e6f78e1-b345-488c-9d2f-ad6bc051911d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Request method failure captured: Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/tempest-invalid-479189014/action HTTP/1.1 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 112 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jPtORfjYqexCYhouomDu3763VnsHptxUGwk9gI3Z_Aj1y52ex6nEdKstta7llKcxWs1g-DVJrGsd6sv8bmmGolLjOgqWu8YmgGHE5F5-viQaLXewmYvLmrTJx-9HuOK2ZVISTUxZWmri5cjEMIJVjlBfGGV2gYoFwzFrCVyo6JIo0 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74485b211f854132b59f02e4decdf998", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74485b211f854132b59f02e4decdf998"}]}] Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 67ece33b583c4baeb46ac278aa60ae4f Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1004016625", "metadata": {"image_type": "test"}}} Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance tempest-invalid-479189014 could not be found. Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'tempest-invalid-479189014', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1004016625', 'metadata': {'image_type': 'test'}}}} Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-479189014 could not be found. Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:31.863338 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-479189014 could not be found. Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-479189014 could not be found. Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e6f78e1-b345-488c-9d2f-ad6bc051911d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Returning 404 to user: Instance tempest-invalid-479189014 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e6f78e1-b345-488c-9d2f-ad6bc051911d tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "POST /compute/v2.1/servers/tempest-invalid-479189014/action" status: 404 len: 100 microversion: 2.1 time: 0.011059 Oct 28 10:03:31.881878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1638/3279] 10.222.0.16 () {60 vars in 1246 bytes} [Fri Oct 28 10:03:31 2022] POST /compute/v2.1/servers/tempest-invalid-479189014/action => generated 100 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:03:31.884777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99a0bb17-86b8-4fb1-915d-b78b5a08d8ba tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.147456 Oct 28 10:03:31.884777 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1642/3280] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 10:03:31 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec761f03-c6c3-46bd-aada-5d959c97a75b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-55252200"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec761f03-c6c3-46bd-aada-5d959c97a75b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-ec761f03-c6c3-46bd-aada-5d959c97a75b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec761f03-c6c3-46bd-aada-5d959c97a75b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Request method failure captured: Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 55 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jPtORfjYqexCYhouomDu3763VnsHptxUGwk9gI3Z_Aj1y52ex6nEdKstta7llKcxWs1g-DVJrGsd6sv8bmmGolLjOgqWu8YmgGHE5F5-viQaLXewmYvLmrTJx-9HuOK2ZVISTUxZWmri5cjEMIJVjlBfGGV2gYoFwzFrCVyo6JIo0 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74485b211f854132b59f02e4decdf998", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74485b211f854132b59f02e4decdf998"}]}] Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 67ece33b583c4baeb46ac278aa60ae4f Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: {"createImage": {"name": "tempest-test-snap-55252200"}} Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-55252200'}}} Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:31.885358 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec761f03-c6c3-46bd-aada-5d959c97a75b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec761f03-c6c3-46bd-aada-5d959c97a75b tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.011526 Oct 28 10:03:31.892831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1639/3281] 10.222.0.16 () {60 vars in 1275 bytes} [Fri Oct 28 10:03:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:31.896754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e66c152a-85e8-4eb9-a7be-82fe341bee41 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1504763434"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:31.896754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e66c152a-85e8-4eb9-a7be-82fe341bee41 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 10:03:31.896754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e66c152a-85e8-4eb9-a7be-82fe341bee41 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e66c152a-85e8-4eb9-a7be-82fe341bee41 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Request method failure captured: Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 57 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jPtORfjYqexCYhouomDu3763VnsHptxUGwk9gI3Z_Aj1y52ex6nEdKstta7llKcxWs1g-DVJrGsd6sv8bmmGolLjOgqWu8YmgGHE5F5-viQaLXewmYvLmrTJx-9HuOK2ZVISTUxZWmri5cjEMIJVjlBfGGV2gYoFwzFrCVyo6JIo0 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74485b211f854132b59f02e4decdf998", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74485b211f854132b59f02e4decdf998"}]}] Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 67ece33b583c4baeb46ac278aa60ae4f Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: {"createImage": {"name": "tempest-test-snap-1504763434"}} Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1504763434'}}} Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.898035 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e66c152a-85e8-4eb9-a7be-82fe341bee41 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e66c152a-85e8-4eb9-a7be-82fe341bee41 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.010597 Oct 28 10:03:31.907351 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1643/3282] 10.222.0.16 () {60 vars in 1281 bytes} [Fri Oct 28 10:03:31 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:03:31.910616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.911188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.918178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.918838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.919294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.920018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.920482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.920940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.936086 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] HTTP exception thrown: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Request method failure captured: Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 HTTP/1.1 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jPtORfjYqexCYhouomDu3763VnsHptxUGwk9gI3Z_Aj1y52ex6nEdKstta7llKcxWs1g-DVJrGsd6sv8bmmGolLjOgqWu8YmgGHE5F5-viQaLXewmYvLmrTJx-9HuOK2ZVISTUxZWmri5cjEMIJVjlBfGGV2gYoFwzFrCVyo6JIo0 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74485b211f854132b59f02e4decdf998", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74485b211f854132b59f02e4decdf998"}]}] Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 67ece33b583c4baeb46ac278aa60ae4f Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'bcb34008-bfc6-4422-b1fa-31695c007531'} Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:31.937711 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Returning 404 to user: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2525084a-bdff-40e4-abc8-57c1e3f9ecf9 tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 404 len: 111 microversion: 2.1 time: 0.033159 Oct 28 10:03:31.942095 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1640/3283] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:31 2022] DELETE /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:31.948973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:31.949662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] [instance: bcb34008-bfc6-4422-b1fa-31695c007531] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:31.956956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.957679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.957930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.958705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:31.959171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:31.959600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:31.973996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] HTTP exception thrown: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Request method failure captured: Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 HTTP/1.1 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jPtORfjYqexCYhouomDu3763VnsHptxUGwk9gI3Z_Aj1y52ex6nEdKstta7llKcxWs1g-DVJrGsd6sv8bmmGolLjOgqWu8YmgGHE5F5-viQaLXewmYvLmrTJx-9HuOK2ZVISTUxZWmri5cjEMIJVjlBfGGV2gYoFwzFrCVyo6JIo0 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/74485b211f854132b59f02e4decdf998"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_74485b211f854132b59f02e4decdf998", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/74485b211f854132b59f02e4decdf998"}]}] Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 74485b211f854132b59f02e4decdf998 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-29019784 Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 67ece33b583c4baeb46ac278aa60ae4f Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesNegativeTestJSON-29019784-project Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'bcb34008-bfc6-4422-b1fa-31695c007531'} Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:31.975532 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] Returning 404 to user: Instance bcb34008-bfc6-4422-b1fa-31695c007531 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce2dd34a-c0f3-4072-a3e1-a5a6e84ce2ba tempest-ImagesNegativeTestJSON-29019784 tempest-ImagesNegativeTestJSON-29019784-project] 10.222.0.16 "GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531" status: 404 len: 111 microversion: 2.1 time: 0.032997 Oct 28 10:03:31.980017 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1644/3284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:31 2022] GET /compute/v2.1/servers/bcb34008-bfc6-4422-b1fa-31695c007531 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:32.143686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:32.144745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:32.151785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.152449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.153008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.153820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.154358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.154870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.226100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:32.227224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:32.233434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.233918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.234360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.235454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.235919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.236345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.361572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:32.369901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2de8d58d-3e86-40f1-a160-fa6971ebd50a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.230242 Oct 28 10:03:32.370809 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1641/3285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:32 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:32.375346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:32.376177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:32.382885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.383490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.384946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.385745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.386282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.386791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.474229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:32.484179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:32.486374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:32.488105 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-739fbcbe-1ddf-4fe9-bf33-21c788b1b5b1 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1407 microversion: 2.54 time: 0.116236 Oct 28 10:03:32.497159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1642/3286] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:32 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:32.576828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:32.591772 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1a811845-3940-4a52-a080-fd37e088d362 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.369984 Oct 28 10:03:32.592488 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1645/3287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:32 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:32.653890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:32.654658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:32.661307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.661928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.662598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.664154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.664897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.665470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.835024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:32.836498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:32.843532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.844163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.844705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.845809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:32.846369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:32.847070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:32.886649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:32.894842 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-93c71bcf-6c65-4c67-9921-5968ee768594 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1508 microversion: 2.1 time: 0.245006 Oct 28 10:03:32.895719 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1643/3288] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:32 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:33.215883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:33.234650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1321d24b-441f-447c-97a6-3d2f1e8f2f50 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.403371 Oct 28 10:03:33.235318 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1646/3289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:32 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:33.393522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:33.394822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:33.405646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.406000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.406506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.407771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.408597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.409397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.516151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:33.517204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:33.524921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.525423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.525889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.526813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.527588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.528258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.611667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:33.624142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:33.625663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:33.626862 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f80e80b7-fe74-424f-b9ac-7001497795e4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1413 microversion: 2.54 time: 0.114713 Oct 28 10:03:33.640930 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1647/3290] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:33 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:33.640930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:33.640930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:33.640930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.640930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.640930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.641701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.642783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.643230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.830403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:33.839397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:33.839964 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c4fd0f7-de31-4c24-8c50-eda5045f18cc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.210819 Oct 28 10:03:33.842033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1648/3291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:33 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:33.847709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-016aaa6c-3879-4380-879d-716a877b114b req-7ce32aea-efed-4a38-a4c6-63e0e7d405d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:33.859706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-016aaa6c-3879-4380-879d-716a877b114b req-7ce32aea-efed-4a38-a4c6-63e0e7d405d7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.860450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-016aaa6c-3879-4380-879d-716a877b114b req-7ce32aea-efed-4a38-a4c6-63e0e7d405d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.860762 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b01ffbc1-12f3-40d9-a9c1-8e0d8c3b7ddd tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.471117 Oct 28 10:03:33.861702 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1644/3292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:33 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:33.861880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-016aaa6c-3879-4380-879d-716a877b114b req-7ce32aea-efed-4a38-a4c6-63e0e7d405d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.875519 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-016aaa6c-3879-4380-879d-716a877b114b req-7ce32aea-efed-4a38-a4c6-63e0e7d405d7 service nova] Creating event network-changed:56677974-42d3-4fca-a764-dca3e5226c74 for instance 635cb96d-039d-4c62-9784-aa89b4b879d1 on n-h2-zed-1 Oct 28 10:03:33.881954 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-016aaa6c-3879-4380-879d-716a877b114b req-7ce32aea-efed-4a38-a4c6-63e0e7d405d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037902 Oct 28 10:03:33.886980 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1649/3293] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:33.919525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:33.920538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:33.927065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.927937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.928603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:33.930167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:33.930856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:33.931509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.263236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:34.263954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:34.274429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.275208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.275858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.277297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:34.277698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.278578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.279177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.289414 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d495652-38ae-404f-9857-a9f0d3cd966d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1508 microversion: 2.1 time: 0.373176 Oct 28 10:03:34.290591 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1645/3294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:33 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1508 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:34.510363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:34.525746 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb1962f4-1259-48bf-8100-ed7eb1ae55c4 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.268167 Oct 28 10:03:34.541628 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1650/3295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:34 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:34.638977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c74ee471-cbb3-425e-876b-92af3500d631 req-ec164b26-20ad-4b6d-9194-9e46811a7e5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b89ee9-c206-400e-8c38-fea96f43859f", "name": "network-vif-deleted", "tag": "38af1972-062f-46da-84ae-eefada1fda7c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:34.657504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:34.658392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:34.666216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c74ee471-cbb3-425e-876b-92af3500d631 req-ec164b26-20ad-4b6d-9194-9e46811a7e5e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.666729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c74ee471-cbb3-425e-876b-92af3500d631 req-ec164b26-20ad-4b6d-9194-9e46811a7e5e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.670867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c74ee471-cbb3-425e-876b-92af3500d631 req-ec164b26-20ad-4b6d-9194-9e46811a7e5e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.672218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.673414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.679737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.680768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.681435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.682037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.699844 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c74ee471-cbb3-425e-876b-92af3500d631 req-ec164b26-20ad-4b6d-9194-9e46811a7e5e service nova] Creating event network-vif-deleted:38af1972-062f-46da-84ae-eefada1fda7c for instance a8b89ee9-c206-400e-8c38-fea96f43859f on n-h1-zed-1 Oct 28 10:03:34.714892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c74ee471-cbb3-425e-876b-92af3500d631 req-ec164b26-20ad-4b6d-9194-9e46811a7e5e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086690 Oct 28 10:03:34.715875 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1646/3296] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:03:34.825883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:34.842109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:34.852392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:34.854247 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8cc83108-d5cf-4000-9331-9a4e53828b07 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1413 microversion: 2.54 time: 0.200907 Oct 28 10:03:34.855099 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1651/3297] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:34 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1413 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:34.867563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:34.869047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:34.883126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.883708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.885661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.886427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.886896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.887331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.887449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:34.887984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:34.904830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.905361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.905808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:34.906543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:34.907264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:34.907878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.186003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:35.194026 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bce4217b-e4ad-4d5f-ab76-bb590ba3f01b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.310404 Oct 28 10:03:35.209366 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1652/3298] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:34 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:35.275952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:35.286953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0b4cacf-0a3b-48f3-8629-6676ba26dbe3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.424616 Oct 28 10:03:35.293299 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1647/3299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:34 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:35.320710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:35.321365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:35.337286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:35.337796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:35.338255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.338994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:35.339451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:35.339882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.416524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:35.417057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:35.421932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.422422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lazy-loading 'fault' on Instance uuid a8b89ee9-c206-400e-8c38-fea96f43859f {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:03:35.550878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:35.551502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:35.572476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:35.577802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:35.578320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:35.578770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.582807 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-20504dc4-8fc8-47ad-a9f0-4e0f45e90905 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 200 len: 1305 microversion: 2.1 time: 0.266020 Oct 28 10:03:35.590127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:35.590768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:35.591230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.602965 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1653/3300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:35 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 1305 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:35.884608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:35.889823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:35.893226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:35.896804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:35.898798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:35.899643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.900653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:35.901394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:35.902066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:35.905141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd6a7526-48ba-4d40-ac3b-e757021399b2 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.357868 Oct 28 10:03:35.905944 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1648/3301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:35 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:36.218035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:36.218702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:36.223480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.226381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.227001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.227516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.228537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.229434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.230105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.237443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.239450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.241438 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-020dc2f1-e216-418f-9b6f-0c12f2b165f4 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1398 microversion: 2.54 time: 0.361417 Oct 28 10:03:36.244294 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1654/3302] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:35 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1398 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:36.272337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ae68639-dad4-4348-bff6-e8a421327384 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '.version_select at 0x7fca324d8430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:36.309121 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ae68639-dad4-4348-bff6-e8a421327384 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-471275590" status: 204 len: 0 microversion: 2.54 time: 0.038937 Oct 28 10:03:36.318705 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1655/3303] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 10:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-471275590 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:03:36.328507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:36.332373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:36.346436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.347065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.349560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.351263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.352094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.353020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.402131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.410489 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb476818-fd1c-4d7c-8600-80237d592bb3 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.196682 Oct 28 10:03:36.411071 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1649/3304] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:36 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:36.416745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:36.417516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:36.431344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.431870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.432314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.433099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.433692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.433985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.468972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:03:36.499640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:36.563558 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-189f1f98-f8bd-4b32-8def-c4a7d7020956 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 204 len: 0 microversion: 2.54 time: 0.150822 Oct 28 10:03:36.565013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1650/3305] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:03:36 2022] DELETE /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:03:36.577765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:36.578492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:36.584602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:36.586893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.587620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.588236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.589499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.589499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.589887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.634961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.665117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ad8025f-7d73-4835-b39b-9eda869dc05f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.343554 Oct 28 10:03:36.665603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.666502 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1656/3306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:36 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:36.674113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:36.675209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:36.686907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.688517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.689738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.690985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.691653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.692255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.693822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.702391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:36.706316 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ce163c3-24c9-46bc-8c41-b717a80a9757 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1404 microversion: 2.54 time: 0.136063 Oct 28 10:03:36.724752 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1651/3307] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:36 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f HTTP/1.1 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'a8b89ee9-c206-400e-8c38-fea96f43859f'} Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:36.725153 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe523b83-4623-4082-8fc9-21d18c8656b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 404 len: 111 microversion: 2.1 time: 0.056511 Oct 28 10:03:36.728937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1657/3308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:36 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:36.798416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-652474246", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa47211-0e93-41b2-a356-031426d3c83c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:36.896140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] validate_networks() for [('afa47211-0e93-41b2-a356-031426d3c83c', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:03:36.927952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:36.928808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:36.936392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.936889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.937350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:36.938062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:36.940433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:36.940864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.091563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:37.209450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:37.212953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:37.221029 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a216ffd1-9fd6-46a0-973b-7f9b7686f242 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.297055 Oct 28 10:03:37.221775 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1658/3309] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:36 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:37.339489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:03:37.341257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:03:37.341914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:03:37.342600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:03:37.343221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:03:37.350451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=17 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:37.353071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.353570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.354044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.354766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.355230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.355661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.378342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:03:37.384640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for user 6859db32b98f4caba7379962eaef9de3 and project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:03:37.397426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:03:37.399793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:03:37.436251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:37.437800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:37.450728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.453322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.453772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.454504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.454953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.455376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.469344 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd2bb1a5-cc32-499b-96d5-fc5803437849 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.675400 Oct 28 10:03:37.473585 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1652/3310] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:03:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:03:37.481473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-214e586a-1937-4077-aabd-9517c2e36797 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:37.486417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-214e586a-1937-4077-aabd-9517c2e36797 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:37.573463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-214e586a-1937-4077-aabd-9517c2e36797 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:37.585350 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-214e586a-1937-4077-aabd-9517c2e36797 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1214 microversion: 2.1 time: 0.105157 Oct 28 10:03:37.587121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1653/3311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:37 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:37.692791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:37.693812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:37.709334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.709778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.710251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.713630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.714105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.714556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.715383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:37.738792 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf390cb2-034e-4209-b263-066c64330375 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.307296 Oct 28 10:03:37.740380 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1659/3312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:37 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:37.756470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:37.757338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:37.764371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.764880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.765368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.766101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:37.766696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:37.767316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:37.866489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:37.883541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:37.886819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:37.888764 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3e884f8f-b7e0-4530-9efc-dc7c78635ade tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1404 microversion: 2.54 time: 0.146843 Oct 28 10:03:37.891579 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1660/3313] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:37 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:03:38.034380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:38.044135 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a26e3afc-dee6-4a7d-8200-511830c02d52 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.355894 Oct 28 10:03:38.058539 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1654/3314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:37 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:38.244305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:38.245134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:38.266519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.267024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.267469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.268310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.268993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.269428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.455329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:38.465284 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4942eb63-aac6-45ff-9f81-62be588cd133 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.225187 Oct 28 10:03:38.465916 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1661/3315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:38 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:38.472751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5d6f9bc3-cca8-46b6-a2e7-7ce5c1de4565 req-058d8ea0-9382-4c6f-a0c9-39855dc12c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6", "name": "network-vif-plugged", "status": "completed", "tag": "0ee719de-862d-4e3a-82a8-3b41475f5b2f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:38.492734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d6f9bc3-cca8-46b6-a2e7-7ce5c1de4565 req-058d8ea0-9382-4c6f-a0c9-39855dc12c50 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.493618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d6f9bc3-cca8-46b6-a2e7-7ce5c1de4565 req-058d8ea0-9382-4c6f-a0c9-39855dc12c50 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.494271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d6f9bc3-cca8-46b6-a2e7-7ce5c1de4565 req-058d8ea0-9382-4c6f-a0c9-39855dc12c50 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.509320 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5d6f9bc3-cca8-46b6-a2e7-7ce5c1de4565 req-058d8ea0-9382-4c6f-a0c9-39855dc12c50 service nova] Creating event network-vif-plugged:0ee719de-862d-4e3a-82a8-3b41475f5b2f for instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 on n-h1-zed-1 Oct 28 10:03:38.520197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5d6f9bc3-cca8-46b6-a2e7-7ce5c1de4565 req-058d8ea0-9382-4c6f-a0c9-39855dc12c50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051425 Oct 28 10:03:38.520874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1655/3316] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:38.611457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:38.612576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:38.628853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.629213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.630250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.633967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.634853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.635538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.743500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:38.767902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:38.768679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:38.772381 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4573c349-b4c9-4502-9149-040ebcc333a4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1266 microversion: 2.1 time: 0.166135 Oct 28 10:03:38.780637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.781512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.782201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.783309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.784046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.784939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.801244 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1662/3317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:38 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:38.924982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:38.926016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:38.938134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.939121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.941900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:38.942912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:38.958266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:38.958929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:39.021738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:39.033325 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-de08e832-7c2c-42e5-895f-a85cdbd0ca35 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.271002 Oct 28 10:03:39.034564 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1656/3318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:38 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:39.038403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:39.038958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:39.039398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:39.040861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lazy-loading 'fault' on Instance uuid 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:03:39.074269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:39.074892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:39.087903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:39.088413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:39.088859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:39.089614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:39.090077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:39.090509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:39.101170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:39.109206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:39.110636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ab81cb775afb4c4a9da03d28e6a0e155', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07385b489b9140dc89df96c1f3edf670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:39.112193 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a4edbd9-1238-4678-b187-f19a45dbcf00 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 200 len: 1409 microversion: 2.54 time: 0.198632 Oct 28 10:03:39.113294 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1663/3319] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:38 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:03:39.338615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:39.346956 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-417580e2-014a-4146-935f-f3052509a148 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.278326 Oct 28 10:03:39.347538 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1657/3320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:39 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:39.490416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:39.491175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:39.499676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:39.500158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:39.500808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:39.501537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:39.502106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:39.502701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:39.662922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:39.673988 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9d6a882c-ce90-4755-b0d1-a8b08d728572 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1332 microversion: 2.1 time: 0.187423 Oct 28 10:03:39.675022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1664/3321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:39 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1332 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:39.802581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:39.803559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:39.822274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:39.823641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:39.824229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:39.825105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:39.826080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:39.826541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.062923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:40.064324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:40.067063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:40.073264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.073802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.074243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.074948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.075257 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ace1fc02-765d-4b9a-94aa-646ebf1c41fc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.279280 Oct 28 10:03:40.075382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.075811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.085354 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1658/3322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:39 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:40.157143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:40.157768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] [instance: 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:40.175874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.180796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.181478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.183035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.188589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.193349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.237880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] HTTP exception thrown: Instance 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 could not be found. Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Request method failure captured: Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 HTTP/1.1 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jMdPF59iLJRjK3JqsgjG86MHkiLfYjNTxtcUE7hqcPGaWSo4iu1a2NZyl3QwKK6whZeUzMd41KQxdg0yqR2QFm5b1Rme2C9AO_faDmGuGCP_5VPJuAIukJ1YuLuXF-V2VFK5Zic3Ns7eyZTlgIVoE-RfWq3E8_5hCjZS_x1i8Oc1A Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.54 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 07385b489b9140dc89df96c1f3edf670 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerShowV254Test-859529960 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07385b489b9140dc89df96c1f3edf670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/07385b489b9140dc89df96c1f3edf670"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_07385b489b9140dc89df96c1f3edf670", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/07385b489b9140dc89df96c1f3edf670"}]}] Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerShowV254Test-859529960 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 07385b489b9140dc89df96c1f3edf670 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerShowV254Test-859529960 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerShowV254Test-859529960-project Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: ab81cb775afb4c4a9da03d28e6a0e155 Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerShowV254Test-859529960-project Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 could not be found. Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4'} Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 could not be found. Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 could not be found. Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:40.239842 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:40.245238 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:40.245238 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:40.245238 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:40.245238 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:40.245238 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:40.245238 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 could not be found. Oct 28 10:03:40.245238 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:40.246510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] Returning 404 to user: Instance 6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:40.247382 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5dbffe1-0554-4101-acd0-d4cd1345d687 tempest-ServerShowV254Test-859529960 tempest-ServerShowV254Test-859529960-project] 10.222.0.16 "GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4" status: 404 len: 111 microversion: 2.54 time: 0.094589 Oct 28 10:03:40.256518 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1659/3323] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:03:40 2022] GET /compute/v2.1/servers/6dcc9ca1-4cd5-431b-8d0b-798dfe527aa4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:03:40.338882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:40.350180 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf71b109-8297-4ae8-bdd9-ee0123ef556b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.292271 Oct 28 10:03:40.350810 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1665/3324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:40 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:40.376330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:40.377179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:40.387134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.387646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.392968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.395765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.397395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.398280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.550965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4aec6c84-4865-46d0-973b-106023aef063 req-a6bf84d8-7bb8-4bae-9610-3a16394d83d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d06442d-74eb-4207-9362-555ed34ffa32", "name": "network-vif-plugged", "status": "completed", "tag": "5ecd48d6-f790-43eb-81b4-e47d04989e7d"}, {"server_uuid": "fdebd876-8db0-419a-a3b6-34959a10e80b", "name": "network-vif-plugged", "status": "completed", "tag": "5f9534b7-7e21-4ad7-afcb-260c0f973c13"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:40.572435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4aec6c84-4865-46d0-973b-106023aef063 req-a6bf84d8-7bb8-4bae-9610-3a16394d83d4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.573160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4aec6c84-4865-46d0-973b-106023aef063 req-a6bf84d8-7bb8-4bae-9610-3a16394d83d4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.573596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4aec6c84-4865-46d0-973b-106023aef063 req-a6bf84d8-7bb8-4bae-9610-3a16394d83d4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.602442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4aec6c84-4865-46d0-973b-106023aef063 req-a6bf84d8-7bb8-4bae-9610-3a16394d83d4 service nova] Creating event network-vif-plugged:5ecd48d6-f790-43eb-81b4-e47d04989e7d for instance 2d06442d-74eb-4207-9362-555ed34ffa32 on n-h1-zed-1 Oct 28 10:03:40.602960 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4aec6c84-4865-46d0-973b-106023aef063 req-a6bf84d8-7bb8-4bae-9610-3a16394d83d4 service nova] Creating event network-vif-plugged:5f9534b7-7e21-4ad7-afcb-260c0f973c13 for instance fdebd876-8db0-419a-a3b6-34959a10e80b on n-h2-zed-1 Oct 28 10:03:40.613441 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4aec6c84-4865-46d0-973b-106023aef063 req-a6bf84d8-7bb8-4bae-9610-3a16394d83d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.065938 Oct 28 10:03:40.614709 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1666/3325] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:03:40.637106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:40.647003 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7111ac88-dd6c-49e0-9d76-937cf0fd4e9a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.277964 Oct 28 10:03:40.648154 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1660/3326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:40 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:40.699879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:40.701452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:40.714896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.716146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.717885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:40.719974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:40.720720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:40.722109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.092035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1f6d31f3-49eb-4b2c-90ee-6f8d56b13c44 req-1c894afe-0c6c-4b49-9a58-c9c3d8774203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3233b1da-fccc-4e96-923f-859d06eb3be8", "tag": "470b2ede-750d-46ab-b5ac-adcece51546c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:41.105021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1f6d31f3-49eb-4b2c-90ee-6f8d56b13c44 req-1c894afe-0c6c-4b49-9a58-c9c3d8774203 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:41.105633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1f6d31f3-49eb-4b2c-90ee-6f8d56b13c44 req-1c894afe-0c6c-4b49-9a58-c9c3d8774203 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:41.106305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1f6d31f3-49eb-4b2c-90ee-6f8d56b13c44 req-1c894afe-0c6c-4b49-9a58-c9c3d8774203 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.109874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:41.125028 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1f6d31f3-49eb-4b2c-90ee-6f8d56b13c44 req-1c894afe-0c6c-4b49-9a58-c9c3d8774203 service nova] Creating event network-changed:470b2ede-750d-46ab-b5ac-adcece51546c for instance 3233b1da-fccc-4e96-923f-859d06eb3be8 on n-h2-zed-1 Oct 28 10:03:41.128610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4fea84ed-e2e2-4b1a-b97b-d48c0efec08e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1536 microversion: 2.1 time: 0.434076 Oct 28 10:03:41.130761 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1667/3327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:40 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1536 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:41.147437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:41.150652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:41.154431 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1f6d31f3-49eb-4b2c-90ee-6f8d56b13c44 req-1c894afe-0c6c-4b49-9a58-c9c3d8774203 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065661 Oct 28 10:03:41.156049 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1661/3328] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:03:41.163668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b78b1d1c-a754-48d8-b220-ca04540fea52 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'create', calling method: .version_select at 0x7fca3b9c0820>, body: {"pool": "9db80090-5c04-405d-b3ea-0727931e1e52"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:41.184011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:41.185079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:41.185753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.186701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:41.187247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:41.187596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.411676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:41.422732 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-88134940-d1ff-4108-b863-fbd324e0d91d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.290430 Oct 28 10:03:41.423684 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1668/3329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:41 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:41.428627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:41.429492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:41.444309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:41.444309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:41.444309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.445262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:41.445553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:41.446530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.625932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:41.635808 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8977d2e4-65d6-4b10-9214-eb4b509287de tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1325 microversion: 2.1 time: 0.210647 Oct 28 10:03:41.644582 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1669/3330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:41 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:41.672333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:41.673231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:41.680377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:41.681138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:41.682254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.683235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:41.683399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:41.684056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:41.843735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:41.855110 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9a0e809-43ab-4eeb-9839-95ec59e3cb1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1308 microversion: 2.1 time: 0.187967 Oct 28 10:03:41.857058 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1670/3331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:41 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1308 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:42.446272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:42.447188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:42.458042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:42.458544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:42.458988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:42.459701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:42.462324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:42.462989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:42.778790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:42.790188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8be11678-10b3-43e5-8ddb-2aa814661d9a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.347789 Oct 28 10:03:42.806798 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1671/3332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:42 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:42.814978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:42.816266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:42.826911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:42.827669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:42.828927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:42.829904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:42.830577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:42.831240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.174058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:43.184098 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9af5dca5-1b48-480c-9e4a-458fd226791e tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1522 microversion: 2.1 time: 0.375298 Oct 28 10:03:43.185672 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1672/3333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:42 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:43.191118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:43.192670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:43.206924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.207801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.208551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.209600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.210367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.213139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.372058 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b78b1d1c-a754-48d8-b220-ca04540fea52 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.214340 Oct 28 10:03:43.373118 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1662/3334] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 10:03:41 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:43.378796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:43.380285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:43.389184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.389775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.390968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.392372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.392946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.393913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.434242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:03:43.536790 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48262587-0128-41cc-927d-1962e92473fa tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 204 len: 0 microversion: 2.1 time: 0.161750 Oct 28 10:03:43.537648 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1663/3335] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:43 2022] DELETE /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:03:43.544948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.199"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:43.547941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:43.556393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.556393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.556824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.557992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.558669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.559310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.596350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:03:43.596695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquired lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:03:43.619625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:43.629681 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f3c697ee-8dd8-4d79-bed1-ade8caae86c4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1486 microversion: 2.1 time: 0.442726 Oct 28 10:03:43.630553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1673/3336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:43 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1486 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:43.643860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:43.645530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:43.652449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.653341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.654062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:43.655314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:43.656155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:43.659954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:44.242045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:44.251178 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c26c9a0-2787-45c4-b51d-4f5b04026a24 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1528 microversion: 2.1 time: 0.619362 Oct 28 10:03:44.252398 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1674/3337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:43 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1528 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:44.259282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:44.260109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:44.266486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:44.267280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:44.267933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:44.268855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:44.269554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:44.270199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:44.302360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:44.364736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22ac3de5-931c-495e-92fa-f4abc01cbba5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32/action" status: 202 len: 0 microversion: 2.1 time: 0.110319 Oct 28 10:03:44.365640 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1675/3338] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:03:44 2022] POST /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:03:44.399392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:44.400643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:44.430505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:44.432527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:44.433987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:44.435912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:44.436796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:44.436976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:44.877116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:44.891227 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd8c846a-33fd-44ae-8e79-90c4b11f691e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.523901 Oct 28 10:03:44.893362 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1676/3339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:44 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:44.900756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:44.901785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:44.910535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:44.912182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:44.913192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:44.914864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:44.915484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:44.916084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:45.142223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:45.150732 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9a2f2b42-43f5-4f27-b155-e7b86b4c3ee0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 200 len: 1471 microversion: 2.1 time: 0.255777 Oct 28 10:03:45.152063 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1677/3340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:44 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 1471 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:45.174027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1390010540"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:45.176765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:45.184138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:45.184853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:45.185805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:45.186880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:45.187638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:45.188285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:45.297792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Building network info cache for instance {{(pid=128747) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:03:45.548282 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-740d3d6c-c5fd-45c7-bc6c-615e1b782c03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32/action" status: 202 len: 0 microversion: 2.1 time: 0.378101 Oct 28 10:03:45.554541 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1678/3341] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:03:45 2022] POST /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 28 10:03:45.571531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:45.572253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:45.605191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:45.606287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:45.606963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:45.607897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:45.608511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:45.609421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:45.925039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:45.940677 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d029b1a9-6e68-44a8-89b7-6a8416e3e37c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1528 microversion: 2.1 time: 0.382670 Oct 28 10:03:45.942667 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1679/3342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:45 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1528 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:45.952605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-46d3b3a5-e0f6-4048-a93a-4846f38e336c req-4e99a393-7832-459a-8522-b339ce81911c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6", "tag": "0ee719de-862d-4e3a-82a8-3b41475f5b2f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:45.966897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-46d3b3a5-e0f6-4048-a93a-4846f38e336c req-4e99a393-7832-459a-8522-b339ce81911c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:45.967776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-46d3b3a5-e0f6-4048-a93a-4846f38e336c req-4e99a393-7832-459a-8522-b339ce81911c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:45.968408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-46d3b3a5-e0f6-4048-a93a-4846f38e336c req-4e99a393-7832-459a-8522-b339ce81911c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:45.983917 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-46d3b3a5-e0f6-4048-a93a-4846f38e336c req-4e99a393-7832-459a-8522-b339ce81911c service nova] Creating event network-changed:0ee719de-862d-4e3a-82a8-3b41475f5b2f for instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 on n-h1-zed-1 Oct 28 10:03:45.990210 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-46d3b3a5-e0f6-4048-a93a-4846f38e336c req-4e99a393-7832-459a-8522-b339ce81911c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045618 Oct 28 10:03:45.991391 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1680/3343] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:45.996870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c5ada2d-34c5-4937-b264-58e5b575deb2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca324c4c10>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:46.067762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c5ada2d-34c5-4937-b264-58e5b575deb2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.074889 Oct 28 10:03:46.068587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1681/3344] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:45 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:46.078641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:46.081870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:46.094671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:46.095166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:46.100465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:46.101468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:46.102058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:46.103614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:46.369291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:46.381650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12f42c42-c18a-4613-9527-b86539eb565f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.309295 Oct 28 10:03:46.403376 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1682/3345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:46 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:46.965875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:46.966558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:46.985393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:46.988622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:46.990017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:47.000797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:47.003310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:47.004390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:47.276879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Updating instance_info_cache with network_info: [{"id": "0ee719de-862d-4e3a-82a8-3b41475f5b2f", "address": "fa:16:3e:6e:62:59", "network": {"id": "9ac107bd-0d69-41cf-a8fd-73f28562cf8d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1077438460-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cb09627a84e44334b45c8828d00f255a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0ee719de-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128747) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:03:47.307860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Releasing lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:03:47.309642 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5292686e-e9d0-4356-902d-6e9c28c08ef8 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action" status: 202 len: 0 microversion: 2.1 time: 3.769195 Oct 28 10:03:47.311455 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1664/3346] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:03:43 2022] POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action => generated 0 bytes in 3773 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:03:47.327154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23749257-e5f5-491d-a55a-c9c3c0aa8bcc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32fb1310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:47.364469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:47.370020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:47.386233 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0cac1067-d909-4f96-94c8-979a31f73d5c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1528 microversion: 2.1 time: 0.426347 Oct 28 10:03:47.391755 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23749257-e5f5-491d-a55a-c9c3c0aa8bcc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.078900 Oct 28 10:03:47.392953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1665/3347] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:47 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:47.403207 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1683/3348] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:46 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1528 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:47.411037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b2b6e6e4-5d2a-4099-8de8-09eff1f65c1f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'create', calling method: .version_select at 0x7fca3307ce50>, body: {"pool": "9db80090-5c04-405d-b3ea-0727931e1e52"} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:47.415188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:47.415814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:47.425261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:47.425765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:47.426210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:47.426928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:47.427387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:47.427818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:47.578260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=7 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:47.935540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:47.947284 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0029988c-2e72-497f-bd83-64d623187284 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.540579 Oct 28 10:03:47.962772 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1684/3349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:47 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:48.424706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2857448c-b830-4ce2-bf94-e134f4c30e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca324f21f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:48.518787 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2857448c-b830-4ce2-bf94-e134f4c30e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.112369 Oct 28 10:03:48.519392 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1685/3350] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:48 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:48.556371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:48.556935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:48.588035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:48.589392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:48.589943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:48.590710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:48.591268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:48.591694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:48.957911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:48.967406 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-86594f0c-97bf-4e09-92de-c9a575b09d1c tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1528 microversion: 2.1 time: 0.446954 Oct 28 10:03:48.973203 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1686/3351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:48 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1528 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:48.981278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:48.983389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:49.002727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:49.003125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:49.003575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:49.004292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:49.012982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:49.013451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:49.261500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:49.270240 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2778235-0e5e-4c4d-ad6f-2c8247a2f1fe tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.295528 Oct 28 10:03:49.272682 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1687/3352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:48 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:49.485437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4b2fd8c-2df0-4ac3-984e-2c379c82f211 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Action: 'create', calling method: .version_select at 0x7fca32b5a5e0>, body: {"keypair": {"name": "tempest-keypair-1790629120", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK0mijXDPDoMnDCNr/DdQVEFWy2vR2ikPsSNdceKATvwnqs+ds0fxV+aJSVkG+n/JfXNhmuVHUxSVMw0WIumClL1oWJmrvLoa3JqUxCnkXY29ApP6XWViZHOV0deISq7ww=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:49.506433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:49.524693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e4b2fd8c-2df0-4ac3-984e-2c379c82f211 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Getting quotas for project 2e1adf828480437ea6595561c912d9bf. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:03:49.531851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e4b2fd8c-2df0-4ac3-984e-2c379c82f211 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Getting quotas for user b125e9d6136447169f052690eeaab064 and project 2e1adf828480437ea6595561c912d9bf. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:03:49.574344 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4b2fd8c-2df0-4ac3-984e-2c379c82f211 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.300166 Oct 28 10:03:49.576809 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1688/3353] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:03:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:49.584005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8969b9b-d8a3-4f00-a172-c8166af06267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3243fca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:49.667536 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8969b9b-d8a3-4f00-a172-c8166af06267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.089021 Oct 28 10:03:49.675495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1689/3354] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:49 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:49.998486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:49.999442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:50.046033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:50.052097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:50.052654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:50.062304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:50.063098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:50.063749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:50.377740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28313b7c89184dd683e3479d23be489d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3be0ab02a95a48628dd5f9f1ac2f4596', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:50.390018 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e68a038c-a901-4af3-a63b-e2020e59fbc6 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 200 len: 1310 microversion: 2.1 time: 0.397240 Oct 28 10:03:50.399695 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1690/3355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:49 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 1310 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:50.416500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6b62613c-7504-4d82-98ac-8a982c458351 req-2c410d45-4735-4cb0-83c2-326f6da05133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdebd876-8db0-419a-a3b6-34959a10e80b", "name": "network-vif-deleted", "tag": "5f9534b7-7e21-4ad7-afcb-260c0f973c13"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:50.459665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6b62613c-7504-4d82-98ac-8a982c458351 req-2c410d45-4735-4cb0-83c2-326f6da05133 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:50.460175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6b62613c-7504-4d82-98ac-8a982c458351 req-2c410d45-4735-4cb0-83c2-326f6da05133 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:50.472364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6b62613c-7504-4d82-98ac-8a982c458351 req-2c410d45-4735-4cb0-83c2-326f6da05133 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:50.514368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6b62613c-7504-4d82-98ac-8a982c458351 req-2c410d45-4735-4cb0-83c2-326f6da05133 service nova] Creating event network-vif-deleted:5f9534b7-7e21-4ad7-afcb-260c0f973c13 for instance fdebd876-8db0-419a-a3b6-34959a10e80b on n-h2-zed-1 Oct 28 10:03:50.553905 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6b62613c-7504-4d82-98ac-8a982c458351 req-2c410d45-4735-4cb0-83c2-326f6da05133 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136292 Oct 28 10:03:50.555148 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1691/3356] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:50.561206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:50.562170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:50.571823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:50.572620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:50.573260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:50.574149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:50.574865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:50.575444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:51.017898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:51.031007 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cac1a35d-f429-4828-806c-033357895ea4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.471051 Oct 28 10:03:51.032172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1692/3357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:50 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:51.047633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f63a4136-56e6-45da-945e-f1fd95e49cf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca324a9040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:51.192544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f63a4136-56e6-45da-945e-f1fd95e49cf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.150621 Oct 28 10:03:51.194439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1693/3358] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:51 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:51.426973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:51.428183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: fdebd876-8db0-419a-a3b6-34959a10e80b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:51.450435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:51.450935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:51.451377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:51.452102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:51.452558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:51.453010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:51.520111 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Instance fdebd876-8db0-419a-a3b6-34959a10e80b could not be found. Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b HTTP/1.1 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance fdebd876-8db0-419a-a3b6-34959a10e80b could not be found. Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'fdebd876-8db0-419a-a3b6-34959a10e80b'} Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdebd876-8db0-419a-a3b6-34959a10e80b could not be found. Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdebd876-8db0-419a-a3b6-34959a10e80b could not be found. Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.525919 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdebd876-8db0-419a-a3b6-34959a10e80b could not be found. Oct 28 10:03:51.531133 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.535644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Instance fdebd876-8db0-419a-a3b6-34959a10e80b could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:51.537066 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-44946886-cdfa-4b77-a4de-2f4446a0e1b8 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b" status: 404 len: 111 microversion: 2.1 time: 0.116882 Oct 28 10:03:51.538312 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1694/3359] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:51 2022] GET /compute/v2.1/servers/fdebd876-8db0-419a-a3b6-34959a10e80b => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:51.561544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c12c3120-75cb-4164-856b-b5458163f25b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '.version_select at 0x7fca324d8790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:51.597521 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c12c3120-75cb-4164-856b-b5458163f25b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Image not found. Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c12c3120-75cb-4164-856b-b5458163f25b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a HTTP/1.1 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '04bc87d4-62ef-4d03-a4f2-6fba45d4a14a'} Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 04bc87d4-62ef-4d03-a4f2-6fba45d4a14a to delete Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 04bc87d4-62ef-4d03-a4f2-6fba45d4a14a could not be found. Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.606865 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.611624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c12c3120-75cb-4164-856b-b5458163f25b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:51.614336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c12c3120-75cb-4164-856b-b5458163f25b tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a" status: 404 len: 62 microversion: 2.1 time: 0.069262 Oct 28 10:03:51.617379 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1695/3360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:51 2022] DELETE /compute/v2.1/images/04bc87d4-62ef-4d03-a4f2-6fba45d4a14a => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:03:51.625274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:51.626110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:51.637096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:51.637709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:51.638481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:51.639701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:51.640420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:51.641119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:51.675771 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a HTTP/1.1 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e129b38a-00a7-4bc9-8c47-64b85413622a'} Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:51.690049 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.694903 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.700282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:51.704046 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cda016a5-9ec3-4c06-a361-68cd45ce322f tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 404 len: 111 microversion: 2.1 time: 0.085459 Oct 28 10:03:51.712243 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1696/3361] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:51 2022] DELETE /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:51.737710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:51.742417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: e129b38a-00a7-4bc9-8c47-64b85413622a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:51.759795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:51.763659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:51.765581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:51.766837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:51.767597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:51.768216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:51.803542 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a HTTP/1.1 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e129b38a-00a7-4bc9-8c47-64b85413622a'} Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.806244 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. Oct 28 10:03:51.812115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:03:51.814571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Instance e129b38a-00a7-4bc9-8c47-64b85413622a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:51.819446 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3348afde-b3c7-4bee-b743-c347df578a43 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a" status: 404 len: 111 microversion: 2.1 time: 0.105681 Oct 28 10:03:51.821946 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1697/3362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:51 2022] GET /compute/v2.1/servers/e129b38a-00a7-4bc9-8c47-64b85413622a => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:51.828991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae764a07-ddff-4752-afb7-0747e4d69167 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '.version_select at 0x7fca3249c9d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:51.856213 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae764a07-ddff-4752-afb7-0747e4d69167 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-868516986" status: 202 len: 0 microversion: 2.1 time: 0.030600 Oct 28 10:03:51.859980 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1698/3363] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:03:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-868516986 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:03:52.059761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:52.060774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:52.073392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:52.073990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:52.075530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:52.081686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:52.082283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:52.082818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:52.239657 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b2b6e6e4-5d2a-4099-8de8-09eff1f65c1f tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.837474 Oct 28 10:03:52.240274 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1666/3364] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 10:03:47 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:52.254656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4244230c-aeb8-4db4-a4d6-29021d326dd8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3301b670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:52.306439 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4244230c-aeb8-4db4-a4d6-29021d326dd8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.064860 Oct 28 10:03:52.307734 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1667/3365] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:52 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:52.314399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.214"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:52.317625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:52.326844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:52.327555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:52.328175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:52.329278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:52.329913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:52.330516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:52.372886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:03:52.373357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquired lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:03:52.863015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:52.871465 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e92f58a9-6b47-42c8-bd22-eb617bf1dc8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.815636 Oct 28 10:03:52.894228 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1699/3366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:52 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:53.251942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG neutronclient.v2_0.client [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52.", "detail": ""}} {{(pid=128747) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:03:53.253352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Releasing lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:03:53.254128 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] HTTP exception thrown: Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52. Oct 28 10:03:53.254128 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-dc369b03-65df-461a-8151-df567c836a76'] Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Request method failure captured: Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action HTTP/1.1 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 46 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jkaLyC4kIYhcaSNtBwzr3Ys_ye0TAGksRWjoFxgtNjmgwy3_DgyYnTFhbHoBAFETx2jmKHVbpzng_BFmjpB1v7om80ZuQTbWYpVjYr-Xnxo5GVxVqkYkMAM4ty5rjcWjYzA-NCTznnefIO0KnRymf6ttvA6jYTjc889lWYE88YnlU Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb09627a84e44334b45c8828d00f255a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb09627a84e44334b45c8828d00f255a"}]}] Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 7d34514faf454e7996cb87e2bc6847a2 Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: {"addFloatingIp": {"address": "172.35.7.214"}} Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: exception: Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52. Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-dc369b03-65df-461a-8151-df567c836a76'] Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6', 'body': {'addFloatingIp': {'address': '172.35.7.214'}}} Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:03:53.256571 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52. Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc369b03-65df-461a-8151-df567c836a76'] Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52. Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc369b03-65df-461a-8151-df567c836a76'] Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52. Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc369b03-65df-461a-8151-df567c836a76'] Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52. Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dc369b03-65df-461a-8151-df567c836a76'] Oct 28 10:03:53.264417 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:53.275117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Returning 400 to user: Cannot associate floating IP 172.35.7.214 (3e11e923-24ee-4d09-8a71-cc9aab2f9c93) with port 0ee719de-862d-4e3a-82a8-3b41475f5b2f using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 9db80090-5c04-405d-b3ea-0727931e1e52. Oct 28 10:03:53.275117 n-d-zed-1 devstack@n-api.service[128747]: Neutron server returns request_ids: ['req-dc369b03-65df-461a-8151-df567c836a76'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:53.275117 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e28795a4-a63a-4139-a5b7-497ba8c6a2d7 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action" status: 400 len: 381 microversion: 2.1 time: 0.964977 Oct 28 10:03:53.276132 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1668/3367] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:03:52 2022] POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action => generated 381 bytes in 968 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:03:53.284427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9eba57af-2e92-4ca5-b47e-f843c0e40861 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '.version_select at 0x7fca324fb790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:53.323819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-667aabf8-0ecc-43ce-b70f-3a65aac9d4c2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3301baf0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:53.387780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-667aabf8-0ecc-43ce-b70f-3a65aac9d4c2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.068512 Oct 28 10:03:53.390845 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1669/3368] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:53 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:53.861993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5711d4cf-0e9e-42bd-9244-e34b6807f5fd req-9882616c-f9c9-4a99-b187-aa852e9a459f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d06442d-74eb-4207-9362-555ed34ffa32", "name": "network-vif-plugged", "status": "completed", "tag": "5ecd48d6-f790-43eb-81b4-e47d04989e7d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:53.903733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5711d4cf-0e9e-42bd-9244-e34b6807f5fd req-9882616c-f9c9-4a99-b187-aa852e9a459f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:53.909252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5711d4cf-0e9e-42bd-9244-e34b6807f5fd req-9882616c-f9c9-4a99-b187-aa852e9a459f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:53.909777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5711d4cf-0e9e-42bd-9244-e34b6807f5fd req-9882616c-f9c9-4a99-b187-aa852e9a459f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:53.932671 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5711d4cf-0e9e-42bd-9244-e34b6807f5fd req-9882616c-f9c9-4a99-b187-aa852e9a459f service nova] Creating event network-vif-plugged:5ecd48d6-f790-43eb-81b4-e47d04989e7d for instance 2d06442d-74eb-4207-9362-555ed34ffa32 on n-h1-zed-1 Oct 28 10:03:53.940969 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5711d4cf-0e9e-42bd-9244-e34b6807f5fd req-9882616c-f9c9-4a99-b187-aa852e9a459f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083202 Oct 28 10:03:53.941706 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1670/3369] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:03:53.956874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:53.961154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:53.978806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:53.982582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:53.986988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:53.987788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:53.988275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:53.989515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:54.284739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:54.312458 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45c118e9-eee0-46a8-8498-641263bd0f1b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.359838 Oct 28 10:03:54.313497 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1671/3370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:53 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:54.406864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8cd9d09b-6905-4aad-8fe6-a55e98c20b7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3313aee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:54.475134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8cd9d09b-6905-4aad-8fe6-a55e98c20b7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.073026 Oct 28 10:03:54.476674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1672/3371] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:54 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:55.338648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:55.343534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:55.354566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:55.355624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:55.356418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:55.357354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:55.357972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:55.358572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:55.705629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:55.726248 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4dc7cdc-1632-4410-9d46-65523d9b5d8f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.394020 Oct 28 10:03:55.759268 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1673/3372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:55 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:55.775680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37735008-1c61-4914-a026-594d39575375 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3313adc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:55.934369 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37735008-1c61-4914-a026-594d39575375 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1414 microversion: 2.1 time: 0.154458 Oct 28 10:03:55.938934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1674/3373] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:55 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1414 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:03:55.995990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ec270bc5-b77d-43f8-9710-516ab5b3869e req-4db6b049-5317-4616-a273-ba34d5d1336e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3233b1da-fccc-4e96-923f-859d06eb3be8", "name": "network-vif-plugged", "status": "completed", "tag": "470b2ede-750d-46ab-b5ac-adcece51546c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:56.017218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ec270bc5-b77d-43f8-9710-516ab5b3869e req-4db6b049-5317-4616-a273-ba34d5d1336e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:56.017867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ec270bc5-b77d-43f8-9710-516ab5b3869e req-4db6b049-5317-4616-a273-ba34d5d1336e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:56.019202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ec270bc5-b77d-43f8-9710-516ab5b3869e req-4db6b049-5317-4616-a273-ba34d5d1336e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:56.051130 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ec270bc5-b77d-43f8-9710-516ab5b3869e req-4db6b049-5317-4616-a273-ba34d5d1336e service nova] Creating event network-vif-plugged:470b2ede-750d-46ab-b5ac-adcece51546c for instance 3233b1da-fccc-4e96-923f-859d06eb3be8 on n-h2-zed-1 Oct 28 10:03:56.070808 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ec270bc5-b77d-43f8-9710-516ab5b3869e req-4db6b049-5317-4616-a273-ba34d5d1336e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080168 Oct 28 10:03:56.080071 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1675/3374] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:03:56.280168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-450d80ee-f85d-4f7f-a331-2fc01e33e281 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '.version_select at 0x7fca330593a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:56.321590 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-450d80ee-f85d-4f7f-a331-2fc01e33e281 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Image not found. Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-450d80ee-f85d-4f7f-a331-2fc01e33e281 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/images/06f3b20c-fd8b-4120-965e-71d26cfe6136 HTTP/1.1 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '06f3b20c-fd8b-4120-965e-71d26cfe6136'} Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 06f3b20c-fd8b-4120-965e-71d26cfe6136 to delete Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06f3b20c-fd8b-4120-965e-71d26cfe6136 could not be found. Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:56.323837 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:03:56.328730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.330710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-450d80ee-f85d-4f7f-a331-2fc01e33e281 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:56.331805 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-450d80ee-f85d-4f7f-a331-2fc01e33e281 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/images/06f3b20c-fd8b-4120-965e-71d26cfe6136" status: 404 len: 62 microversion: 2.1 time: 0.060042 Oct 28 10:03:56.336093 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1676/3375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:56 2022] DELETE /compute/v2.1/images/06f3b20c-fd8b-4120-965e-71d26cfe6136 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:03:56.345880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:56.346814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:56.357312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:56.358269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:56.358917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:56.360738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:56.361603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:56.362916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:56.397645 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 HTTP/1.1 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0210ec12-d8b3-4557-8b38-a57d74f96fd0'} Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:56.401108 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.405831 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.412358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:56.413457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a39c934c-5d7c-4275-a7b2-031a83f74978 tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 404 len: 111 microversion: 2.1 time: 0.075357 Oct 28 10:03:56.419001 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1677/3376] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:03:56 2022] DELETE /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:56.431699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:56.432254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] [instance: 0210ec12-d8b3-4557-8b38-a57d74f96fd0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:56.446169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:56.447790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:56.463327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:56.463327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:56.463327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:56.463327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:56.475364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:56.499046 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] HTTP exception thrown: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Request method failure captured: Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 HTTP/1.1 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6iBXuEYx3nItSOpjTi--hNtZvKvPoS2WpGHuK-JEtA7AJrhmZz0jdlKbiZSsBM1IRZGgPJfT56UUyinn1HH3P7dgMwML0MxSERC55DV7qd0M1lHWlRCaQKjMtmrBeZ3lYtylHv5GJey0GW562go_LicO1dYo3fx0ifvOHli4LfRyFA Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3be0ab02a95a48628dd5f9f1ac2f4596"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3be0ab02a95a48628dd5f9f1ac2f4596", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3be0ab02a95a48628dd5f9f1ac2f4596"}]}] Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3be0ab02a95a48628dd5f9f1ac2f4596 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-982746032 Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 28313b7c89184dd683e3479d23be489d Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-982746032-project Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0210ec12-d8b3-4557-8b38-a57d74f96fd0'} Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.501133 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] Returning 404 to user: Instance 0210ec12-d8b3-4557-8b38-a57d74f96fd0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e265b0d-23fb-4dbe-a08d-c80d67dbbe2a tempest-ImagesOneServerNegativeTestJSON-982746032 tempest-ImagesOneServerNegativeTestJSON-982746032-project] 10.222.0.16 "GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0" status: 404 len: 111 microversion: 2.1 time: 0.084050 Oct 28 10:03:56.505475 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1678/3377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:56 2022] GET /compute/v2.1/servers/0210ec12-d8b3-4557-8b38-a57d74f96fd0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:56.798333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:56.925739 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9eba57af-2e92-4ca5-b47e-f843c0e40861 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/3e11e923-24ee-4d09-8a71-cc9aab2f9c93" status: 202 len: 0 microversion: 2.1 time: 3.645141 Oct 28 10:03:56.926672 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1700/3378] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:03:53 2022] DELETE /compute/v2.1/os-floating-ips/3e11e923-24ee-4d09-8a71-cc9aab2f9c93 => generated 0 bytes in 3647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:03:56.935453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.7.199"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:03:57.113419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:03:57.130006 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8debb409-0f9c-4820-b8e0-56c3a8badb7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1314 microversion: 2.1 time: 0.376182 Oct 28 10:03:57.131669 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1679/3379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:03:56 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1314 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:03:57.143166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9cda819c-90b7-4f09-b6b4-f24c83e691ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3301b040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:03:57.625749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:03:57.644528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:57.645137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:57.646588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:57.648752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:03:57.649832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:03:57.658826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:03:57.698385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:03:58.373337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:03:58.373961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquired lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:03:59.541603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:00.058348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Building network info cache for instance {{(pid=128748) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:04:01.239104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Updating instance_info_cache with network_info: [{"id": "0ee719de-862d-4e3a-82a8-3b41475f5b2f", "address": "fa:16:3e:6e:62:59", "network": {"id": "9ac107bd-0d69-41cf-a8fd-73f28562cf8d", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1077438460-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "cb09627a84e44334b45c8828d00f255a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap0ee719de-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:04:01.278951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Releasing lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:04:01.283464 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b886b1f-e3df-4440-a683-3e42f988689e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action" status: 202 len: 0 microversion: 2.1 time: 4.351118 Oct 28 10:04:01.292473 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1701/3380] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:03:56 2022] POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action => generated 0 bytes in 4360 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 28 10:04:01.307511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:01.309571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:01.319628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:01.320482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:01.321486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:01.322638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:01.324036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:01.325494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:01.697960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:01.717769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0dbdb0d-b8c7-4379-89a0-aa031b4f930d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1502 microversion: 2.1 time: 0.420214 Oct 28 10:04:01.720270 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1702/3381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:01 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1502 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:01.725578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9607d5db-0f58-4c6b-a7f2-bf22d1f08dea req-0bc4ca87-11ba-4aaf-845a-9ab9cb71fa7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6", "tag": "0ee719de-862d-4e3a-82a8-3b41475f5b2f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:01.757792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9607d5db-0f58-4c6b-a7f2-bf22d1f08dea req-0bc4ca87-11ba-4aaf-845a-9ab9cb71fa7b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:01.774584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9607d5db-0f58-4c6b-a7f2-bf22d1f08dea req-0bc4ca87-11ba-4aaf-845a-9ab9cb71fa7b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:01.775377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9607d5db-0f58-4c6b-a7f2-bf22d1f08dea req-0bc4ca87-11ba-4aaf-845a-9ab9cb71fa7b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:01.808208 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9607d5db-0f58-4c6b-a7f2-bf22d1f08dea req-0bc4ca87-11ba-4aaf-845a-9ab9cb71fa7b service nova] Creating event network-changed:0ee719de-862d-4e3a-82a8-3b41475f5b2f for instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 on n-h1-zed-1 Oct 28 10:04:01.834309 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9607d5db-0f58-4c6b-a7f2-bf22d1f08dea req-0bc4ca87-11ba-4aaf-845a-9ab9cb71fa7b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097244 Oct 28 10:04:01.835330 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1703/3382] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:01.870813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9794cb99-07ec-4559-b8a3-5fb0d7d94896 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '.version_select at 0x7fca324a9af0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:04.119829 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9794cb99-07ec-4559-b8a3-5fb0d7d94896 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/408f763c-d8a6-41e4-8c9b-8845de080409" status: 202 len: 0 microversion: 2.1 time: 2.281669 Oct 28 10:04:04.121480 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1704/3383] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:04:01 2022] DELETE /compute/v2.1/os-floating-ips/408f763c-d8a6-41e4-8c9b-8845de080409 => generated 0 bytes in 2285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:04:04.130891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63de9237-8ead-4c82-b0f8-d80fef0db40d tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63de9237-8ead-4c82-b0f8-d80fef0db40d tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Request method failure captured: Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action HTTP/1.1 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 34 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jkaLyC4kIYhcaSNtBwzr3Ys_ye0TAGksRWjoFxgtNjmgwy3_DgyYnTFhbHoBAFETx2jmKHVbpzng_BFmjpB1v7om80ZuQTbWYpVjYr-Xnxo5GVxVqkYkMAM4ty5rjcWjYzA-NCTznnefIO0KnRymf6ttvA6jYTjc889lWYE88YnlU Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb09627a84e44334b45c8828d00f255a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb09627a84e44334b45c8828d00f255a"}]}] Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 7d34514faf454e7996cb87e2bc6847a2 Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: {"addFloatingIp": {"address": ""}} Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6', 'body': {'addFloatingIp': {'address': ''}}} Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '' Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:04:04.137835 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 28 10:04:04.144200 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.146781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63de9237-8ead-4c82-b0f8-d80fef0db40d tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:04.148485 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63de9237-8ead-4c82-b0f8-d80fef0db40d tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action" status: 400 len: 142 microversion: 2.1 time: 0.022123 Oct 28 10:04:04.149312 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1705/3384] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:04:04 2022] POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action => generated 142 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 10:04:04.165566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:04.192565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:04.216239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:04.217423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:04.223650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:04.224686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:04.227820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:04.228600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:04.299920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:04:04.300736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquired lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:04:04.524218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Releasing lock "refresh_cache-afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" {{(pid=128748) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:04:04.525058 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] HTTP exception thrown: floating IP not found Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Request method failure captured: Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action HTTP/1.1 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 41 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jkaLyC4kIYhcaSNtBwzr3Ys_ye0TAGksRWjoFxgtNjmgwy3_DgyYnTFhbHoBAFETx2jmKHVbpzng_BFmjpB1v7om80ZuQTbWYpVjYr-Xnxo5GVxVqkYkMAM4ty5rjcWjYzA-NCTznnefIO0KnRymf6ttvA6jYTjc889lWYE88YnlU Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb09627a84e44334b45c8828d00f255a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb09627a84e44334b45c8828d00f255a"}]}] Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 7d34514faf454e7996cb87e2bc6847a2 Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: exception: floating IP not found Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 28 10:04:04.526849 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 28 10:04:04.531402 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.533501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Returning 404 to user: floating IP not found {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:04.536068 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50cebf5b-9165-4e2f-84c7-bae3b225692b tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action" status: 404 len: 67 microversion: 2.1 time: 0.378484 Oct 28 10:04:04.537309 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1706/3385] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:04:04 2022] POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action => generated 67 bytes in 380 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:04:04.547584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fea13983-3ab9-461e-9379-09715c1c1562 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:04.698620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-fea13983-3ab9-461e-9379-09715c1c1562 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fea13983-3ab9-461e-9379-09715c1c1562 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Request method failure captured: Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action HTTP/1.1 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 44 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jkaLyC4kIYhcaSNtBwzr3Ys_ye0TAGksRWjoFxgtNjmgwy3_DgyYnTFhbHoBAFETx2jmKHVbpzng_BFmjpB1v7om80ZuQTbWYpVjYr-Xnxo5GVxVqkYkMAM4ty5rjcWjYzA-NCTznnefIO0KnRymf6ttvA6jYTjc889lWYE88YnlU Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb09627a84e44334b45c8828d00f255a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb09627a84e44334b45c8828d00f255a"}]}] Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 7d34514faf454e7996cb87e2bc6847a2 Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: exception: Floating IP not found for address 0.0.0.0. Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 28 10:04:04.701228 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 28 10:04:04.707891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:04.711003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fea13983-3ab9-461e-9379-09715c1c1562 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:04.712086 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fea13983-3ab9-461e-9379-09715c1c1562 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action" status: 404 len: 88 microversion: 2.1 time: 0.169595 Oct 28 10:04:04.713234 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1707/3386] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:04:04 2022] POST /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6/action => generated 88 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:04:04.722248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:04.723121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:04.744692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:04.746533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:04.747600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:04.751137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:04.751908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:04.753521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:04.833659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:04:05.115378 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-72c80274-e4de-4479-9afc-64b10dee5c22 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "DELETE /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 204 len: 0 microversion: 2.1 time: 0.396353 Oct 28 10:04:05.116563 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1708/3387] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:04 2022] DELETE /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:05.125954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:05.128759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:05.151480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:05.151971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:05.152586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:05.153469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:05.154067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:05.154651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:05.234727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:04:05.503286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba617359-7e55-4da3-9a40-80af317a3e68 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "DELETE /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 204 len: 0 microversion: 2.1 time: 0.384514 Oct 28 10:04:05.508191 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1709/3388] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:05 2022] DELETE /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:05.519278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87fe6493-06a5-4503-a0bd-827345f3d1bc"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:05.530608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:05.537602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:05.538486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:05.539079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:05.539951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:05.540570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:05.541189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:06.765347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:07.068122 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d98c14cf-15e0-4c02-a05e-98dca59bb0bd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.557249 Oct 28 10:04:07.073002 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1710/3389] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:04:05 2022] POST /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8/os-volume_attachments => generated 194 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:07.095448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:07.096408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:07.107064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:07.107813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:07.118670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=7 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:07.124524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:07.126319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:07.127382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:07.128334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:07.549622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:07.563491 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ed1019a-9ade-43e1-b9ff-e9e443a96d8e tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1542 microversion: 2.1 time: 0.487952 Oct 28 10:04:07.564644 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1711/3390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:07 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1542 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:07.578859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:07.579485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:07.592523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:07.593568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:07.594217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:07.597817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:07.598299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:07.599413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:07.924338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:07.976736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-362aa155-b4af-436f-9e47-2da2f069957d tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1666 microversion: 2.1 time: 0.410722 Oct 28 10:04:07.978167 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1712/3391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:07 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1666 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:08.594177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:08.597743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:08.618028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:08.618620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:08.619482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:08.621390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:08.622823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:08.624662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:08.896351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:08.909493 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6ca4709d-5404-4309-93bc-4b65926d7460 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1500 microversion: 2.1 time: 0.322651 Oct 28 10:04:08.942976 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1713/3392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:08 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1500 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:09.006137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:09.007799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:09.026035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:09.026808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:09.029070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:09.030002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:09.046956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:09.048867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:09.597296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:09.615458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1dd0fb82-89fe-4a8b-84a3-90e7476a3ab1 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1666 microversion: 2.1 time: 0.609645 Oct 28 10:04:09.619439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1714/3393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:09 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1666 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:09.635262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-904eb957-68b6-4b5a-af36-80e34a5374d5 req-eb56e0a0-000d-4fea-a261-8283b0de31c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6", "name": "network-vif-deleted", "tag": "0ee719de-862d-4e3a-82a8-3b41475f5b2f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:09.665452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-904eb957-68b6-4b5a-af36-80e34a5374d5 req-eb56e0a0-000d-4fea-a261-8283b0de31c0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:09.670716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-904eb957-68b6-4b5a-af36-80e34a5374d5 req-eb56e0a0-000d-4fea-a261-8283b0de31c0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:09.673863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-904eb957-68b6-4b5a-af36-80e34a5374d5 req-eb56e0a0-000d-4fea-a261-8283b0de31c0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:09.715084 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-904eb957-68b6-4b5a-af36-80e34a5374d5 req-eb56e0a0-000d-4fea-a261-8283b0de31c0 service nova] Creating event network-vif-deleted:0ee719de-862d-4e3a-82a8-3b41475f5b2f for instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 on n-h1-zed-1 Oct 28 10:04:09.730627 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-904eb957-68b6-4b5a-af36-80e34a5374d5 req-eb56e0a0-000d-4fea-a261-8283b0de31c0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105509 Oct 28 10:04:09.731570 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1715/3394] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:09.939900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:09.940857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:09.964882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:09.965408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:09.965847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:09.981644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:09.982265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:09.982731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:10.137198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:10.137700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:10.144014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:10.144552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lazy-loading 'fault' on Instance uuid afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:10.558121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d34514faf454e7996cb87e2bc6847a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb09627a84e44334b45c8828d00f255a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:10.558121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=5,nova_cell1:RELEASE=1,nova_cell1:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:10.595951 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5de9af62-4d98-49f3-b629-923ccbf8ac0c tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 200 len: 1322 microversion: 2.1 time: 0.661551 Oct 28 10:04:10.606437 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1716/3395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:09 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:10.674737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:10.693267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:10.728986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:10.728986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:10.729628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:10.731247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:10.733734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:10.734370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:11.160892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:11.178034 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90f7b267-1504-4b25-9c98-3b07d5cd0cb0 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1598 microversion: 2.1 time: 0.527041 Oct 28 10:04:11.183248 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1717/3396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:10 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1598 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:11.654563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:11.655234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] [instance: afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:11.670593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:11.673221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:11.675753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:11.683181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:11.686097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:11.689476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:11.743254 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] HTTP exception thrown: Instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 could not be found. Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Request method failure captured: Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 HTTP/1.1 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jkaLyC4kIYhcaSNtBwzr3Ys_ye0TAGksRWjoFxgtNjmgwy3_DgyYnTFhbHoBAFETx2jmKHVbpzng_BFmjpB1v7om80ZuQTbWYpVjYr-Xnxo5GVxVqkYkMAM4ty5rjcWjYzA-NCTznnefIO0KnRymf6ttvA6jYTjc889lWYE88YnlU Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cb09627a84e44334b45c8828d00f255a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cb09627a84e44334b45c8828d00f255a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cb09627a84e44334b45c8828d00f255a"}]}] Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cb09627a84e44334b45c8828d00f255a Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 7d34514faf454e7996cb87e2bc6847a2 Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 could not be found. Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6'} Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 could not be found. Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 could not be found. Oct 28 10:04:11.748081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 could not be found. Oct 28 10:04:11.753022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:11.758757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] Returning 404 to user: Instance afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:11.760388 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-04301a95-3614-462e-8b79-6ad0bb2a7291 tempest-FloatingIPsAssociationNegativeTestJSON-906167782 tempest-FloatingIPsAssociationNegativeTestJSON-906167782-project] 10.222.0.16 "GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6" status: 404 len: 111 microversion: 2.1 time: 0.112712 Oct 28 10:04:11.764371 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1718/3397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:11 2022] GET /compute/v2.1/servers/afc4fa7e-a6b0-4a11-b5ee-96b2b10630f6 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:11.961675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0355e555-0f3b-4b52-9cbb-b0d354b8b7b5 req-4bbb5f2e-3fcf-4c47-964f-920e85cd50eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "490b9884-a435-48a0-8744-d3dbe924ae9f", "name": "network-vif-deleted", "tag": "f8185e36-de99-4fbc-ab9d-a8fa2d3354c1"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:11.979832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0355e555-0f3b-4b52-9cbb-b0d354b8b7b5 req-4bbb5f2e-3fcf-4c47-964f-920e85cd50eb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:11.980631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0355e555-0f3b-4b52-9cbb-b0d354b8b7b5 req-4bbb5f2e-3fcf-4c47-964f-920e85cd50eb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:11.981376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0355e555-0f3b-4b52-9cbb-b0d354b8b7b5 req-4bbb5f2e-3fcf-4c47-964f-920e85cd50eb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:11.999668 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0355e555-0f3b-4b52-9cbb-b0d354b8b7b5 req-4bbb5f2e-3fcf-4c47-964f-920e85cd50eb service nova] Creating event network-vif-deleted:f8185e36-de99-4fbc-ab9d-a8fa2d3354c1 for instance 490b9884-a435-48a0-8744-d3dbe924ae9f on n-h2-zed-1 Oct 28 10:04:12.006684 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0355e555-0f3b-4b52-9cbb-b0d354b8b7b5 req-4bbb5f2e-3fcf-4c47-964f-920e85cd50eb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066519 Oct 28 10:04:12.007974 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1719/3398] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:04:12.224067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:12.225151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:12.274092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:12.275233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:12.280115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:12.282579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:12.289319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:12.291141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:12.446362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:12.451456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:12.452523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:12.453266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lazy-loading 'fault' on Instance uuid 490b9884-a435-48a0-8744-d3dbe924ae9f {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:13.211976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78e6fe2e79b54462b20619cf36ffadf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fc42ddeb5cd4170a5d01683e0605a87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:13.222028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1cfc69a-2e1d-4ed6-8ce1-585b8e6fe5c3 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 200 len: 1315 microversion: 2.1 time: 1.016699 Oct 28 10:04:13.223926 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1720/3399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:12 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 1315 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:14.247741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:14.249976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] [instance: 490b9884-a435-48a0-8744-d3dbe924ae9f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:14.268087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:14.288366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:14.292760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:14.293740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:14.297659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:14.299174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:14.364626 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] HTTP exception thrown: Instance 490b9884-a435-48a0-8744-d3dbe924ae9f could not be found. Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Request method failure captured: Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f HTTP/1.1 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6isQl8GmENJU8Wugf9EQI85BD2bQsHGoaV48rLcAIWoZQzl-UbnvH6kJ07953lr7bGF9U3-91ltWZWqhGfX7dsLQWAd52sgM_rEtxsMs2mAm4mp87N1R3H0WxkmBmP1VbKfFThenufrvgstEjl_ZO5Ar-py4OsjgntDlrb35gNrLjk Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 2fc42ddeb5cd4170a5d01683e0605a87 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestFqdnHostnames-926194504 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fc42ddeb5cd4170a5d01683e0605a87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2fc42ddeb5cd4170a5d01683e0605a87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2fc42ddeb5cd4170a5d01683e0605a87", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2fc42ddeb5cd4170a5d01683e0605a87"}]}] Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestFqdnHostnames-926194504 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 2fc42ddeb5cd4170a5d01683e0605a87 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-926194504 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestFqdnHostnames-926194504-project Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 78e6fe2e79b54462b20619cf36ffadf0 Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestFqdnHostnames-926194504-project Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 490b9884-a435-48a0-8744-d3dbe924ae9f could not be found. Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '490b9884-a435-48a0-8744-d3dbe924ae9f'} Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 490b9884-a435-48a0-8744-d3dbe924ae9f could not be found. Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 490b9884-a435-48a0-8744-d3dbe924ae9f could not be found. Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:14.367984 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:14.373104 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:14.373104 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:14.373104 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:14.373104 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:14.373104 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:14.373104 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 490b9884-a435-48a0-8744-d3dbe924ae9f could not be found. Oct 28 10:04:14.373104 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:14.384427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Returning 404 to user: Instance 490b9884-a435-48a0-8744-d3dbe924ae9f could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:14.385390 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a98e8d3d-e870-4770-b594-599636b31131 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f" status: 404 len: 111 microversion: 2.1 time: 0.141617 Oct 28 10:04:14.385980 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1721/3400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:14 2022] GET /compute/v2.1/servers/490b9884-a435-48a0-8744-d3dbe924ae9f => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:14.408302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6bc013c-63a8-4b67-b4ca-20e397bcb403 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] Calling method '.version_select at 0x7fca3243ff70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:14.459787 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a6bc013c-63a8-4b67-b4ca-20e397bcb403 tempest-ServersTestFqdnHostnames-926194504 tempest-ServersTestFqdnHostnames-926194504-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441107403" status: 202 len: 0 microversion: 2.1 time: 0.067514 Oct 28 10:04:14.461629 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1722/3401] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:04:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441107403 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:04:18.197984 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9cda819c-90b7-4f09-b6b4-f24c83e691ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1423 microversion: 2.1 time: 21.062485 Oct 28 10:04:18.207708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1680/3402] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:03:57 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1423 bytes in 21066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:18.213838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7994d472-bbb8-4648-950e-af15f348a3d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca324a9dc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:18.295563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7994d472-bbb8-4648-950e-af15f348a3d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 200 len: 1423 microversion: 2.1 time: 0.085879 Oct 28 10:04:18.307158 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1723/3403] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:04:18 2022] GET /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 1423 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:18.312795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1711dcae-9c36-4e4b-9461-acde1a0921ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca330b0430>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:18.776354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-198318827", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "d9eff588-6c9b-4e7c-b465-8d6d47e5566b"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:19.628492 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1711dcae-9c36-4e4b-9461-acde1a0921ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 204 len: 0 microversion: 2.1 time: 1.319947 Oct 28 10:04:19.630446 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1681/3404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:18 2022] DELETE /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 0 bytes in 1322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:19.639177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:19.640231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:19.661075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:19.661877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:19.664827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:19.668862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:19.669593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:19.670205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:19.697825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] validate_networks() for [('d9eff588-6c9b-4e7c-b465-8d6d47e5566b', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:04:19.747792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:04:20.000611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f92a4199-2236-4203-a4cb-e8cd1de39578 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 204 len: 0 microversion: 2.1 time: 0.363436 Oct 28 10:04:20.004946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1682/3405] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:19 2022] DELETE /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:20.243765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1243888394", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "153b4feb-5f46-4862-85be-edb054eb6bc9"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:20.377822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] validate_networks() for [('153b4feb-5f46-4862-85be-edb054eb6bc9', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:04:21.200401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:04:21.201011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:04:21.201501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:04:21.202149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:04:21.202773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:04:21.214047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:21.243011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:04:21.244166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:04:21.244956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:04:21.245591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:04:21.246225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:04:21.267214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:21.270940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:21.271535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:21.272836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:21.273700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:21.274117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:21.274656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:21.276165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:21.279710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:21.280277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:21.291246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:21.293706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:21.347362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:21.363987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Getting quotas for project 478a5b85b2154eae946434f0de92780e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:21.364176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for user 90aefa22b02749e8a6b03d16378a0a6c and project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:21.382943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Getting quotas for user d1aa2ecfe6334fdeb302c761dd404d2d and project 478a5b85b2154eae946434f0de92780e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:21.417501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:04:21.419259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:04:21.422554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:04:21.423504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:04:21.559836 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-577b09ba-2bfc-44bd-ada4-eb20bb792cfa tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.111529 Oct 28 10:04:21.569805 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1724/3406] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:04:21.588726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22c13b97-6bf0-4ab8-ab21-81e226f842fe tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:21.589735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22c13b97-6bf0-4ab8-ab21-81e226f842fe tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:21.594814 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-636b9340-ec3a-44e8-b70b-dff76810ea98 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.361041 Oct 28 10:04:21.602673 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1683/3407] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:04:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:04:21.661271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c4516eef-660c-430e-9474-624b6f4e3cff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:21.671064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c4516eef-660c-430e-9474-624b6f4e3cff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:22.027486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-22c13b97-6bf0-4ab8-ab21-81e226f842fe tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:22.037163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22c13b97-6bf0-4ab8-ab21-81e226f842fe tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1227 microversion: 2.1 time: 0.466020 Oct 28 10:04:22.039949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1725/3408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:21 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1227 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:22.060507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c4516eef-660c-430e-9474-624b6f4e3cff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:22.068267 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c4516eef-660c-430e-9474-624b6f4e3cff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1208 microversion: 2.1 time: 0.462440 Oct 28 10:04:22.069336 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1684/3409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:21 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1208 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:23.068256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:23.069153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:23.093049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:23.093804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:23.094275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:23.094431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:23.096955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:23.108250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:23.108767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:23.109253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:23.109970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:23.110797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:23.113609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:23.114352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:23.115019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:23.115163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:23.322528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:23.343171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4cca2bb-4e82-41c5-a9ca-05b52e619f7b tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1223 microversion: 2.1 time: 0.280346 Oct 28 10:04:23.343761 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1726/3410] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:23 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1223 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:23.537974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-dc661c41-2a9f-4ed5-862a-eb8196b1ea4a req-24f4b5be-5158-484b-9ca1-ed263eeb78b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d06442d-74eb-4207-9362-555ed34ffa32", "name": "network-vif-unplugged", "status": "completed", "tag": "5ecd48d6-f790-43eb-81b4-e47d04989e7d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:23.569303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-dc661c41-2a9f-4ed5-862a-eb8196b1ea4a req-24f4b5be-5158-484b-9ca1-ed263eeb78b1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:23.574899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-dc661c41-2a9f-4ed5-862a-eb8196b1ea4a req-24f4b5be-5158-484b-9ca1-ed263eeb78b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:23.575767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-dc661c41-2a9f-4ed5-862a-eb8196b1ea4a req-24f4b5be-5158-484b-9ca1-ed263eeb78b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:23.581917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:23.599896 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d807b7c-1e85-4a1f-b949-91c41239ba81 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1260 microversion: 2.1 time: 0.511201 Oct 28 10:04:23.627039 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1685/3411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:23 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1260 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:23.666789 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-dc661c41-2a9f-4ed5-862a-eb8196b1ea4a req-24f4b5be-5158-484b-9ca1-ed263eeb78b1 service nova] Creating event network-vif-unplugged:5ecd48d6-f790-43eb-81b4-e47d04989e7d for instance 2d06442d-74eb-4207-9362-555ed34ffa32 on n-h1-zed-1 Oct 28 10:04:23.680773 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-dc661c41-2a9f-4ed5-862a-eb8196b1ea4a req-24f4b5be-5158-484b-9ca1-ed263eeb78b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150015 Oct 28 10:04:23.684065 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1727/3412] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:04:24.411106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:24.412595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:24.455523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:24.456300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:24.461621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:24.465467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:24.466240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:24.467614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:24.673191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:24.673937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:24.728443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:24.730640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:24.731500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:24.735499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:24.737215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:24.737858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:25.046929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:25.058370 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de3e4442-949d-476b-b435-06ece1b982b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1266 microversion: 2.1 time: 0.402959 Oct 28 10:04:25.064698 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1728/3413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:24 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1266 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:25.364030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:25.374220 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-584ca36a-1f62-4859-8c9c-955bff765122 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1287 microversion: 2.1 time: 1.006357 Oct 28 10:04:25.379083 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1686/3414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:24 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1287 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:25.752022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c06fa975-2f27-4c15-86ab-75af3336c98d req-96f10154-5518-4f72-bd50-e7104347ca67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d06442d-74eb-4207-9362-555ed34ffa32", "name": "network-vif-deleted", "tag": "5ecd48d6-f790-43eb-81b4-e47d04989e7d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:25.783286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c06fa975-2f27-4c15-86ab-75af3336c98d req-96f10154-5518-4f72-bd50-e7104347ca67 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:25.783768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c06fa975-2f27-4c15-86ab-75af3336c98d req-96f10154-5518-4f72-bd50-e7104347ca67 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:25.790691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c06fa975-2f27-4c15-86ab-75af3336c98d req-96f10154-5518-4f72-bd50-e7104347ca67 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:25.823028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c06fa975-2f27-4c15-86ab-75af3336c98d req-96f10154-5518-4f72-bd50-e7104347ca67 service nova] Creating event network-vif-deleted:5ecd48d6-f790-43eb-81b4-e47d04989e7d for instance 2d06442d-74eb-4207-9362-555ed34ffa32 on n-h1-zed-1 Oct 28 10:04:25.852531 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c06fa975-2f27-4c15-86ab-75af3336c98d req-96f10154-5518-4f72-bd50-e7104347ca67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104427 Oct 28 10:04:25.853493 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1729/3415] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:26.088218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:26.088844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:26.118368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:26.119216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:26.127173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:26.129925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:26.130574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:26.132967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:26.358283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:26.371079 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a31ea09e-1b5a-4e55-911f-61b79681ec30 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1266 microversion: 2.1 time: 0.286966 Oct 28 10:04:26.373526 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1687/3416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:26 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1266 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:26.405857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:26.407014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:26.418378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:26.418881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:26.419321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:26.420036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:26.420486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:26.420930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:26.618497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:26.634002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5357ce2e-5865-4084-a652-51e92914dce7 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1285 microversion: 2.1 time: 0.233566 Oct 28 10:04:26.635139 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1730/3417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:26 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1285 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:27.219420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:27.219964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:27.227224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.236107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.236839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.237656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.242275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.242759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.320430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:04:27.399804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:27.401633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:27.410211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.411702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.412517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.415444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.417916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.418741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.556635 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8648db31-8b2a-4517-95ff-156c7e497180 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 204 len: 0 microversion: 2.1 time: 0.341717 Oct 28 10:04:27.557584 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1688/3418] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:27 2022] DELETE /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:27.566594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:27.575215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:27.582243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.584947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.586117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.587030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.589942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.590559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.788071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:27.804417 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad0de9df-8f74-45e7-8d0b-e36fa59dfee4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1308 microversion: 2.1 time: 0.409885 Oct 28 10:04:27.805296 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1731/3419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:27 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:27.813184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:27.814309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:27.821338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.822466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.823261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.824385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:27.825706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:27.826421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:27.932083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:27.951785 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-add55a38-024b-4fc9-beca-e85e29e3837d tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1285 microversion: 2.1 time: 0.144020 Oct 28 10:04:27.952584 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1732/3420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:27 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:28.558739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:28.575575 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b53607a7-b4cb-4e30-bddd-2bc87d0f4e2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1554 microversion: 2.1 time: 1.013452 Oct 28 10:04:28.578118 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1689/3421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:27 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1554 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:28.827591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:28.828219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:28.840386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:28.843510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:28.845365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:28.846281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:28.848767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:28.852944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1085902692", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "6e1aacaa-7762-4d99-8e64-f519f0b392fb"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:28.853657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:28.979905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] validate_networks() for [('6e1aacaa-7762-4d99-8e64-f519f0b392fb', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:04:29.832764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:29.843290 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5f2207f7-9961-4e58-871a-f5a35731e66b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1308 microversion: 2.1 time: 1.017421 Oct 28 10:04:29.856953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1690/3422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:28 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1308 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:29.856953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:29.856953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:29.864097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:29.864597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:29.865084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:29.865940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:29.866456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:29.866894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:30.043778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:04:30.044885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:04:30.045613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:04:30.047028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:04:30.047856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:04:30.067425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:30.068541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:30.069183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:30.070234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:30.070871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:30.071492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:30.095372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Getting quotas for project 6bbc01e308ae49a3b71a6483021afeaa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:30.105443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Getting quotas for user f19af7f3e233433db9a4812fe34f458e and project 6bbc01e308ae49a3b71a6483021afeaa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:30.121425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:04:30.124437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:04:30.185706 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.493757 Oct 28 10:04:30.188329 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1733/3423] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:04:30.195707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ce9ce349-fc35-4c4b-9807-bad17e7cda4b req-7da22cee-79c9-4668-90cc-48f488ce99d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15ca8e5c-539b-4bca-801a-66238374918c", "tag": "ab34384e-f3c7-4961-8e60-c582cbd31e2e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:30.209404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ce9ce349-fc35-4c4b-9807-bad17e7cda4b req-7da22cee-79c9-4668-90cc-48f488ce99d1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:30.211367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ce9ce349-fc35-4c4b-9807-bad17e7cda4b req-7da22cee-79c9-4668-90cc-48f488ce99d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:30.211975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ce9ce349-fc35-4c4b-9807-bad17e7cda4b req-7da22cee-79c9-4668-90cc-48f488ce99d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:30.225442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ce9ce349-fc35-4c4b-9807-bad17e7cda4b req-7da22cee-79c9-4668-90cc-48f488ce99d1 service nova] Creating event network-changed:ab34384e-f3c7-4961-8e60-c582cbd31e2e for instance 15ca8e5c-539b-4bca-801a-66238374918c on n-h1-zed-1 Oct 28 10:04:30.232468 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ce9ce349-fc35-4c4b-9807-bad17e7cda4b req-7da22cee-79c9-4668-90cc-48f488ce99d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042604 Oct 28 10:04:30.234389 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1734/3424] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:30.241070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:30.241892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:30.250098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:30.250597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:30.251042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:30.251862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:30.252324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:30.252753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:30.512759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:30.524144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-881a8654-938b-4b26-aa93-ee417c98c8ec tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1554 microversion: 2.1 time: 0.287999 Oct 28 10:04:30.525091 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1735/3425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:30 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:30.531512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-908aaa84-430d-4e21-a339-f15b3a397ada tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:30.531512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-908aaa84-430d-4e21-a339-f15b3a397ada tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:30.661892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-908aaa84-430d-4e21-a339-f15b3a397ada tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:30.674047 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-908aaa84-430d-4e21-a339-f15b3a397ada tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1217 microversion: 2.1 time: 0.146753 Oct 28 10:04:30.674657 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1736/3426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:30 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:30.703541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:30.721030 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7bf410f6-6840-4ad1-a49e-eac90c90616e tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.874434 Oct 28 10:04:30.721886 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1691/3427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:29 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:30.871482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:30.872150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:30.880358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:30.881206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:30.881974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:30.883711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:30.884228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:30.884872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:31.111272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:31.121748 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-44fc2e91-97ca-4148-bd13-457327b08a89 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1308 microversion: 2.1 time: 0.254726 Oct 28 10:04:31.123259 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1737/3428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:30 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1308 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:31.551687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:31.553299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:31.556987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:31.577797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:31.579391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:31.579960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:31.580976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:31.583622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:31.584327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:31.700292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:31.701091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:31.713348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:31.714389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:31.715042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:31.718842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:31.719684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:31.721313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:32.065014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:32.112863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:32.141942 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-51926e76-1d5b-460a-811c-965734850911 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1554 microversion: 2.1 time: 0.589344 Oct 28 10:04:32.143216 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1692/3429] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:31 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1554 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:32.153650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:32.156538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:32.161827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:32.169226 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a762f6c7-5b2b-466f-a179-992bbad31a30 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1269 microversion: 2.1 time: 0.474407 Oct 28 10:04:32.171296 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1738/3430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:31 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1269 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:32.175590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:32.176140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:32.176846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:32.181105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:32.181648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:32.182217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:32.182679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:32.183260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:32.198378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:32.199241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:32.199890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:32.200823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:32.203382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:32.205349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:32.875238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:32.891796 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-857acdab-4d7b-4028-b38c-f0f53079c65f tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.745654 Oct 28 10:04:32.893237 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1693/3431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:32 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:32.904097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-31b1980e-550b-42c2-9b71-9f308331efe0 req-54116ba3-58a5-4065-add1-8b73496f7147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3233b1da-fccc-4e96-923f-859d06eb3be8", "name": "network-vif-deleted", "tag": "470b2ede-750d-46ab-b5ac-adcece51546c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:32.931001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-31b1980e-550b-42c2-9b71-9f308331efe0 req-54116ba3-58a5-4065-add1-8b73496f7147 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:32.931803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-31b1980e-550b-42c2-9b71-9f308331efe0 req-54116ba3-58a5-4065-add1-8b73496f7147 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:32.932352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-31b1980e-550b-42c2-9b71-9f308331efe0 req-54116ba3-58a5-4065-add1-8b73496f7147 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:32.951440 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-31b1980e-550b-42c2-9b71-9f308331efe0 req-54116ba3-58a5-4065-add1-8b73496f7147 service nova] Creating event network-vif-deleted:470b2ede-750d-46ab-b5ac-adcece51546c for instance 3233b1da-fccc-4e96-923f-859d06eb3be8 on n-h2-zed-1 Oct 28 10:04:32.962724 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-31b1980e-550b-42c2-9b71-9f308331efe0 req-54116ba3-58a5-4065-add1-8b73496f7147 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066817 Oct 28 10:04:32.964193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1694/3432] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:33.169936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:33.170824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:33.183262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:33.195051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:33.196958 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5bf4b2bf-2504-4861-8202-33123c958e12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1308 microversion: 2.1 time: 1.024334 Oct 28 10:04:33.197954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:33.199713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:33.200031 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1739/3433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:32 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1308 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:33.202942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:33.206481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:33.211456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:33.216834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:33.217689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:33.229978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:33.230551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:33.231105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:33.232080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:33.234407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:33.234947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:33.359847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:33.369256 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb77eaba-8341-49a2-a0ef-7ed392be0376 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1275 microversion: 2.1 time: 0.166822 Oct 28 10:04:33.388944 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1740/3434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:33 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1275 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:33.481905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:33.498917 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f4d072a-00f3-450a-9ba7-0c4d4ea6ff5f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1345 microversion: 2.1 time: 0.332746 Oct 28 10:04:33.500509 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1695/3435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:33 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1345 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:33.715008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1080694469", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1fcb6bd7-2e5c-4aab-8f4e-0677b3be51e2"}], "security_groups": [{"name": "tempest-securitygroup--291088253"}], "key_name": "tempest-keypair-1790629120", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "c783f0fa-3f3d-42b2-9b9b-70e6eb1f360b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:33.909700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] validate_networks() for [('1fcb6bd7-2e5c-4aab-8f4e-0677b3be51e2', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:04:33.921056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:33.921676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:33.939562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:33.943773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:33.944682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:33.947101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:33.947959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:33.950684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:34.366019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:34.375201 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d2eedd61-84cd-4e48-8959-3a3a645e9a16 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.464020 Oct 28 10:04:34.376216 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1696/3436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:33 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:34.383692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:34.384724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:34.391853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:34.394353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:34.395044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:34.396038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:34.396734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:34.398428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:34.426606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:34.746846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:34.760245 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81c274d2-acf4-46ee-8b51-bf6c1fef28e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1308 microversion: 2.1 time: 0.381665 Oct 28 10:04:34.760858 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1697/3437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:34 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1308 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:34.770138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:34.770895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:34.777829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:34.784417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:34.784881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:34.787429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:34.787904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:34.788380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:34.901208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:34.914731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7d3f550-f8ce-4b59-b1e5-c48daef4b801 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1275 microversion: 2.1 time: 0.148567 Oct 28 10:04:34.915535 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1698/3438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:34 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1275 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:34.944136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:34.946070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:34.954202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:34.954880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:34.955485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:34.956444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:34.957116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:34.957931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:35.037322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:35.048376 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af33ed8d-dbb8-45a1-b49d-bdd8c1d12db2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1345 microversion: 2.1 time: 0.129674 Oct 28 10:04:35.049918 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1699/3439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:34 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:35.199761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Getting quotas for project 2e1adf828480437ea6595561c912d9bf. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:35.211303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Getting quotas for user b125e9d6136447169f052690eeaab064 and project 2e1adf828480437ea6595561c912d9bf. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:35.227592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:04:35.228330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:04:35.229013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:04:35.229588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:04:35.230182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:04:35.239867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:35.240637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:35.242361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:35.243322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:35.243949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:35.244564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:35.267456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Getting quotas for project 2e1adf828480437ea6595561c912d9bf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:35.275172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Getting quotas for user b125e9d6136447169f052690eeaab064 and project 2e1adf828480437ea6595561c912d9bf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:35.294265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3df8a3bd-ffb3-4ef9-b7c6-4b9cb806ed72 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca3ba0b820>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY4R9EtocV16TbzVr8Fm+hZpB5R0HgMYzcEhuzo7UHoSza23+g8/RDLYKK/9rBxQILNH9u8YYdsVWIkllBYcUX1mCZvZVvVoSLLSRBYrVBX7y375+vfNS7SPCWsvr85Wg=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3df8a3bd-ffb3-4ef9-b7c6-4b9cb806ed72 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 257 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY4R9EtocV16TbzVr8Fm+hZpB5R0HgMYzcEhuzo7UHoSza23+g8/RDLYKK/9rBxQILNH9u8YYdsVWIkllBYcUX1mCZvZVvVoSLLSRBYrVBX7y375+vfNS7SPCWsvr85Wg=="}} Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY4R9EtocV16TbzVr8Fm+hZpB5R0HgMYzcEhuzo7UHoSza23+g8/RDLYKK/9rBxQILNH9u8YYdsVWIkllBYcUX1mCZvZVvVoSLLSRBYrVBX7y375+vfNS7SPCWsvr85Wg=='}}} Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 28 10:04:35.302052 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 28 10:04:35.306932 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.313210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3df8a3bd-ffb3-4ef9-b7c6-4b9cb806ed72 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:35.316569 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3df8a3bd-ffb3-4ef9-b7c6-4b9cb806ed72 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.264759 Oct 28 10:04:35.320030 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1700/3440] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:04:35 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:04:35.334565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d898ee18-b0d5-447e-9dfe-c834d4899a36 req-98cf6137-d896-40df-b3c4-b4ab2d18d619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5780736d-7c54-45f2-92c8-bd69f6d56b6a", "tag": "4d9aa48b-8f34-4a64-8dfb-08b870c836a9"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:35.354753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d898ee18-b0d5-447e-9dfe-c834d4899a36 req-98cf6137-d896-40df-b3c4-b4ab2d18d619 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:35.355669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d898ee18-b0d5-447e-9dfe-c834d4899a36 req-98cf6137-d896-40df-b3c4-b4ab2d18d619 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:35.356375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d898ee18-b0d5-447e-9dfe-c834d4899a36 req-98cf6137-d896-40df-b3c4-b4ab2d18d619 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:35.371457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d898ee18-b0d5-447e-9dfe-c834d4899a36 req-98cf6137-d896-40df-b3c4-b4ab2d18d619 service nova] Creating event network-changed:4d9aa48b-8f34-4a64-8dfb-08b870c836a9 for instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a on n-h1-zed-1 Oct 28 10:04:35.379441 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d898ee18-b0d5-447e-9dfe-c834d4899a36 req-98cf6137-d896-40df-b3c4-b4ab2d18d619 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057906 Oct 28 10:04:35.385703 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1701/3441] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:35.407342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70cca6c1-84dd-4015-a92d-62795302dda7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca33072160>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2069211058", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:35.436830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-70cca6c1-84dd-4015-a92d-62795302dda7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:35.446852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-70cca6c1-84dd-4015-a92d-62795302dda7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for user 904c635190724109b5e3d6742f3f17c1 and project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:35.487116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:04:35.489759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c783f0fa-3f3d-42b2-9b9b-70e6eb1f360b',volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:04:35.506042 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-70cca6c1-84dd-4015-a92d-62795302dda7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70cca6c1-84dd-4015-a92d-62795302dda7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 2167 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-2069211058", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:04:35.552809 n-d-zed-1 devstack@n-api.service[128747]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-2069211058', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:35.557031 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:35.560440 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:35.564306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70cca6c1-84dd-4015-a92d-62795302dda7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:35.565437 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70cca6c1-84dd-4015-a92d-62795302dda7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.164909 Oct 28 10:04:35.573017 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1702/3442] 10.222.0.16 () {60 vars in 1160 bytes} [Fri Oct 28 10:04:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 184 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:35.587666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:35.588402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:35.621536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:35.622046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:35.622503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:35.623239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:35.623826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:35.624275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:35.815510 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d9b010c-e148-45d2-8ee8-e4e21f9bfab5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.105731 Oct 28 10:04:35.822973 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1741/3443] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:04:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:04:35.828624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b45a854-9b37-436f-bf88-2423cb6fdc3f tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca3243fd30>, body: {"keypair": {"name": "tempest-keypair-244464890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjvDTAXDPOKZZPZSgZhdEYjmhJZ34eBbg3Deu4Iuh4jZf+Bcuu9iPevD1tKfQJvtpuU8/lfTGApEYnFOFnN3angg5hgX58CQ1wtjk1TtwNkTcW0mGdF6VOT77XE2ibhwA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:35.853608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0b45a854-9b37-436f-bf88-2423cb6fdc3f tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:35.860434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0b45a854-9b37-436f-bf88-2423cb6fdc3f tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for user 904c635190724109b5e3d6742f3f17c1 and project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:35.907701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:35.918513 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b45a854-9b37-436f-bf88-2423cb6fdc3f tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.093920 Oct 28 10:04:35.920963 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1742/3444] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:04:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:35.938373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:35.939546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:35.955456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:35.956895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:35.957721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:35.958877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:35.959623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:35.961042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:36.079913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:36.091885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-43f0f6f4-1c48-4313-83a4-8ffa5691c45a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.520400 Oct 28 10:04:36.104927 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1703/3445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:35 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:36.104927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b7b07fc-c813-45ed-8831-aaf058cb7197 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:36.104927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b7b07fc-c813-45ed-8831-aaf058cb7197 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:36.305908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b7b07fc-c813-45ed-8831-aaf058cb7197 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:36.314162 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b7b07fc-c813-45ed-8831-aaf058cb7197 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1122 microversion: 2.1 time: 0.214625 Oct 28 10:04:36.317913 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1704/3446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:36 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1122 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:36.323362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2aaae3a8-d6a8-4bcc-a021-908b0699b04c tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca330724c0>, body: {"keypair": {"name": "tempest-keypair-244464890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVRlfPFOVsqn7P1Twky+8uYVRW2K8Z8yBMntRIdYuSkZ9vr73vc3FDx4egNt/INDnM3zg8rfu+312XhxR8W4LiF/GWY0xyEMHVh1A9SGnPVhaFQT5ncLP6OEdfoj4J53A=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:36.367707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2aaae3a8-d6a8-4bcc-a021-908b0699b04c tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:36.377768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2aaae3a8-d6a8-4bcc-a021-908b0699b04c tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for user 904c635190724109b5e3d6742f3f17c1 and project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:36.431285 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2aaae3a8-d6a8-4bcc-a021-908b0699b04c tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] HTTP exception thrown: Key pair 'tempest-keypair-244464890' already exists. Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2aaae3a8-d6a8-4bcc-a021-908b0699b04c tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 272 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: {"keypair": {"name": "tempest-keypair-244464890", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVRlfPFOVsqn7P1Twky+8uYVRW2K8Z8yBMntRIdYuSkZ9vr73vc3FDx4egNt/INDnM3zg8rfu+312XhxR8W4LiF/GWY0xyEMHVh1A9SGnPVhaFQT5ncLP6OEdfoj4J53A=="}} Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: exception: Key pair 'tempest-keypair-244464890' already exists. Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-244464890', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVRlfPFOVsqn7P1Twky+8uYVRW2K8Z8yBMntRIdYuSkZ9vr73vc3FDx4egNt/INDnM3zg8rfu+312XhxR8W4LiF/GWY0xyEMHVh1A9SGnPVhaFQT5ncLP6OEdfoj4J53A=='}}} Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result.read() Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '904c635190724109b5e3d6742f3f17c1-tempest-keypair-244464890' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 10:04:36.447985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi session.flush() Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result.read() Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 28 10:04:36.451938 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '904c635190724109b5e3d6742f3f17c1-tempest-keypair-244464890' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 28, 10, 4, 36, 420151), 'updated_at': None, 'name': 'tempest-keypair-244464890', 'user_id': '904c635190724109b5e3d6742f3f17c1', 'fingerprint': '76:ea:88:73:7b:35:fe:9d:1c:50:89:22:49:48:4d:54', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVRlfPFOVsqn7P1Twky+8uYVRW2K8Z8yBMntRIdYuSkZ9vr73vc3FDx4egNt/INDnM3zg8rfu+312XhxR8W4LiF/GWY0xyEMHVh1A9SGnPVhaFQT5ncLP6OEdfoj4J53A==', 'type': 'ssh'}] Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi keypair.create() Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._create() Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-244464890' already exists. Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 28 10:04:36.455531 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-244464890' already exists. Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-244464890' already exists. Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2aaae3a8-d6a8-4bcc-a021-908b0699b04c tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 409 to user: Key pair 'tempest-keypair-244464890' already exists. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2aaae3a8-d6a8-4bcc-a021-908b0699b04c tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.130558 Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1705/3447] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:04:36 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:36.465793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:36.470265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:36.475429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-72eba0d3-c748-48fc-9ec6-0f7ff76cac03 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1308 microversion: 2.1 time: 0.552750 Oct 28 10:04:36.479001 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1743/3448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:35 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1308 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:36.494520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:36.494888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:36.495147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:36.497107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:36.497742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:36.498776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:36.501106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:36.503147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:36.511045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:36.511626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:36.512183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:36.515279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:36.515745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:36.516188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:36.524216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:36.810861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:36.825175 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-764e2d5e-cbf7-4919-96d5-a4b225e5eab9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1345 microversion: 2.1 time: 0.343080 Oct 28 10:04:36.829587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1744/3449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:36 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1345 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:36.842686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fcd94f5f-e02c-4145-a818-0911ae9eef48 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Calling method '.version_select at 0x7fca3249cd30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:36.883375 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fcd94f5f-e02c-4145-a818-0911ae9eef48 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-244464890" status: 202 len: 0 microversion: 2.1 time: 0.051770 Oct 28 10:04:36.889775 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1745/3450] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:04:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-244464890 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:04:36.901223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae7ae825-bd9b-4fd1-b0fb-b88fa8303ab7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca32469c10>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtxe2j47XWvKQHHyZj0zQJJ7kL5dvHfv01xeugLPjlbQzIVE9TnVu84mPK3wbNqx2SetaZmvw+htFFN00C/QBL0ajPqj4Ic2O8BGcGJhS50mzIpclPfoJrJPkm10n3J1Q=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae7ae825-bd9b-4fd1-b0fb-b88fa8303ab7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 247 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtxe2j47XWvKQHHyZj0zQJJ7kL5dvHfv01xeugLPjlbQzIVE9TnVu84mPK3wbNqx2SetaZmvw+htFFN00C/QBL0ajPqj4Ic2O8BGcGJhS50mzIpclPfoJrJPkm10n3J1Q=="}} Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtxe2j47XWvKQHHyZj0zQJJ7kL5dvHfv01xeugLPjlbQzIVE9TnVu84mPK3wbNqx2SetaZmvw+htFFN00C/QBL0ajPqj4Ic2O8BGcGJhS50mzIpclPfoJrJPkm10n3J1Q=='}}} Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '' Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:04:36.913172 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:04:36.918322 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:36.922467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae7ae825-bd9b-4fd1-b0fb-b88fa8303ab7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:36.923609 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae7ae825-bd9b-4fd1-b0fb-b88fa8303ab7 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.030630 Oct 28 10:04:36.926449 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1746/3451] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:04:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:04:36.943608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2c893e19-fabc-4a1b-a86d-2031b287b1f6 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca3247b550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-43273", "public_key": " "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:37.015420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2c893e19-fabc-4a1b-a86d-2031b287b1f6 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:37.025757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:37.041359 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2848c6f9-c1d7-410f-9c79-0d8351114da4 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 0.589558 Oct 28 10:04:37.041967 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1706/3452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:36 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:37.050429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3130114b-11c9-4fb1-af0a-afc87e3a67a2 req-66b15232-ae01-4dda-80fa-15761adaed21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ca8e5c-539b-4bca-801a-66238374918c", "name": "network-vif-plugged", "status": "completed", "tag": "ab34384e-f3c7-4961-8e60-c582cbd31e2e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:37.053027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2c893e19-fabc-4a1b-a86d-2031b287b1f6 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for user 904c635190724109b5e3d6742f3f17c1 and project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:37.088686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3130114b-11c9-4fb1-af0a-afc87e3a67a2 req-66b15232-ae01-4dda-80fa-15761adaed21 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.089170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3130114b-11c9-4fb1-af0a-afc87e3a67a2 req-66b15232-ae01-4dda-80fa-15761adaed21 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.089520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3130114b-11c9-4fb1-af0a-afc87e3a67a2 req-66b15232-ae01-4dda-80fa-15761adaed21 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.102819 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-2c893e19-fabc-4a1b-a86d-2031b287b1f6 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2c893e19-fabc-4a1b-a86d-2031b287b1f6 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 90 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-43273", "public_key": " "}} Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-43273', 'public_key': ' '}}} Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.107037 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.112180 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.114812 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3130114b-11c9-4fb1-af0a-afc87e3a67a2 req-66b15232-ae01-4dda-80fa-15761adaed21 service nova] Creating event network-vif-plugged:ab34384e-f3c7-4961-8e60-c582cbd31e2e for instance 15ca8e5c-539b-4bca-801a-66238374918c on n-h1-zed-1 Oct 28 10:04:37.116328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2c893e19-fabc-4a1b-a86d-2031b287b1f6 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:37.118042 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2c893e19-fabc-4a1b-a86d-2031b287b1f6 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.185780 Oct 28 10:04:37.119014 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1747/3453] 10.222.0.16 () {60 vars in 1158 bytes} [Fri Oct 28 10:04:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 187 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:37.130685 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3130114b-11c9-4fb1-af0a-afc87e3a67a2 req-66b15232-ae01-4dda-80fa-15761adaed21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083802 Oct 28 10:04:37.131796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:37.135150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:37.136206 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1707/3454] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:37.147312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62ad025b-9526-41c4-b5a2-d6700fd422f2 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca330590d0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09cVdd82BxRw8FQ3gsFFF9codin332v33ngTOlJiRq+0ZCaRJBjH32uwhNcjm5TFaZOMoy8BWLU8wxfPB7WAsYueMFPaYzKEP2tji9/MTNuxGh5HKKBT3IcNrC6iGpSg=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62ad025b-9526-41c4-b5a2-d6700fd422f2 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 507 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09cVdd82BxRw8FQ3gsFFF9codin332v33ngTOlJiRq+0ZCaRJBjH32uwhNcjm5TFaZOMoy8BWLU8wxfPB7WAsYueMFPaYzKEP2tji9/MTNuxGh5HKKBT3IcNrC6iGpSg=="}} Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09cVdd82BxRw8FQ3gsFFF9codin332v33ngTOlJiRq+0ZCaRJBjH32uwhNcjm5TFaZOMoy8BWLU8wxfPB7WAsYueMFPaYzKEP2tji9/MTNuxGh5HKKBT3IcNrC6iGpSg=='}}} Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 28 10:04:37.152668 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 28 10:04:37.156321 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.160101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.161360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62ad025b-9526-41c4-b5a2-d6700fd422f2 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:37.161604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.162620 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62ad025b-9526-41c4-b5a2-d6700fd422f2 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.023494 Oct 28 10:04:37.164273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1708/3455] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:04:37 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:04:37.170020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.171583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.172065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.172609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.186661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6faedec-a540-4c08-b92d-6da310d3e002 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Action: 'create', calling method: .version_select at 0x7fca3309bc10>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1702143005", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:37.198174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:37.240415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f6faedec-a540-4c08-b92d-6da310d3e002 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:37.248794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f6faedec-a540-4c08-b92d-6da310d3e002 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Getting quotas for user 904c635190724109b5e3d6742f3f17c1 and project 24e6c82706674dd89e73ffdf04ac5ffd. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:37.290558 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f6faedec-a540-4c08-b92d-6da310d3e002 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6faedec-a540-4c08-b92d-6da310d3e002 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 118 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1702143005", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: exception: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1702143005', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 28 10:04:37.292461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6faedec-a540-4c08-b92d-6da310d3e002 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:37.297893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6faedec-a540-4c08-b92d-6da310d3e002 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.124486 Oct 28 10:04:37.302759 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1709/3456] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:04:37 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:04:37.309680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70b3b523-93d9-40a2-b9fb-56c9e06e82f9 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Calling method '.version_select at 0x7fca3309b700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:37.325254 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-70b3b523-93d9-40a2-b9fb-56c9e06e82f9 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-248958374 not found for user 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70b3b523-93d9-40a2-b9fb-56c9e06e82f9 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Request method failure captured: Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-248958374 HTTP/1.1 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6kyFMl9xRvqBvLXYEuZj3S_ezy-okvGLUM3NRpaQ2fJzWO4sTBYEyP1eyhrcQmjqZI169dRf4ZRQ91J6lxvs6NToCDqjqQVzWKtx8cgHWmF3uDw-ztu0NL_NbojHnV-1s9kZyXk-5_YSRpo37N-v-ASp4x0UM0UG3yLl3Zq-kGmF3w Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/24e6c82706674dd89e73ffdf04ac5ffd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_24e6c82706674dd89e73ffdf04ac5ffd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/24e6c82706674dd89e73ffdf04ac5ffd"}]}] Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 24e6c82706674dd89e73ffdf04ac5ffd Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1986801603 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1986801603-project Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: exception: Keypair tempest-keypair-non-existent-248958374 not found for user 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'tempest-keypair-non-existent-248958374'} Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise self.value Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-248958374 not found for user 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.327124 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-248958374 not found for user 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-248958374 not found for user 904c635190724109b5e3d6742f3f17c1 Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70b3b523-93d9-40a2-b9fb-56c9e06e82f9 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] Returning 404 to user: Keypair tempest-keypair-non-existent-248958374 not found for user 904c635190724109b5e3d6742f3f17c1 {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:37.331096 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70b3b523-93d9-40a2-b9fb-56c9e06e82f9 tempest-KeyPairsNegativeTestJSON-1986801603 tempest-KeyPairsNegativeTestJSON-1986801603-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-248958374" status: 404 len: 144 microversion: 2.1 time: 0.027351 Oct 28 10:04:37.333267 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1710/3457] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 10:04:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-248958374 => generated 144 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:37.343845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:37.345087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:37.352541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.353086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.353534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.354402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.355168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.355611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.474370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:37.490447 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78b753b0-0699-423e-be9f-f3ef29166143 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1220 microversion: 2.1 time: 0.150935 Oct 28 10:04:37.514344 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1711/3458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:37 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:37.526264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:37.527851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:37.528715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:37.543983 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-023cb3fa-b13a-421e-aeca-c6b43751bb1a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.423566 Oct 28 10:04:37.544590 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1748/3459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:37 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:37.545121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.545922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.546593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.547949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.548630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.549458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.842193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:37.855599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3996800c-351f-4215-b9b2-90ba138c4408 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1308 microversion: 2.1 time: 0.340294 Oct 28 10:04:37.855757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:37.856789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:37.858281 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1712/3460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:37 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1308 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:37.874784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.877760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.879013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.882578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.885803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.886249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.934077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7eb2b5af-d483-410d-a2a7-553794179ebf req-71454b41-0c2d-4802-99f0-0c3621030b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "243ff6fd-ddaa-43cc-9f71-5fda436b2719", "tag": "56642ffc-e947-419e-bb93-d7a9948c5c6d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:37.951883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7eb2b5af-d483-410d-a2a7-553794179ebf req-71454b41-0c2d-4802-99f0-0c3621030b7d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:37.954290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7eb2b5af-d483-410d-a2a7-553794179ebf req-71454b41-0c2d-4802-99f0-0c3621030b7d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:37.956136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7eb2b5af-d483-410d-a2a7-553794179ebf req-71454b41-0c2d-4802-99f0-0c3621030b7d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:37.987567 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7eb2b5af-d483-410d-a2a7-553794179ebf req-71454b41-0c2d-4802-99f0-0c3621030b7d service nova] Creating event network-changed:56642ffc-e947-419e-bb93-d7a9948c5c6d for instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 on n-h2-zed-1 Oct 28 10:04:38.007420 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7eb2b5af-d483-410d-a2a7-553794179ebf req-71454b41-0c2d-4802-99f0-0c3621030b7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077136 Oct 28 10:04:38.012351 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1713/3461] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:04:38.067240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:38.068069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:38.076876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.093158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.093800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:38.095663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.096150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.096593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:38.155749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:38.169952 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-200d644a-3351-45b0-ba3d-867da54dd4e5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1345 microversion: 2.1 time: 0.319883 Oct 28 10:04:38.176791 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1749/3462] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:37 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1345 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:38.518150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:38.518934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:38.532502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.541498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.542177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:38.542990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.543917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.544349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:38.695350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:38.705450 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1854fd27-424e-4184-84f0-90bd8626f95e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1238 microversion: 2.1 time: 0.192257 Oct 28 10:04:38.722486 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1750/3463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:38 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1238 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:38.729058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:38.730099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:38.736745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.737494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.738221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:38.739116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.739740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.740456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:38.921999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:38.932116 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bad8c555-7f2f-466a-9daa-b9de8355994a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.207613 Oct 28 10:04:38.933127 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1751/3464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:38 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:38.938806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:38.939669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:38.948605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.950134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.950788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:38.951743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:38.952558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:38.953395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.114301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:39.123914 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-df5b856b-3e95-406e-95c7-75c1d6e4b1e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1486 microversion: 2.1 time: 0.189570 Oct 28 10:04:39.124646 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1752/3465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:38 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1486 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:39.132640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:39.144600 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15f595b0-dd94-4426-aa06-959032c11dde tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 1.081263 Oct 28 10:04:39.146263 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1714/3466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:38 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:39.153668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-982c89e5-3b50-4a5c-8d4b-09e30a7446d3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:39.160605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982c89e5-3b50-4a5c-8d4b-09e30a7446d3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:39.161558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982c89e5-3b50-4a5c-8d4b-09e30a7446d3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:39.162251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-982c89e5-3b50-4a5c-8d4b-09e30a7446d3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.193737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-982c89e5-3b50-4a5c-8d4b-09e30a7446d3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Going to try to stop instance {{(pid=128748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:04:39.201726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:39.202465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:39.216638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:39.218127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:39.218815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.219775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:39.220439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:39.221254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.250012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-982c89e5-3b50-4a5c-8d4b-09e30a7446d3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c/action" status: 202 len: 0 microversion: 2.1 time: 0.103481 Oct 28 10:04:39.251251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1753/3467] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:04:39 2022] POST /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:04:39.262605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:39.264590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:39.273010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:39.274032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:39.274754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.275601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:39.276150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:39.276644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.378218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:39.390641 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c9da8c7-8b62-432d-8ab4-a13ef9b86684 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1345 microversion: 2.1 time: 0.197483 Oct 28 10:04:39.393171 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1715/3468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:39 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:39.734790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:39.735562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:39.748924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:39.749840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:39.752062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.753331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:39.755129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:39.757144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:39.864546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:39.888194 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c859160-e32f-4ab5-b231-1a75437a44f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.628644 Oct 28 10:04:39.890845 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1754/3469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:39 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:39.933751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:39.942188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6d7542f-1fc9-4ae8-a08b-634660f905b0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1238 microversion: 2.1 time: 0.212499 Oct 28 10:04:39.945959 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1716/3470] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:39 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1238 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:39.968036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:39.969769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:40.003012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.003903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.005400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.006414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.012248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.012998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.168362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:40.169276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:40.178449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.178997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.179472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.180202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.180686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.181154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.385351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:40.403736 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-665f9441-c7af-4e23-95b0-2106642d5f6b tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 0.239223 Oct 28 10:04:40.404638 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1717/3471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:40 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:40.418166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:40.419661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:40.427949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.429685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.430417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.431464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.432351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.433077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.450084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:40.458218 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd7d2fc2-a145-49d5-9677-6702f94b4016 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.499039 Oct 28 10:04:40.458815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1755/3472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:39 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:40.537968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:40.551188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-127022f1-5480-4291-ad4c-9c104433e1e6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 200 len: 1345 microversion: 2.1 time: 0.138502 Oct 28 10:04:40.553041 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1718/3473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:40 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 1345 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:40.915426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:40.916040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:40.928593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.929705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.930206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.930869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.940835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.941644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:40.971881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:40.972823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:40.995615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:40.995615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:40.995615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:41.004344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:41.004957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:41.005420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:41.440709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:41.452534 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a57aba0b-78a8-4d2f-9504-c94727f87731 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.538452 Oct 28 10:04:41.453579 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1756/3474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:40 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:41.458487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f582bbd3-2080-4700-ba92-90882e7ac24f req-3205286e-a1ee-41b7-8132-73b975d5cd86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5780736d-7c54-45f2-92c8-bd69f6d56b6a", "name": "network-vif-plugged", "status": "completed", "tag": "4d9aa48b-8f34-4a64-8dfb-08b870c836a9"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:41.490037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f582bbd3-2080-4700-ba92-90882e7ac24f req-3205286e-a1ee-41b7-8132-73b975d5cd86 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:41.490892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f582bbd3-2080-4700-ba92-90882e7ac24f req-3205286e-a1ee-41b7-8132-73b975d5cd86 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:41.491564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f582bbd3-2080-4700-ba92-90882e7ac24f req-3205286e-a1ee-41b7-8132-73b975d5cd86 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:41.516059 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f582bbd3-2080-4700-ba92-90882e7ac24f req-3205286e-a1ee-41b7-8132-73b975d5cd86 service nova] Creating event network-vif-plugged:4d9aa48b-8f34-4a64-8dfb-08b870c836a9 for instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a on n-h1-zed-1 Oct 28 10:04:41.528650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f582bbd3-2080-4700-ba92-90882e7ac24f req-3205286e-a1ee-41b7-8132-73b975d5cd86 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073585 Oct 28 10:04:41.531408 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1757/3475] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:41.549139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:41.550179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:41.562094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:41.563718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:41.565223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:41.568181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:41.569244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:41.571690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:41.575660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:41.610172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-272ec7bf-e578-49fa-a418-de1cc644eb49 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1305 microversion: 2.1 time: 0.642636 Oct 28 10:04:41.629651 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1719/3476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:40 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1305 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:41.645895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:41.647425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:41.664654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:41.672353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:41.673144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:41.674541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:41.676580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:41.677265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.057901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:42.066270 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38108bbf-fece-4509-b276-dc9b592f0cd9 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 0.530061 Oct 28 10:04:42.073672 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1758/3477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:41 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:42.085936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:42.092997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:42.093621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:42.097069 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff1bcb79-f1a5-4615-8931-e8546ad35281 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1327 microversion: 2.1 time: 0.464963 Oct 28 10:04:42.098897 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1720/3478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:41 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1327 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:42.120680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.121215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.121662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.122391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.122836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.123269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.144812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 HTTP/1.1 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '3233b1da-fccc-4e96-923f-859d06eb3be8'} Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:42.151266 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.157305 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:42.157305 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:42.157305 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:42.157305 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:42.157305 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:42.157305 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.157305 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.159581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:42.161261 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e7fb0d6f-e59f-4f68-b7ef-728944b1fe75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 404 len: 111 microversion: 2.1 time: 0.071538 Oct 28 10:04:42.162967 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1759/3479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:42 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:42.377118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:42.379668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:42.389142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.391525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.392264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.394188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.395201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.396124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.430367 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8/os-volume_attachments HTTP/1.1 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': '3233b1da-fccc-4e96-923f-859d06eb3be8'} Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:42.433707 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:04:42.439818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:42.443251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:42.444354 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d673ab84-1bb3-4930-8fc4-a2044703e36d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.071342 Oct 28 10:04:42.449613 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1721/3480] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:04:42 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8/os-volume_attachments => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:42.479378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:42.480374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:42.504045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.509556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.510666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.511522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.512260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.512810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.636351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:42.637595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:42.651043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.651872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.655609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.657898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:42.658725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:42.667314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:42.946518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:42.961603 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb00bf37-48db-4f86-bfcb-bfb5c1fda3f1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.489308 Oct 28 10:04:42.962917 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1760/3481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:42 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:42.974629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1801251856", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa47211-0e93-41b2-a356-031426d3c83c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:43.039777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:43.054441 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6cad1de-86e3-4fb1-bf33-59f776cec5a3 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1305 microversion: 2.1 time: 0.422133 Oct 28 10:04:43.056210 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1722/3482] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:42 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1305 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:43.080337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5920592e-d20b-4bd3-b6ee-0ccc06cfea31 req-ec17e10e-0e18-4094-8d6f-a4936a00f6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1881709-67ac-4bd8-9d2a-e41d453a6412", "tag": "3e8cb734-09fb-4ec3-9089-592ed8eee3dc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:43.113227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5920592e-d20b-4bd3-b6ee-0ccc06cfea31 req-ec17e10e-0e18-4094-8d6f-a4936a00f6f0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:43.114968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5920592e-d20b-4bd3-b6ee-0ccc06cfea31 req-ec17e10e-0e18-4094-8d6f-a4936a00f6f0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:43.115436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5920592e-d20b-4bd3-b6ee-0ccc06cfea31 req-ec17e10e-0e18-4094-8d6f-a4936a00f6f0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:43.125265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] validate_networks() for [('afa47211-0e93-41b2-a356-031426d3c83c', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:04:43.181742 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5920592e-d20b-4bd3-b6ee-0ccc06cfea31 req-ec17e10e-0e18-4094-8d6f-a4936a00f6f0 service nova] Creating event network-changed:3e8cb734-09fb-4ec3-9089-592ed8eee3dc for instance e1881709-67ac-4bd8-9d2a-e41d453a6412 on n-h2-zed-1 Oct 28 10:04:43.196246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5920592e-d20b-4bd3-b6ee-0ccc06cfea31 req-ec17e10e-0e18-4094-8d6f-a4936a00f6f0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120200 Oct 28 10:04:43.209836 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1723/3483] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:43.217948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:43.218792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:43.230024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:43.230971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:43.232990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:43.233854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:43.235677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:43.237331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:43.298256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:43.549852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:43.558421 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-333fefab-c9b8-4bb6-ac81-9c66a186cfea tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 0.345830 Oct 28 10:04:43.565905 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1724/3484] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:43 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:43.571381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:43.577257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:43.604939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:43.605661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:43.606335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:43.607355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:43.617825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:43.618591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:43.932025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:43.959130 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddc5876d-e03c-4e57-8122-711eab71a163 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1528 microversion: 2.1 time: 0.391470 Oct 28 10:04:43.983458 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1725/3485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:43 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1528 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:43.988827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:43.998886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:44.028826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:44.029611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:44.030157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:44.035927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:44.037508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:44.038208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:44.304923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:44.314952 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74dc062c-35be-4974-85d4-3686210e3a74 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1528 microversion: 2.1 time: 0.329924 Oct 28 10:04:44.317740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1726/3486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:43 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1528 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:44.323713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:44.330911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:44.341930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:44.342848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:44.343459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:44.344352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:44.345478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:44.346080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:44.677586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:44.689797 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dfea342-b77f-4f8e-ac7f-2f3ad665ab12 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.370620 Oct 28 10:04:44.708862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1727/3487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:44 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:44.716248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:44.717178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:44.726973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:44.728176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:44.729492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:44.730504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:44.731167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:44.731790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.057991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:04:45.060115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:04:45.061030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:04:45.061880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:04:45.062558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:04:45.076170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.076953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.078354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.079550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.081546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.083864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.117124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:45.125235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for user 6859db32b98f4caba7379962eaef9de3 and project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:45.142443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:04:45.145794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:04:45.204092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:45.218197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81131737-2050-40ca-9e6a-02ad66e414d8 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1305 microversion: 2.1 time: 0.505095 Oct 28 10:04:45.235449 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1728/3488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:44 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1305 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:45.241478 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad6da13a-f5f7-431f-9397-dcbb73b8216c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.276110 Oct 28 10:04:45.242152 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1761/3489] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:04:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2279 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:04:45.252560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:45.253381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:45.271939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.272471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.273583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.274310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.274772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.275209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.562710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:45.563616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:45.575195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.575704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.576154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.576876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.577394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.577861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.624376 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] HTTP exception thrown: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Request method failure captured: Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a HTTP/1.1 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6khcvtdnL4lUBWNX2KEy0UGD5PA9x9Tl3wp_VAFpzn-gw2fgpTnmTGn55oRDwEMJ4gupMiPNwS-ISfjiOdwEClasbTQeV0fcYX4l4aU4W8Sw7ACwJHvohU0TTBf-I_YS873nN9WltAfMqmTL6BqgyTagy_KTY77CO4BmNMp-mTNxdE Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 67ae6c8347d44182b83f7fd0d69eb786 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1239247903 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ae6c8347d44182b83f7fd0d69eb786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ae6c8347d44182b83f7fd0d69eb786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67ae6c8347d44182b83f7fd0d69eb786", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67ae6c8347d44182b83f7fd0d69eb786"}]}] Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1239247903 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 67ae6c8347d44182b83f7fd0d69eb786 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1239247903 Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1239247903-project Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90339f9db1484706836ed509927a209e Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1239247903-project Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '5780736d-7c54-45f2-92c8-bd69f6d56b6a'} Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:45.632761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:45.637683 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:45.641323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Returning 404 to user: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:45.644847 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-16c0cf0b-64c4-4146-9209-965b62b91d39 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 404 len: 111 microversion: 2.1 time: 0.406981 Oct 28 10:04:45.647261 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1729/3490] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:45 2022] DELETE /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 111 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:45.662146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1f65f4f-343d-4708-8a06-36f9d9d1f0a1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:45.663216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1f65f4f-343d-4708-8a06-36f9d9d1f0a1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:45.776079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f1f65f4f-343d-4708-8a06-36f9d9d1f0a1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:45.784587 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1f65f4f-343d-4708-8a06-36f9d9d1f0a1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 200 len: 1215 microversion: 2.1 time: 0.135405 Oct 28 10:04:45.785494 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1730/3491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:45 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:45.793313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:45.809251 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8bfbcee1-c445-4dcd-bcf4-cbacacbbf130 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 0.565806 Oct 28 10:04:45.811380 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1762/3492] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:45 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:45.817678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:45.818237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:45.821036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:45.830843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:45.840570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.841111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.841745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.842653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.843804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.844408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.846900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.849364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.855812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:45.860953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:45.861476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:45.861937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.070506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:46.081571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a9d0011a-5996-4566-af20-1a936d3ea642 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1528 microversion: 2.1 time: 0.288020 Oct 28 10:04:46.099697 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1731/3493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:45 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1528 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:46.110436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:46.111505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:46.120251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.120855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.121422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.122273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.122851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.123724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.180780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:04:46.192881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.193850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.194652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.260647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lazy-loading 'flavor' on Instance uuid b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:46.279246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lazy-loading 'system_metadata' on Instance uuid b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:46.339172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lazy-loading 'metadata' on Instance uuid b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:46.445893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:46.472022 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f419715-9ef1-466b-b20a-47521455fc17 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.658010 Oct 28 10:04:46.474845 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1763/3494] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:45 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:46.478318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.478936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.479396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.487853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Action: 'update', calling method: >, body: {"server": {"name": "5780736d-7c54-45f2-92c8-bd69f6d56b6a_new"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:46.493521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:46.505680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.524394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.525150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.527296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.530244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.531131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.566513 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] HTTP exception thrown: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Request method failure captured: Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a HTTP/1.1 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 64 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6khcvtdnL4lUBWNX2KEy0UGD5PA9x9Tl3wp_VAFpzn-gw2fgpTnmTGn55oRDwEMJ4gupMiPNwS-ISfjiOdwEClasbTQeV0fcYX4l4aU4W8Sw7ACwJHvohU0TTBf-I_YS873nN9WltAfMqmTL6BqgyTagy_KTY77CO4BmNMp-mTNxdE Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 67ae6c8347d44182b83f7fd0d69eb786 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1239247903 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ae6c8347d44182b83f7fd0d69eb786"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/67ae6c8347d44182b83f7fd0d69eb786"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_67ae6c8347d44182b83f7fd0d69eb786", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/67ae6c8347d44182b83f7fd0d69eb786"}]}] Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1239247903 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 67ae6c8347d44182b83f7fd0d69eb786 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1239247903 Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1239247903-project Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90339f9db1484706836ed509927a209e Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1239247903-project Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "5780736d-7c54-45f2-92c8-bd69f6d56b6a_new"}} Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5780736d-7c54-45f2-92c8-bd69f6d56b6a', 'body': {'server': {'name': '5780736d-7c54-45f2-92c8-bd69f6d56b6a_new'}}} Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:04:46.573715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:46.578961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:46.585795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] Returning 404 to user: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:46.587826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c5b7c63-02c5-4c1e-928b-d26e3b5507f6 tempest-ServersNegativeTestMultiTenantJSON-1239247903 tempest-ServersNegativeTestMultiTenantJSON-1239247903-project] 10.222.0.16 "PUT /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 404 len: 111 microversion: 2.1 time: 0.109335 Oct 28 10:04:46.589552 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1764/3495] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:04:46 2022] PUT /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:46.617219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c385847d-1623-4f90-ae3c-792aa93ce522 req-03c834ef-94ba-4ad1-84c4-89332e7b6a20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243ff6fd-ddaa-43cc-9f71-5fda436b2719", "name": "network-vif-plugged", "status": "completed", "tag": "56642ffc-e947-419e-bb93-d7a9948c5c6d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:46.636159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c385847d-1623-4f90-ae3c-792aa93ce522 req-03c834ef-94ba-4ad1-84c4-89332e7b6a20 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.637039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c385847d-1623-4f90-ae3c-792aa93ce522 req-03c834ef-94ba-4ad1-84c4-89332e7b6a20 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.637741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c385847d-1623-4f90-ae3c-792aa93ce522 req-03c834ef-94ba-4ad1-84c4-89332e7b6a20 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.652067 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c385847d-1623-4f90-ae3c-792aa93ce522 req-03c834ef-94ba-4ad1-84c4-89332e7b6a20 service nova] Creating event network-vif-plugged:56642ffc-e947-419e-bb93-d7a9948c5c6d for instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 on n-h2-zed-1 Oct 28 10:04:46.658836 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c385847d-1623-4f90-ae3c-792aa93ce522 req-03c834ef-94ba-4ad1-84c4-89332e7b6a20 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067437 Oct 28 10:04:46.659807 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1765/3496] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:46.662676 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-075cbb1c-e2d6-4f34-9fb2-9cd6e2367e87 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 204 len: 0 microversion: 2.1 time: 0.560208 Oct 28 10:04:46.666822 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1732/3497] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:46 2022] DELETE /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:46.669541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:46.670574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:46.673337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:46.674120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:46.680065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.681149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.681908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.683006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.683883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.684267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.684605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.685184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.685549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.686027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.687569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.688405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.691618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:46.726398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:04:46.849530 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b3fd6a8c-c9c8-4683-ac6a-56321e06bc3c tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 204 len: 0 microversion: 2.1 time: 0.183445 Oct 28 10:04:46.850434 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1733/3498] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:46 2022] DELETE /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:46.858214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:46.859783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:46.867743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.868273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.868739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.869469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.869967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.870467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.953901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:46.963611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bce490a3-5086-4c51-97fc-ddd462a90bdd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 200 len: 1273 microversion: 2.1 time: 0.111732 Oct 28 10:04:46.965097 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1734/3499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:46 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:46.969104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:46.969725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:46.985682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.986072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.986663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:46.988886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:46.989400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:46.989851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:47.075623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:47.084365 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-179828d9-5859-4940-bb5d-a7ec478ed52b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.422904 Oct 28 10:04:47.085484 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1766/3500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:46 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:47.091220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:47.092477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:47.100043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:47.101349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:47.102057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:47.103054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:47.103736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:47.104445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:47.183118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:47.192356 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f79b58c8-f1c3-4606-a1c3-0f6d1cc05b0a tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 0.227033 Oct 28 10:04:47.208649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1735/3501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:46 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:47.499089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:47.501383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:47.513966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:47.514844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:47.515643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:47.516564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:47.517233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:47.517870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:47.545660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:47.758512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:47.768131 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1436dee-c7b5-48b0-945f-51f7713a2978 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.273561 Oct 28 10:04:47.771724 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1736/3502] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:47 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:47.817891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:47.829271 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2196578-08aa-4168-b473-33ea2729f796 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1534 microversion: 2.1 time: 0.742140 Oct 28 10:04:47.830303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1767/3503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:47 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1534 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:47.990690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:47.994752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:48.002875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.003658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.004614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.005576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.006352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.007182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.101966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:48.112855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:48.113505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:48.124119 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-abf4e7e9-f696-45f9-979e-125b053237da tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 200 len: 1273 microversion: 2.1 time: 0.140201 Oct 28 10:04:48.124831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.125121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1737/3504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:47 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:48.125504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.125959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.126678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.127136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.128321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.217265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:48.217880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:48.236775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.237497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.237741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.239037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.239495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.239921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.682485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:48.702354 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85c5bfbf-5d14-4876-99ca-93d1137c2453 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1317 microversion: 2.1 time: 0.488665 Oct 28 10:04:48.704794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1738/3505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:48 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1317 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:48.805761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:48.806411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:48.815527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.816205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.817098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.820648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.823996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.824638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.890660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:48.907537 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-11db8e3e-535f-418c-a0df-48cb89511dc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.797699 Oct 28 10:04:48.908551 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1768/3506] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:48 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:48.930940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:48.931948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:48.943750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.944961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.945955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:48.947183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:48.947905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:48.948649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.406601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1aa2ecfe6334fdeb302c761dd404d2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '478a5b85b2154eae946434f0de92780e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:49.418384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4c3b1b5-2879-4c82-83cd-478b3c62fd8a tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 200 len: 1534 microversion: 2.1 time: 0.491783 Oct 28 10:04:49.436965 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1769/3507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:48 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 1534 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:49.456204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:49.459113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:49.464391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:49.473338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.474093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.474765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.478770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.479719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.480237 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b8dd98d-c912-4005-b0d2-94b09afe52e3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.685357 Oct 28 10:04:49.480978 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1739/3508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:48 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:49.481242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.626046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:49.641675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a61c5e51-f02c-477f-b712-0c444c5216d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 200 len: 1217 microversion: 2.1 time: 0.202883 Oct 28 10:04:49.642887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1770/3509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:49 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 1217 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:49.649110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-216f69bb-168b-4f7e-8afa-cad31c1a574d req-68c3f9ad-422f-4985-a143-7127a8d08963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5780736d-7c54-45f2-92c8-bd69f6d56b6a", "name": "network-vif-deleted", "tag": "4d9aa48b-8f34-4a64-8dfb-08b870c836a9"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:49.670513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-216f69bb-168b-4f7e-8afa-cad31c1a574d req-68c3f9ad-422f-4985-a143-7127a8d08963 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.677738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-216f69bb-168b-4f7e-8afa-cad31c1a574d req-68c3f9ad-422f-4985-a143-7127a8d08963 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.678849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-216f69bb-168b-4f7e-8afa-cad31c1a574d req-68c3f9ad-422f-4985-a143-7127a8d08963 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.681566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:49.682151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:49.693640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.694252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.695002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-216f69bb-168b-4f7e-8afa-cad31c1a574d req-68c3f9ad-422f-4985-a143-7127a8d08963 service nova] Creating event network-vif-deleted:4d9aa48b-8f34-4a64-8dfb-08b870c836a9 for instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a on n-h1-zed-1 Oct 28 10:04:49.695604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.699797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.700246 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-216f69bb-168b-4f7e-8afa-cad31c1a574d req-68c3f9ad-422f-4985-a143-7127a8d08963 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055856 Oct 28 10:04:49.700492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.700897 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1771/3510] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:49.701142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.734919 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1351a9bd-5644-4f16-b635-47b27cc4eb2e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/ips" status: 200 len: 151 microversion: 2.20 time: 0.252572 Oct 28 10:04:49.735676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1740/3511] 10.222.0.16 () {60 vars in 1289 bytes} [Fri Oct 28 10:04:49 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/ips => generated 151 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:04:49.737057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:49.737797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:49.755410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.760041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.760755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.762954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.764228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.764845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.931489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:49.932110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:49.938774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.939271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.939726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:49.940430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:49.940886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:49.941542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.130177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:50.138803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2944ee2f-35cd-4de5-94e0-fd26f9e75f19 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.211467 Oct 28 10:04:50.139618 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1741/3512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:49 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:50.339787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:50.352882 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4514817b-5366-4989-9d9f-ab001d84fb1c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1505 microversion: 2.1 time: 0.625807 Oct 28 10:04:50.353542 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1772/3513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:49 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1505 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:50.376318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:50.376877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:50.393558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.394419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.395344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.396572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.397448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.399740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.439080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:50.440088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddc68500-8e33-4879-a902-13ecba2868b8 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719/os-instance-actions/req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb" status: 200 len: 313 microversion: 2.1 time: 0.068165 Oct 28 10:04:50.443815 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1742/3514] 10.222.0.16 () {58 vars in 1419 bytes} [Fri Oct 28 10:04:50 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719/os-instance-actions/req-3d3b3f5c-f3e9-499d-866a-13b66848b1fb => generated 313 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:50.461292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:50.462481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] [instance: 5780736d-7c54-45f2-92c8-bd69f6d56b6a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:50.466890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:50.472641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:50.474085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.475143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.475873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.477173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.477854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.478682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.483318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.484148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.484841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.485909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.488559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.494239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.505122 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] HTTP exception thrown: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Request method failure captured: Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a HTTP/1.1 Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6kOir8VjLm5o6UIU9JxqlMpYJ8uEAltZq9pQimSXL-YiFc7bIr0D87gihXxDij_QkOt70qoOlrpv9DpSwY0Dov-o8JBo5rpcP_SY_dknzyVtEygfWJU6O8ZYxp8F5xxK1u21StAp6FkGPTba_Fj0pi_ivLJlAOT83ISDze6LkbYHnE Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 478a5b85b2154eae946434f0de92780e Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1731561672 Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/478a5b85b2154eae946434f0de92780e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/478a5b85b2154eae946434f0de92780e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_478a5b85b2154eae946434f0de92780e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/478a5b85b2154eae946434f0de92780e"}]}] Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1731561672 Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 478a5b85b2154eae946434f0de92780e Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1731561672 Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1731561672-project Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: d1aa2ecfe6334fdeb302c761dd404d2d Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1731561672-project Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5780736d-7c54-45f2-92c8-bd69f6d56b6a'} Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:50.508005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. Oct 28 10:04:50.513766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:04:50.517421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] Returning 404 to user: Instance 5780736d-7c54-45f2-92c8-bd69f6d56b6a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:50.518736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-59254c17-8d11-4837-b49d-eb91894e5983 tempest-ServersNegativeTestMultiTenantJSON-1731561672 tempest-ServersNegativeTestMultiTenantJSON-1731561672-project] 10.222.0.16 "GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a" status: 404 len: 111 microversion: 2.1 time: 0.063313 Oct 28 10:04:50.519976 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1773/3515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:50 2022] GET /compute/v2.1/servers/5780736d-7c54-45f2-92c8-bd69f6d56b6a => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:50.529123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:50.530428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:50.546538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.551051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.551710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.552644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.553313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.553970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.664252 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a453cadb-fa32-43bb-899e-bc28681962eb tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "POST /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719/action" status: 202 len: 0 microversion: 2.1 time: 0.206670 Oct 28 10:04:50.664898 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1743/3516] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:04:50 2022] POST /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:04:50.683615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:50.684860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:50.695998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.699485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.700138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.701100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.706441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.707118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.838322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:50.851466 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8d6874da-4391-4102-a267-f28f5760e81c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 200 len: 1219 microversion: 2.1 time: 0.180624 Oct 28 10:04:50.866284 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1744/3517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:50 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 1219 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:50.878524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:50.879144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:50.893134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:50.894573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.895071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.895503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:50.899306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:50.901431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:50.902071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:51.275736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:51.293088 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9352ba22-c8aa-4d57-941f-d0f0a77ded93 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.763611 Oct 28 10:04:51.295067 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1774/3518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:50 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:51.322450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:51.323078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:51.346735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:51.348171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:51.348862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:51.349594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:51.350063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:51.358891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:51.701350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:51.710814 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c11ec9de-ffff-43d4-8556-e0918d16e44e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.414388 Oct 28 10:04:51.713643 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1775/3519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:51 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:51.879550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:51.880165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:51.888389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:51.888882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:51.889345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:51.890040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:51.890491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:51.890915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:51.946448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:51.972926 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1368091-4325-4132-8da3-dedbeaa84e94 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1507 microversion: 2.1 time: 1.101015 Oct 28 10:04:51.973716 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1745/3520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:50 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1507 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:52.012647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:52.023878 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c57822ef-f21a-4f31-b4ae-20f0f6c226f5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 200 len: 1219 microversion: 2.1 time: 0.148006 Oct 28 10:04:52.036937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1776/3521] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:51 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 1219 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:52.328036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:52.329613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:52.364192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:52.366411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:52.368250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:52.372354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:52.373699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:52.375797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:52.732722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:52.733679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:52.747955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:52.748539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:52.749034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:52.749757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:52.750791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:52.752324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:52.908012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:52.919104 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3bc07586-bd0d-4f21-b432-99079eb353bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.600735 Oct 28 10:04:52.919724 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1746/3522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:52 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:52.951467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:52.952694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:52.969726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:52.970502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:52.971144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:52.972068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:52.972847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:52.973475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:53.010006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lazy-loading 'flavor' on Instance uuid 635cb96d-039d-4c62-9784-aa89b4b879d1 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:53.108333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:53.145019 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-59ec44a8-9b65-4f18-93ad-d5c554c7a90b tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.414835 Oct 28 10:04:53.148709 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1777/3523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:52 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:53.159175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:53.160447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:53.171603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:53.180575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:53.181260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:53.182046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:53.183967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:53.185377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:53.387963 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80e52237-5810-4cce-84ee-e2fff3f33140 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/action" status: 202 len: 0 microversion: 2.20 time: 0.442268 Oct 28 10:04:53.388679 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1747/3524] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 10:04:52 2022] POST /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:53.397264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:53.404083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:53.418398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:53.423848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:53.425895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:53.427652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:53.429604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:53.430219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:53.466804 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc HTTP/1.1 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc'} Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:04:53.474146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-84600c41-3a0b-4f6c-8700-8d2e9c455740 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 404 len: 111 microversion: 2.1 time: 0.083097 Oct 28 10:04:53.478168 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1748/3525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:53 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:04:53.484066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:53.484691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:53.494324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:53.494784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:53.495697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:53.496017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:53.496484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:53.496939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:53.612160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:53.625666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5470bb9b-7c6b-49d3-ac65-73dffd8bd92c tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1507 microversion: 2.1 time: 0.475637 Oct 28 10:04:53.626905 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1778/3526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:53 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1507 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:53.682760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1750941916", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa47211-0e93-41b2-a356-031426d3c83c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:53.747660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] validate_networks() for [('afa47211-0e93-41b2-a356-031426d3c83c', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:04:54.071987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:54.098894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:54.100806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:54.102238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc2d36ca-6d57-4a96-8bf9-696ed1fd3221 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.623692 Oct 28 10:04:54.109066 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1749/3527] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:04:53 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:04:54.117352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:54.118436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:54.125582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.126513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.127325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.128492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.130880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.131630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.307183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:04:54.307530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:04:54.308298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:04:54.308816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:04:54.309697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:04:54.319026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=41 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:54.324081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.324560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.325024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.325754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.326210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.326643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.334020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=9 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:54.341278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=95,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:54.349450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:04:54.357058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for user 6859db32b98f4caba7379962eaef9de3 and project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:04:54.371807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:04:54.374306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:04:54.427576 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b78ef32b-266a-4c68-ba9f-f691f4146d2c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.748713 Oct 28 10:04:54.429650 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1779/3528] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:04:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:04:54.434765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:54.435739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:54.446212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.449882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.450698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.451657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.452289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.455156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.589101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:54.602463 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c1c386df-8d30-4861-a35a-2af546162c9c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.491601 Oct 28 10:04:54.603061 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1750/3529] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:54 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:54.624572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3902a09d-f746-4de7-9ece-4c9e3671cb30 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:54.624572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3902a09d-f746-4de7-9ece-4c9e3671cb30 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:54.708516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:54.739488 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-18e2d28c-03fc-4a61-a8b9-d699e258ea62 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.308416 Oct 28 10:04:54.740085 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1780/3530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:54 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:54.753920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:54.757004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:54.798578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.801400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.801860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.802604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:54.803067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:54.803499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:54.885994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3902a09d-f746-4de7-9ece-4c9e3671cb30 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:54.894243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3902a09d-f746-4de7-9ece-4c9e3671cb30 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1215 microversion: 2.1 time: 0.290106 Oct 28 10:04:54.894837 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1751/3531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:54 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1215 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:55.142295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:55.146361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:55.149486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:55.162145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5673a7d6-412b-4dc1-9c64-b8e762d7d684 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1505 microversion: 2.1 time: 0.420770 Oct 28 10:04:55.163209 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1781/3532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:54 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:55.179514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.182162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.188452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:55.189251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.190339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.190939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:55.194215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '.version_select at 0x7fca3247b550>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:55.196067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:55.198640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:55.212560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.216291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.218237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:55.219245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.219941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.220617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:55.273431 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-911efd21-e8ab-441c-a828-904a4f6a1dc2 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.088754 Oct 28 10:04:55.274813 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1782/3533] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 10:04:55 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719/os-instance-actions => generated 611 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:55.344146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:55.347007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:55.368529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.369287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.369877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:55.370861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.371548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.372205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:55.423722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:04:55.491891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:04:55.586636 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-556b8d6d-93bb-4080-a48e-01939ab55861 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "DELETE /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 204 len: 0 microversion: 2.1 time: 0.256470 Oct 28 10:04:55.586636 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1783/3534] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:04:55 2022] DELETE /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:04:55.608420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:55.610047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:55.628980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.631932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.635725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:55.640017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:55.643338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:55.645733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:56.019567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:56.034877 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b34328ca-b4f0-4f81-a5e6-9386ff3c8867 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1511 microversion: 2.1 time: 0.443876 Oct 28 10:04:56.035503 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1784/3535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:55 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1511 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:56.044267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:56.047795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:56.059784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:56.062002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:56.062642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:56.063530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:56.064146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:56.064735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:56.298302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:56.326859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:56.331835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:56.348213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3022f3bd-1ae3-4f4b-9f65-7a95400bfbbb tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 1.213162 Oct 28 10:04:56.353619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1752/3536] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:04:55 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:04:56.370993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:56.373631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:56.392939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:56.396420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:56.397135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:56.400093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:56.400684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:56.402414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:56.866005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:56.915545 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7437165a-e108-44e2-bc3f-2aed0be38318 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.558067 Oct 28 10:04:56.916455 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1753/3537] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:56 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:56.944121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:56.946922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:56.968828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:56.970940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:56.971747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:56.973255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:56.973969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:56.977788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:57.085901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:57.094658 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2338c398-d601-4e14-ba67-0af2014e9266 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 1.058018 Oct 28 10:04:57.110316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:57.110316 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6e040822-edeb-4b56-abfb-72481d9ac805 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1273 microversion: 2.1 time: 0.169750 Oct 28 10:04:57.110316 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1754/3538] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:56 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:57.113006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1785/3539] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:56 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:57.115605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:57.116769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:57.124679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:57.125212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:57.125809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:57.126697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:57.127168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:57.127660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:57.381858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:57.383089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:57.403474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:57.404358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:57.405043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:57.406050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:57.410205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:57.411355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:57.874619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:57.889835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:57.893837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:57.896881 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-abb69eaf-bfc9-4e8b-bbca-96b3ae26889a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.520903 Oct 28 10:04:57.898816 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1786/3540] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:04:57 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:04:57.929511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:57.940552 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0a9a66a-e817-455b-aa28-c17a6b6c4934 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1511 microversion: 2.1 time: 0.829646 Oct 28 10:04:57.941872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:57.942346 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1755/3541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:57 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1511 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:57.949830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:57.962768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:57.965846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:57.966326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:57.969392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:57.972136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:57.972697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:58.123193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:58.123823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:58.143024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:58.143541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:58.143988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:58.144710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:58.145380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:58.145980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:58.519019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:58.544087 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ab03439-5c07-462f-858e-d024a087a63f tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.604764 Oct 28 10:04:58.554821 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1787/3542] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:57 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:58.567122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:58.567753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:58.584582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:58.586514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:58.587391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:58.588361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:58.589316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:58.590000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:58.738362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:58.747184 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c5171e7-4f5c-4ee3-af76-46f98d0667d5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1273 microversion: 2.1 time: 0.191189 Oct 28 10:04:58.747777 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1788/3543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:58 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:58.753856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:58.760617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9c686605-62b6-48ba-85ed-2486e5341193 req-5729928c-ddd8-476b-8413-89b547e42c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1881709-67ac-4bd8-9d2a-e41d453a6412", "name": "network-vif-plugged", "status": "completed", "tag": "3e8cb734-09fb-4ec3-9089-592ed8eee3dc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:58.770176 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23d90175-5360-4f48-863f-d55d5730a85b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.650664 Oct 28 10:04:58.771098 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1756/3544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:58 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:04:58.789224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9c686605-62b6-48ba-85ed-2486e5341193 req-5729928c-ddd8-476b-8413-89b547e42c9d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:58.789849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9c686605-62b6-48ba-85ed-2486e5341193 req-5729928c-ddd8-476b-8413-89b547e42c9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:58.790519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9c686605-62b6-48ba-85ed-2486e5341193 req-5729928c-ddd8-476b-8413-89b547e42c9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:58.815973 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9c686605-62b6-48ba-85ed-2486e5341193 req-5729928c-ddd8-476b-8413-89b547e42c9d service nova] Creating event network-vif-plugged:3e8cb734-09fb-4ec3-9089-592ed8eee3dc for instance e1881709-67ac-4bd8-9d2a-e41d453a6412 on n-h2-zed-1 Oct 28 10:04:58.824201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9c686605-62b6-48ba-85ed-2486e5341193 req-5729928c-ddd8-476b-8413-89b547e42c9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073814 Oct 28 10:04:58.825829 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1789/3545] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:58.929730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:58.930674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:58.942540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:58.944927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:58.950936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:58.952633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:58.953373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:58.954765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.017462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5424525b-0b73-4db4-ae0d-d9267d4ef032 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca32e1f700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1607500097", "description": "tempest-description-51570673"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:59.682890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:59.708931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:59.711093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:59.712738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19c2d305-efda-4391-94c3-b1723829b9d9 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.790703 Oct 28 10:04:59.714069 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1790/3546] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:04:58 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:04:59.719962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:59.720942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:59.728754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.729750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.730454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.731411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.731962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.732510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.785833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.789726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.790482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.792516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lazy-loading 'fault' on Instance uuid 243ff6fd-ddaa-43cc-9f71-5fda436b2719 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:04:59.836483 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5424525b-0b73-4db4-ae0d-d9267d4ef032 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.064292 Oct 28 10:04:59.837128 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1757/3547] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:04:58 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:59.853806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e34fa3f9-6de7-4fb9-a274-e8d947702b47 req-d8511545-1f39-4dbd-970f-738b51f343dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "243ff6fd-ddaa-43cc-9f71-5fda436b2719", "name": "network-vif-deleted", "tag": "56642ffc-e947-419e-bb93-d7a9948c5c6d"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:04:59.866448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e34fa3f9-6de7-4fb9-a274-e8d947702b47 req-d8511545-1f39-4dbd-970f-738b51f343dd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.867352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e34fa3f9-6de7-4fb9-a274-e8d947702b47 req-d8511545-1f39-4dbd-970f-738b51f343dd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.868183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e34fa3f9-6de7-4fb9-a274-e8d947702b47 req-d8511545-1f39-4dbd-970f-738b51f343dd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.880121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:04:59.885655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e34fa3f9-6de7-4fb9-a274-e8d947702b47 req-d8511545-1f39-4dbd-970f-738b51f343dd service nova] Creating event network-vif-deleted:56642ffc-e947-419e-bb93-d7a9948c5c6d for instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 on n-h2-zed-1 Oct 28 10:04:59.891466 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e34fa3f9-6de7-4fb9-a274-e8d947702b47 req-d8511545-1f39-4dbd-970f-738b51f343dd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053102 Oct 28 10:04:59.891666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-569b3bc1-6020-4b7f-8720-e160f90fce4e tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1307 microversion: 2.1 time: 0.174325 Oct 28 10:04:59.892647 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1791/3548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:59 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:04:59.893779 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1758/3549] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:04:59.900344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:59.900511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:04:59.901173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:59.901721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:04:59.909462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.910373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.911030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.911965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.912737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.914053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.926342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.929175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.929443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:04:59.930858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:04:59.931342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:04:59.934403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:00.438107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:00.472462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e50d3a82-640b-475c-9a2b-9a88c0c54757 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.574410 Oct 28 10:05:00.490554 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1759/3550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:59 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:00.514731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:00.515662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:00.541045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:00.544771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:00.545462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:00.547564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:00.549340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:00.550227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:00.739242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:00.747165 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62cc47f6-da38-4438-9e82-09339771fdc6 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1293 microversion: 2.1 time: 0.851748 Oct 28 10:05:00.749670 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1792/3551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:04:59 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1293 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:00.755028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-460907b8-19b0-482e-ad38-3833eb08d8c4 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca32451280>, body: {"security_group_rule": {"parent_group_id": "36b7d38a-d44c-4d6a-9806-3b1ebe6a5762", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:00.832865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:00.846782 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f97daf9e-2719-408f-8560-00fd39a50bb9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.351391 Oct 28 10:05:00.847376 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1760/3552] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:00 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:00.867295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:00.868217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:00.875491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:00.880991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:00.883909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:00.885003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:00.885644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:00.888685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:01.259053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:01.286019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:01.290141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:01.294224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8443b096-e8e0-4372-992d-c57df70e5c13 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.444119 Oct 28 10:05:01.298838 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1761/3553] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:00 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:01.306400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:01.307462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:01.317548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:01.318612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:01.319331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:01.320324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:01.321027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:01.321664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:01.384011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:01.384937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:01.386086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:01.386895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lazy-loading 'fault' on Instance uuid 243ff6fd-ddaa-43cc-9f71-5fda436b2719 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:05:01.484945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f19af7f3e233433db9a4812fe34f458e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bbc01e308ae49a3b71a6483021afeaa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:01.501854 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-88ad6cad-a522-4876-9896-e8ca050d71b3 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 200 len: 1307 microversion: 2.1 time: 0.200663 Oct 28 10:05:01.503112 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1762/3554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:01 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 1307 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:01.515992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:01.523340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:01.542392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:01.543954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:01.549690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:01.550559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:01.551044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:01.551482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:01.822111 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-460907b8-19b0-482e-ad38-3833eb08d8c4 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.071078 Oct 28 10:05:01.823699 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1793/3555] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:00 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:01.828351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:01.828998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:01.841145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:01.841448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:01.842076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:01.844466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:01.845171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:01.846809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:02.266583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:02.295833 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-057c642e-bba6-4e55-808e-fdf7e86bcc98 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1484 microversion: 2.1 time: 0.469107 Oct 28 10:05:02.302210 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1794/3556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:01 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1484 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:02.320137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e55d740-9293-41db-83e4-45cdc34efa3c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca3246ef70>, body: {"security_group_rule": {"parent_group_id": "36b7d38a-d44c-4d6a-9806-3b1ebe6a5762", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:02.357460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:02.366770 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f21dfa7-5c23-4cb7-b70f-1e9ad6fb9def tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.862402 Oct 28 10:05:02.388288 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1763/3557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:01 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:02.399941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:02.400864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:02.419957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:02.422036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:02.422514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:02.428945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:02.429466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:02.430075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:02.506003 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6e55d740-9293-41db-83e4-45cdc34efa3c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: This rule already exists in group 36b7d38a-d44c-4d6a-9806-3b1ebe6a5762 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e55d740-9293-41db-83e4-45cdc34efa3c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 138 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: {"security_group_rule": {"parent_group_id": "36b7d38a-d44c-4d6a-9806-3b1ebe6a5762", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: exception: This rule already exists in group 36b7d38a-d44c-4d6a-9806-3b1ebe6a5762 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'security_group_rule': {'parent_group_id': '36b7d38a-d44c-4d6a-9806-3b1ebe6a5762', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 36b7d38a-d44c-4d6a-9806-3b1ebe6a5762 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 36b7d38a-d44c-4d6a-9806-3b1ebe6a5762 Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:02.509696 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:02.515252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:02.515252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:02.515252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 36b7d38a-d44c-4d6a-9806-3b1ebe6a5762 Oct 28 10:05:02.515252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:02.518630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e55d740-9293-41db-83e4-45cdc34efa3c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 400 to user: This rule already exists in group 36b7d38a-d44c-4d6a-9806-3b1ebe6a5762 {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:02.519764 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6e55d740-9293-41db-83e4-45cdc34efa3c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.215749 Oct 28 10:05:02.520920 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1795/3558] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:02 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:05:02.528147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-26140951-6656-46a3-b858-de715fd7fc3c req-419c64b4-0345-479f-ac14-6ca7065adc67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6668c6d-d735-4d74-9844-4555e56b8f1c", "tag": "b77d23e5-6732-4f1d-8ab7-fd54a730c3a3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:02.576225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-26140951-6656-46a3-b858-de715fd7fc3c req-419c64b4-0345-479f-ac14-6ca7065adc67 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:02.577515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-26140951-6656-46a3-b858-de715fd7fc3c req-419c64b4-0345-479f-ac14-6ca7065adc67 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:02.578153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-26140951-6656-46a3-b858-de715fd7fc3c req-419c64b4-0345-479f-ac14-6ca7065adc67 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:02.604758 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-26140951-6656-46a3-b858-de715fd7fc3c req-419c64b4-0345-479f-ac14-6ca7065adc67 service nova] Creating event network-changed:b77d23e5-6732-4f1d-8ab7-fd54a730c3a3 for instance b6668c6d-d735-4d74-9844-4555e56b8f1c on n-h1-zed-1 Oct 28 10:05:02.623593 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-26140951-6656-46a3-b858-de715fd7fc3c req-419c64b4-0345-479f-ac14-6ca7065adc67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101183 Oct 28 10:05:02.624774 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1796/3559] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:02.630224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:02.631165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:02.638746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:02.639492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:02.640501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:02.641582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:02.642427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:02.643021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:03.057578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:03.068632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4815644-233b-4c70-9f96-e1eb17449136 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.678882 Oct 28 10:05:03.069480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1764/3560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:02 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:03.070494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:03.101594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:03.108063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:03.109171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:03.113242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:03.117164 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c5c34af-5701-4ae8-9438-bbd3c1307307 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.489515 Oct 28 10:05:03.122712 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1797/3561] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:02 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:03.133414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:03.134239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] [instance: 243ff6fd-ddaa-43cc-9f71-5fda436b2719] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:03.139753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:03.146360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:03.148844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:03.149766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:03.152177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:03.152822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:03.153399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:03.153717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:03.156518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:03.158526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:03.159618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:03.160634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:03.198427 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] HTTP exception thrown: Instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 could not be found. Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Request method failure captured: Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 HTTP/1.1 Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ks5iVMq3zbco6i-UeRqhZW7ZluhAdmJbBQYlCa8jpYERWSg2QAuSLDbisOrxX5tX_tEzVRcpVZzQJHVPuKx7OGg_HzdqnhVk16q02infKQ6TlpHu1-Wc-7qFi4FT9lFQCucLqA_Qz4FG8cvvTnrfblnmSz8mo2nGObXxOvDq46Dhk Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 6bbc01e308ae49a3b71a6483021afeaa Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-InstanceActionsTestJSON-2075794756 Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bbc01e308ae49a3b71a6483021afeaa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6bbc01e308ae49a3b71a6483021afeaa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6bbc01e308ae49a3b71a6483021afeaa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6bbc01e308ae49a3b71a6483021afeaa"}]}] Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-InstanceActionsTestJSON-2075794756 Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 6bbc01e308ae49a3b71a6483021afeaa Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-InstanceActionsTestJSON-2075794756 Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-InstanceActionsTestJSON-2075794756-project Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f19af7f3e233433db9a4812fe34f458e Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-InstanceActionsTestJSON-2075794756-project Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 could not be found. Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '243ff6fd-ddaa-43cc-9f71-5fda436b2719'} Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 could not be found. Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 could not be found. Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:03.200232 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 could not be found. Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] Returning 404 to user: Instance 243ff6fd-ddaa-43cc-9f71-5fda436b2719 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d09534b5-3585-4122-8a92-ca1ecb976a50 tempest-InstanceActionsTestJSON-2075794756 tempest-InstanceActionsTestJSON-2075794756-project] 10.222.0.16 "GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719" status: 404 len: 111 microversion: 2.1 time: 0.077760 Oct 28 10:05:03.206254 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1798/3562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:03 2022] GET /compute/v2.1/servers/243ff6fd-ddaa-43cc-9f71-5fda436b2719 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:05:03.227477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c6cc7642-186a-4578-b8d8-1e9e85245ba7 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Calling method '.version_select at 0x7fca324fb4c0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:03.367109 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4cecf177-9cc9-47fb-8bd9-ab6729edf82c tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272251 Oct 28 10:05:03.377165 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1765/3563] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:05:03 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412/os-interface => generated 284 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:03.394637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:03.395652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:03.405827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:03.406436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:03.407415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:03.408623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:03.409348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:03.410009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:03.832434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:03.844381 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca4e97a2-a266-46cb-bfa5-1a7aa47b03b8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.452860 Oct 28 10:05:03.845468 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1766/3564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:03 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:05:03.995169 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c6cc7642-186a-4578-b8d8-1e9e85245ba7 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/a33c816e-bf9c-4aa9-958d-53cfe6a74166" status: 202 len: 0 microversion: 2.1 time: 0.779539 Oct 28 10:05:03.995780 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1799/3565] 10.222.0.16 () {58 vars in 1287 bytes} [Fri Oct 28 10:05:03 2022] DELETE /compute/v2.1/os-security-group-rules/a33c816e-bf9c-4aa9-958d-53cfe6a74166 => generated 0 bytes in 793 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:04.006392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f81f867-ed54-4843-8ed6-7414ea62434c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca32e1faf0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1676318346", "description": "tempest-description-1862893605"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:04.096145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:04.096862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:04.104302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:04.104884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:04.105414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:04.106190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:04.106720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:04.107217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:04.339918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:04.367345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=5 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:04.590141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2f81f867-ed54-4843-8ed6-7414ea62434c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.587517 Oct 28 10:05:04.591223 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1767/3566] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:05:04 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:04.595849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:04.596666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:04.603657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:04.604406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:04.605147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:04.606074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:04.606766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:04.607408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:04.708626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:04.718708 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0b67e54-5814-4f83-9850-169c23d96918 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1496 microversion: 2.1 time: 0.626586 Oct 28 10:05:04.719465 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1800/3567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:04 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1496 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:04.730956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9770bd45-a5d2-4611-9e03-5f096805358c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca32409f70>, body: {"security_group_rule": {"parent_group_id": "03ba2c56-1675-4cab-ae19-826be0368cf2", "ip_protocol": "tcp", "from_port": 1588536414, "to_port": 22}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:04.891815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=18 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:04.957675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9770bd45-a5d2-4611-9e03-5f096805358c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: Invalid port range 1588536414:22. Former value cannot be greater than the later Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9770bd45-a5d2-4611-9e03-5f096805358c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 146 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: {"security_group_rule": {"parent_group_id": "03ba2c56-1675-4cab-ae19-826be0368cf2", "ip_protocol": "tcp", "from_port": 1588536414, "to_port": 22}} Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid port range 1588536414:22. Former value cannot be greater than the later Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'security_group_rule': {'parent_group_id': '03ba2c56-1675-4cab-ae19-826be0368cf2', 'ip_protocol': 'tcp', 'from_port': 1588536414, 'to_port': 22}}} Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1588536414:22. Former value cannot be greater than the later Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1588536414:22. Former value cannot be greater than the later Oct 28 10:05:04.959497 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1588536414:22. Former value cannot be greater than the later Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9770bd45-a5d2-4611-9e03-5f096805358c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 400 to user: Invalid port range 1588536414:22. Former value cannot be greater than the later {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:04.965546 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9770bd45-a5d2-4611-9e03-5f096805358c tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.244198 Oct 28 10:05:04.967087 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1801/3568] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:04 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 246 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:05:04.976676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:04.977601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:04.986839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:04.987925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:04.988611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:04.989679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:04.990418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:04.991085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:05.390400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:05.400773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:05.402534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:05.403864 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1caea5ac-fcf4-457a-b87a-9ed3ba08485e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.811537 Oct 28 10:05:05.404618 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1768/3569] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:04 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:05.409488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ca12ebd-4f12-4b01-82aa-b30db69fcb7e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca32e41ee0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-353803606", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:05.411884 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8ca12ebd-4f12-4b01-82aa-b30db69fcb7e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: Security group id should be uuid Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ca12ebd-4f12-4b01-82aa-b30db69fcb7e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 130 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-353803606", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: exception: Security group id should be uuid Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-353803606', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:05.413736 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:05.418018 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 28 10:05:05.418018 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:05.421053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ca12ebd-4f12-4b01-82aa-b30db69fcb7e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 400 to user: Security group id should be uuid {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:05.422759 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ca12ebd-4f12-4b01-82aa-b30db69fcb7e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.016418 Oct 28 10:05:05.423856 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1769/3570] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:05 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:05.438427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-32e963ec-f87c-4b9e-9ce6-e300d50c554e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca32db6d30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-453583914", "description": "tempest-description-933268774"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:05.501218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:05.517643 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b4c4898-e787-42e7-afda-3c5f30429435 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.548899 Oct 28 10:05:05.518693 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1802/3571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:04 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:05.746157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:05.746981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:05.764775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:05.765302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:05.765739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:05.766630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:05.767248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:05.767682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:05.979084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-32e963ec-f87c-4b9e-9ce6-e300d50c554e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.545678 Oct 28 10:05:05.979690 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1770/3572] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:05:05 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:05.998074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d36e77d-b116-401f-8210-ec6090abd822 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca32f99040>, body: {"security_group_rule": {"parent_group_id": "4b0eddc9-b9ce-4524-80d1-30272738ce66", "ip_protocol": "tempest-999-747367613", "from_port": 22, "to_port": 22}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:06.134964 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-1d36e77d-b116-401f-8210-ec6090abd822 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: Invalid IP protocol tempest-999-747367613. Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d36e77d-b116-401f-8210-ec6090abd822 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 156 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: {"security_group_rule": {"parent_group_id": "4b0eddc9-b9ce-4524-80d1-30272738ce66", "ip_protocol": "tempest-999-747367613", "from_port": 22, "to_port": 22}} Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid IP protocol tempest-999-747367613. Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'security_group_rule': {'parent_group_id': '4b0eddc9-b9ce-4524-80d1-30272738ce66', 'ip_protocol': 'tempest-999-747367613', 'from_port': 22, 'to_port': 22}}} Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-747367613. Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-747367613. Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:06.136867 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-747367613. Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d36e77d-b116-401f-8210-ec6090abd822 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 400 to user: Invalid IP protocol tempest-999-747367613. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:06.141716 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d36e77d-b116-401f-8210-ec6090abd822 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.149953 Oct 28 10:05:06.144150 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1771/3573] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:05 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:05:06.151077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:06.152201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:06.189106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:06.189880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:06.192458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:06.193730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:06.195268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:06.197014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:06.398375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:06.415380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0f896d16-6890-4959-bb65-150fe82a1588 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 200 len: 1473 microversion: 2.1 time: 0.672935 Oct 28 10:05:06.416931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1803/3574] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:05 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 1473 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:05:06.438225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fdfdce88-fb05-409e-a3e7-100c930b32be req-a9e9ab99-58da-4063-adc2-708db5031375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1881709-67ac-4bd8-9d2a-e41d453a6412", "tag": "3e8cb734-09fb-4ec3-9089-592ed8eee3dc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:06.475784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fdfdce88-fb05-409e-a3e7-100c930b32be req-a9e9ab99-58da-4063-adc2-708db5031375 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:06.476703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fdfdce88-fb05-409e-a3e7-100c930b32be req-a9e9ab99-58da-4063-adc2-708db5031375 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:06.477602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fdfdce88-fb05-409e-a3e7-100c930b32be req-a9e9ab99-58da-4063-adc2-708db5031375 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:06.518312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fdfdce88-fb05-409e-a3e7-100c930b32be req-a9e9ab99-58da-4063-adc2-708db5031375 service nova] Creating event network-changed:3e8cb734-09fb-4ec3-9089-592ed8eee3dc for instance e1881709-67ac-4bd8-9d2a-e41d453a6412 on n-h2-zed-1 Oct 28 10:05:06.527020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fdfdce88-fb05-409e-a3e7-100c930b32be req-a9e9ab99-58da-4063-adc2-708db5031375 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107725 Oct 28 10:05:06.532963 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1804/3575] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:06.539469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e75d766-c39e-4e95-99fd-e5b7cb72e332 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca323e58b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1658967674", "description": "tempest-description-2022094130"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:06.721905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:06.731667 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e97d78f2-29d0-4191-9cb9-27e37a967a23 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1484 microversion: 2.1 time: 0.586243 Oct 28 10:05:06.749817 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1772/3576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:06 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1484 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:06.760556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:06.761352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:06.774518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:06.775400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:06.776071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:06.777111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:06.777858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:06.778540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:07.213080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:07.229282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:07.243098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:07.247705 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c68b8dd0-59a5-43ac-b312-f3c1063b6804 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1745 microversion: 2.20 time: 0.494507 Oct 28 10:05:07.250238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1773/3577] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:06 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1745 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:07.268814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1333183560"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:07.276624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:07.294919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:07.297038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:07.298211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:07.300688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:07.302167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:07.303086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:07.391207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:07.808658 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25b1a7d9-f60c-45ff-ac40-6a50c1a4addf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c/action" status: 202 len: 0 microversion: 2.1 time: 0.555554 Oct 28 10:05:07.828983 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1774/3578] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:05:07 2022] POST /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:05:07.844854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:07.847141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:07.866113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:07.867583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:07.869026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:07.871175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:07.872025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:07.872651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:07.965679 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e75d766-c39e-4e95-99fd-e5b7cb72e332 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.431094 Oct 28 10:05:07.967452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1805/3579] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:05:06 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:07.972918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0fd8fcc9-b39c-4246-b2c4-9c565a49f2c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca323f9820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:08.061709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0fd8fcc9-b39c-4246-b2c4-9c565a49f2c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 200 len: 1414 microversion: 2.1 time: 0.092813 Oct 28 10:05:08.076112 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1806/3580] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:07 2022] GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 1414 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:08.084610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-daec344e-6eda-4d9d-8e8c-2a03eb5c238e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca323c9a60>, body: {"security_group_rule": {"parent_group_id": "aea9f8ac-d2c3-465e-ba2b-b777f18a37e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:08.230064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:08.240306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-21785530-8ca8-4a34-a2db-c8d2cc8ab690 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.408153 Oct 28 10:05:08.246890 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1775/3581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:07 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:08.280543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:08.281368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:08.294452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:08.294969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:08.295419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:08.296143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:08.299297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:08.299990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:08.469965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-daec344e-6eda-4d9d-8e8c-2a03eb5c238e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-daec344e-6eda-4d9d-8e8c-2a03eb5c238e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 138 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: {"security_group_rule": {"parent_group_id": "aea9f8ac-d2c3-465e-ba2b-b777f18a37e3", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'aea9f8ac-d2c3-465e-ba2b-b777f18a37e3', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 10:05:08.472211 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 28 10:05:08.477323 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.479312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-daec344e-6eda-4d9d-8e8c-2a03eb5c238e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:08.480345 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-daec344e-6eda-4d9d-8e8c-2a03eb5c238e tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.402867 Oct 28 10:05:08.481139 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1807/3582] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:08 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 404 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:05:08.490059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0102bb53-8519-4f92-beaa-718368c1141f tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca323f9ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1521240741", "description": "tempest-description-948439899"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:08.814719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0102bb53-8519-4f92-beaa-718368c1141f tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.328262 Oct 28 10:05:08.815717 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1808/3583] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:05:08 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:05:08.829517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f17fe239-e07b-42c4-b3df-64adf832f704 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca323f54c0>, body: {"security_group_rule": {"parent_group_id": "c19bb1ad-b04d-4b8e-ae7e-15846a9970ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 1335058086}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:08.924514 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f17fe239-e07b-42c4-b3df-64adf832f704 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: Invalid port range 22:1335058086. Valid TCP ports should be between 1-65535 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f17fe239-e07b-42c4-b3df-64adf832f704 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 146 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: {"security_group_rule": {"parent_group_id": "c19bb1ad-b04d-4b8e-ae7e-15846a9970ed", "ip_protocol": "tcp", "from_port": 22, "to_port": 1335058086}} Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid port range 22:1335058086. Valid TCP ports should be between 1-65535 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c19bb1ad-b04d-4b8e-ae7e-15846a9970ed', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1335058086}}} Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1335058086. Valid TCP ports should be between 1-65535 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1335058086. Valid TCP ports should be between 1-65535 Oct 28 10:05:08.926293 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1335058086. Valid TCP ports should be between 1-65535 Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f17fe239-e07b-42c4-b3df-64adf832f704 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 400 to user: Invalid port range 22:1335058086. Valid TCP ports should be between 1-65535 {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f17fe239-e07b-42c4-b3df-64adf832f704 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.101998 Oct 28 10:05:08.936738 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1809/3584] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:08 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 10:05:08.938375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f7befc6-0bfb-4243-9770-efbf179a3d92 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Action: 'create', calling method: .version_select at 0x7fca324fbc10>, body: {"security_group_rule": {"parent_group_id": "bd6cf960-fc00-4069-9efc-4c0d54790bd8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:08.969964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-9f7befc6-0bfb-4243-9770-efbf179a3d92 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:05:08.970630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-9f7befc6-0bfb-4243-9770-efbf179a3d92 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Neutron security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 not found {{(pid=128748) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 28 10:05:08.971171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9f7befc6-0bfb-4243-9770-efbf179a3d92 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist Oct 28 10:05:08.971171 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-8fd5e21e-c1d5-475d-bdeb-ddf6da6f12d5'] Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f7befc6-0bfb-4243-9770-efbf179a3d92 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 138 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: {"security_group_rule": {"parent_group_id": "bd6cf960-fc00-4069-9efc-4c0d54790bd8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-8fd5e21e-c1d5-475d-bdeb-ddf6da6f12d5'] Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'bd6cf960-fc00-4069-9efc-4c0d54790bd8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:05:08.973139 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd5e21e-c1d5-475d-bdeb-ddf6da6f12d5'] Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd5e21e-c1d5-475d-bdeb-ddf6da6f12d5'] Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd5e21e-c1d5-475d-bdeb-ddf6da6f12d5'] Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8fd5e21e-c1d5-475d-bdeb-ddf6da6f12d5'] Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f7befc6-0bfb-4243-9770-efbf179a3d92 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 404 to user: Security group bd6cf960-fc00-4069-9efc-4c0d54790bd8 does not exist Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-8fd5e21e-c1d5-475d-bdeb-ddf6da6f12d5'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f7befc6-0bfb-4243-9770-efbf179a3d92 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.040499 Oct 28 10:05:08.978130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1810/3585] 10.222.0.16 () {60 vars in 1195 bytes} [Fri Oct 28 10:05:08 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:05:08.988840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:08.991969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b7028e2-14c8-4b01-ad9c-865f91164d5b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Calling method '.version_select at 0x7fca323f5d30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:08.997624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:08.999081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:09.000271 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e82aebfe-9fb1-4bc6-b174-d08fd6156e88 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1745 microversion: 2.20 time: 0.724782 Oct 28 10:05:09.015555 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1776/3586] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:08 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1745 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:09.033978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG neutronclient.v2_0.client [None req-5b7028e2-14c8-4b01-ad9c-865f91164d5b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist", "detail": ""}} {{(pid=128748) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 28 10:05:09.034943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-5b7028e2-14c8-4b01-ad9c-865f91164d5b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Neutron security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf not found {{(pid=128748) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 28 10:05:09.035661 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-5b7028e2-14c8-4b01-ad9c-865f91164d5b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] HTTP exception thrown: Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist Oct 28 10:05:09.035661 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-998fab90-ea2b-4298-a770-9d43e04023e3'] Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b7028e2-14c8-4b01-ad9c-865f91164d5b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Request method failure captured: Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-security-group-rules/ac6384fb-8ebf-4d18-bc70-6e81313022cf HTTP/1.1 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lKiLS6j4Sz6VEgDTrCpP8J3BBVbSwsJExBq6oqmtAi0CRrmf76jvGx_vzic593TTzyHhsHHoO4R0V5_1nWHIsB4gafTGEJSyQLPDSJ_Bzq4t1wBhTD91FSBO60YmREcfVixApJDz3sfe142ozdMG9qAZ8Vjc6TSsCAMs8iNHDb92g Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/464468c4eb514931ac21cf728e28fd50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_464468c4eb514931ac21cf728e28fd50", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/464468c4eb514931ac21cf728e28fd50"}]}] Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 464468c4eb514931ac21cf728e28fd50 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0207c4170e35470385869f18e09828d0 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: exception: Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-998fab90-ea2b-4298-a770-9d43e04023e3'] Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ac6384fb-8ebf-4d18-bc70-6e81313022cf'} Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 28 10:05:09.039115 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-998fab90-ea2b-4298-a770-9d43e04023e3'] Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-998fab90-ea2b-4298-a770-9d43e04023e3'] Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-998fab90-ea2b-4298-a770-9d43e04023e3'] Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-998fab90-ea2b-4298-a770-9d43e04023e3'] Oct 28 10:05:09.043579 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:09.049984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b7028e2-14c8-4b01-ad9c-865f91164d5b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Returning 404 to user: Security group rule ac6384fb-8ebf-4d18-bc70-6e81313022cf does not exist Oct 28 10:05:09.049984 n-d-zed-1 devstack@n-api.service[128748]: Neutron server returns request_ids: ['req-998fab90-ea2b-4298-a770-9d43e04023e3'] {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:09.051148 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b7028e2-14c8-4b01-ad9c-865f91164d5b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-group-rules/ac6384fb-8ebf-4d18-bc70-6e81313022cf" status: 404 len: 199 microversion: 2.1 time: 0.070026 Oct 28 10:05:09.051914 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1811/3587] 10.222.0.16 () {58 vars in 1287 bytes} [Fri Oct 28 10:05:08 2022] DELETE /compute/v2.1/os-security-group-rules/ac6384fb-8ebf-4d18-bc70-6e81313022cf => generated 199 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:05:09.063424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49482693-7fe6-450c-8b15-64bbeea614ec tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Calling method '.version_select at 0x7fca32eec700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:09.093811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4344fc9a-7f45-437a-8fe4-d46da5b50d49 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca323f9040>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:09.158236 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4344fc9a-7f45-437a-8fe4-d46da5b50d49 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 200 len: 1414 microversion: 2.1 time: 0.070488 Oct 28 10:05:09.160816 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1812/3588] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:09 2022] GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 1414 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:05:09.274986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:09.276536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:09.295002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:09.296367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:09.300051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:09.300827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:09.301333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:09.301771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:09.653246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:09.664858 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67e053d2-0613-461f-952d-4a87d5f5b181 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.394800 Oct 28 10:05:09.683387 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1813/3589] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:09 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:10.030461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:10.032299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:10.045847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:10.051408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:10.051940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:10.052701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:10.053225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:10.054217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:10.064099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:10.186823 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49482693-7fe6-450c-8b15-64bbeea614ec tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/c19bb1ad-b04d-4b8e-ae7e-15846a9970ed" status: 202 len: 0 microversion: 2.1 time: 1.129780 Oct 28 10:05:10.189270 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1777/3590] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:05:09 2022] DELETE /compute/v2.1/os-security-groups/c19bb1ad-b04d-4b8e-ae7e-15846a9970ed => generated 0 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:10.194741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8d790d3-21c4-4ffb-b8c0-2165a2ac1ae2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32db6430>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:10.293880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8d790d3-21c4-4ffb-b8c0-2165a2ac1ae2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 200 len: 1414 microversion: 2.1 time: 0.097940 Oct 28 10:05:10.294575 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1778/3591] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:10 2022] GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:10.305469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f3dd48b-c33e-4e69-aaa5-b4f79a26c9fa tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Calling method '.version_select at 0x7fca32e1fca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:10.373799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:10.384386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:10.385865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:10.392528 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14384fc3-177b-4ad8-84f8-aeeb3db67ec8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1745 microversion: 2.20 time: 0.366873 Oct 28 10:05:10.413033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1814/3592] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:10 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1745 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:05:10.486301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d95120d6-3aea-4e64-880e-2798762a73d1 req-554bb9d3-f0ee-43fa-b0d2-110b3869bc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "name": "network-vif-plugged", "status": "completed", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:10.504276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d95120d6-3aea-4e64-880e-2798762a73d1 req-554bb9d3-f0ee-43fa-b0d2-110b3869bc75 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:10.511157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d95120d6-3aea-4e64-880e-2798762a73d1 req-554bb9d3-f0ee-43fa-b0d2-110b3869bc75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:10.514805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d95120d6-3aea-4e64-880e-2798762a73d1 req-554bb9d3-f0ee-43fa-b0d2-110b3869bc75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:10.548688 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d95120d6-3aea-4e64-880e-2798762a73d1 req-554bb9d3-f0ee-43fa-b0d2-110b3869bc75 service nova] Creating event network-vif-plugged:56677974-42d3-4fca-a764-dca3e5226c74 for instance 635cb96d-039d-4c62-9784-aa89b4b879d1 on n-h2-zed-1 Oct 28 10:05:10.577326 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d95120d6-3aea-4e64-880e-2798762a73d1 req-554bb9d3-f0ee-43fa-b0d2-110b3869bc75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097294 Oct 28 10:05:10.582160 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1815/3593] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:05:10.691147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:10.692192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:10.702787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:10.704614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:10.709344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:10.711865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:10.712514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:10.714206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:10.986125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:10.997167 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1622e625-7bdf-485c-bd50-21d160065ce2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.310926 Oct 28 10:05:10.998972 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1816/3594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:10 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:05:11.321955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f13d4cac-790e-4834-8f87-eedce2f0578c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3243cdc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:11.819611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f3dd48b-c33e-4e69-aaa5-b4f79a26c9fa tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/aea9f8ac-d2c3-465e-ba2b-b777f18a37e3" status: 202 len: 0 microversion: 2.1 time: 1.523783 Oct 28 10:05:11.823386 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1779/3595] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:05:10 2022] DELETE /compute/v2.1/os-security-groups/aea9f8ac-d2c3-465e-ba2b-b777f18a37e3 => generated 0 bytes in 1525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:11.828225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:11.830806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:11.852402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:11.853541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:11.854392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:11.855372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:11.856267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:11.856949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:12.319907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:12.333967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:12.341954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:12.346429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-052432b1-2b7e-469c-a8cb-f1522404182f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.521545 Oct 28 10:05:12.349153 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1780/3596] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:11 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:12.390117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ce69d6a-cb5c-4a25-a870-004afb762dc9 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Calling method '.version_select at 0x7fca32e659d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:12.908062 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ce69d6a-cb5c-4a25-a870-004afb762dc9 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/4b0eddc9-b9ce-4524-80d1-30272738ce66" status: 202 len: 0 microversion: 2.1 time: 0.557244 Oct 28 10:05:12.908644 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1781/3597] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:05:12 2022] DELETE /compute/v2.1/os-security-groups/4b0eddc9-b9ce-4524-80d1-30272738ce66 => generated 0 bytes in 559 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:12.920883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:12.923432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:12.945746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:12.947017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:12.954105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:12.958064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:12.958990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:12.959690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:13.430453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:13.459327 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-67d2f00e-82a2-45bc-93ba-5f8d3cff04d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.546149 Oct 28 10:05:13.462237 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1782/3598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:12 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:13.478260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5f58695e-7a24-4746-9668-97c28af0cd53 req-e4de88bd-0aac-4914-96ca-f60a2267d22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6668c6d-d735-4d74-9844-4555e56b8f1c", "name": "network-vif-plugged", "status": "completed", "tag": "b77d23e5-6732-4f1d-8ab7-fd54a730c3a3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:13.509818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f58695e-7a24-4746-9668-97c28af0cd53 req-e4de88bd-0aac-4914-96ca-f60a2267d22c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:13.511122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f58695e-7a24-4746-9668-97c28af0cd53 req-e4de88bd-0aac-4914-96ca-f60a2267d22c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:13.514207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f58695e-7a24-4746-9668-97c28af0cd53 req-e4de88bd-0aac-4914-96ca-f60a2267d22c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:13.550237 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5f58695e-7a24-4746-9668-97c28af0cd53 req-e4de88bd-0aac-4914-96ca-f60a2267d22c service nova] Creating event network-vif-plugged:b77d23e5-6732-4f1d-8ab7-fd54a730c3a3 for instance b6668c6d-d735-4d74-9844-4555e56b8f1c on n-h1-zed-1 Oct 28 10:05:13.567047 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5f58695e-7a24-4746-9668-97c28af0cd53 req-e4de88bd-0aac-4914-96ca-f60a2267d22c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102008 Oct 28 10:05:13.572184 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1783/3599] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:13.619587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b5f2af89-e3b6-452e-967a-49fc36883dc4 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Calling method '.version_select at 0x7fca33072160>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:14.001569 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b5f2af89-e3b6-452e-967a-49fc36883dc4 tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/03ba2c56-1675-4cab-ae19-826be0368cf2" status: 202 len: 0 microversion: 2.1 time: 0.427780 Oct 28 10:05:14.002921 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1784/3600] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:05:13 2022] DELETE /compute/v2.1/os-security-groups/03ba2c56-1675-4cab-ae19-826be0368cf2 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:14.008939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:14.009816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:14.031720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:14.037361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:14.039338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:14.042914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:14.048167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:14.049313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:14.622154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:14.642002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:14.645946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:14.649347 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b21039e-7fdb-42b2-a05e-363fa4a1df46 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.644327 Oct 28 10:05:14.651514 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1785/3601] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:14 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:14.662654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c3a6629-73ba-451b-9197-4e523a2f3b1b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] Calling method '.version_select at 0x7fca32f9fdc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:15.144322 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c3a6629-73ba-451b-9197-4e523a2f3b1b tempest-SecurityGroupRulesNegativeTestJSON-1278709342 tempest-SecurityGroupRulesNegativeTestJSON-1278709342-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/36b7d38a-d44c-4d6a-9806-3b1ebe6a5762" status: 202 len: 0 microversion: 2.1 time: 0.490774 Oct 28 10:05:15.146025 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1786/3602] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:05:14 2022] DELETE /compute/v2.1/os-security-groups/36b7d38a-d44c-4d6a-9806-3b1ebe6a5762 => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:15.156721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:15.158894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:15.179393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:15.181237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:15.181721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:15.186857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:15.188883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:15.189675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:15.870311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:15.879010 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8384654-6b08-4405-bbdc-8948ac2e9437 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1315 microversion: 2.1 time: 0.731261 Oct 28 10:05:15.888953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1787/3603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:15 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:15.888953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:15.896315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:15.906478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:15.911127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:15.912293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:15.914318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:15.914795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:15.915229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:16.315470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:16.327924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:16.329423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:16.334027 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b9e51a5-eaeb-41d9-923a-90540d4ee57b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.452705 Oct 28 10:05:16.337766 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1788/3604] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:15 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:16.342592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4c6ef150-af1f-4512-b12b-8261ea9db5a0 req-12043b4b-fbc0-4c2c-a641-f2718cae8ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ca8e5c-539b-4bca-801a-66238374918c", "name": "network-vif-plugged", "status": "completed", "tag": "ab34384e-f3c7-4961-8e60-c582cbd31e2e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:16.363570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4c6ef150-af1f-4512-b12b-8261ea9db5a0 req-12043b4b-fbc0-4c2c-a641-f2718cae8ef9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:16.364392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4c6ef150-af1f-4512-b12b-8261ea9db5a0 req-12043b4b-fbc0-4c2c-a641-f2718cae8ef9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:16.365071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4c6ef150-af1f-4512-b12b-8261ea9db5a0 req-12043b4b-fbc0-4c2c-a641-f2718cae8ef9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:16.399088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4c6ef150-af1f-4512-b12b-8261ea9db5a0 req-12043b4b-fbc0-4c2c-a641-f2718cae8ef9 service nova] Creating event network-vif-plugged:ab34384e-f3c7-4961-8e60-c582cbd31e2e for instance 15ca8e5c-539b-4bca-801a-66238374918c on n-h1-zed-1 Oct 28 10:05:16.405693 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4c6ef150-af1f-4512-b12b-8261ea9db5a0 req-12043b4b-fbc0-4c2c-a641-f2718cae8ef9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066506 Oct 28 10:05:16.411694 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1789/3605] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:16.907711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:16.908630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:16.918016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:16.918804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:16.919427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:16.922339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:16.923194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:16.924095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:17.724986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:17.737863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6a18aeb8-f543-4dcb-9d13-bca61377c248 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1502 microversion: 2.1 time: 0.832455 Oct 28 10:05:17.738747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1790/3606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:16 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1502 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:05:17.747315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:17.748265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:17.762514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:17.765531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:17.766180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:17.767128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:17.777388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:17.778146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:18.026222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:18.037363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:18.039677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:18.046090 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad4cc3b4-c20e-4566-bb88-f296cee42428 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.305911 Oct 28 10:05:18.052750 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1791/3607] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:17 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:18.068778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:18.077555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:18.092414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:18.093232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:18.096160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:18.097141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:18.101963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:18.109666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:18.283602 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-03eabef2-766e-404d-a599-003ab0fd7380 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c/action" status: 202 len: 0 microversion: 2.1 time: 0.229165 Oct 28 10:05:18.286736 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1792/3608] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:05:18 2022] POST /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:18.300640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:18.302811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:18.319774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:18.321725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:18.324675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:18.325677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:18.326566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:18.328935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:19.174219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:19.187520 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-036518e7-9439-4ef2-9aeb-6e0538a013d4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1507 microversion: 2.1 time: 0.895674 Oct 28 10:05:19.195393 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1793/3609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:18 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1507 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:19.514197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e36e103-31d2-4f2c-a1a5-0cbecfff501b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Calling method '.version_select at 0x7fca3362b670>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:19.626168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e36e103-31d2-4f2c-a1a5-0cbecfff501b tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.429247 Oct 28 10:05:19.629337 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1794/3610] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:05:19 2022] GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6/defaults => generated 371 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:19.641466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:19.642675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:19.661034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:19.662235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:19.664918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:19.665859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:19.666545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:19.668417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:19.993277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:20.019111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:20.020839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:20.029381 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6bfcb93f-5c42-493b-a59b-bdcd9a06654e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.398832 Oct 28 10:05:20.030455 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1795/3611] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:19 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:20.041457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-678799b5-6e26-4ab1-9e5c-63e8297a83a0 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Calling method '.version_select at 0x7fca32d0f0d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:20.155719 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-678799b5-6e26-4ab1-9e5c-63e8297a83a0 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6" status: 200 len: 371 microversion: 2.1 time: 0.123967 Oct 28 10:05:20.156978 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1796/3612] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:05:20 2022] GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6 => generated 371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:20.189879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7475dac4-37d6-4d7a-8077-0f32d5495abc tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Calling method '.version_select at 0x7fca32db6d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:20.305522 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7475dac4-37d6-4d7a-8077-0f32d5495abc tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.134006 Oct 28 10:05:20.307447 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1797/3613] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:05:20 2022] GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6/defaults => generated 371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:20.315789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:20.316801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:20.325397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:20.326187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:20.327145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:20.331148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:20.332220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:20.333683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:20.696897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:20.992391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:21.504604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:21.578163 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3c01c7fb-73aa-4012-8eb3-7966030d6701 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1487 microversion: 2.1 time: 1.269328 Oct 28 10:05:21.602840 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1798/3614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:20 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1487 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:21.613152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4f25179-1058-46c0-9801-2d018fe2f312 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Calling method '.version_select at 0x7fca32db68b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:21.785879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=91 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:21.841587 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4f25179-1058-46c0-9801-2d018fe2f312 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6" status: 200 len: 371 microversion: 2.1 time: 0.237054 Oct 28 10:05:21.849617 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1799/3615] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:05:21 2022] GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6 => generated 371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:21.860630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:21.864004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:21.879784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:21.880123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:21.880579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:21.881347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:21.881922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:21.882370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:21.885422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:22.296391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:22.312637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:22.318673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:22.320462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4af0f430-693c-4958-a693-913118bc60ee tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.471371 Oct 28 10:05:22.322497 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1800/3616] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:21 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:22.334000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:22.338166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:22.351420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:22.356131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:22.360057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:22.362557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:22.365235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:22.368882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:22.454583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:05:22.688716 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-354f4ac5-4114-4b75-a4b6-1d1670ba15c6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 204 len: 0 microversion: 2.1 time: 0.363804 Oct 28 10:05:22.691232 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1801/3617] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:05:22 2022] DELETE /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:05:22.698013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-063e5fdf-c976-4fa9-a23e-14c7003c10d8 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] Calling method '.version_select at 0x7fca32f99b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:22.901779 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-063e5fdf-c976-4fa9-a23e-14c7003c10d8 tempest-QuotasTestJSON-981989435 tempest-QuotasTestJSON-981989435-project] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6?user_id=1db8a85614994d2387f62cabf2b26fcc" status: 200 len: 371 microversion: 2.1 time: 0.204410 Oct 28 10:05:22.907001 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1802/3618] 10.222.0.16 () {58 vars in 1323 bytes} [Fri Oct 28 10:05:22 2022] GET /compute/v2.1/os-quota-sets/2064f7889d354c3f975786fbf4c90be6?user_id=1db8a85614994d2387f62cabf2b26fcc => generated 371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:22.931087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:22.931834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:22.951161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:22.951734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:22.952174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:22.952860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:22.958038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:22.972459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:23.468055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:23.482783 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-11d6acc0-1053-4d61-9670-a32e2faabdd3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1493 microversion: 2.1 time: 0.572165 Oct 28 10:05:23.486283 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1803/3619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:22 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1493 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:23.508334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:23.509378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:23.527988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:23.528512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:23.530905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:23.533989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:23.536567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:23.537354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:24.638509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:24.664030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:24.667704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:24.671449 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ba8aacd-13ed-4f69-a38c-b1f000b9d9ca tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 1.181643 Oct 28 10:05:24.673201 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1804/3620] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:23 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:24.686405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:24.687707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:24.721805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:24.722341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:24.724495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:24.727930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:24.731320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:24.732781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:26.439984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:26.459095 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a755dbd4-d2ed-41a0-883e-5875d010f61b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 200 len: 1493 microversion: 2.1 time: 1.784255 Oct 28 10:05:26.469100 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1805/3621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:24 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 1493 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:26.509836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:26.525812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:26.549363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:26.555954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:26.556932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:26.568688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:26.570411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:26.571403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:27.161960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:27.180654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:27.188689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:27.193110 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9e44a495-a64e-4764-9c79-6e787935b5f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.719024 Oct 28 10:05:27.197126 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1806/3622] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:26 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:27.215668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-64c2ba42-ad03-4aa0-8f5d-58e9dd7c9f9f req-93fb3b0e-d471-41a7-8bfc-3b42e0a9aacb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6668c6d-d735-4d74-9844-4555e56b8f1c", "name": "network-vif-deleted", "tag": "b77d23e5-6732-4f1d-8ab7-fd54a730c3a3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:27.246769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-64c2ba42-ad03-4aa0-8f5d-58e9dd7c9f9f req-93fb3b0e-d471-41a7-8bfc-3b42e0a9aacb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:27.254336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-64c2ba42-ad03-4aa0-8f5d-58e9dd7c9f9f req-93fb3b0e-d471-41a7-8bfc-3b42e0a9aacb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:27.255059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-64c2ba42-ad03-4aa0-8f5d-58e9dd7c9f9f req-93fb3b0e-d471-41a7-8bfc-3b42e0a9aacb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:27.293089 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-64c2ba42-ad03-4aa0-8f5d-58e9dd7c9f9f req-93fb3b0e-d471-41a7-8bfc-3b42e0a9aacb service nova] Creating event network-vif-deleted:b77d23e5-6732-4f1d-8ab7-fd54a730c3a3 for instance b6668c6d-d735-4d74-9844-4555e56b8f1c on n-h1-zed-1 Oct 28 10:05:27.307239 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-64c2ba42-ad03-4aa0-8f5d-58e9dd7c9f9f req-93fb3b0e-d471-41a7-8bfc-3b42e0a9aacb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108583 Oct 28 10:05:27.312273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1807/3623] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:27.502566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:27.503446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:27.521050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:27.521050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:27.521050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:27.521050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:27.529506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:27.529958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:27.581599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c HTTP/1.1 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'b6668c6d-d735-4d74-9844-4555e56b8f1c'} Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:27.585702 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:27.591017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:27.591017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:27.591017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:27.591017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:27.591017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:27.591017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:05:27.591017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:05:27.594725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:27.595876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d555173f-237c-4d9e-a72d-7db882a2d072 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 404 len: 111 microversion: 2.1 time: 0.097919 Oct 28 10:05:27.599338 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1808/3624] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:27 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:05:27.844093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-49803042", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa47211-0e93-41b2-a356-031426d3c83c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:30.656662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f13d4cac-790e-4834-8f87-eedce2f0578c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 200 len: 1414 microversion: 2.1 time: 19.350152 Oct 28 10:05:30.659023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1817/3625] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:11 2022] GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 1414 bytes in 19353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:30.665282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:30.672571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:30.686864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:30.687256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:30.688139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:30.688775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:30.689220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:30.695490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:30.700173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] validate_networks() for [('afa47211-0e93-41b2-a356-031426d3c83c', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:05:31.050760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:31.089151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:31.098503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:31.110737 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.449147 Oct 28 10:05:31.114289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1818/3626] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:30 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:31.118855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:31.124303 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5041c7d-fc7d-48fe-aaf1-dd3c61a42132 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006128 Oct 28 10:05:31.126615 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1819/3627] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 10:05:31 2022] GET /compute/ => generated 377 bytes in 11 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 10:05:31.300171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1541581152", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "54478ca8-34e7-4877-b2ed-e87647f92450"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:31.844874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:05:31.845497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:05:31.846041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:05:31.846689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:05:31.847126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:05:31.866435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:31.867696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:31.868886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:31.870152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:31.872890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:31.873685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:31.911443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:05:31.919917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for user 6859db32b98f4caba7379962eaef9de3 and project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:05:31.971127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:05:31.982051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:05:32.161197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.321189 Oct 28 10:05:32.169936 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1809/3628] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:05:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:05:32.178400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:32.182301 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08935172-2d67-450a-b382-3dea65c8f01b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.010797 Oct 28 10:05:32.191726 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1810/3629] 10.222.0.16 () {54 vars in 1035 bytes} [Fri Oct 28 10:05:32 2022] GET /compute/v2/ => generated 379 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 28 10:05:32.225108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3ac475c8-8765-48f8-aa8e-581559d7b15b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca326f4a60>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:36.460737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] validate_networks() for [('54478ca8-34e7-4877-b2ed-e87647f92450', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:05:36.483682 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3ac475c8-8765-48f8-aa8e-581559d7b15b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 200 len: 1423 microversion: 2.1 time: 4.288990 Oct 28 10:05:36.486567 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1811/3630] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:32 2022] GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 1423 bytes in 4294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:36.499877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:36.500875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:36.530660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:36.535905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:36.537246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:36.538867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:36.542774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:36.552489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:36.964682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:36.977532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:36.981923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:36.983458 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5816bb97-72e3-4015-87ad-8897fb567a3b tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.495574 Oct 28 10:05:36.987076 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1812/3631] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:36 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:36.992078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:36.993022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:37.015949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:37.017303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:37.018083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:37.019168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:37.019879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:37.022074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:37.354985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:37.373556 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1313 microversion: 2.1 time: 0.380860 Oct 28 10:05:37.375315 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1813/3632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:36 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:37.378234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:37.385911 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2f0fff12-7b16-4884-873f-82c58e13e424 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.007972 Oct 28 10:05:37.387902 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1814/3633] 10.222.0.16 () {54 vars in 1041 bytes} [Fri Oct 28 10:05:37 2022] GET /compute/v2.1/ => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:37.401011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5f24bb55-52eb-42e9-a0a7-56a8ced59002 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3272ef70>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:37.543308 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5f24bb55-52eb-42e9-a0a7-56a8ced59002 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 200 len: 1423 microversion: 2.1 time: 0.154183 Oct 28 10:05:37.544701 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1815/3634] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:05:37 2022] GET /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 1423 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:37.547101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5f24bb55-52eb-42e9-a0a7-56a8ced59002 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:37.553386 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5f24bb55-52eb-42e9-a0a7-56a8ced59002 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.007359 Oct 28 10:05:37.554579 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1816/3635] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 10:05:37 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 10:05:37.563272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ecc536fb-2812-4ca9-ab96-8eb4ef39b2ad tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32e56ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:38.201204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:05:38.202407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:05:38.203122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:05:38.203802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:05:38.204729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:05:38.227199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:38.229530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:38.230263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:38.232375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:38.234409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:38.235366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:38.295419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Getting quotas for project cdec51986d2644d6a667908a6fa34da2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:05:38.310356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Getting quotas for user 8c89b4a51ce649389bbff589d10e1585 and project cdec51986d2644d6a667908a6fa34da2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:05:38.345544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Going to run 3 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:05:38.360084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:05:38.504703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:05:38.641440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:05:38.916150 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-768c8add-8d7e-4fc2-bf21-6767eaf4e06e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.787209 Oct 28 10:05:38.920109 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1820/3636] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:05:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 7793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:05:38.943779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:38.983037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:39.011443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:39.015751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:39.017824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:39.020807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:39.022080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:39.025058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:39.248435 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ecc536fb-2812-4ca9-ab96-8eb4ef39b2ad tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 204 len: 0 microversion: 2.1 time: 1.689580 Oct 28 10:05:39.254390 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1817/3637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:37 2022] DELETE /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 0 bytes in 1695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:05:39.268210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:39.269300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:39.291460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:39.293516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:39.298067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:39.299035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:39.299675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:39.300414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:39.681685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:39.703718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:39.711412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:39.722771 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ec78d4f-dc7b-4dda-91ab-83ad9a1b5e64 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.791268 Oct 28 10:05:39.737042 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1821/3638] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:38 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:39.749273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:39.775566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:39.779447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:05:39.857703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:39.858230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:39.858677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:39.859376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:39.859833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:39.860248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:39.965436 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a3d72456-eb85-441d-a422-42a0f8894590 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.225641 Oct 28 10:05:39.969565 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1822/3639] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:05:39 2022] GET /compute/v2.1/servers => generated 1018 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:39.987865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:39.988385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:40.016036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:40.016542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:40.018127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:40.018850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:40.019304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:40.019727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:40.087563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:05:40.292863 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bbc9a589-6172-4ff9-8f26-427cd529f53f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 204 len: 0 microversion: 2.1 time: 0.322010 Oct 28 10:05:40.293556 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1823/3640] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:05:39 2022] DELETE /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:05:40.302584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-91f2db7a-7747-47e6-90ca-ac7100be05dc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:40.304644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-91f2db7a-7747-47e6-90ca-ac7100be05dc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:40.440152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-91f2db7a-7747-47e6-90ca-ac7100be05dc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:40.458468 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-91f2db7a-7747-47e6-90ca-ac7100be05dc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1223 microversion: 2.1 time: 0.160958 Oct 28 10:05:40.460984 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1824/3641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:40 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1223 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:40.480095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-42c33f0a-270c-4455-827f-16dd74241225 req-0458fa1c-7e06-41ed-a191-92ef2b2d13ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d20727e-4105-4bbe-8e93-a3960f8330bf", "tag": "fcb63ddf-3037-4721-8845-2a2d42350c8f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:40.551637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-42c33f0a-270c-4455-827f-16dd74241225 req-0458fa1c-7e06-41ed-a191-92ef2b2d13ba service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:40.552499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-42c33f0a-270c-4455-827f-16dd74241225 req-0458fa1c-7e06-41ed-a191-92ef2b2d13ba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:40.553975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-42c33f0a-270c-4455-827f-16dd74241225 req-0458fa1c-7e06-41ed-a191-92ef2b2d13ba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:40.572546 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-42c33f0a-270c-4455-827f-16dd74241225 req-0458fa1c-7e06-41ed-a191-92ef2b2d13ba service nova] Creating event network-changed:fcb63ddf-3037-4721-8845-2a2d42350c8f for instance 3d20727e-4105-4bbe-8e93-a3960f8330bf on n-h1-zed-1 Oct 28 10:05:40.586524 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-42c33f0a-270c-4455-827f-16dd74241225 req-0458fa1c-7e06-41ed-a191-92ef2b2d13ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122508 Oct 28 10:05:40.591769 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1825/3642] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:40.625997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-521098150", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "153b4feb-5f46-4862-85be-edb054eb6bc9"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:40.773011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] validate_networks() for [('153b4feb-5f46-4862-85be-edb054eb6bc9', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:05:41.071787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:41.080522 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-84618388-28da-46d1-91f1-1004159981c9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1313 microversion: 2.1 time: 1.824753 Oct 28 10:05:41.091433 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1818/3643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:39 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1313 bytes in 1836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:41.122542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:41.129687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:41.155931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:41.156493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:41.156879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:41.157658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:41.158113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:41.158541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:41.895193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:41.946725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=14 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:42.280841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:05:42.282530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:05:42.283507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:05:42.284103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:05:42.284689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:05:42.331091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:42.333423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:42.334547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:42.339822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:42.341374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:42.342012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:42.392158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:42.434428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:42.446695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:42.450624 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52c099fd-4e36-49e0-97a1-fa9948eba120 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 1.353437 Oct 28 10:05:42.482669 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1819/3644] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:41 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:42.500176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:05:42.519702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:42.540611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for user 90aefa22b02749e8a6b03d16378a0a6c and project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:05:42.543664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:42.560119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Searching by: {'deleted': False, 'project_id': '2e1adf828480437ea6595561c912d9bf'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:05:42.598054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:42.598560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:42.607921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:42.615124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:42.622197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:42.622805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:42.634314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:05:42.649449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:05:42.736843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:05:42.879930 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f94fce14-e88d-4457-a2b4-972a54bdfdc4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.395998 Oct 28 10:05:42.883373 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1820/3645] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:05:42 2022] GET /compute/v2.1/servers => generated 344 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:42.899598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:42.901616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:42.934535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:42.935049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:42.937058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:42.938672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:42.939153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:42.941714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:42.995907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-395a124b-31e8-48cc-8259-1c1967f4d4b9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.369714 Oct 28 10:05:43.003984 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1826/3646] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:05:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2383 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:05:43.020107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4b4231b4-bf43-4691-8c37-6c2f03a95b07 req-ce725dff-582f-4368-b8c9-f4b81b135f9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ca8e5c-539b-4bca-801a-66238374918c", "name": "network-vif-unplugged", "status": "completed", "tag": "ab34384e-f3c7-4961-8e60-c582cbd31e2e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:43.066316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4b4231b4-bf43-4691-8c37-6c2f03a95b07 req-ce725dff-582f-4368-b8c9-f4b81b135f9c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:43.068977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4b4231b4-bf43-4691-8c37-6c2f03a95b07 req-ce725dff-582f-4368-b8c9-f4b81b135f9c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:43.073379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4b4231b4-bf43-4691-8c37-6c2f03a95b07 req-ce725dff-582f-4368-b8c9-f4b81b135f9c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:43.178230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4b4231b4-bf43-4691-8c37-6c2f03a95b07 req-ce725dff-582f-4368-b8c9-f4b81b135f9c service nova] Creating event network-vif-unplugged:ab34384e-f3c7-4961-8e60-c582cbd31e2e for instance 15ca8e5c-539b-4bca-801a-66238374918c on n-h1-zed-1 Oct 28 10:05:43.202629 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4b4231b4-bf43-4691-8c37-6c2f03a95b07 req-ce725dff-582f-4368-b8c9-f4b81b135f9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.197284 Oct 28 10:05:43.215331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1827/3647] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:43.241524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:43.261925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:43.299505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:43.310019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:43.314416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:43.314416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:43.314698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:43.315137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:43.977333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:43.993792 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d95d941-0af3-40dc-a98c-a8920ab56580 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1313 microversion: 2.1 time: 0.776676 Oct 28 10:05:44.020195 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1828/3648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:43 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:44.040552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:44.052127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:44.071516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Searching by: {'deleted': False, 'project_id': '2e1adf828480437ea6595561c912d9bf'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:05:44.086315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:44.087665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:44.088361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:44.091949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:44.092680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:44.093331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:44.139175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:05:44.213080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:44.242439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:44.245170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:44.246136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:44.431725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:44.452846 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d36981f9-18b2-432c-8d3b-20d301d03e31 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1275 microversion: 2.1 time: 1.565642 Oct 28 10:05:44.468967 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1821/3649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:42 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1275 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:44.924062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc6a3bf0-2f13-426c-81ba-d98d98b6aeb5 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Action: 'create', calling method: .version_select at 0x7fca32d0f3a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1472876225", "metadata": {"Type": "work"}}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:44.955729 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7afc397e-56ad-440b-a471-a79496e4ffec tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.934179 Oct 28 10:05:44.956844 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1829/3650] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:05:44 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:44.963388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:44.965153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:44.986064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:44.986832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:44.987470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:44.988601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:44.990780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:44.992836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:45.622260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:45.635017 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-154cc147-d967-4773-9a3d-3d4ac8cf1b9f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1203 microversion: 2.1 time: 0.676640 Oct 28 10:05:45.638206 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1830/3651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:44 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1203 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:45.648746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:45.649812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:45.685467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:45.688214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:45.689668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:45.691210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:45.693511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:45.694107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:46.042305 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc6a3bf0-2f13-426c-81ba-d98d98b6aeb5 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.583364 Oct 28 10:05:46.043515 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1822/3652] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:05:44 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1586 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 28 10:05:46.050143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-bb349d3d-1cd2-4e5e-982c-20dabb671842 req-506df367-0846-4ae9-9554-3dc009128365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15ca8e5c-539b-4bca-801a-66238374918c", "name": "network-vif-deleted", "tag": "ab34384e-f3c7-4961-8e60-c582cbd31e2e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:46.133704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bb349d3d-1cd2-4e5e-982c-20dabb671842 req-506df367-0846-4ae9-9554-3dc009128365 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:46.135511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bb349d3d-1cd2-4e5e-982c-20dabb671842 req-506df367-0846-4ae9-9554-3dc009128365 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:46.136945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bb349d3d-1cd2-4e5e-982c-20dabb671842 req-506df367-0846-4ae9-9554-3dc009128365 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:46.173256 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-bb349d3d-1cd2-4e5e-982c-20dabb671842 req-506df367-0846-4ae9-9554-3dc009128365 service nova] Creating event network-vif-deleted:ab34384e-f3c7-4961-8e60-c582cbd31e2e for instance 15ca8e5c-539b-4bca-801a-66238374918c on n-h1-zed-1 Oct 28 10:05:46.205217 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-bb349d3d-1cd2-4e5e-982c-20dabb671842 req-506df367-0846-4ae9-9554-3dc009128365 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159414 Oct 28 10:05:46.207928 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1823/3653] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:46.228554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1aa11ff5-bedd-4638-91a8-110daa6ec3f1 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:46.261443 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1aa11ff5-bedd-4638-91a8-110daa6ec3f1 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.051526 Oct 28 10:05:46.270043 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1824/3654] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:05:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:46.281309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:46.284784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:46.302189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:46.306410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:46.307867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:46.311635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:46.313404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:46.316273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:47.303830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:47.321488 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-607464d2-79d0-4b53-96e5-0125593c5595 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1313 microversion: 2.1 time: 1.049625 Oct 28 10:05:47.325947 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1825/3655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:46 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1313 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:47.368352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:47.371777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:47.389336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:47.390049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:47.396660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:47.398208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:47.402249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:47.403019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:47.443326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:47.582846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:47.597215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:47.598749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:47.600038 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-499997ac-4380-42a5-86d9-bf8713390a86 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 1.960554 Oct 28 10:05:47.617142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1831/3656] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:45 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:47.632323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c70eb880-4e78-468d-9bdc-0a0c221cfaf7 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Calling method '.version_select at 0x7fca323f5dc0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:47.717900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:47.730558 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa25f143-0751-4d3b-a846-65e34e83beb1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1281 microversion: 2.1 time: 0.385578 Oct 28 10:05:47.735092 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1826/3657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:47 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1281 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:47.744486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:47.758836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:47.761026 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c70eb880-4e78-468d-9bdc-0a0c221cfaf7 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991" status: 200 len: 353 microversion: 2.1 time: 0.148145 Oct 28 10:05:47.761610 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1832/3658] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:05:47 2022] GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 => generated 353 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:47.767456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:47.768267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:47.778901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:47.782484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:47.785993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:47.790079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:47.790643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:47.791143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:47.796258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:47.796493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:47.797490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:47.797981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:47.798424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:47.800783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:47.873384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:05:48.006323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:48.016332 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-156b1ab7-60b0-4867-941b-212810c6088d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1265 microversion: 2.1 time: 0.253358 Oct 28 10:05:48.021440 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1833/3659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:47 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:48.095770 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bfe635cb-3f30-49ea-8bae-9eb5e295babf tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 204 len: 0 microversion: 2.1 time: 0.358925 Oct 28 10:05:48.097092 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1827/3660] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:05:47 2022] DELETE /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:05:48.105351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:48.105961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:48.119965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:48.121796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:48.122251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:48.125649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:48.126129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:48.130788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:48.353740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:48.355238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:48.368509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:48.372633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:48.373403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:48.376712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:48.377530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:48.383057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:49.198287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:49.213669 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d58cc0b7-2ef0-4332-9577-24eaa815b5c5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1608 microversion: 2.1 time: 1.112332 Oct 28 10:05:49.214809 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1834/3661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:48 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1608 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:49.220620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:49.223867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:49.239664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:49.242136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:49.245790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:49.260221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:49.261478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:49.264442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:49.503804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:49.513257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:49.520686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:49.522268 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4eebe31b-1a49-40e6-b18d-d92433909b5a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.306123 Oct 28 10:05:49.525406 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1835/3662] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:49 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:49.531186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:49.532046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:49.540887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:49.541681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:49.542315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:49.543213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:49.543825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:49.544410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.022249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:50.031143 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d5176249-c5c1-407d-a354-55f925a0a091 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1313 microversion: 2.1 time: 1.684453 Oct 28 10:05:50.045849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1828/3663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:48 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1313 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:05:50.051133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b7e7eb0-9438-4bd1-96a5-da8683562c10 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Calling method '.version_select at 0x7fca32db6310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:50.184927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:50.197001 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fbfaef66-6f82-43a0-9f52-08226061e51b tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.666010 Oct 28 10:05:50.200107 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1836/3664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:49 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:50.222840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:50.226178 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b7e7eb0-9438-4bd1-96a5-da8683562c10 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991" status: 200 len: 354 microversion: 2.1 time: 0.178666 Oct 28 10:05:50.227033 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1829/3665] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:05:50 2022] GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 => generated 354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:50.232691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5b827933-2f86-44c3-b76b-3064730a1880 req-4dfdd69f-f89f-4089-a328-2bf191993013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d20727e-4105-4bbe-8e93-a3960f8330bf", "name": "network-vif-plugged", "status": "completed", "tag": "fcb63ddf-3037-4721-8845-2a2d42350c8f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:50.241680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:50.273186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:50.276885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5b827933-2f86-44c3-b76b-3064730a1880 req-4dfdd69f-f89f-4089-a328-2bf191993013 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:50.277415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5b827933-2f86-44c3-b76b-3064730a1880 req-4dfdd69f-f89f-4089-a328-2bf191993013 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:50.277865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5b827933-2f86-44c3-b76b-3064730a1880 req-4dfdd69f-f89f-4089-a328-2bf191993013 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.282866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:50.283550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.287705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:50.287705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:50.287956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.330906 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5b827933-2f86-44c3-b76b-3064730a1880 req-4dfdd69f-f89f-4089-a328-2bf191993013 service nova] Creating event network-vif-plugged:fcb63ddf-3037-4721-8845-2a2d42350c8f for instance 3d20727e-4105-4bbe-8e93-a3960f8330bf on n-h1-zed-1 Oct 28 10:05:50.337445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5b827933-2f86-44c3-b76b-3064730a1880 req-4dfdd69f-f89f-4089-a328-2bf191993013 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108184 Oct 28 10:05:50.338579 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1830/3666] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:50.346092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:50.346810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:50.387061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:50.387578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:50.388041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.388853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:50.389342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:50.389793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.470065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:50.480793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07be05dc-05f3-4214-9c15-ae5648e91ad6 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1265 microversion: 2.1 time: 0.276970 Oct 28 10:05:50.495591 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1837/3667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:50 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:50.501018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bbc8d4f-824e-46c6-aff8-4d7fc5e1666c tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Calling method '.version_select at 0x7fca3243c820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:50.640620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6bbc8d4f-824e-46c6-aff8-4d7fc5e1666c tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991" status: 200 len: 354 microversion: 2.1 time: 0.143412 Oct 28 10:05:50.641423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1838/3668] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:05:50 2022] GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:50.646832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:50.647453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:50.675973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:50.676927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:50.677626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.679183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:50.679877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:50.680538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:50.716660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:51.056570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:51.072627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:51.077511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:51.081718 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b750fb53-4e3e-48bf-a4aa-a210acc368a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.438984 Oct 28 10:05:51.085177 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1839/3669] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:50 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:51.104030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0386b23-0246-4244-8895-afa992c4ca69 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Calling method '.version_select at 0x7fca323f5f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:51.220001 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0386b23-0246-4244-8895-afa992c4ca69 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991" status: 202 len: 0 microversion: 2.1 time: 0.129965 Oct 28 10:05:51.220883 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1840/3670] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:05:51 2022] DELETE /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:51.227256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:51.227883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:51.235534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:51.258108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:51.259544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:51.262335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:51.263084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:51.263552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:51.266957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:51.525026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:51.541678 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-47d11d2b-8078-4684-a89b-973104914129 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1608 microversion: 2.1 time: 1.201352 Oct 28 10:05:51.545118 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1831/3671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:50 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1608 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:51.564734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:51.565832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:51.575488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:51.577516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:51.590407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:51.591447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:51.592146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:51.600825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:52.041329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:52.052511 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3021c8fe-39eb-40fb-b8e8-e2df2a142e08 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1313 microversion: 2.1 time: 0.826818 Oct 28 10:05:52.055825 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1841/3672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:51 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:52.083227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50b8ae23-ffa1-4f46-9c99-3e352aa6f77d tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Calling method '.version_select at 0x7fca324fb1f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:52.287006 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50b8ae23-ffa1-4f46-9c99-3e352aa6f77d tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991" status: 200 len: 353 microversion: 2.1 time: 0.229625 Oct 28 10:05:52.288073 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1842/3673] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:05:52 2022] GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 => generated 353 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:52.294015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8a51ea1b-cf6f-4c69-8151-70034e78234e req-c10d6f39-15c1-45f9-99bd-0f433915a57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a", "tag": "bf61c338-ac33-4dc5-ab15-6f0bb3a62973"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:52.334816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a51ea1b-cf6f-4c69-8151-70034e78234e req-c10d6f39-15c1-45f9-99bd-0f433915a57a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:52.341831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a51ea1b-cf6f-4c69-8151-70034e78234e req-c10d6f39-15c1-45f9-99bd-0f433915a57a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:52.345181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a51ea1b-cf6f-4c69-8151-70034e78234e req-c10d6f39-15c1-45f9-99bd-0f433915a57a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:52.386578 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8a51ea1b-cf6f-4c69-8151-70034e78234e req-c10d6f39-15c1-45f9-99bd-0f433915a57a service nova] Creating event network-changed:bf61c338-ac33-4dc5-ab15-6f0bb3a62973 for instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a on n-h2-zed-1 Oct 28 10:05:52.430982 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8a51ea1b-cf6f-4c69-8151-70034e78234e req-c10d6f39-15c1-45f9-99bd-0f433915a57a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140871 Oct 28 10:05:52.441694 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1843/3674] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:52.485761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:52.494069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:52.531880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:52.540537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:52.542663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:52.544756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:52.548062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:52.551446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:52.661864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:52.844479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:52.861650 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25d825c9-954a-4f50-bd2b-7629755319a0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 1.314791 Oct 28 10:05:52.868168 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1832/3675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:51 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:52.885925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:52.886908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:52.907147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:52.911870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:52.913557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:52.914005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:52.914729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:52.915192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:52.915623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:52.933702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:52.944658 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-372b8447-0f5a-481f-8248-c1ea66bce37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.486411 Oct 28 10:05:52.946236 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1844/3676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:52 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:52.951996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:52.952816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:52.971480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:52.972242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:52.972867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:52.975163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:52.976182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:52.976624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:53.214695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:53.236215 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a31bba44-d28e-49f2-a9fb-abf423f93b9a tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1608 microversion: 2.1 time: 0.287660 Oct 28 10:05:53.254207 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1845/3677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:52 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1608 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:53.261024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:53.263763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:53.279334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:53.279839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:53.283740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:53.284575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:53.286631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:53.287117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:53.690998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:53.706382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9d751940-2747-48f9-a540-7960b080f83c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1500 microversion: 2.1 time: 0.462808 Oct 28 10:05:53.722880 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1846/3678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:53 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1500 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:53.734159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2afd5bd6-00bf-4a32-968f-4a9eb6025c9b tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Calling method '.version_select at 0x7fca323881f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:53.848794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2afd5bd6-00bf-4a32-968f-4a9eb6025c9b tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991" status: 200 len: 353 microversion: 2.1 time: 0.132647 Oct 28 10:05:53.849498 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1847/3679] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:05:53 2022] GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:53.855871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:53.855871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:53.868800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:53.869330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:53.871963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:53.872747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:53.873249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:53.877567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:53.939811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lazy-loading 'flavor' on Instance uuid 3d20727e-4105-4bbe-8e93-a3960f8330bf {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:05:54.128200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:54.210894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:05:54.431080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1e6b2533-aa6a-40e1-95a9-8f0d517412e0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf/action" status: 202 len: 0 microversion: 2.1 time: 0.580296 Oct 28 10:05:54.436421 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1848/3680] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:05:53 2022] POST /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:05:54.456718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:54.457539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:54.482138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:54.482650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:54.483093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:54.483837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:54.484296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:54.484723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:54.788315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:54.800509 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-db2c8c55-c30e-4e6c-831d-4cbc170d2b8d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.362675 Oct 28 10:05:54.802277 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1849/3681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:54 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:54.815351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:54.816584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:54.830339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:54.831226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:54.831904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:54.833135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:54.833838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:54.835871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:55.071694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:55.098141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:55.104300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:55.105881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2424c45f-3bae-4920-bbc1-febb63b7e54e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 2.236419 Oct 28 10:05:55.106986 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1833/3682] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:52 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 2238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:55.116974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:55.120409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:55.148821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:55.154426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:55.157699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:55.168265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:55.169024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:55.169480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:55.220153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:55.245836 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3410f5ad-4060-4476-8d75-8e8c56a4dbdd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.442144 Oct 28 10:05:55.279669 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1850/3683] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:54 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:55.301857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:55.301857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:55.316771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:55.320322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:55.320793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:55.323558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:55.324052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:55.324492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:55.953564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:55.964391 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9296a02d-08f6-470a-9e2a-e1219a1f0fde tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.683474 Oct 28 10:05:55.969398 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1851/3684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:55 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:55.980359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-de12df04-5772-4523-8e35-e757ca313109 req-4ccf6467-9374-4ec3-aeef-40ac42ed9dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1881709-67ac-4bd8-9d2a-e41d453a6412", "name": "network-vif-unplugged", "status": "completed", "tag": "3e8cb734-09fb-4ec3-9089-592ed8eee3dc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:56.003276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-de12df04-5772-4523-8e35-e757ca313109 req-4ccf6467-9374-4ec3-aeef-40ac42ed9dec service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:56.009949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-de12df04-5772-4523-8e35-e757ca313109 req-4ccf6467-9374-4ec3-aeef-40ac42ed9dec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:56.010571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-de12df04-5772-4523-8e35-e757ca313109 req-4ccf6467-9374-4ec3-aeef-40ac42ed9dec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:56.059104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-de12df04-5772-4523-8e35-e757ca313109 req-4ccf6467-9374-4ec3-aeef-40ac42ed9dec service nova] Creating event network-vif-unplugged:3e8cb734-09fb-4ec3-9089-592ed8eee3dc for instance e1881709-67ac-4bd8-9d2a-e41d453a6412 on n-h2-zed-1 Oct 28 10:05:56.079762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-de12df04-5772-4523-8e35-e757ca313109 req-4ccf6467-9374-4ec3-aeef-40ac42ed9dec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108665 Oct 28 10:05:56.080303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1852/3685] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:56.098708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14a7c37d-9563-4d64-b91d-962950ddb2f3 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Calling method '.version_select at 0x7fca32388280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:56.171738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-14a7c37d-9563-4d64-b91d-962950ddb2f3 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] HTTP exception thrown: Volume 75f19129-3eea-4e9d-af38-63a3e7738991 could not be found. Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14a7c37d-9563-4d64-b91d-962950ddb2f3 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Request method failure captured: Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 HTTP/1.1 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6l24Zq5n3u21s2KIk9UPwMHO8FCt9cLVwE_kRvRQ5fHIjLW8NAcN87Pq5eCaoctf97AUsny9Qs7Ml5csBByRUfW99YfsNsZPT6fikrXP6Yes4kuFQ7swnw08c1JVPssE2l37-liiYdnjOgkz5u4K-lj2Xv7J81soDAZxFMtmWDQRBE Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: a2172b8f682b4096845ddd570838466c Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesGetTestJSON-1842879337 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a2172b8f682b4096845ddd570838466c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a2172b8f682b4096845ddd570838466c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a2172b8f682b4096845ddd570838466c", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a2172b8f682b4096845ddd570838466c"}]}] Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesGetTestJSON-1842879337 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: a2172b8f682b4096845ddd570838466c Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesGetTestJSON-1842879337 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesGetTestJSON-1842879337-project Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 835e7d7fae5749f49a53beab143fdc43 Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesGetTestJSON-1842879337-project Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: exception: Volume 75f19129-3eea-4e9d-af38-63a3e7738991 could not be found. Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '75f19129-3eea-4e9d-af38-63a3e7738991'} Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 75f19129-3eea-4e9d-af38-63a3e7738991 could not be found. (HTTP 404) (Request-ID: req-421fc690-1375-4c5a-a542-a2731f48c98d) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:05:56.174158 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 75f19129-3eea-4e9d-af38-63a3e7738991 could not be found. Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 75f19129-3eea-4e9d-af38-63a3e7738991 could not be found. Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 75f19129-3eea-4e9d-af38-63a3e7738991 could not be found. Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14a7c37d-9563-4d64-b91d-962950ddb2f3 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] Returning 404 to user: Volume 75f19129-3eea-4e9d-af38-63a3e7738991 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:05:56.180012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14a7c37d-9563-4d64-b91d-962950ddb2f3 tempest-VolumesGetTestJSON-1842879337 tempest-VolumesGetTestJSON-1842879337-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991" status: 404 len: 109 microversion: 2.1 time: 0.094094 Oct 28 10:05:56.187363 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1853/3686] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:05:56 2022] GET /compute/v2.1/os-volumes/75f19129-3eea-4e9d-af38-63a3e7738991 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:05:56.187363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:56.187363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:56.209177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:56.217291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:56.219280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:56.222720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:56.226328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:56.229788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:56.851102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:56.866376 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b68ea01-df81-48ce-adaa-9b569664e9f4 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1608 microversion: 2.1 time: 1.756159 Oct 28 10:05:56.868347 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1834/3687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:55 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1608 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:56.879217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:56.881255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:56.892080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:56.893869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:56.895266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:56.899339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:56.900269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:56.901092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:57.298178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:57.308590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d6cea642-bc13-4bb4-a1be-852add6fd452 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 1.127239 Oct 28 10:05:57.309211 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1854/3688] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:56 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:57.326651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:57.327473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:57.337400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:57.338193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:57.338822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:57.339746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:57.340362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:57.340979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:57.962286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:57.975711 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1603fa2c-5d2d-4cf2-9692-f008b137f267 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.660768 Oct 28 10:05:57.977218 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1855/3689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:57 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:57.983916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-34e6da9d-f67f-4e21-84ba-e5ceda02a652 req-4684d65b-69c7-4534-9507-17f3b7bc321f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581", "tag": "775919f4-ed6a-44f7-b0fc-015f26fb08af"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:58.008530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34e6da9d-f67f-4e21-84ba-e5ceda02a652 req-4684d65b-69c7-4534-9507-17f3b7bc321f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:58.009444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34e6da9d-f67f-4e21-84ba-e5ceda02a652 req-4684d65b-69c7-4534-9507-17f3b7bc321f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:58.010173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34e6da9d-f67f-4e21-84ba-e5ceda02a652 req-4684d65b-69c7-4534-9507-17f3b7bc321f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:58.042093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-34e6da9d-f67f-4e21-84ba-e5ceda02a652 req-4684d65b-69c7-4534-9507-17f3b7bc321f service nova] Creating event network-changed:775919f4-ed6a-44f7-b0fc-015f26fb08af for instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 on n-h1-zed-1 Oct 28 10:05:58.051370 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-34e6da9d-f67f-4e21-84ba-e5ceda02a652 req-4684d65b-69c7-4534-9507-17f3b7bc321f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072331 Oct 28 10:05:58.052913 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1856/3690] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:05:58.062107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:58.063465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:58.073437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:58.074645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:58.076175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:58.077660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:58.078511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:58.079377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:58.391378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:58.402211 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-091b9bf0-a735-414c-8aa6-f90e05ed238c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.346290 Oct 28 10:05:58.403846 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1857/3691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:58 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:58.445971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-826119178", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7df04b26-3ca9-44e5-b81e-8eac12ecade1"}, {"uuid": "9dd014ee-8291-401a-b614-4b526c7bb46c"}, {"uuid": "7df04b26-3ca9-44e5-b81e-8eac12ecade1"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:05:58.527358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] validate_networks() for [('7df04b26-3ca9-44e5-b81e-8eac12ecade1', None, None, None, None, None), ('9dd014ee-8291-401a-b614-4b526c7bb46c', None, None, None, None, None), ('7df04b26-3ca9-44e5-b81e-8eac12ecade1', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:05:58.561613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:58.573100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:58.578591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:58.581571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b768cbf-2c5c-47fa-bd07-6c6ae1d17714 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 1.710626 Oct 28 10:05:58.608163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1835/3692] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:05:56 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:05:58.614379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:58.619030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:58.636229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:58.637591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:58.639194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:58.642077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:58.649018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:58.649913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:58.923400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:05:58.939555 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e0ee8fd-35cc-45ac-925c-d9518403db45 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1541 microversion: 2.1 time: 0.329290 Oct 28 10:05:58.957991 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1836/3693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:58 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1541 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:05:58.985947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:05:58.986715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:05:58.998926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:58.999468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:59.001467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:59.005757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:59.006876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:59.007504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:59.940454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:05:59.941024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:05:59.941405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:05:59.941820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:05:59.942237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:05:59.959699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:59.960202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:59.960839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:59.961858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:05:59.963086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:05:59.964129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:05:59.996423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Getting quotas for project 26e212a668cf47d38ef3b363ce7dbba4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:06:00.003346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Getting quotas for user 1f95d3b5d2334eefb1b5386fb8580780 and project 26e212a668cf47d38ef3b363ce7dbba4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:06:00.021201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:06:00.023859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:06:00.131803 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f73c0a6-18ff-4f61-b801-7209781bdbcd tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.726244 Oct 28 10:06:00.135122 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1858/3694] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:05:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:06:00.148298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:00.149272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:00.164005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:00.164499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:00.167602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:00.170544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:00.171492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:00.171492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:00.639075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:00.655434 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f04fde91-176b-4d6f-9d02-6b75b1c0ff89 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 1.696121 Oct 28 10:06:00.668119 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1837/3695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:05:58 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:00.689754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:00.690491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:00.699204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:00.699797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:00.700307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:00.701119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:00.701804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:00.703256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:00.941593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:00.952462 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d7c051aa-8864-46e6-9067-78d9f5b850df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.816020 Oct 28 10:06:00.959606 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1859/3696] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:00 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:00.967423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:00.968056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:00.990449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:00.999966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:01.001384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:01.002637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:01.003292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:01.004156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:01.355466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:01.381422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ac26623-f92f-4e2a-ac11-42161861f68e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.697003 Oct 28 10:06:01.384797 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1838/3697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:00 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:01.404622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:01.405290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:01.436940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:01.439398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:01.439866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:01.445472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:01.446028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:01.446481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:01.816406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:01.822745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:01.827298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:01.828784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:01.830043 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab2f72a9-7cc6-4f41-ac28-d0d822b69dde tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.869004 Oct 28 10:06:01.830475 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1860/3698] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:00 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:01.849231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:01.875478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:01.876370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:01.884708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:01.889782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:01.890426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:01.893353 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da46a3f8-9580-445f-ab36-28841f75a5da tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1253 microversion: 2.1 time: 0.487195 Oct 28 10:06:01.902176 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1839/3699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:01 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1253 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:01.905662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:01.908663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:01.910052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:01.915665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-dbc36546-c58b-4123-852e-1d2c906350d2 req-dadde83b-951b-4880-a21c-7e7ccdfa9d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74f6a377-e958-47ab-94cf-a19001270b5f", "tag": "433b5532-bceb-49ff-9fc9-9b3d72973982"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:01.992361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dbc36546-c58b-4123-852e-1d2c906350d2 req-dadde83b-951b-4880-a21c-7e7ccdfa9d30 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.000343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dbc36546-c58b-4123-852e-1d2c906350d2 req-dadde83b-951b-4880-a21c-7e7ccdfa9d30 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.000922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dbc36546-c58b-4123-852e-1d2c906350d2 req-dadde83b-951b-4880-a21c-7e7ccdfa9d30 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:02.055923 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-dbc36546-c58b-4123-852e-1d2c906350d2 req-dadde83b-951b-4880-a21c-7e7ccdfa9d30 service nova] Creating event network-changed:433b5532-bceb-49ff-9fc9-9b3d72973982 for instance 74f6a377-e958-47ab-94cf-a19001270b5f on n-h2-zed-1 Oct 28 10:06:02.068295 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-dbc36546-c58b-4123-852e-1d2c906350d2 req-dadde83b-951b-4880-a21c-7e7ccdfa9d30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164798 Oct 28 10:06:02.069003 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1840/3700] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:02.152984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:02.161491 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-60b336de-8a57-44e5-9c53-a7c9827dde6d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1264 microversion: 2.1 time: 0.302576 Oct 28 10:06:02.164441 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1861/3701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:01 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1264 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:02.171927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:02.182958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:02.209322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.211588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.218706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:02.219838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.220842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.223028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:02.418737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7f5a7da9-9855-47cd-b40d-f844f1c66c92 req-14ebf946-3fd7-4999-8a46-971fcf1b1bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a", "name": "network-vif-plugged", "status": "completed", "tag": "bf61c338-ac33-4dc5-ab15-6f0bb3a62973"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:02.439769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f5a7da9-9855-47cd-b40d-f844f1c66c92 req-14ebf946-3fd7-4999-8a46-971fcf1b1bbd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.453302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f5a7da9-9855-47cd-b40d-f844f1c66c92 req-14ebf946-3fd7-4999-8a46-971fcf1b1bbd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.454260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f5a7da9-9855-47cd-b40d-f844f1c66c92 req-14ebf946-3fd7-4999-8a46-971fcf1b1bbd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:02.476592 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7f5a7da9-9855-47cd-b40d-f844f1c66c92 req-14ebf946-3fd7-4999-8a46-971fcf1b1bbd service nova] Creating event network-vif-plugged:bf61c338-ac33-4dc5-ab15-6f0bb3a62973 for instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a on n-h2-zed-1 Oct 28 10:06:02.483371 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7f5a7da9-9855-47cd-b40d-f844f1c66c92 req-14ebf946-3fd7-4999-8a46-971fcf1b1bbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.406606 Oct 28 10:06:02.494933 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1841/3702] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:02.501035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:02.501981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:02.519422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.520111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.520730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:02.521984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.523397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.523832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:02.675027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:02.685193 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-60bf962d-3260-4ff8-80f4-38c5b0033198 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.517314 Oct 28 10:06:02.686286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1862/3703] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:02 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:02.694745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:02.708655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:02.734138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.735511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.737720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:02.739785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:02.740564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:02.741908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.022834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:03.032487 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eee6e021-1eb8-4ffa-95f6-09c22a6a52b4 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.342765 Oct 28 10:06:03.037124 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1863/3704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:02 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:03.042846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:03.043730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:03.064803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.065855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.066749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.073452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.075896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.076776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.520773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:03.532598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:03.540101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:03.544829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:03.549768 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-610ecf23-a5c0-433e-a7f6-5806354d057a tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.510345 Oct 28 10:06:03.550861 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25775e07-0cfc-4976-b7ed-78b427712414 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 1.054155 Oct 28 10:06:03.551920 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1864/3705] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:03 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:03.553351 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1842/3706] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:02 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:03.559732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:03.565745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:03.568163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:03.569203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:03.577488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.581820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.582626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.583630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.584334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.587490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.593066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.605099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.605709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.606489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.606973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.610863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.753717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:03.764305 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d2e1e51-6367-4d58-aa89-4c847e4a502e tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1253 microversion: 2.1 time: 0.209955 Oct 28 10:06:03.765470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:03.778412 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1865/3707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:03 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1253 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:03.783563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6fd0ea42-afb1-4bfb-8ad4-17eb6146a625 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1264 microversion: 2.1 time: 0.227410 Oct 28 10:06:03.784157 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1843/3708] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:03 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:03.792261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:03.793238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:03.819236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.820677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.821403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:03.822371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:03.823042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:03.823681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.058220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:04.059064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:04.071544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:04.072061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:04.073845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.076709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:04.077296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:04.078521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.117124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:04.148229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:04.156874 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0f7402b-c920-42fc-8b9a-dad0db960a1f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.377211 Oct 28 10:06:04.159469 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1866/3709] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:03 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:04.280316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ad5ed01b-bc40-4e8e-8552-23a6e27a3b04 req-d5f3645e-9747-4930-b393-a4329e28a0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c887bd71-f702-4d75-98af-df3ea11c7184", "tag": "1a6d3ce1-8750-4f98-b746-5014ab5c01dd"}, {"server_uuid": "e1881709-67ac-4bd8-9d2a-e41d453a6412", "name": "network-vif-deleted", "tag": "3e8cb734-09fb-4ec3-9089-592ed8eee3dc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:04.313970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ad5ed01b-bc40-4e8e-8552-23a6e27a3b04 req-d5f3645e-9747-4930-b393-a4329e28a0d0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:04.320655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ad5ed01b-bc40-4e8e-8552-23a6e27a3b04 req-d5f3645e-9747-4930-b393-a4329e28a0d0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:04.321285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ad5ed01b-bc40-4e8e-8552-23a6e27a3b04 req-d5f3645e-9747-4930-b393-a4329e28a0d0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.366027 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ad5ed01b-bc40-4e8e-8552-23a6e27a3b04 req-d5f3645e-9747-4930-b393-a4329e28a0d0 service nova] Creating event network-changed:1a6d3ce1-8750-4f98-b746-5014ab5c01dd for instance c887bd71-f702-4d75-98af-df3ea11c7184 on n-h1-zed-1 Oct 28 10:06:04.369794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ad5ed01b-bc40-4e8e-8552-23a6e27a3b04 req-d5f3645e-9747-4930-b393-a4329e28a0d0 service nova] Creating event network-vif-deleted:3e8cb734-09fb-4ec3-9089-592ed8eee3dc for instance e1881709-67ac-4bd8-9d2a-e41d453a6412 on n-h2-zed-1 Oct 28 10:06:04.391391 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ad5ed01b-bc40-4e8e-8552-23a6e27a3b04 req-d5f3645e-9747-4930-b393-a4329e28a0d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.114390 Oct 28 10:06:04.395587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1867/3710] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:04.433161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:04.450194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ba34d69-7528-4217-bcc7-f69c15c331ba tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.392273 Oct 28 10:06:04.452689 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1844/3711] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:04 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:04.577109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:04.579250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:04.579687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:04.580023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:04.590008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:04.590546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:04.591014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.594240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:04.594961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:04.598746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.610403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:04.610910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:04.611354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.612087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:04.612548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:04.613027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:04.947543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:04.974387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:04.983439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:04.988110 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2246aa3d-d2dc-48e3-b949-32da3164d5ff tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.411068 Oct 28 10:06:04.989834 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1845/3712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:04 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:06:04.990017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:04.994412 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-db02a5df-139e-4b6b-94fa-529014de7f57 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1740 microversion: 2.20 time: 0.420622 Oct 28 10:06:04.997723 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1868/3713] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:04 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1740 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:05.008443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:05.011858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:05.014312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:05.019837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:05.022965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.024697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.028252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.029540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.030968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.033190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.036225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.036762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.037266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.038036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.038504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.044024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.235709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:05.246036 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b8aaf2f-0d31-4b37-9c06-12c1ad550ae2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1264 microversion: 2.1 time: 0.247070 Oct 28 10:06:05.246630 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1869/3714] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:04 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:05.251163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:05.258962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:05.271461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.272096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.272554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.273302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.277148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.277916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.325117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:05.332687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6fba30fe-cf58-438e-9ec8-56089ddc68c0 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1253 microversion: 2.1 time: 0.340281 Oct 28 10:06:05.333288 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1846/3715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:04 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1253 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:05.478307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:05.479654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:05.495639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.500119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.500615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.501394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:05.501870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:05.506136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:05.603616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:05.616414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dcd71c35-7f00-4efe-9908-7d429df69fc4 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.368733 Oct 28 10:06:05.617669 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1870/3716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:05 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:05.673206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7209e330-f36f-49f0-9d3a-428ffaefa2ca tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca3246e940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:05.786924 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7209e330-f36f-49f0-9d3a-428ffaefa2ca tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/b62896e2-9a87-4365-8423-fd943aa3e0c9" status: 200 len: 351 microversion: 2.1 time: 0.117845 Oct 28 10:06:05.795922 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1871/3717] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:06:05 2022] GET /compute/v2.1/os-volumes/b62896e2-9a87-4365-8423-fd943aa3e0c9 => generated 351 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:06:06.023482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:06.024106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:06.039121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.039648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.040376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:06.041388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.042070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.042681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:06.261690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:06.293401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2314b1a9-472f-48b8-917f-9b7651fcc18f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.817937 Oct 28 10:06:06.310077 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1847/3718] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:05 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:06.310077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:06.310077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:06.334275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.335532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.336082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:06.336933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.337518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.338110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:06.641848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:06.667049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1de59524-088f-4459-8533-476ab8ac895e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.649891 Oct 28 10:06:06.669757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1872/3719] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:06 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:06:06.677258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:06.678998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:06.690665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.691467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.693224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:06.695656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.696460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.698340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:06.893163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:06.904361 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-140a2150-f7d5-42d3-87a9-2e840499b63d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1270 microversion: 2.1 time: 0.233221 Oct 28 10:06:06.907818 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1873/3720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:06 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1270 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:06.913840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:06.924687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:06.942326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.945116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.945918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:06.947768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:06.948281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:06.948722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:07.203454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:07.217888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-585f46e9-33da-43a0-999a-e1e659ed9f5d tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1253 microversion: 2.1 time: 0.308614 Oct 28 10:06:07.218796 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1874/3721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:06 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1253 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:07.228623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:07.232496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:07.245950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:07.246863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:07.247543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:07.253448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:07.254182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:07.254867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:07.301826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:07.322302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:07.326188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:07.328080 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6c6fa33e-a03a-43b2-b1e9-c260081c9c09 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1722 microversion: 2.20 time: 1.031617 Oct 28 10:06:07.332957 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1848/3722] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:06 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1722 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:07.350929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:07.360402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:07.390440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:07.391271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:07.392806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:07.394528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:07.398363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:07.399002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:07.758964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:07.779270 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-449fe1f8-5c7c-4aca-8f04-d2aa297fd64d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.559088 Oct 28 10:06:07.800701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1875/3723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:07 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:07.807604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01425f0a-e7dc-4314-88d7-e65661af3c0d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Action: 'create', calling method: .version_select at 0x7fca3243c670>, body: {"keypair": {"name": "tempest-keypair-1350235924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIABGePrlkZ/GjBS+ISEHz6KjPjOLG3evIQFTHEn2eGlkOfsilDFPQ8N7Aa+7OshLPXv3CI5snTKnrQySniARYM2eSjFIbbgFOKL9ldPn/peQWFyHVTvbKwWp7n8gynLQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:07.848233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-01425f0a-e7dc-4314-88d7-e65661af3c0d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Getting quotas for project 7db61a6ccbee4a298909d79faabc004d. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:06:07.867538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-01425f0a-e7dc-4314-88d7-e65661af3c0d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Getting quotas for user 45369fea2a654d1d88145db9677a53fb and project 7db61a6ccbee4a298909d79faabc004d. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:06:07.927344 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01425f0a-e7dc-4314-88d7-e65661af3c0d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.121649 Oct 28 10:06:07.932117 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1876/3724] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 10:06:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 129 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 10:06:07.949286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:07.950393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:07.977218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:07.977717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:07.978162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:07.978881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:07.979342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:07.979762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.076831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:08.089798 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b96b336-8233-409e-a076-2042201c17d0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.754092 Oct 28 10:06:08.094887 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1849/3725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:07 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:08.112097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:08.114116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:08.134458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.140456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.141123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.143900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.144509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.147931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.437994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:08.458516 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0895a5af-ed0d-4268-9199-9aa97ddcf4b0 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1270 microversion: 2.1 time: 0.361281 Oct 28 10:06:08.470209 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1850/3726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:08 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1270 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:08.481921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:08.482105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:08.484649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:08.496422 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca4ec330-4d8f-43a2-a310-e9e2ebe4646f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.562794 Oct 28 10:06:08.498899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.501345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.502058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.503400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.504068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.505012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.511385 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1877/3727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:07 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:08.527104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:08.529683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:08.547199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.547882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.548486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.549788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.551376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.552125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.692096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:08.705595 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d3b9066-2b45-4cf8-b088-ec5f2ddd6cba tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1253 microversion: 2.1 time: 0.234079 Oct 28 10:06:08.706643 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1851/3728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:08 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1253 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:08.712849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-690f16b2-75e8-4577-a2c3-685bf4b69adc tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca326b7040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:08.821080 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-690f16b2-75e8-4577-a2c3-685bf4b69adc tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/e677f5f4-3463-441c-ae89-dbe36d40f4a4" status: 200 len: 351 microversion: 2.1 time: 0.112248 Oct 28 10:06:08.821695 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1852/3729] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:06:08 2022] GET /compute/v2.1/os-volumes/e677f5f4-3463-441c-ae89-dbe36d40f4a4 => generated 351 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:08.827598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:08.828522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:08.852882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.856021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.859563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:08.860529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:08.861354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:08.864971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.043547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:09.058952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:09.069945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:09.077703 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4a4deaf6-15b3-4fa1-b420-f87dfc6281c6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1722 microversion: 2.20 time: 0.558743 Oct 28 10:06:09.081361 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1878/3730] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:08 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1722 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:09.120840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:09.121920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:09.139908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:09.140312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:09.140783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.154334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:09.155515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:09.157979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.372712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:09.390136 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a9a3f8a-6ca9-4d91-a3db-5cd20173facb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.567140 Oct 28 10:06:09.390743 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1853/3731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:08 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:09.420370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-48f533ef-4c0d-4b0f-96db-e7645fbd7d9e req-cd091963-224f-40f9-842e-c09b728e1adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581", "name": "network-vif-plugged", "status": "completed", "tag": "775919f4-ed6a-44f7-b0fc-015f26fb08af"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:09.468555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48f533ef-4c0d-4b0f-96db-e7645fbd7d9e req-cd091963-224f-40f9-842e-c09b728e1adb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:09.469239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48f533ef-4c0d-4b0f-96db-e7645fbd7d9e req-cd091963-224f-40f9-842e-c09b728e1adb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:09.469491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-48f533ef-4c0d-4b0f-96db-e7645fbd7d9e req-cd091963-224f-40f9-842e-c09b728e1adb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.543627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-48f533ef-4c0d-4b0f-96db-e7645fbd7d9e req-cd091963-224f-40f9-842e-c09b728e1adb service nova] Creating event network-vif-plugged:775919f4-ed6a-44f7-b0fc-015f26fb08af for instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 on n-h1-zed-1 Oct 28 10:06:09.557474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-48f533ef-4c0d-4b0f-96db-e7645fbd7d9e req-cd091963-224f-40f9-842e-c09b728e1adb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156604 Oct 28 10:06:09.558414 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1854/3732] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:09.570331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:09.589297 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a92968b8-db63-47a1-ba47-8d967130b14b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.471658 Oct 28 10:06:09.590304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:09.591231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:09.591438 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1879/3733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:09 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:09.602469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:09.603106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:09.621744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:09.622502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:09.623111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.623996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:09.624844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:09.625473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.626114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:09.626617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:09.627060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.631213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:09.632271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:09.632718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:09.642857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:09.981451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:10.023900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:10.039333 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1bd167c-6169-420e-ad8d-17d35600bacf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.445463 Oct 28 10:06:10.057820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1880/3734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:09 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:10.057820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:10.057820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:10.057820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.057820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.057820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.059555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.066420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.067332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.187150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:10.195984 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44425ac8-0af9-4524-a1ce-bf83740f8e4f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1312 microversion: 2.1 time: 0.628898 Oct 28 10:06:10.200569 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1855/3735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:09 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1312 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:10.206895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:10.217959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:10.233908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.238806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.242303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.245645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.251123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.253561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.376652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:10.390411 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01419153-31b1-4ff1-8632-8530dc12b956 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1253 microversion: 2.1 time: 0.345799 Oct 28 10:06:10.394925 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1881/3736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:10 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1253 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:10.440481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:10.442158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:10.464234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.479897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.480632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.486283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.486794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.487246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.575581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:10.605320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:10.607228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:10.610338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb6d0316-06f5-4eae-9624-41701c0542ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1722 microversion: 2.20 time: 0.408410 Oct 28 10:06:10.614715 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1856/3737] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:10 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1722 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:10.619944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:10.629111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:10.646185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.649025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.649708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.651759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:10.653546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:10.655292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:10.921762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:10.939256 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-534fd402-ac6b-4982-8c7f-0c7707f8359b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.322891 Oct 28 10:06:10.940053 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1857/3738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:10 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:11.067030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:11.067659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:11.081625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.082127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.082578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.083296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.083759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.084191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.470760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:11.488246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24292e4a-a650-44c6-9a2f-5508f6e4eaf7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.425992 Oct 28 10:06:11.488869 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1858/3739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:11 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:06:11.507256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:11.507918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:11.526106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.526691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.527124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.527914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.528489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.528948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.719854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:11.732171 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a013b47-7332-4152-b674-a817ba07d7cf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1312 microversion: 2.1 time: 0.238769 Oct 28 10:06:11.733563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1859/3740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:11 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1312 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:11.739379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:11.740259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:11.749384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.750237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.750938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.751894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.752552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.753604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.761992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:11.773020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f96e1e4-78f8-4b08-bf3d-6aad3626c9a8 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 1.360175 Oct 28 10:06:11.788577 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1882/3741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:10 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:06:11.793191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.793894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.794629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.795613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lazy-loading 'fault' on Instance uuid e1881709-67ac-4bd8-9d2a-e41d453a6412 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:06:11.812726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:11.814345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:11.821512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:11.837574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.837983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.838635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.839542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.840169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.840818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.851560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b125e9d6136447169f052690eeaab064', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e1adf828480437ea6595561c912d9bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:11.861584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c0bc363-de03-4649-9d46-d76d90ff08b5 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 200 len: 1258 microversion: 2.1 time: 0.126354 Oct 28 10:06:11.862618 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1860/3742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:11 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 1258 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:11.867276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6a5ede0d-4fd7-4598-b49c-d1923601d882 req-c3aa3a08-734c-484b-90b6-0817a62e2098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "name": "network-vif-unplugged", "status": "completed", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}, {"server_uuid": "74f6a377-e958-47ab-94cf-a19001270b5f", "name": "network-vif-plugged", "status": "completed", "tag": "433b5532-bceb-49ff-9fc9-9b3d72973982"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:11.879416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6a5ede0d-4fd7-4598-b49c-d1923601d882 req-c3aa3a08-734c-484b-90b6-0817a62e2098 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:11.880196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6a5ede0d-4fd7-4598-b49c-d1923601d882 req-c3aa3a08-734c-484b-90b6-0817a62e2098 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:11.880929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6a5ede0d-4fd7-4598-b49c-d1923601d882 req-c3aa3a08-734c-484b-90b6-0817a62e2098 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:11.899528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.server_external_events [req-6a5ede0d-4fd7-4598-b49c-d1923601d882 req-c3aa3a08-734c-484b-90b6-0817a62e2098 service nova] Unable to find a host for instance 635cb96d-039d-4c62-9784-aa89b4b879d1. Dropping event network-vif-unplugged {{(pid=128747) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 10:06:11.900518 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6a5ede0d-4fd7-4598-b49c-d1923601d882 req-c3aa3a08-734c-484b-90b6-0817a62e2098 service nova] Creating event network-vif-plugged:433b5532-bceb-49ff-9fc9-9b3d72973982 for instance 74f6a377-e958-47ab-94cf-a19001270b5f on n-h2-zed-1 Oct 28 10:06:11.906488 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6a5ede0d-4fd7-4598-b49c-d1923601d882 req-c3aa3a08-734c-484b-90b6-0817a62e2098 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 353 microversion: 2.1 time: 0.042473 Oct 28 10:06:11.907776 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1861/3743] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 353 bytes in 44 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 10:06:11.917476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40ef1b42-ca97-4191-a282-0dea8d0ae788 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca32e65040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:11.999051 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40ef1b42-ca97-4191-a282-0dea8d0ae788 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/2df6e301-9edf-4137-96c0-c35167ea6d99" status: 200 len: 350 microversion: 2.1 time: 0.089410 Oct 28 10:06:11.999831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1862/3744] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:06:11 2022] GET /compute/v2.1/os-volumes/2df6e301-9edf-4137-96c0-c35167ea6d99 => generated 350 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:12.008149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:12.008919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:12.015484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.015997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.016444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:12.017301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.018513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.018974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:12.272848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:12.304480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:12.305228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:12.311003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:12.312263 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba8fae21-d21c-4b4c-8d47-206593f3e6f2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1665 microversion: 2.20 time: 0.519506 Oct 28 10:06:12.315714 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-54ab7299-a7fe-4a3c-a2f6-f9ef16251aa6 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.315015 Oct 28 10:06:12.320997 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1863/3745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:11 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:12.327157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-251051d9-af7a-4000-9faa-d653f3db26b1 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca32eec280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:12.334194 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1883/3746] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:11 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1665 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:12.369334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "199e5eaf-0aea-407e-8591-6aa71ce0952e"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:12.371800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:12.396084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.396837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.397532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:12.398513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.399348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.399947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:12.535369 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-251051d9-af7a-4000-9faa-d653f3db26b1 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.210815 Oct 28 10:06:12.536824 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1864/3747] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 10:06:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:12.545967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:12.557359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:12.572547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.573897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.574827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:12.575906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.576539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.577187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:12.581888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:12.827855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:12.836898 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd005a8f-87a7-4aa3-b824-dbc9e9c62a7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.297191 Oct 28 10:06:12.837783 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1865/3748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:12 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:12.854630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b27e0c34-c3e2-4805-b602-b3d3df96ff2c tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca32e415e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:12.897789 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-60b78a95-db2d-430c-8801-cffdac28b860 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.534503 Oct 28 10:06:12.899055 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1884/3749] 10.222.0.16 () {62 vars in 1364 bytes} [Fri Oct 28 10:06:12 2022] POST /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-volume_attachments => generated 188 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:06:12.904893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:12.906372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:12.915037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.916133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.916695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:12.917720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:12.918657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:12.920097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.012272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b27e0c34-c3e2-4805-b602-b3d3df96ff2c tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.173410 Oct 28 10:06:13.012866 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1866/3750] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 10:06:12 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:13.018072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.018985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:13.031062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.033767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.034652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.035644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.037404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.040989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.229457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:13.238434 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0eff6591-93b8-4956-aeff-44a258104704 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1323 microversion: 2.1 time: 0.223983 Oct 28 10:06:13.239236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1867/3751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:13 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1323 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:13.244580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.245334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] [instance: e1881709-67ac-4bd8-9d2a-e41d453a6412] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:13.251678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.252351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.253261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.253970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.254552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.255009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.271017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:13.272256 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] HTTP exception thrown: Instance e1881709-67ac-4bd8-9d2a-e41d453a6412 could not be found. Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Request method failure captured: Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 HTTP/1.1 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6kE8cbG2ckENfJfWHYr-3ILGR3RVtcJ1LbdflNFXCIIZik2GWgx-ivgDbYDzQW3w1uRDPDoyK_Nj4Jpe0CRgdHIrDHWdZaVqTIbaY4sGxPTIC1QhOdj2uw01qkVub55u_c4FZGG7Vojera0x-bew3-f1okfgO62rSN7KUAwl-i4EXY Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 2e1adf828480437ea6595561c912d9bf Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestBootFromVolume-1335460829 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e1adf828480437ea6595561c912d9bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2e1adf828480437ea6595561c912d9bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2e1adf828480437ea6595561c912d9bf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2e1adf828480437ea6595561c912d9bf"}]}] Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestBootFromVolume-1335460829 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 2e1adf828480437ea6595561c912d9bf Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1335460829 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestBootFromVolume-1335460829-project Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b125e9d6136447169f052690eeaab064 Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestBootFromVolume-1335460829-project Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e1881709-67ac-4bd8-9d2a-e41d453a6412 could not be found. Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e1881709-67ac-4bd8-9d2a-e41d453a6412'} Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1881709-67ac-4bd8-9d2a-e41d453a6412 could not be found. Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1881709-67ac-4bd8-9d2a-e41d453a6412 could not be found. Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:13.273783 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1881709-67ac-4bd8-9d2a-e41d453a6412 could not be found. Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Returning 404 to user: Instance e1881709-67ac-4bd8-9d2a-e41d453a6412 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dffe9fa-c81b-42f5-8fda-d2b91fc22662 tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412" status: 404 len: 111 microversion: 2.1 time: 0.035621 Oct 28 10:06:13.279429 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1868/3752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:13 2022] GET /compute/v2.1/servers/e1881709-67ac-4bd8-9d2a-e41d453a6412 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:06:13.282015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31a5492c-ed4f-4997-9c8b-50aadd0aab10 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca32db60d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.288107 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15f715cd-10f0-4e8f-b924-54bbbd7a9931 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1333 microversion: 2.1 time: 0.387822 Oct 28 10:06:13.293197 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1885/3753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:12 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1333 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:13.301177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.303176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:13.317765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.318275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.323537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.324359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.325467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.325924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.414484 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31a5492c-ed4f-4997-9c8b-50aadd0aab10 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.136621 Oct 28 10:06:13.423965 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1869/3754] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 10:06:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:13.433295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5293812d-0b8b-40ff-aafb-071d276aedad tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] Calling method '.version_select at 0x7fca3266b040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.501818 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5293812d-0b8b-40ff-aafb-071d276aedad tempest-ServersTestBootFromVolume-1335460829 tempest-ServersTestBootFromVolume-1335460829-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790629120" status: 202 len: 0 microversion: 2.1 time: 0.076791 Oct 28 10:06:13.504693 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1870/3755] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:06:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1790629120 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:06:13.527591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.528349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:13.535602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.540658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.541303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.542169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.543516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.545402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.845088 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4e70ee9-b350-473b-bb51-704ff614e88c tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-volume_attachments/199e5eaf-0aea-407e-8591-6aa71ce0952e" status: 202 len: 0 microversion: 2.20 time: 0.550191 Oct 28 10:06:13.849405 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1886/3756] 10.222.0.16 () {60 vars in 1457 bytes} [Fri Oct 28 10:06:13 2022] DELETE /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-volume_attachments/199e5eaf-0aea-407e-8591-6aa71ce0952e => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:06:13.859336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:13.871236 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0e581bb-8eaa-4d6e-bedc-8bd53d5b0a70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.364293 Oct 28 10:06:13.871832 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1871/3757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:13 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:13.889628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.894565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:13.897585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2997011a-43ec-4cc4-ba91-163e364b8467 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca325353a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:13.907839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.910575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.913656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:13.915784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:13.916667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:13.917312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:14.088436 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2997011a-43ec-4cc4-ba91-163e364b8467 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.240949 Oct 28 10:06:14.099530 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1887/3758] 10.222.0.16 () {58 vars in 1167 bytes} [Fri Oct 28 10:06:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:14.099530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6abb4850-36fc-4355-a967-e6e2c97927c0 req-346455ff-1df2-4c3f-8f0d-34bf53dc6e91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c887bd71-f702-4d75-98af-df3ea11c7184", "name": "network-vif-plugged", "status": "completed", "tag": "1a6d3ce1-8750-4f98-b746-5014ab5c01dd"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:14.110820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6abb4850-36fc-4355-a967-e6e2c97927c0 req-346455ff-1df2-4c3f-8f0d-34bf53dc6e91 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:14.111632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6abb4850-36fc-4355-a967-e6e2c97927c0 req-346455ff-1df2-4c3f-8f0d-34bf53dc6e91 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:14.112417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6abb4850-36fc-4355-a967-e6e2c97927c0 req-346455ff-1df2-4c3f-8f0d-34bf53dc6e91 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:14.128336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6abb4850-36fc-4355-a967-e6e2c97927c0 req-346455ff-1df2-4c3f-8f0d-34bf53dc6e91 service nova] Creating event network-vif-plugged:1a6d3ce1-8750-4f98-b746-5014ab5c01dd for instance c887bd71-f702-4d75-98af-df3ea11c7184 on n-h1-zed-1 Oct 28 10:06:14.135336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6abb4850-36fc-4355-a967-e6e2c97927c0 req-346455ff-1df2-4c3f-8f0d-34bf53dc6e91 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044105 Oct 28 10:06:14.136253 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1888/3759] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:14.143471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:14.144401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:14.153151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:14.153918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:14.154581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:14.155502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:14.156153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:14.156861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:14.157802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:14.168676 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-69e4d418-9da0-4af3-ad48-13828c5149bd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1307 microversion: 2.1 time: 0.293192 Oct 28 10:06:14.169452 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1872/3760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:13 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:14.176848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1991394922", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "0019d693-02d0-4ebb-b001-fb51e3a4f70e"}, {"port": "756d6a72-fb3d-4304-b156-82f6ea73f4be", "tag": "port-1"}, {"port": "86e41076-3452-446c-a9c1-83159521c6f4", "tag": "port-2"}, {"uuid": "994c9086-9c93-4005-ad8e-9566ef447d53", "tag": "net-1"}, {"uuid": "994c9086-9c93-4005-ad8e-9566ef447d53"}, {"uuid": "d33cab1a-e54e-4030-a318-060d474cfc3f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d33cab1a-e54e-4030-a318-060d474cfc3f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "4fe2b999-2471-45d1-83a4-ef3d025bf755", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "b29521dd-0fc3-4a91-9008-13f1dfead39e", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "fbf293c4-d7bb-43f2-ba31-7152f76aa873", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1448789925"}], "key_name": "tempest-keypair-1350235924", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:14.209129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128748) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 10:06:14.358769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-02c29bb9-edda-4e83-9178-e93610db1bf7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "POST /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/action" status: 202 len: 0 microversion: 2.20 time: 0.220839 Oct 28 10:06:14.362743 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1889/3761] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 10:06:14 2022] POST /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:06:14.368353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-788b899b-51a0-4f69-869f-1f4ce497f78a tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca323938b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:14.403008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] validate_networks() for [('0019d693-02d0-4ebb-b001-fb51e3a4f70e', None, None, None, None, None), (None, None, '756d6a72-fb3d-4304-b156-82f6ea73f4be', None, None, None), (None, None, '86e41076-3452-446c-a9c1-83159521c6f4', None, None, None), ('994c9086-9c93-4005-ad8e-9566ef447d53', None, None, None, None, None), ('994c9086-9c93-4005-ad8e-9566ef447d53', None, None, None, None, None), ('d33cab1a-e54e-4030-a318-060d474cfc3f', '10.2.2.100', None, None, None, None), ('d33cab1a-e54e-4030-a318-060d474cfc3f', '10.2.2.200', None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:06:14.547176 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-788b899b-51a0-4f69-869f-1f4ce497f78a tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.183172 Oct 28 10:06:14.548291 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1890/3762] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 10:06:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:14.554378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:14.558393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:14.589588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:14.590101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:14.590547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:14.591291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:14.591753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:14.592187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:15.124066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:15.133175 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a0be1287-7daa-4656-bfa7-c78df91015aa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 200 len: 1516 microversion: 2.1 time: 0.583238 Oct 28 10:06:15.136127 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1891/3763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:14 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 1516 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:15.147625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:15.154379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:15.166504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:15.167027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:15.167684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:15.168715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:15.169406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:15.170041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:15.570949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:15.585595 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea3575bd-b4cc-4a20-9e56-77dd1324acbb tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.440142 Oct 28 10:06:15.608017 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1892/3764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:15 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:15.617918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:15.618807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:15.631045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:15.632082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:15.633599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:15.645916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:15.651900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:15.655762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:15.687123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:15.991458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:16.008649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:16.010409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:16.011837 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7ef8c02a-125e-4176-a47d-11adde75e830 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1673 microversion: 2.20 time: 0.402454 Oct 28 10:06:16.012562 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1893/3765] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:15 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1673 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:16.017309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c87b57a-9798-4bf4-a9cd-8c7a6d6c9404 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca324c48b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:16.139358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c87b57a-9798-4bf4-a9cd-8c7a6d6c9404 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.125389 Oct 28 10:06:16.140579 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1894/3766] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 10:06:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:16.145363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:16.146147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:16.165703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:16.168461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:16.170671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:16.171695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:16.172345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:16.175342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:16.435428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:16.446172 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9749f39c-201a-40fb-9431-7bd728c442aa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.304227 Oct 28 10:06:16.462321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1895/3767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:16 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:16.471500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:16.472267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:16.479100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:16.479603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:16.480038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:16.480739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:16.482097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:16.482678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:17.136360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:17.145778 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-450009b7-36cd-44c7-a6c1-40cff9d1336f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581" status: 200 len: 1517 microversion: 2.1 time: 0.681034 Oct 28 10:06:17.157660 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1896/3768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:16 2022] GET /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 => generated 1517 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:17.170362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:17.171137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:17.177907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:17.178650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:17.179193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:17.180010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:17.180575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:17.181141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:17.472302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:17.481429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d4c35e0-7f06-4ee2-8bd5-95ae42c94fac tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1486 microversion: 2.1 time: 0.322485 Oct 28 10:06:17.497456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1897/3769] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:17 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1486 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:17.504326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82ecbb77-6398-4cb3-aeae-875c3b711a12 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca323e5ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:17.595966 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82ecbb77-6398-4cb3-aeae-875c3b711a12 tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.097316 Oct 28 10:06:17.596552 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1898/3770] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Oct 28 10:06:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:17.610767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:17.611407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:17.618982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:17.619481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:17.620870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:17.621691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:17.622163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:17.622602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:17.630318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:06:17.630808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:06:17.631203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:06:17.632148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:06:17.632564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:06:17.645223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:17.645741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:17.646179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:17.646902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:17.647944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:17.648372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:17.676628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Getting quotas for project 7db61a6ccbee4a298909d79faabc004d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:06:17.683805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Getting quotas for user 45369fea2a654d1d88145db9677a53fb and project 7db61a6ccbee4a298909d79faabc004d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:06:17.866785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:06:17.870089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='4fe2b999-2471-45d1-83a4-ef3d025bf755',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='b29521dd-0fc3-4a91-9008-13f1dfead39e',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fbf293c4-d7bb-43f2-ba31-7152f76aa873',volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:06:17.882625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:18.024826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:18.035200 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2451660c-9e34-4ffb-afc9-8074ba048b7e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.436310 Oct 28 10:06:18.036253 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1899/3771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:17 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:18.044202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:18.045365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:18.052792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.053597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.054202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.055077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.055637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.056213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.244575 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb23701c-80ba-46aa-9697-9a181dacf33d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 4.072013 Oct 28 10:06:18.245814 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1873/3772] 10.222.0.16 () {62 vars in 1189 bytes} [Fri Oct 28 10:06:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 4075 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:06:18.250523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:18.251335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:18.258388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.259105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.259745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.260624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.261273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.261867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.367522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:18.390199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:18.392088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:18.393669 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7ba06a1-7fe7-44b2-b76b-4491418f187d tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.356010 Oct 28 10:06:18.408929 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1900/3773] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:18 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:18.408929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:18.408929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:18.414041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.414326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.415204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.416659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.417882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.418535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.508569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:18.535112 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ae95f611-24ca-46d9-a2dc-0f8ec85672fa tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 200 len: 1516 microversion: 2.1 time: 0.288028 Oct 28 10:06:18.553921 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1874/3774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:18 2022] GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:18.559756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:18.560556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:18.567699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.568594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.569099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.569959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.570590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.571016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.599830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lazy-loading 'flavor' on Instance uuid c887bd71-f702-4d75-98af-df3ea11c7184 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:06:18.704472 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7efd7aa8-b6c5-4c2e-b96e-aba7d07fd298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184/action" status: 202 len: 0 microversion: 2.1 time: 0.148300 Oct 28 10:06:18.705223 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1875/3775] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:06:18 2022] POST /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:06:18.712617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1c2bf06c-024b-4155-98ec-aa429660cd0a req-8e1479a3-5744-4b98-8480-d2f103e2a7ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "tag": "75175b94-3024-485a-aa66-d32c67067621"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:18.734476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1c2bf06c-024b-4155-98ec-aa429660cd0a req-8e1479a3-5744-4b98-8480-d2f103e2a7ae service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:18.735579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1c2bf06c-024b-4155-98ec-aa429660cd0a req-8e1479a3-5744-4b98-8480-d2f103e2a7ae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:18.736635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1c2bf06c-024b-4155-98ec-aa429660cd0a req-8e1479a3-5744-4b98-8480-d2f103e2a7ae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:18.755238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1c2bf06c-024b-4155-98ec-aa429660cd0a req-8e1479a3-5744-4b98-8480-d2f103e2a7ae service nova] Creating event network-changed:75175b94-3024-485a-aa66-d32c67067621 for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:06:18.763769 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1c2bf06c-024b-4155-98ec-aa429660cd0a req-8e1479a3-5744-4b98-8480-d2f103e2a7ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056622 Oct 28 10:06:18.764696 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1876/3776] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:18.770018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c72b212-d4d4-465a-9b1c-87f82b554afd tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] Calling method '.version_select at 0x7fca32e56a60>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:18.888773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:18.890294 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c72b212-d4d4-465a-9b1c-87f82b554afd tempest-VolumesTestJSON-1494813487 tempest-VolumesTestJSON-1494813487-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.124313 Oct 28 10:06:18.890873 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1877/3777] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 10:06:18 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:18.896234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a10c1e0-215c-4803-87f2-104533bd9e9e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:18.897063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a10c1e0-215c-4803-87f2-104533bd9e9e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:18.900009 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-889b8453-84b2-4b61-a740-093661f2ecc8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.499432 Oct 28 10:06:18.900892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1901/3778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:18 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:18.916122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:19.032877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5ac5018b-10cb-403f-a00e-b6d0a6540d81 req-a87e7263-f1cb-4f6b-8293-dbc5f465684b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:19.064422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a10c1e0-215c-4803-87f2-104533bd9e9e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.071333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5ac5018b-10cb-403f-a00e-b6d0a6540d81 req-a87e7263-f1cb-4f6b-8293-dbc5f465684b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.075708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5ac5018b-10cb-403f-a00e-b6d0a6540d81 req-a87e7263-f1cb-4f6b-8293-dbc5f465684b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.076191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5ac5018b-10cb-403f-a00e-b6d0a6540d81 req-a87e7263-f1cb-4f6b-8293-dbc5f465684b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.079512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a10c1e0-215c-4803-87f2-104533bd9e9e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.083362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a10c1e0-215c-4803-87f2-104533bd9e9e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.087222 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a10c1e0-215c-4803-87f2-104533bd9e9e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1286 microversion: 2.32 time: 0.195066 Oct 28 10:06:19.089466 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1878/3779] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:18 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:19.105426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:19.106248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5ac5018b-10cb-403f-a00e-b6d0a6540d81 req-a87e7263-f1cb-4f6b-8293-dbc5f465684b service nova] Creating event network-changed:56677974-42d3-4fca-a764-dca3e5226c74 for instance 635cb96d-039d-4c62-9784-aa89b4b879d1 on n-h1-zed-1 Oct 28 10:06:19.106423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:19.118947 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5ac5018b-10cb-403f-a00e-b6d0a6540d81 req-a87e7263-f1cb-4f6b-8293-dbc5f465684b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.216578 Oct 28 10:06:19.120151 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1902/3780] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:19.122901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.123408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.123860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.124584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.125089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.125527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.127991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:19.128974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:19.137834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.138557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.139209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.140682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.141407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.141998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.177921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:06:19.338428 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a32174a-7fe1-4e54-99f5-838da20694eb tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 204 len: 0 microversion: 2.1 time: 0.247169 Oct 28 10:06:19.344144 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1879/3781] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:06:19 2022] DELETE /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:06:19.351990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:19.353120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:19.361374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.362956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.363660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.367125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.367800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.368697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.533889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.547380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6863b8c0-224b-401a-a98d-109808811062 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1494 microversion: 2.1 time: 0.425456 Oct 28 10:06:19.555531 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1903/3782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:19 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1494 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:19.561221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:19.562111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:19.580624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.581153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.581663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.582377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.582832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.583257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.725789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.733902 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-327e028d-2ed0-49a7-b710-d57407b21158 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.386561 Oct 28 10:06:19.734482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1880/3783] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:19 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:19.747072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:19.748273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:19.754955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.755809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.756380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.757822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.758431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.759134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.919697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.931955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.933789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.935677 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a41947a-514b-41ab-99c9-a3fcad6d5552 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.199591 Oct 28 10:06:19.936894 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1881/3784] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:19 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:19.943582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:19.944578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:19.949781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:19.960567 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c14a8b5-0756-4b13-b780-ab1fc373badc tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 200 len: 1522 microversion: 2.1 time: 0.403262 Oct 28 10:06:19.962297 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1904/3785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:19 2022] GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:19.970727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.978484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.979208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:19.979850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:19.980372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:19.980880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:20.121605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:20.122465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:20.133422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:20.136502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:20.137067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:20.137751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:20.138214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:20.138637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:20.268673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:20.301354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:20.303158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:20.304559 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab6dbe05-1700-4424-82f4-f136eee9be5e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1520 microversion: 2.32 time: 0.186913 Oct 28 10:06:20.305452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1905/3786] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:20 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:20.579227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:20.580129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:20.592500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:20.593241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:20.595106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:20.596056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:20.600891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:20.601713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:20.678886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:20.690505 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ac160138-b3da-4e50-8b22-253c25f37546 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1506 microversion: 2.1 time: 0.752184 Oct 28 10:06:20.697365 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1882/3787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:19 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1506 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:20.760118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:20.761722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:20.779673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:20.780511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:20.782679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:20.783667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:20.788032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:20.788897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:21.428570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:21.437867 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9d2508ed-f0fd-4e2c-b814-049c6aa57795 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 200 len: 1477 microversion: 2.1 time: 0.862442 Oct 28 10:06:21.439365 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1906/3788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:20 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 1477 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:06:21.456778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:21.457690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:21.478631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:21.489735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:21.490497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:21.491991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:21.492624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:21.493271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:21.848734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:21.866947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:21.868414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:21.869729 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1dd9c9d6-eef7-4a41-b64e-b0d15f29e3d1 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.429223 Oct 28 10:06:21.877235 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1907/3789] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:21 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:21.888466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:21.890147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:21.897573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:21.898598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:21.899586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:21.901310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:21.902380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:21.907041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:22.296348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:22.309385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-627ea901-47ca-474a-9363-e8888775575e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 1.555082 Oct 28 10:06:22.312049 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1883/3790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:20 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:22.465774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5d54aab2-4f0b-40ac-a6d1-a2f8a5259c51 req-ffeaa9cd-bcb6-40bd-8ed3-54341f3f7fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "tag": "d94e1309-57a1-4415-9852-746e27f8cd5a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:22.484490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d54aab2-4f0b-40ac-a6d1-a2f8a5259c51 req-ffeaa9cd-bcb6-40bd-8ed3-54341f3f7fc2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:22.485360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d54aab2-4f0b-40ac-a6d1-a2f8a5259c51 req-ffeaa9cd-bcb6-40bd-8ed3-54341f3f7fc2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:22.486027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d54aab2-4f0b-40ac-a6d1-a2f8a5259c51 req-ffeaa9cd-bcb6-40bd-8ed3-54341f3f7fc2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:22.503684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:22.512011 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5d54aab2-4f0b-40ac-a6d1-a2f8a5259c51 req-ffeaa9cd-bcb6-40bd-8ed3-54341f3f7fc2 service nova] Creating event network-changed:d94e1309-57a1-4415-9852-746e27f8cd5a for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:06:22.517171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e157ac5c-42e4-4dd5-9ebc-95f45cf1e91f tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 200 len: 1522 microversion: 2.1 time: 0.638461 Oct 28 10:06:22.526461 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1908/3791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:21 2022] GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 1522 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:22.535593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:22.536080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:22.544840 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5d54aab2-4f0b-40ac-a6d1-a2f8a5259c51 req-ffeaa9cd-bcb6-40bd-8ed3-54341f3f7fc2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231160 Oct 28 10:06:22.545849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1884/3792] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:22.552134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-878006885"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:22.560237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:22.567512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:22.568296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:22.569630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:22.572066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:22.573961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:22.574411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:22.579666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:22.580536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:22.581255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:22.582230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:22.590399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:22.591118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:22.921176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:23.076273 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50b0ac0c-fd88-4982-970f-307ebfc58882 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184/action" status: 202 len: 0 microversion: 2.1 time: 0.528231 Oct 28 10:06:23.079388 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1885/3793] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:06:22 2022] POST /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184/action => generated 0 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:06:23.104764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:23.105134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:23.105660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:23.114545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:23.115192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:23.116654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:23.117329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:23.117789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:23.118634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:23.126665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:23.128106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:23.153162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a03a470e-6af4-41a1-ac52-1f4ed04e5ecd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1594 microversion: 2.32 time: 0.601796 Oct 28 10:06:23.156225 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1909/3794] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:22 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1594 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:23.164119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:23.164442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:23.195110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:23.200541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:23.206430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:23.207265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:23.207742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:23.208374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:23.935575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:23.971571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:23.973287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:23.982760 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46b4bd6a-04c0-4a97-8529-d9ca941a6f49 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.825428 Oct 28 10:06:23.993150 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1910/3795] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:23 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:24.017635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0533874-94d7-40e5-afa2-ba48aa5ef04c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3385eee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:24.885738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:24.903128 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2fa1e8f8-0a84-4c5f-93aa-2ccf546dfc7e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1522 microversion: 2.1 time: 1.817137 Oct 28 10:06:24.904641 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1886/3796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:23 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1522 bytes in 1825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:24.921404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:24.926786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:24.956710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:24.957272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:24.957726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:24.964085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:24.964610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:24.968756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:26.901647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:26.912066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cec98636-a659-4832-aba0-2f305879d245 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 2.004091 Oct 28 10:06:26.913785 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1887/3797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:24 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 2006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:26.936121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:26.939718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:26.966377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:26.967402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:26.969465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:26.970244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:26.970735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:26.975614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:27.657918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:27.671935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9296bc18-d1c5-441d-885e-edcc5d83c293 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 200 len: 1308 microversion: 2.1 time: 0.752656 Oct 28 10:06:27.673135 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1888/3798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:26 2022] GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 1308 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:27.693209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:27.700353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:27.713692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:27.722799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:27.727625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:27.732124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:27.733202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:27.733908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:27.736141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:27.924434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:27.939921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:27.941778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:27.946650 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b51704b5-435d-4501-98ae-8d24616e15ad tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1594 microversion: 2.32 time: 0.270326 Oct 28 10:06:27.972547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1889/3799] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:27 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1594 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:27.986315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1a218d8b-3287-4d4f-9d01-e1331734cd50 req-f9a926e9-1112-4c32-975a-8ea5cb0588ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d20727e-4105-4bbe-8e93-a3960f8330bf", "name": "network-vif-plugged", "status": "completed", "tag": "fcb63ddf-3037-4721-8845-2a2d42350c8f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:28.013795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1a218d8b-3287-4d4f-9d01-e1331734cd50 req-f9a926e9-1112-4c32-975a-8ea5cb0588ee service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:28.014598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1a218d8b-3287-4d4f-9d01-e1331734cd50 req-f9a926e9-1112-4c32-975a-8ea5cb0588ee service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:28.015430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1a218d8b-3287-4d4f-9d01-e1331734cd50 req-f9a926e9-1112-4c32-975a-8ea5cb0588ee service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:28.040128 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1a218d8b-3287-4d4f-9d01-e1331734cd50 req-f9a926e9-1112-4c32-975a-8ea5cb0588ee service nova] Creating event network-vif-plugged:fcb63ddf-3037-4721-8845-2a2d42350c8f for instance 3d20727e-4105-4bbe-8e93-a3960f8330bf on n-h1-zed-1 Oct 28 10:06:28.055090 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1a218d8b-3287-4d4f-9d01-e1331734cd50 req-f9a926e9-1112-4c32-975a-8ea5cb0588ee service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072604 Oct 28 10:06:28.056228 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1890/3800] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:28.065825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:28.067825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:28.090867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:28.093034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:28.093866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:28.094926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:28.095705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:28.096433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:29.065436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:29.072579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:29.079408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:29.080997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:29.082223 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-27691be7-d58d-4449-aac4-c690db147206 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 1.024757 Oct 28 10:06:29.117368 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1891/3801] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:28 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:29.122147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d8741799-aaa0-4323-9578-1141c2c9f6fb req-d79ce089-d404-4265-8a5d-886ebd30f09a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "tag": "f804f215-4ec4-4a4c-b6c5-b109b55c68cb"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:29.155813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d8741799-aaa0-4323-9578-1141c2c9f6fb req-d79ce089-d404-4265-8a5d-886ebd30f09a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:29.168481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d8741799-aaa0-4323-9578-1141c2c9f6fb req-d79ce089-d404-4265-8a5d-886ebd30f09a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:29.168981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d8741799-aaa0-4323-9578-1141c2c9f6fb req-d79ce089-d404-4265-8a5d-886ebd30f09a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:29.212437 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d8741799-aaa0-4323-9578-1141c2c9f6fb req-d79ce089-d404-4265-8a5d-886ebd30f09a service nova] Creating event network-changed:f804f215-4ec4-4a4c-b6c5-b109b55c68cb for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:06:29.232837 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d8741799-aaa0-4323-9578-1141c2c9f6fb req-d79ce089-d404-4265-8a5d-886ebd30f09a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113979 Oct 28 10:06:29.237640 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1892/3802] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:29.249071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:29.249864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:29.277329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:29.278233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:29.281211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:29.285974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:29.286690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:29.290954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:31.094266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:31.124266 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fef39462-12ce-4933-9fa3-143db0b15c75 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1522 microversion: 2.1 time: 1.881730 Oct 28 10:06:31.128753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1893/3803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:29 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1522 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:31.150389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:31.153661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:31.184689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:31.185303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:31.185789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:31.186735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:31.187369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:31.187975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:31.759846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:31.770325 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83dacf5f-a6ce-429a-a641-36015c344db9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.639074 Oct 28 10:06:31.779524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1894/3804] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:31 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:31.786357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:31.802617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:31.829422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:31.830090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:31.832227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:31.833150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:31.835599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:31.836153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:31.896400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] HTTP exception thrown: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a HTTP/1.1 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a'} Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:31.898474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:31.905020 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:31.918312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 404 to user: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:06:31.919764 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d0a9f6bc-a3a9-4be8-979d-701cc57e6b19 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 404 len: 111 microversion: 2.1 time: 0.137356 Oct 28 10:06:31.920747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1895/3805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:31 2022] GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:06:31.962777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:31.973442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:32.029214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:32.041720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:32.045434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:32.046509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:32.047216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:32.047894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:33.187651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:33.329138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:33.339590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:33.345837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:33.350905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5eb0510-d447-4f86-a44a-c3088a99e339 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1662 microversion: 2.32 time: 1.425890 Oct 28 10:06:33.355578 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1896/3806] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:31 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1662 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:33.372783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-85fe7136-dafe-4813-8c77-262144f3a426 req-1515254d-f0fc-41e4-86ca-5d844cf55b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a", "name": "network-vif-unplugged", "status": "completed", "tag": "bf61c338-ac33-4dc5-ab15-6f0bb3a62973"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:33.388401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-85fe7136-dafe-4813-8c77-262144f3a426 req-1515254d-f0fc-41e4-86ca-5d844cf55b96 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:33.393055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-85fe7136-dafe-4813-8c77-262144f3a426 req-1515254d-f0fc-41e4-86ca-5d844cf55b96 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:33.394655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-85fe7136-dafe-4813-8c77-262144f3a426 req-1515254d-f0fc-41e4-86ca-5d844cf55b96 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:33.421571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-85fe7136-dafe-4813-8c77-262144f3a426 req-1515254d-f0fc-41e4-86ca-5d844cf55b96 service nova] Creating event network-vif-unplugged:bf61c338-ac33-4dc5-ab15-6f0bb3a62973 for instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a on n-h2-zed-1 Oct 28 10:06:33.438227 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-85fe7136-dafe-4813-8c77-262144f3a426 req-1515254d-f0fc-41e4-86ca-5d844cf55b96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081007 Oct 28 10:06:33.442535 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1897/3807] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:33.450234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:33.460440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:33.474705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:33.478253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:33.480254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:33.482024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:33.483505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:33.484892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:33.941283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=89 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:34.236046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:34.250619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:34.252538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:34.254191 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-66bf3584-5d05-4a0d-9ec7-df095c4d424e tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.808280 Oct 28 10:06:34.260698 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1898/3808] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:33 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:34.273051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ceec322c-bbd4-4a69-8e05-6fe861ab94be req-0dbb279b-c293-4bde-b171-9c82175423e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a", "name": "network-vif-deleted", "tag": "bf61c338-ac33-4dc5-ab15-6f0bb3a62973"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:34.288408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ceec322c-bbd4-4a69-8e05-6fe861ab94be req-0dbb279b-c293-4bde-b171-9c82175423e7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:34.291327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ceec322c-bbd4-4a69-8e05-6fe861ab94be req-0dbb279b-c293-4bde-b171-9c82175423e7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:34.292099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ceec322c-bbd4-4a69-8e05-6fe861ab94be req-0dbb279b-c293-4bde-b171-9c82175423e7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:34.316539 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ceec322c-bbd4-4a69-8e05-6fe861ab94be req-0dbb279b-c293-4bde-b171-9c82175423e7 service nova] Creating event network-vif-deleted:bf61c338-ac33-4dc5-ab15-6f0bb3a62973 for instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a on n-h2-zed-1 Oct 28 10:06:34.344225 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ceec322c-bbd4-4a69-8e05-6fe861ab94be req-0dbb279b-c293-4bde-b171-9c82175423e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081928 Oct 28 10:06:34.345869 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1899/3809] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:34.351362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:34.371063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:34.372470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:34.386373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:34.387286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:34.390015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:34.392988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:34.393961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:34.394682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:34.738701 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-045b12bd-0472-471f-8a4f-77ab7fc8d83c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.391227 Oct 28 10:06:34.753794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1900/3810] 10.222.0.16 () {58 vars in 1230 bytes} [Fri Oct 28 10:06:34 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:06:34.764715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:34.766266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:34.789082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:34.791079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:34.792095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:34.793150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:34.797570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:34.798380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:35.171296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:35.182353 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04f96b2e-3267-417f-806a-6e3644b5f5db tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1522 microversion: 2.1 time: 0.427285 Oct 28 10:06:35.187177 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1901/3811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:34 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:35.207519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:35.213162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:35.237090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:35.240955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:35.241641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:35.245570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:35.247488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:35.248513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:36.086318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:36.100749 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a9ce986-a3a5-4e3a-bac6-7b30ce0c27b4 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.908673 Oct 28 10:06:36.102561 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1902/3812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:35 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:36.119918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:36.125318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:36.172197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:36.176357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:36.177988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:36.180139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:36.180823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:36.181571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:37.005746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:37.039859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:37.045568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:37.050886 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af860bf3-ba20-46f3-af2e-2f3b2af0a2cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1709 microversion: 2.32 time: 0.947023 Oct 28 10:06:37.055720 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1903/3813] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:36 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1709 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:37.070070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e4fbfc2-5916-4d61-a7e0-53adbf1ed4e6 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e4fbfc2-5916-4d61-a7e0-53adbf1ed4e6 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: action_args: {} Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 10:06:37.082629 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 28 10:06:37.088953 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:37.093204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e4fbfc2-5916-4d61-a7e0-53adbf1ed4e6 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:06:37.093424 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e4fbfc2-5916-4d61-a7e0-53adbf1ed4e6 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.032115 Oct 28 10:06:37.101109 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1904/3814] 10.222.0.16 () {58 vars in 1182 bytes} [Fri Oct 28 10:06:37 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:06:37.122314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:37.125123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:37.148926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:37.152063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:37.153855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:37.155148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:37.160234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:37.166132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:38.432984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:38.444852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:38.454406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:38.455457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04597124-4cf1-4c67-a08b-977dc54c5c45 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 1.352360 Oct 28 10:06:38.481236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1905/3815] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:37 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:38.497497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c661ffdc-5f60-4034-95a8-4d1bff6c1fb8 req-34ff594e-42dc-41ab-a7b1-70d57ea4df90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c887bd71-f702-4d75-98af-df3ea11c7184", "name": "network-vif-plugged", "status": "completed", "tag": "1a6d3ce1-8750-4f98-b746-5014ab5c01dd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:38.543562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c661ffdc-5f60-4034-95a8-4d1bff6c1fb8 req-34ff594e-42dc-41ab-a7b1-70d57ea4df90 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:38.544186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c661ffdc-5f60-4034-95a8-4d1bff6c1fb8 req-34ff594e-42dc-41ab-a7b1-70d57ea4df90 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:38.547594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c661ffdc-5f60-4034-95a8-4d1bff6c1fb8 req-34ff594e-42dc-41ab-a7b1-70d57ea4df90 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:38.583704 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c661ffdc-5f60-4034-95a8-4d1bff6c1fb8 req-34ff594e-42dc-41ab-a7b1-70d57ea4df90 service nova] Creating event network-vif-plugged:1a6d3ce1-8750-4f98-b746-5014ab5c01dd for instance c887bd71-f702-4d75-98af-df3ea11c7184 on n-h1-zed-1 Oct 28 10:06:38.609505 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c661ffdc-5f60-4034-95a8-4d1bff6c1fb8 req-34ff594e-42dc-41ab-a7b1-70d57ea4df90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126604 Oct 28 10:06:38.610163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1906/3816] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:38.623193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:38.633855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:38.651710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:38.652179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:38.652626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:38.657717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:38.665749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:38.666508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:38.671417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:39.582066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:39.595104 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49645f6d-1a1d-47f2-9a57-5a75b3d58188 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1522 microversion: 2.1 time: 0.976051 Oct 28 10:06:39.606540 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1907/3817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:38 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1522 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:39.611638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:39.638642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:39.657195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:39.688875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:39.688875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:39.688875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:39.688875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:39.688875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:39.688875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:39.804321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:06:39.947596 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f6a6192-317f-4ab9-9ed5-1a1426366f37 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.339596 Oct 28 10:06:39.970377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1908/3818] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:06:39 2022] GET /compute/v2.1/servers => generated 683 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:39.982213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:39.993967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:40.024837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:40.033181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:40.037886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:40.038689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:40.039185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:40.039685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:41.457551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:41.465488 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0a768f4-3c30-4489-a8f6-3e3c62543244 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 1.493644 Oct 28 10:06:41.467396 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1909/3819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:39 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:41.485394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:41.496321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:41.525799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:41.526333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:41.527237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:41.528854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:41.529399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:41.532078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:43.004411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:43.024934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:43.040799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:43.043204 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7614c254-943b-43d9-9c6d-9897be13826d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1756 microversion: 2.32 time: 1.574728 Oct 28 10:06:43.048219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1910/3820] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:41 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1756 bytes in 1580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:43.072432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:43.073105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:43.108990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:43.114762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:43.116218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:43.117505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:43.120597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:43.122887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:44.820030 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0533874-94d7-40e5-afa2-ba48aa5ef04c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 20.827074 Oct 28 10:06:44.825738 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1911/3821] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:23 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 20833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:44.852659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:44.873485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:44.891298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.servers [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Removing options 'limit' from query {{(pid=128748) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 28 10:06:44.897691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:44.914983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:44.924651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:44.939672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:44.940170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:44.940611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:44.948089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:44.954154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-01ce670d-827d-41e2-9aff-f4df516f19df tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 1.904715 Oct 28 10:06:44.962547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1911/3822] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:43 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 1912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:44.965967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:44.966736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:44.968295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:44.990670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:44.994297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:45.025351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:45.035098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:45.035802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:45.045652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:45.049295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:45.055617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:45.101909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:06:45.244347 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-042ee8d6-0c71-49f8-9d65-9ab603470a73 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.409389 Oct 28 10:06:45.245663 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1912/3823] 10.222.0.16 () {58 vars in 1144 bytes} [Fri Oct 28 10:06:44 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:45.259119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:45.260889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:45.282415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:45.287755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:45.288444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:45.289403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:45.290055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:45.290684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:45.725562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:45.739218 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-11c95b10-7c36-48e4-80c7-874e8f8aa3ea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.484924 Oct 28 10:06:45.757172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1913/3824] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:45 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:45.782296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:45.783414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:45.794560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:45.806368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfb4d990-7912-46db-92e2-5f3dc654f649 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1522 microversion: 2.1 time: 0.840189 Oct 28 10:06:45.811301 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1912/3825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:44 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1522 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:45.817670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91eaa5b7-1f88-4d7b-a127-54c5629834ef tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91eaa5b7-1f88-4d7b-a127-54c5629834ef tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: action_args: {} Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi '-1' Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 10:06:45.825139 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 28 10:06:45.831069 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:06:45.842704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91eaa5b7-1f88-4d7b-a127-54c5629834ef tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:06:45.843717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:45.845727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:45.845932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-91eaa5b7-1f88-4d7b-a127-54c5629834ef tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.032629 Oct 28 10:06:45.846611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:45.847572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:45.848241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:45.852987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:45.853116 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1913/3826] 10.222.0.16 () {58 vars in 1142 bytes} [Fri Oct 28 10:06:45 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:06:45.859582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c1d7f991-9cc6-44f4-847e-4f4af764944d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca325b1b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:45.936089 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c1d7f991-9cc6-44f4-847e-4f4af764944d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.080963 Oct 28 10:06:45.948993 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1914/3827] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:45 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:46.207464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:46.230238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:46.235478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:46.238407 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a3144fc-9a31-4496-95a2-7b06249979a9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1803 microversion: 2.32 time: 0.479946 Oct 28 10:06:46.241349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1914/3828] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:45 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1803 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:46.251958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ce74776-651a-4f6e-a55e-d20a9ba5edc0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ce74776-651a-4f6e-a55e-d20a9ba5edc0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: action_args: {} Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'testing' Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 28 10:06:46.273108 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 28 10:06:46.277935 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:46.283774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ce74776-651a-4f6e-a55e-d20a9ba5edc0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:06:46.286587 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ce74776-651a-4f6e-a55e-d20a9ba5edc0 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.041583 Oct 28 10:06:46.288983 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1915/3829] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:06:46 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:06:46.300827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:46.301869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:46.329330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:46.330147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:46.330860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:46.331852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:46.332583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:46.333873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:46.510192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-629648242", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b95a8852-c8f9-4dd1-96a4-df9f84a3da97"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:46.771780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:46.785720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:46.791120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:46.792392 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31fd2185-e8e3-4d29-b682-809abf404da0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.500795 Oct 28 10:06:46.808951 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1916/3830] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:46 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:46.808951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5b0eea81-7e92-4873-a26f-b36c3a29a324 req-02f9f449-2cc4-4bf6-b219-4d986971e448 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "name": "network-vif-plugged", "status": "completed", "tag": "75175b94-3024-485a-aa66-d32c67067621"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:46.826747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5b0eea81-7e92-4873-a26f-b36c3a29a324 req-02f9f449-2cc4-4bf6-b219-4d986971e448 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:46.827238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5b0eea81-7e92-4873-a26f-b36c3a29a324 req-02f9f449-2cc4-4bf6-b219-4d986971e448 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:46.827689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5b0eea81-7e92-4873-a26f-b36c3a29a324 req-02f9f449-2cc4-4bf6-b219-4d986971e448 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:46.864504 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5b0eea81-7e92-4873-a26f-b36c3a29a324 req-02f9f449-2cc4-4bf6-b219-4d986971e448 service nova] Creating event network-vif-plugged:75175b94-3024-485a-aa66-d32c67067621 for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:06:46.877289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5b0eea81-7e92-4873-a26f-b36c3a29a324 req-02f9f449-2cc4-4bf6-b219-4d986971e448 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079400 Oct 28 10:06:46.877938 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1917/3831] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:46.886379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc8ff162-ebfb-48ab-b2c0-80768c28c8c9 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:46.895193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc8ff162-ebfb-48ab-b2c0-80768c28c8c9 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:46.895978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc8ff162-ebfb-48ab-b2c0-80768c28c8c9 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:46.915915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.servers [None req-cc8ff162-ebfb-48ab-b2c0-80768c28c8c9 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Flavor 'non_existing_flavor' could not be found {{(pid=128748) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 28 10:06:46.917029 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc8ff162-ebfb-48ab-b2c0-80768c28c8c9 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.037605 Oct 28 10:06:46.925793 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1918/3832] 10.222.0.16 () {58 vars in 1178 bytes} [Fri Oct 28 10:06:46 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:06:46.940067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:46.940884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:46.953023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:46.953529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:46.953981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:46.954706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:46.962806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:46.963362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:47.344515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:47.356133 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8bb00a77-4c90-4739-8f3d-33cbaa088d9c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.435066 Oct 28 10:06:47.356720 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1919/3833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:46 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:47.363501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:47.372467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:47.401348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:47.403342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:47.405731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:47.407556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:47.411046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:47.412211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:47.841899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:47.853663 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d08a208e-4ebd-440d-87db-632ac0e57977 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1522 microversion: 2.1 time: 0.493429 Oct 28 10:06:47.854790 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1920/3834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:47 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1522 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:47.861654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:47.868523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:47.870436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:47.880395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:47.882717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:47.883469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:47.884524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:47.885928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:47.886646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:48.134769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19c06056-318e-442b-8899-84a5cdc88204 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.278273 Oct 28 10:06:48.136425 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1921/3835] 10.222.0.16 () {58 vars in 1174 bytes} [Fri Oct 28 10:06:47 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:06:48.143907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1d11cef-0819-44cf-951f-4ef6634f612d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca33e13670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:49.759878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:49.769984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] validate_networks() for [('b95a8852-c8f9-4dd1-96a4-df9f84a3da97', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:06:49.809762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1d11cef-0819-44cf-951f-4ef6634f612d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 1.670899 Oct 28 10:06:49.820856 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1922/3836] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:48 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 1682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:49.828813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:49.829766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:49.855211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:49.858566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:49.859241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:49.861044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:49.864183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:49.864918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:50.142624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:50.153980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:50.155823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:50.157278 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e558bc53-6569-4ec4-83f4-ec595138ef96 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1850 microversion: 2.32 time: 0.334828 Oct 28 10:06:50.158648 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1923/3837] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:49 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1850 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:50.176584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:50.177880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:50.196468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:50.197427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:50.198043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:50.199281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:50.199938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:50.200541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:50.546779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:50.556217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:50.565410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:50.572318 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d829938b-f6e7-4a55-aacb-e7ca6e270ed0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.412354 Oct 28 10:06:50.574886 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1924/3838] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:50 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:50.592632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:50.611572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:50.621335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:50.656187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:50.658487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:50.662500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:50.665189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:50.666402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:50.667155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:50.910816 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce4375f3-f3d2-4741-85fa-4813b9587106 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.330119 Oct 28 10:06:50.911980 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1925/3839] 10.222.0.16 () {58 vars in 1184 bytes} [Fri Oct 28 10:06:50 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:06:50.923124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:50.923756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:50.931440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:50.931991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:50.932398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:50.933292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:50.933759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:50.934359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:51.237634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:51.252028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2949cdb9-4f62-42ac-9676-166aa8c66f40 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.337824 Oct 28 10:06:51.252838 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1926/3840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:50 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:51.270149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:51.270149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:51.281140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:51.283980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:51.284495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:51.285290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:51.285769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:51.292154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:51.611867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:51.627269 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e3b7f7f5-4e6a-4e55-bb5a-78475854fb3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1504 microversion: 2.1 time: 0.373474 Oct 28 10:06:51.631781 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1927/3841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:51 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1504 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:51.657593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-026eb87e-d0c3-4712-ba5d-16f879722549 req-4376678b-8b68-4371-8393-32bfa9eebc9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "name": "network-vif-plugged", "status": "completed", "tag": "d94e1309-57a1-4415-9852-746e27f8cd5a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:51.700336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-026eb87e-d0c3-4712-ba5d-16f879722549 req-4376678b-8b68-4371-8393-32bfa9eebc9f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:51.702063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-026eb87e-d0c3-4712-ba5d-16f879722549 req-4376678b-8b68-4371-8393-32bfa9eebc9f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:51.707779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-026eb87e-d0c3-4712-ba5d-16f879722549 req-4376678b-8b68-4371-8393-32bfa9eebc9f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:51.753743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:06:51.756140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:06:51.757342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:06:51.765552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:06:51.766062 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-026eb87e-d0c3-4712-ba5d-16f879722549 req-4376678b-8b68-4371-8393-32bfa9eebc9f service nova] Creating event network-vif-plugged:d94e1309-57a1-4415-9852-746e27f8cd5a for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:06:51.768536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:06:51.774838 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-026eb87e-d0c3-4712-ba5d-16f879722549 req-4376678b-8b68-4371-8393-32bfa9eebc9f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140759 Oct 28 10:06:51.775373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:51.778832 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1928/3842] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:51.787752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-39b40a98-a61e-49ff-a8ff-b2d7342d2e11 req-dcd70c01-2adb-4fe2-a047-2a93780f70e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "a0323752-f69f-4f04-a247-644f13d40fbb"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:51.811152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:51.811891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:51.813986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:51.826048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:51.826270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-39b40a98-a61e-49ff-a8ff-b2d7342d2e11 req-dcd70c01-2adb-4fe2-a047-2a93780f70e9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:51.826966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:51.827846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:51.828137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-39b40a98-a61e-49ff-a8ff-b2d7342d2e11 req-dcd70c01-2adb-4fe2-a047-2a93780f70e9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:51.828582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-39b40a98-a61e-49ff-a8ff-b2d7342d2e11 req-dcd70c01-2adb-4fe2-a047-2a93780f70e9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:51.855715 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-39b40a98-a61e-49ff-a8ff-b2d7342d2e11 req-dcd70c01-2adb-4fe2-a047-2a93780f70e9 service nova] Creating event network-changed:a0323752-f69f-4f04-a247-644f13d40fbb for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:06:51.865473 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-39b40a98-a61e-49ff-a8ff-b2d7342d2e11 req-dcd70c01-2adb-4fe2-a047-2a93780f70e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084944 Oct 28 10:06:51.867120 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1929/3843] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:51.873683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-42a844bb-fc75-498d-b199-e50037f610e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32535310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:51.931225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Getting quotas for project 8fe652e1ff264b89938f9c5b4b9c09c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:06:51.944027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Getting quotas for user 46e60190fc7542aea2104d11446c2614 and project 8fe652e1ff264b89938f9c5b4b9c09c6. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:06:51.984638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:06:51.991398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:06:51.994499 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-42a844bb-fc75-498d-b199-e50037f610e7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.125646 Oct 28 10:06:51.995323 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1930/3844] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:51 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:52.015820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:52.029570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:52.035174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:52.088876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:52.091289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:52.094423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:52.098421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:52.101996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:52.102801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:52.155782 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3860eab5-1003-4636-a52c-29fd0c97e5fa tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 6.205137 Oct 28 10:06:52.165105 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1915/3845] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 10:06:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 6215 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:06:52.173390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:52.178843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:52.195390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:06:52.195779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:52.196421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:52.197019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:52.197849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:52.198418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:52.199458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:52.306788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:52.322716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:52.323202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:52.324053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.079408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-843e376d-ed1b-4d01-9d6d-acbc9ae50671 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 1.081830 Oct 28 10:06:53.081162 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1931/3846] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:06:51 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:53.102931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:53.104079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:53.117231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.124272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.124793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.125748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.128104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.128713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.699688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.729884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.731334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.732535 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82fede76-4288-4250-be94-5697c3930010 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.649279 Oct 28 10:06:53.749592 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1932/3847] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:53 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:53.755317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:53.755932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:53.796951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.802101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.802817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.803754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.804388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.805464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.824576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.847257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.849786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.855876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b51e94d3-dc9b-4568-847b-8bcf371ef83c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1871 microversion: 2.32 time: 1.686652 Oct 28 10:06:53.857133 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1916/3848] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:52 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1871 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:53.873263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:53.874275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:53.884009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.884747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.885427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.888879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.890105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.890869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.964946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.977101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.979097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:53.980507 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fefd9477-933e-4005-a240-04a43f7271a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1262 microversion: 2.21 time: 0.229865 Oct 28 10:06:53.981442 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1933/3849] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:53 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1262 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:53.987610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:53.988628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:53.995598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.996326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.996873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:53.997929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:53.998633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:53.999160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.366481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:54.371319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:06:54.386451 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8fdae71b-76cd-4e24-83dc-92d21648a02b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1504 microversion: 2.1 time: 0.402535 Oct 28 10:06:54.391425 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1934/3850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:53 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1504 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:54.403985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-581ca51d-339a-4495-916a-6844df8543fd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32535790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:54.484880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-581ca51d-339a-4495-916a-6844df8543fd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.091848 Oct 28 10:06:54.485806 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1935/3851] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:54 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:54.506106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b06cd953-71f6-496d-b591-5a8f4637784a tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:54.521209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b06cd953-71f6-496d-b591-5a8f4637784a tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:54.527073 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b06cd953-71f6-496d-b591-5a8f4637784a tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.035504 Oct 28 10:06:54.528607 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1936/3852] 10.222.0.16 () {58 vars in 1178 bytes} [Fri Oct 28 10:06:54 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:06:54.540337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6a5ddb43-b765-4964-8947-c8b6e86b6afb req-1a39803b-c6d3-48fd-9492-058bfe860bb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "name": "network-vif-plugged", "status": "completed", "tag": "f804f215-4ec4-4a4c-b6c5-b109b55c68cb"}, {"server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "name": "network-vif-plugged", "status": "completed", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:54.579797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6a5ddb43-b765-4964-8947-c8b6e86b6afb req-1a39803b-c6d3-48fd-9492-058bfe860bb3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.580547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6a5ddb43-b765-4964-8947-c8b6e86b6afb req-1a39803b-c6d3-48fd-9492-058bfe860bb3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.581018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6a5ddb43-b765-4964-8947-c8b6e86b6afb req-1a39803b-c6d3-48fd-9492-058bfe860bb3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.612371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6a5ddb43-b765-4964-8947-c8b6e86b6afb req-1a39803b-c6d3-48fd-9492-058bfe860bb3 service nova] Creating event network-vif-plugged:f804f215-4ec4-4a4c-b6c5-b109b55c68cb for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:06:54.612802 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6a5ddb43-b765-4964-8947-c8b6e86b6afb req-1a39803b-c6d3-48fd-9492-058bfe860bb3 service nova] Creating event network-vif-plugged:56677974-42d3-4fca-a764-dca3e5226c74 for instance 635cb96d-039d-4c62-9784-aa89b4b879d1 on n-h1-zed-1 Oct 28 10:06:54.628168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6a5ddb43-b765-4964-8947-c8b6e86b6afb req-1a39803b-c6d3-48fd-9492-058bfe860bb3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.098297 Oct 28 10:06:54.636641 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1937/3853] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:54.650161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-178c6ed2-a022-4a5a-b493-139a0ebee708 req-e1e4951a-bbf9-4d4a-ad1c-0f05a0369040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "756d6a72-fb3d-4304-b156-82f6ea73f4be"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:54.680332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-178c6ed2-a022-4a5a-b493-139a0ebee708 req-e1e4951a-bbf9-4d4a-ad1c-0f05a0369040 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.680984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-178c6ed2-a022-4a5a-b493-139a0ebee708 req-e1e4951a-bbf9-4d4a-ad1c-0f05a0369040 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.682607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-178c6ed2-a022-4a5a-b493-139a0ebee708 req-e1e4951a-bbf9-4d4a-ad1c-0f05a0369040 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.718947 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-178c6ed2-a022-4a5a-b493-139a0ebee708 req-e1e4951a-bbf9-4d4a-ad1c-0f05a0369040 service nova] Creating event network-changed:756d6a72-fb3d-4304-b156-82f6ea73f4be for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:06:54.738494 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-178c6ed2-a022-4a5a-b493-139a0ebee708 req-e1e4951a-bbf9-4d4a-ad1c-0f05a0369040 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097858 Oct 28 10:06:54.740356 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1938/3854] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:54.751408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:54.764257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:54.765614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:54.766803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Searching by: {'deleted': False, 'project_id': 'cdec51986d2644d6a667908a6fa34da2'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:06:54.776263 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc3cf839-c44c-4b4c-9618-33ae42a87acc tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.917852 Oct 28 10:06:54.779857 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1917/3855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:53 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:54.780120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.780621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.782592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.783564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.787505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.788223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.802800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:54.803479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:54.812126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.824035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.825874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.834557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.835404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.839612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.853925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:06:54.931002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99636c51-f4c1-4ba1-8706-484ccd3e0289 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.189037 Oct 28 10:06:54.935731 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1939/3856] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:06:54 2022] GET /compute/v2.1/servers => generated 683 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:54.940712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:54.941488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:54.966916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.967433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.967884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:54.968607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:54.969106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:54.969543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.365736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.375862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.377361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.378683 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dc9a54db-95ff-41c2-9315-e6108d5a00cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1892 microversion: 2.32 time: 0.442033 Oct 28 10:06:55.388741 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1940/3857] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:54 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1892 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:55.399779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:55.399779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:55.420210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.420740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.421228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.421980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.422451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.422885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.476793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] HTTP exception thrown: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a HTTP/1.1 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a'} Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:06:55.478565 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 404 to user: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:06:55.483241 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-134a2b97-bfdc-4673-b2a8-bebd009765ed tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 404 len: 111 microversion: 2.1 time: 0.093526 Oct 28 10:06:55.488702 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1941/3858] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:06:55 2022] DELETE /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:06:55.508931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:55.509594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:55.525943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.535551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.536113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.539550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.541058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.542287 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24a4250a-05bb-48c7-8179-fd771611162f tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.759651 Oct 28 10:06:55.543179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.550296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.550296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.550296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.550570 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1918/3859] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:54 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:55.558082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:55.562826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:55.586764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.587310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.587772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.590362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.595964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.596671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.705959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.723809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.726546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:55.728701 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de3833d1-caf4-46fc-b985-a6c2cd16e3f7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1316 microversion: 2.21 time: 0.238424 Oct 28 10:06:55.729958 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1942/3860] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:55 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:55.735644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:55.736443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:55.746283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.747276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.748090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.749242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:55.750180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:55.750906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:55.810650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:06:55.956726 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0298109c-3f1f-4780-ac18-6962b342e10c tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581" status: 204 len: 0 microversion: 2.1 time: 0.225074 Oct 28 10:06:55.961713 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1943/3861] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:06:55 2022] DELETE /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:06:55.977229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef7bf399-e859-4d7b-80fc-d6dd4649eb07 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32b5a820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:56.087464 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef7bf399-e859-4d7b-80fc-d6dd4649eb07 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.120181 Oct 28 10:06:56.097881 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1944/3862] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:55 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:56.103074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:56.103819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:56.118788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.119299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.119739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.120474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.120939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.121373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.459189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:56.476250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6548d5d2-0aef-4347-8d4e-f94ed6469181 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.377106 Oct 28 10:06:56.477202 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1945/3863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:56 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:56.483416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:56.483920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:56.497515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.497853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.498293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.498999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.499452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.502986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.549580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:06:56.697294 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc4cf709-5161-4af4-adef-1c7c8ad781d1 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "DELETE /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 204 len: 0 microversion: 2.1 time: 0.218227 Oct 28 10:06:56.698992 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1946/3864] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:06:56 2022] DELETE /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:06:56.710659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:56.711472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:56.712712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:56.718751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.719616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.720179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.721082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.722308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.722759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.726689 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29257aa7-516f-4112-a87b-aa1b37fc621d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1504 microversion: 2.1 time: 1.176492 Oct 28 10:06:56.741567 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1919/3865] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:55 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1504 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:56.757078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:56.759238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:56.773930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.778413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.778917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.780272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:56.780744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:56.781224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:56.996376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.014717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.017363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.018889 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e3918c5-0508-43c3-b7e0-d40e8435f723 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1892 microversion: 2.32 time: 0.317657 Oct 28 10:06:57.019756 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1947/3866] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:56 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1892 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:57.025530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-70b256b5-51a7-4c31-9d31-9663d39707eb req-0cee238d-e874-400f-ab93-c54bd1404f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d20727e-4105-4bbe-8e93-a3960f8330bf", "name": "network-vif-unplugged", "status": "completed", "tag": "fcb63ddf-3037-4721-8845-2a2d42350c8f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:57.039494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-70b256b5-51a7-4c31-9d31-9663d39707eb req-0cee238d-e874-400f-ab93-c54bd1404f51 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.040388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-70b256b5-51a7-4c31-9d31-9663d39707eb req-0cee238d-e874-400f-ab93-c54bd1404f51 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.041390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-70b256b5-51a7-4c31-9d31-9663d39707eb req-0cee238d-e874-400f-ab93-c54bd1404f51 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.067614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-70b256b5-51a7-4c31-9d31-9663d39707eb req-0cee238d-e874-400f-ab93-c54bd1404f51 service nova] Creating event network-vif-unplugged:fcb63ddf-3037-4721-8845-2a2d42350c8f for instance 3d20727e-4105-4bbe-8e93-a3960f8330bf on n-h1-zed-1 Oct 28 10:06:57.082165 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-70b256b5-51a7-4c31-9d31-9663d39707eb req-0cee238d-e874-400f-ab93-c54bd1404f51 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060678 Oct 28 10:06:57.083044 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1948/3867] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:57.095367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:57.099861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:57.113244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.113737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.114175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.123665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.124651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.134047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.157199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.174145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.175667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.176109 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] HTTP exception thrown: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:57.176941 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce18e83b-a03a-4089-82e1-ca2ff6e39848 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 0.433769 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a HTTP/1.1 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a'} Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:57.177970 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 404 to user: Instance 4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9d625303-b1a2-4f00-bd44-dd6b8ebdb448 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a" status: 404 len: 111 microversion: 2.1 time: 0.092912 Oct 28 10:06:57.184968 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1949/3868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:57 2022] GET /compute/v2.1/servers/4d2c05ce-dd60-4e0a-80c6-57fe9ca0902a => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:06:57.185778 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1920/3869] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:56 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:57.188793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:57.189031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b707c170-eefe-4553-ba2f-a677d3c11997 req-158f8907-ade7-4dda-8b91-ccddfef1394b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "86e41076-3452-446c-a9c1-83159521c6f4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:06:57.189454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:57.202290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.203098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.203255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.204364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.204833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.205304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.231275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b707c170-eefe-4553-ba2f-a677d3c11997 req-158f8907-ade7-4dda-8b91-ccddfef1394b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.231775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b707c170-eefe-4553-ba2f-a677d3c11997 req-158f8907-ade7-4dda-8b91-ccddfef1394b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.232221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b707c170-eefe-4553-ba2f-a677d3c11997 req-158f8907-ade7-4dda-8b91-ccddfef1394b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.267088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b707c170-eefe-4553-ba2f-a677d3c11997 req-158f8907-ade7-4dda-8b91-ccddfef1394b service nova] Creating event network-changed:86e41076-3452-446c-a9c1-83159521c6f4 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:06:57.286525 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b707c170-eefe-4553-ba2f-a677d3c11997 req-158f8907-ade7-4dda-8b91-ccddfef1394b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100114 Oct 28 10:06:57.289934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1921/3870] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:06:57.308057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec5b6444-e524-4749-a54c-00cc86cc2240 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32548700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:57.332508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.349646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.365254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.368166 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7099bcda-3a28-43b1-9273-524e3993d860 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1316 microversion: 2.21 time: 0.185386 Oct 28 10:06:57.385836 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1950/3871] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:57 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:57.402693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:57.408612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:57.426794 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec5b6444-e524-4749-a54c-00cc86cc2240 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.133202 Oct 28 10:06:57.435589 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1922/3872] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:57 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:57.435730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.435730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.435730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.437884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.439204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.439672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.500543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:57.501862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:57.518265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.524800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.525426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.528972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.532489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.535462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.842893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c89b4a51ce649389bbff589d10e1585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdec51986d2644d6a667908a6fa34da2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:57.852187 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1bf07a1-2401-41f7-888b-a8c302118931 tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581" status: 200 len: 1523 microversion: 2.1 time: 0.464370 Oct 28 10:06:57.852778 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1951/3873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:57 2022] GET /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:57.870466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:57.874731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:57.892735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.902267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.902730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:57.903485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:57.903960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:57.904394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:58.206404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:58.226088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3450fab5-de5a-4aaa-9580-256f3c0aec1b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1354 microversion: 2.1 time: 0.724361 Oct 28 10:06:58.227079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1923/3874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:57 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1354 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:58.242884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:58.245298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:58.258746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:58.261370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:58.264053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:58.265730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:58.269995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:58.271518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:58.770279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:58.784163 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b002ef6-4ad0-43d2-bbef-363d65aecca9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 200 len: 1507 microversion: 2.1 time: 0.925677 Oct 28 10:06:58.784789 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1952/3875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:06:57 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 1507 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:06:58.805378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:58.809146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:58.830661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:58.831410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:58.833639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:58.834558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:58.835966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:58.837342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:59.028425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:59.047769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:59.068353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:59.071915 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c2a447f-ede5-44e9-9bb5-e38dc8b39768 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1892 microversion: 2.32 time: 0.842824 Oct 28 10:06:59.079087 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1924/3876] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:58 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1892 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:59.098737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:06:59.101608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:06:59.123699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:59.126600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:59.127707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:59.128801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:06:59.129569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:06:59.130366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:06:59.718512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:59.727837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:59.729354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:06:59.730527 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b29eec2-b524-4b83-a6c0-7be5b96eacb2 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1358 microversion: 2.21 time: 0.650136 Oct 28 10:06:59.743742 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1925/3877] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:59 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1358 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:06:59.748744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06b0a099-795b-4b4e-badb-eb58d9a9ec06 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32fd9430>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:00.438257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:00.465028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:00.466564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:00.475643 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb133d55-3a5e-4a24-a8fd-2534c202aa76 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1731 microversion: 2.20 time: 1.684249 Oct 28 10:07:00.483867 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1953/3878] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:06:58 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1731 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:00.497144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:00.513880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:00.537207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:00.540085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:00.540719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:00.541759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:00.542822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:00.544183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:00.557285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:00.620750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:07:00.641155 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Working on deleting snapshot 3d9d2537-cf4e-4198-bcf6-f3655b5ea8d3 from shelved instance... Oct 28 10:07:01.888531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:01.969617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:02.300750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:02.409987 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-06b0a099-795b-4b4e-badb-eb58d9a9ec06 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 2.665043 Oct 28 10:07:02.410659 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1926/3879] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:06:59 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 2666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:02.421946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:02.422578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:02.449541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:02.456228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Doing local delete in cell 308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=128748) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 10:07:02.457112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:02.457605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:02.458074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:02.458500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 10:07:02.461688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:02.462162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:02.462316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] deallocate_for_instance() {{(pid=128748) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 10:07:02.462922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:02.469573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:02.470263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:02.499780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] HTTP exception thrown: Instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 could not be found. Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 HTTP/1.1 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 could not be found. Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581'} Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 could not be found. Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 could not be found. Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:02.502021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 could not be found. Oct 28 10:07:02.507347 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:02.509919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 404 to user: Instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:02.511552 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a386dc22-05ec-4e31-99ce-3354199adb7e tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581" status: 404 len: 111 microversion: 2.1 time: 0.098379 Oct 28 10:07:02.513791 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1927/3880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:02 2022] GET /compute/v2.1/servers/a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:02.520802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:02.521910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:02.530931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:02.531706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:02.532312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:02.533328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:02.534044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:02.534685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:02.887253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:02.906943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b63382d5-138d-4274-9cd9-3e12b8cf83d6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1801 microversion: 2.1 time: 0.391670 Oct 28 10:07:02.908952 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1928/3881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:02 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1801 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:02.919547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:02.920700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:02.928894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:02.930921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:02.932751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:02.934947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:02.935630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:02.937272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:02.970712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:03.321579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:03.335274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:03.337215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:03.338721 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-adc6d502-0f68-4c64-941a-a64c8098afe5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.428408 Oct 28 10:07:03.339520 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1929/3882] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:02 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:03.368169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-be6a38b6-8e1b-482b-b854-7368981d9748 req-932ca885-8f41-4d97-99bb-75bd449cf47b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581", "name": "network-vif-deleted", "tag": "775919f4-ed6a-44f7-b0fc-015f26fb08af"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:03.387797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be6a38b6-8e1b-482b-b854-7368981d9748 req-932ca885-8f41-4d97-99bb-75bd449cf47b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:03.388748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be6a38b6-8e1b-482b-b854-7368981d9748 req-932ca885-8f41-4d97-99bb-75bd449cf47b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:03.389524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be6a38b6-8e1b-482b-b854-7368981d9748 req-932ca885-8f41-4d97-99bb-75bd449cf47b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:03.695994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Updating instance_info_cache with network_info: [] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:07:03.785609 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-be6a38b6-8e1b-482b-b854-7368981d9748 req-932ca885-8f41-4d97-99bb-75bd449cf47b service nova] Creating event network-vif-deleted:775919f4-ed6a-44f7-b0fc-015f26fb08af for instance a6e6b7fe-b0a5-4fbd-95d6-fcb366d0a581 on n-h1-zed-1 Oct 28 10:07:03.792034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-be6a38b6-8e1b-482b-b854-7368981d9748 req-932ca885-8f41-4d97-99bb-75bd449cf47b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.440628 Oct 28 10:07:03.793305 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1930/3883] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:03.800055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:03.802032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:03.810694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:03.811657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:03.812286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:03.813225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:03.814126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:03.814871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.128543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:04.137279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:04.139952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:04.146398 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-71871578-9b5e-4088-af57-8138b644f53e tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1358 microversion: 2.21 time: 0.351551 Oct 28 10:07:04.147512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1931/3884] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:03 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:04.156401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6928be17-981a-487b-8302-94289df338cd req-30c3bb1a-fa0e-4fc8-a717-33252cac7d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74f6a377-e958-47ab-94cf-a19001270b5f", "name": "network-vif-deleted", "tag": "433b5532-bceb-49ff-9fc9-9b3d72973982"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:04.170534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6928be17-981a-487b-8302-94289df338cd req-30c3bb1a-fa0e-4fc8-a717-33252cac7d4b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.173002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6928be17-981a-487b-8302-94289df338cd req-30c3bb1a-fa0e-4fc8-a717-33252cac7d4b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.174126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6928be17-981a-487b-8302-94289df338cd req-30c3bb1a-fa0e-4fc8-a717-33252cac7d4b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.189797 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6928be17-981a-487b-8302-94289df338cd req-30c3bb1a-fa0e-4fc8-a717-33252cac7d4b service nova] Creating event network-vif-deleted:433b5532-bceb-49ff-9fc9-9b3d72973982 for instance 74f6a377-e958-47ab-94cf-a19001270b5f on n-h2-zed-1 Oct 28 10:07:04.201640 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6928be17-981a-487b-8302-94289df338cd req-30c3bb1a-fa0e-4fc8-a717-33252cac7d4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049288 Oct 28 10:07:04.209029 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1932/3885] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:04.217221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:04.218328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:04.227780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.228667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.229486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.230499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.231216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.231892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.431699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:04.445582 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-072b0106-452a-4086-90c7-56a334080d48 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 204 len: 0 microversion: 2.1 time: 3.959387 Oct 28 10:07:04.446665 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1954/3886] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:07:00 2022] DELETE /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 0 bytes in 3962 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:07:04.447962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:04.450534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:04.451923 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-823b02c1-b2f5-418d-ab7b-bbc68bae1b96 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1718 microversion: 2.20 time: 0.241383 Oct 28 10:07:04.452541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:04.453357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] [instance: 74f6a377-e958-47ab-94cf-a19001270b5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:04.462622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.463552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.464583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.466689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.467330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.468087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.468264 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1933/3887] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:04 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1718 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:04.487052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] HTTP exception thrown: Instance 74f6a377-e958-47ab-94cf-a19001270b5f could not be found. Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Request method failure captured: Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f HTTP/1.1 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lqA_DeIcONWjViKP_LYGlqulFJ4-9XVMi0lFpumjtB6s3lU08uZwucG10Dank_Ja1eLUoXgtBO0OM1gPWVh97KQm6aaY4e5cCIfLrWb03RaFM8eZqnaZ9N9_rDJ8Ed3g8knClgPYcbHQBlAdMBnd5w-on2mz4xSIX81NCgCfN5mwg Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cdec51986d2644d6a667908a6fa34da2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cdec51986d2644d6a667908a6fa34da2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cdec51986d2644d6a667908a6fa34da2"}]}] Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cdec51986d2644d6a667908a6fa34da2 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1488257032 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8c89b4a51ce649389bbff589d10e1585 Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ListServersNegativeTestJSON-1488257032-project Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 74f6a377-e958-47ab-94cf-a19001270b5f could not be found. Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '74f6a377-e958-47ab-94cf-a19001270b5f'} Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74f6a377-e958-47ab-94cf-a19001270b5f could not be found. Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74f6a377-e958-47ab-94cf-a19001270b5f could not be found. Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.489985 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74f6a377-e958-47ab-94cf-a19001270b5f could not be found. Oct 28 10:07:04.496414 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.497157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:04.497157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:04.499842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] Returning 404 to user: Instance 74f6a377-e958-47ab-94cf-a19001270b5f could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:04.501475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b972956-a6c6-47fb-ade3-a241f5f0183d tempest-ListServersNegativeTestJSON-1488257032 tempest-ListServersNegativeTestJSON-1488257032-project] 10.222.0.16 "GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f" status: 404 len: 111 microversion: 2.1 time: 0.053293 Oct 28 10:07:04.503004 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1955/3888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:04 2022] GET /compute/v2.1/servers/74f6a377-e958-47ab-94cf-a19001270b5f => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:04.509634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d6b257f-a5e2-4449-8a9b-4ae12652b101 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32b784c0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:04.510604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.511120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.511579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.512303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.512777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.513250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.603083 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-913c7b8d-ebdf-468b-8428-ab6237b6e1a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3/ips" status: 200 len: 215 microversion: 2.1 time: 0.132167 Oct 28 10:07:04.606402 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1934/3889] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:07:04 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3/ips => generated 215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:04.620115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d6b257f-a5e2-4449-8a9b-4ae12652b101 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.115707 Oct 28 10:07:04.621450 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1956/3890] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:04 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:04.623934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:04.624623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:04.627729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:04.629504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:04.637957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:04.638250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.640222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.640492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.640734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.641494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.642188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.643163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.643433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.644203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.645876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.648539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.649450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.668815 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf HTTP/1.1 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '3d20727e-4105-4bbe-8e93-a3960f8330bf'} Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:04.670869 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.677638 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:04.677638 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:04.677638 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:04.677638 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:04.677638 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:04.677638 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:07:04.677638 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:04.680275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:04.681661 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-743bbc9b-c238-4da5-a631-d79ecdece144 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 404 len: 111 microversion: 2.1 time: 0.059074 Oct 28 10:07:04.682886 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1957/3891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:04 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:04.688137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:04.689197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:04.712411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.713124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.713402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.714142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:04.714602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:04.721765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:04.760151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:07:04.838603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:04.952229 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc632c90-48ca-485b-a118-6a51154b2cea tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 204 len: 0 microversion: 2.1 time: 0.267792 Oct 28 10:07:04.953093 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1958/3892] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:07:04 2022] DELETE /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:07:04.961591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-87277933", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa47211-0e93-41b2-a356-031426d3c83c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:05.045897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] validate_networks() for [('afa47211-0e93-41b2-a356-031426d3c83c', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:07:05.142269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:05.155808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:05.157272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:05.160192 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6bc716d-738c-4cdb-bb01-10d8ff29a692 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.545314 Oct 28 10:07:05.164180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1935/3893] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:04 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:05.169380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:05.170272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:05.178288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:05.179073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:05.179703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:05.180721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:05.185199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:05.193584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:05.971080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:07:05.975999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:07:05.977621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:07:05.980609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:07:05.985270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:07:06.006343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.007147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.007900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.011289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.011994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.012654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.025320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.033261 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a89ced2-579b-4c62-a88d-71a9a97999af tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1807 microversion: 2.1 time: 0.867701 Oct 28 10:07:06.053140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:07:06.055441 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1936/3894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:05 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1807 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:06.059995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for user 6859db32b98f4caba7379962eaef9de3 and project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:07:06.075380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:07:06.079073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:07:06.092982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:06.094237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:06.109991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.112133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.112619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.113385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.119527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.120007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.178467 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edcda743-d808-40b7-b9cf-020ef5201ecb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.222290 Oct 28 10:07:06.183023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1959/3895] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:07:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:07:06.199317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-79d8f1c0-8e69-4a89-b7c4-08b11321550d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3346eee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:06.303071 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-79d8f1c0-8e69-4a89-b7c4-08b11321550d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.117898 Oct 28 10:07:06.310892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1960/3896] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:06 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:06.311190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "50de4fb9-66ad-443a-b871-23446c4f34a8"}, {"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "18e409a1-6b35-42f6-a1c4-c5876cdcbabe"}, {"server_uuid": "3d20727e-4105-4bbe-8e93-a3960f8330bf", "name": "network-vif-deleted", "tag": "fcb63ddf-3037-4721-8845-2a2d42350c8f"}, {"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "89219c1b-a412-4b80-8647-05f0b7c942a2"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:06.359256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.360972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.396063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.403747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.412387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.417176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.418359 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa053760-a19e-4be4-bf6f-487125376915 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1358 microversion: 2.21 time: 0.361618 Oct 28 10:07:06.421248 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1937/3897] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:06 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1358 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:06.440045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:06.440666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:06.458718 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Creating event network-changed:50de4fb9-66ad-443a-b871-23446c4f34a8 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:06.459259 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Creating event network-changed:18e409a1-6b35-42f6-a1c4-c5876cdcbabe for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:06.459801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.server_external_events [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Unable to find a host for instance 3d20727e-4105-4bbe-8e93-a3960f8330bf. Dropping event network-vif-deleted {{(pid=128748) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 10:07:06.460310 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] Creating event network-changed:89219c1b-a412-4b80-8647-05f0b7c942a2 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:06.481087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.481740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.482204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.492349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.492968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.493396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.493518 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a1d3111c-a04e-4eb9-b700-611fe5b5497a req-90fe0616-74b5-4086-9c9b-ff8130bce316 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 681 microversion: 2.1 time: 0.186981 Oct 28 10:07:06.494117 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1961/3898] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 681 bytes in 188 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 10:07:06.523667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2122ed50-819f-4992-8a01-77547cb7eb6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:06.524386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2122ed50-819f-4992-8a01-77547cb7eb6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:06.724196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2122ed50-819f-4992-8a01-77547cb7eb6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.731285 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2122ed50-819f-4992-8a01-77547cb7eb6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1213 microversion: 2.1 time: 0.236006 Oct 28 10:07:06.731879 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1962/3899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:06 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:06.746676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-74d6578f-6600-41f6-81f1-da985383901d req-6b4998be-a66c-450d-a13c-ef5559fb1ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5203aa26-b915-49a2-8a42-f1edeb360238", "tag": "cc1b65c8-e35b-439d-80c6-5bed3e67d362"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:06.767824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-74d6578f-6600-41f6-81f1-da985383901d req-6b4998be-a66c-450d-a13c-ef5559fb1ebf service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:06.768329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-74d6578f-6600-41f6-81f1-da985383901d req-6b4998be-a66c-450d-a13c-ef5559fb1ebf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:06.768961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-74d6578f-6600-41f6-81f1-da985383901d req-6b4998be-a66c-450d-a13c-ef5559fb1ebf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:06.790861 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-74d6578f-6600-41f6-81f1-da985383901d req-6b4998be-a66c-450d-a13c-ef5559fb1ebf service nova] Creating event network-changed:cc1b65c8-e35b-439d-80c6-5bed3e67d362 for instance 5203aa26-b915-49a2-8a42-f1edeb360238 on n-h2-zed-1 Oct 28 10:07:06.807120 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-74d6578f-6600-41f6-81f1-da985383901d req-6b4998be-a66c-450d-a13c-ef5559fb1ebf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073998 Oct 28 10:07:06.807749 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1963/3900] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:06.935581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.955324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.967375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:06.968892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d03f6ea-b7fe-400d-bbe7-fd89927e6624 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.546663 Oct 28 10:07:06.969591 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1938/3901] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:06 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:07.064141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:07.065113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:07.085231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:07.085744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:07.086192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:07.086913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:07.087371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:07.087805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:07.319219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c474a1d-30b0-4065-a0bc-f786e03faa07 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3269daf0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:07.414870 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c474a1d-30b0-4065-a0bc-f786e03faa07 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.099681 Oct 28 10:07:07.423851 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1939/3902] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:07 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:07.446508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:07.447299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:07.469475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:07.470044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:07.470502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:07.471241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:07.478679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:07.482590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:07.627589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:07.682234 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e09fb1a-66ab-4ce0-9d15-0c79b1018ce8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1807 microversion: 2.1 time: 0.622652 Oct 28 10:07:07.690890 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1964/3903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:07 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1807 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:07.755489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:07.756274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:07.768850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:07.769755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:07.770640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:07.771593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:07.772324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:07.773514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:08.100272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:08.111692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f563afd9-6fa6-456d-854a-b3fb5f656280 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1265 microversion: 2.1 time: 0.361078 Oct 28 10:07:08.115394 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1965/3904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:07 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1265 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:08.123531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c51e5b86-17c7-4c84-b1f8-dd2a965836d6 req-e74e177b-43ff-404c-9400-ba06f62cd554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5203aa26-b915-49a2-8a42-f1edeb360238", "name": "network-vif-plugged", "status": "completed", "tag": "cc1b65c8-e35b-439d-80c6-5bed3e67d362"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:08.165162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c51e5b86-17c7-4c84-b1f8-dd2a965836d6 req-e74e177b-43ff-404c-9400-ba06f62cd554 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:08.165656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c51e5b86-17c7-4c84-b1f8-dd2a965836d6 req-e74e177b-43ff-404c-9400-ba06f62cd554 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:08.166095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c51e5b86-17c7-4c84-b1f8-dd2a965836d6 req-e74e177b-43ff-404c-9400-ba06f62cd554 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:08.212588 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c51e5b86-17c7-4c84-b1f8-dd2a965836d6 req-e74e177b-43ff-404c-9400-ba06f62cd554 service nova] Creating event network-vif-plugged:cc1b65c8-e35b-439d-80c6-5bed3e67d362 for instance 5203aa26-b915-49a2-8a42-f1edeb360238 on n-h2-zed-1 Oct 28 10:07:08.231131 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c51e5b86-17c7-4c84-b1f8-dd2a965836d6 req-e74e177b-43ff-404c-9400-ba06f62cd554 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114425 Oct 28 10:07:08.238701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1966/3905] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:08.254647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:08.256796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:08.273995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:08.274874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:08.275656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:08.276683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:08.277419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:08.278073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:08.625209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:08.642245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:08.643701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:08.644875 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d67fa93-778b-4e2d-98db-ef7faa6d3cc3 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1358 microversion: 2.21 time: 1.203248 Oct 28 10:07:08.646027 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1940/3906] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:07 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1358 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:08.664688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48580552-6e5c-4903-9994-06fe0b1b04bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32603af0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:08.767568 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48580552-6e5c-4903-9994-06fe0b1b04bc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.107591 Oct 28 10:07:08.768084 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1941/3907] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:08 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:08.773154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:08.781790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:08.803430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:08.804418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:08.805449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:08.806644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:08.807293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:08.807896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:09.252924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:09.264875 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9308e874-f49f-4ea2-a604-2963d072f0d8 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1807 microversion: 2.1 time: 0.495265 Oct 28 10:07:09.289637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:09.297672 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1942/3908] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:08 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1807 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:09.306760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-52530719-60c9-4ebc-8a80-e94f76509f01 req-18790758-3a79-4a13-9b41-644c0aefab7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "f2bdd9a1-fd0b-40e6-b878-461476842b57"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:09.310048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:09.322652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:09.324072 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-24e2fc43-37bc-4909-9759-c3b6c579ccfe tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 1.083811 Oct 28 10:07:09.325824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-52530719-60c9-4ebc-8a80-e94f76509f01 req-18790758-3a79-4a13-9b41-644c0aefab7d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:09.326534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-52530719-60c9-4ebc-8a80-e94f76509f01 req-18790758-3a79-4a13-9b41-644c0aefab7d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:09.327187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-52530719-60c9-4ebc-8a80-e94f76509f01 req-18790758-3a79-4a13-9b41-644c0aefab7d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:09.332705 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1967/3909] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:08 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:09.350587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:09.354649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:09.358118 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-52530719-60c9-4ebc-8a80-e94f76509f01 req-18790758-3a79-4a13-9b41-644c0aefab7d service nova] Creating event network-changed:f2bdd9a1-fd0b-40e6-b878-461476842b57 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:09.371942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:09.374642 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-52530719-60c9-4ebc-8a80-e94f76509f01 req-18790758-3a79-4a13-9b41-644c0aefab7d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075418 Oct 28 10:07:09.378934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:09.379408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:09.380145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:09.380612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:09.381129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:09.382167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1943/3910] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:09.432737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-db2cfc8d-985a-49b0-95f8-0daf33b189a8 req-d75e0730-a41d-47ec-aed0-ea2bc1c8d6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "name": "network-vif-deleted", "tag": "d94e1309-57a1-4415-9852-746e27f8cd5a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:09.450640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db2cfc8d-985a-49b0-95f8-0daf33b189a8 req-d75e0730-a41d-47ec-aed0-ea2bc1c8d6a6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:09.451133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db2cfc8d-985a-49b0-95f8-0daf33b189a8 req-d75e0730-a41d-47ec-aed0-ea2bc1c8d6a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:09.451576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db2cfc8d-985a-49b0-95f8-0daf33b189a8 req-d75e0730-a41d-47ec-aed0-ea2bc1c8d6a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:09.468393 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-db2cfc8d-985a-49b0-95f8-0daf33b189a8 req-d75e0730-a41d-47ec-aed0-ea2bc1c8d6a6 service nova] Creating event network-vif-deleted:d94e1309-57a1-4415-9852-746e27f8cd5a for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:07:09.483600 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-db2cfc8d-985a-49b0-95f8-0daf33b189a8 req-d75e0730-a41d-47ec-aed0-ea2bc1c8d6a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055578 Oct 28 10:07:09.489364 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1944/3911] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:09.588496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:09.597891 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a8d2367c-4be7-4956-a0b2-b5346d945318 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1271 microversion: 2.1 time: 0.259315 Oct 28 10:07:09.599162 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1968/3912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:09 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1271 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:09.673714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:09.674477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:09.699650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:09.702572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:09.705919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:09.706842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:09.708156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:09.710644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:09.783254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2be6d658-6f30-42b3-a190-1f60c7069dc1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca324d8d30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:09.861442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2be6d658-6f30-42b3-a190-1f60c7069dc1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.082864 Oct 28 10:07:09.862519 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1969/3913] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:09 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:10.266341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:10.282715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:10.293854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:10.295212 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6c900cc-a233-431d-ae09-a9d74271623f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1358 microversion: 2.21 time: 0.627118 Oct 28 10:07:10.306374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:10.306996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:10.310952 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1945/3914] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:09 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1358 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:10.319459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:10.325758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:10.326452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:10.327379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:10.328003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:10.328586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:10.354370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:10.355502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:10.366234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:10.367051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:10.368377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:10.369763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:10.371300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:10.371978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:10.950375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:10.954934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:10.969864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fede5358-881e-4b29-b0ed-54c150d0c876 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1628 microversion: 2.1 time: 0.668801 Oct 28 10:07:10.974704 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1970/3915] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:10 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1628 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:10.986361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:10.992592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:11.001679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:11.002435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:11.003055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:11.004137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:11.009112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:11.013977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:11.257582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:11.271268 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4feb6a9-7bb8-4869-a088-8debd75dc6d9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1271 microversion: 2.1 time: 0.293544 Oct 28 10:07:11.278159 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1971/3916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:10 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1271 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:11.289400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ea5a611-9a88-4ae6-8cd7-7f28a6e0297d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32ae1550>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:11.345632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:11.359640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:11.366704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:11.368242 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48f18c07-ac3e-40fb-9669-7a6774c809cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 1.020565 Oct 28 10:07:11.369460 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1946/3917] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:10 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:11.378104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:11.379109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:11.384628 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ea5a611-9a88-4ae6-8cd7-7f28a6e0297d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.104765 Oct 28 10:07:11.385919 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1972/3918] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:11 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:11.394716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:11.395405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:11.399095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:11.402262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:11.402863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:11.403525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:11.870375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:11.880387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:11.881873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:11.883082 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62a92999-ce26-4315-bd36-3dde2149e42a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1551 microversion: 2.21 time: 0.512296 Oct 28 10:07:11.924053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:11.924667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:11.936347 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1947/3919] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:11 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1551 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:11.946077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:11.946591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:11.948020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:11.948987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:11.951570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:11.953455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:11.998535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:12.002201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:12.026291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.027194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.027822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:12.030306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.030982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.035956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:12.049650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:07:12.395306 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5603caae-356d-473d-b433-a7cf86c9b63b tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 204 len: 0 microversion: 2.21 time: 0.486616 Oct 28 10:07:12.396371 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1973/3920] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:07:11 2022] DELETE /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 10:07:12.417719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-788c32c7-d403-445f-b445-f0a2f5660dbb req-c4601f25-15e7-416d-a78f-9a7e04900070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "name": "network-vif-unplugged", "status": "completed", "tag": "f804f215-4ec4-4a4c-b6c5-b109b55c68cb"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:12.457812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-788c32c7-d403-445f-b445-f0a2f5660dbb req-c4601f25-15e7-416d-a78f-9a7e04900070 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.458703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-788c32c7-d403-445f-b445-f0a2f5660dbb req-c4601f25-15e7-416d-a78f-9a7e04900070 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.460892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-788c32c7-d403-445f-b445-f0a2f5660dbb req-c4601f25-15e7-416d-a78f-9a7e04900070 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:12.493320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-788c32c7-d403-445f-b445-f0a2f5660dbb req-c4601f25-15e7-416d-a78f-9a7e04900070 service nova] Creating event network-vif-unplugged:f804f215-4ec4-4a4c-b6c5-b109b55c68cb for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:07:12.506423 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-788c32c7-d403-445f-b445-f0a2f5660dbb req-c4601f25-15e7-416d-a78f-9a7e04900070 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107702 Oct 28 10:07:12.509345 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1974/3921] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:12.523411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0ee19504-99eb-4fbb-8894-705f89f426bb req-004aaa4d-b89c-4e0e-9ab3-9f1063b8891a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "name": "network-vif-deleted", "tag": "75175b94-3024-485a-aa66-d32c67067621"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:12.548966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ee19504-99eb-4fbb-8894-705f89f426bb req-004aaa4d-b89c-4e0e-9ab3-9f1063b8891a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.551471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ee19504-99eb-4fbb-8894-705f89f426bb req-004aaa4d-b89c-4e0e-9ab3-9f1063b8891a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.552123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ee19504-99eb-4fbb-8894-705f89f426bb req-004aaa4d-b89c-4e0e-9ab3-9f1063b8891a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:12.606843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0ee19504-99eb-4fbb-8894-705f89f426bb req-004aaa4d-b89c-4e0e-9ab3-9f1063b8891a service nova] Creating event network-vif-deleted:75175b94-3024-485a-aa66-d32c67067621 for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:07:12.615826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0ee19504-99eb-4fbb-8894-705f89f426bb req-004aaa4d-b89c-4e0e-9ab3-9f1063b8891a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103244 Oct 28 10:07:12.617006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1975/3922] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:12.625408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:12.627197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:12.637385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.638168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.638832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:12.639842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.640501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.641133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:12.732968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:12.741415 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f356f9a-7b18-442c-89af-4ea5c9c1babe tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1607 microversion: 2.1 time: 0.747427 Oct 28 10:07:12.747984 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1948/3923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:11 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1607 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:12.770649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-be3dfbef-d556-43d5-9a61-f1a1ea3a9c92 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca325e6160>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:12.821830 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-be3dfbef-d556-43d5-9a61-f1a1ea3a9c92 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1439 microversion: 2.1 time: 0.059103 Oct 28 10:07:12.822830 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1949/3924] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:12 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1439 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:12.833266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:12.834389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:12.856766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.857410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.857931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:12.858608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:12.859116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:12.859595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:13.262867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:13.285301 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b254c625-5c96-4bba-945d-7b1916cc06c8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1313 microversion: 2.1 time: 0.664749 Oct 28 10:07:13.286797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1976/3925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:12 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:13.295650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:13.296296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:13.311735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:13.312236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:13.312682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:13.313715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:13.318963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:13.318963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:13.463338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:13.482102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:13.483661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:13.484857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-67310851-7980-4aa7-9ba7-7469dc853e35 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1557 microversion: 2.21 time: 0.660317 Oct 28 10:07:13.485748 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1950/3926] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:12 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1557 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:13.774477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:13.775089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:13.799872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:13.800142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:13.800593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:13.801376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:13.803957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:13.804779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:13.870889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:13.897544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:13.902770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:13.907827 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-011d95d6-5549-4b2b-b216-ff581250db27 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.613371 Oct 28 10:07:13.908456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1977/3927] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:13 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:13.925285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d322b00-fda3-4862-8ed4-85ce3029cf6a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32b38280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:14.001344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:14.016854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d322b00-fda3-4862-8ed4-85ce3029cf6a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1448 microversion: 2.1 time: 0.102517 Oct 28 10:07:14.019217 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50251037-2748-4ec4-9e1d-6bc58436c872 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 200 len: 1297 microversion: 2.1 time: 0.249005 Oct 28 10:07:14.020994 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1951/3928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:13 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 1297 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:14.037606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e8bc4cb-e8d7-4c1e-a073-d5ec271271ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32650e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:14.038303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1978/3929] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:13 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1448 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:14.135450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e8bc4cb-e8d7-4c1e-a073-d5ec271271ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 200 len: 1448 microversion: 2.1 time: 0.101807 Oct 28 10:07:14.140707 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1952/3930] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:14 2022] GET /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 1448 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:14.155571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c99867b2-dba6-47ae-8893-4d1f385a64e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3349b310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:14.311783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:14.312393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:14.339463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:14.340291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:14.340918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:14.342005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:14.342646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:14.343246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:14.350946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:14.814045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:14.836104 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a7a0a29-2cae-4b57-8ca7-0c662d59f2ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1313 microversion: 2.1 time: 0.528058 Oct 28 10:07:14.843787 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1953/3931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:14 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1313 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:14.860665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:14.861680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:14.886063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:14.886639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:14.890080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:14.891292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:14.896463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:14.899082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.511431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:15.526036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:15.527666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:15.528837 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f01cd305-d50a-441d-8fce-b09fc7c6c9dd tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1557 microversion: 2.21 time: 0.682994 Oct 28 10:07:15.529431 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1954/3932] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:14 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1557 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:15.546816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6e1f87a6-b139-48ea-b865-dce0da4b881f req-c84ddb70-9d4f-464b-8b07-0cb50e211360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3", "name": "network-vif-deleted", "tag": "f804f215-4ec4-4a4c-b6c5-b109b55c68cb"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:15.560782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6e1f87a6-b139-48ea-b865-dce0da4b881f req-c84ddb70-9d4f-464b-8b07-0cb50e211360 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.561246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6e1f87a6-b139-48ea-b865-dce0da4b881f req-c84ddb70-9d4f-464b-8b07-0cb50e211360 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.562762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6e1f87a6-b139-48ea-b865-dce0da4b881f req-c84ddb70-9d4f-464b-8b07-0cb50e211360 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.570121 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c99867b2-dba6-47ae-8893-4d1f385a64e4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 204 len: 0 microversion: 2.1 time: 1.418624 Oct 28 10:07:15.571526 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1979/3933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:14 2022] DELETE /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 0 bytes in 1421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:07:15.580388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:15.584616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:15.587485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6e1f87a6-b139-48ea-b865-dce0da4b881f req-c84ddb70-9d4f-464b-8b07-0cb50e211360 service nova] Creating event network-vif-deleted:f804f215-4ec4-4a4c-b6c5-b109b55c68cb for instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 on n-h2-zed-1 Oct 28 10:07:15.594005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.594844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.595526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.596764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.597857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.598642 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6e1f87a6-b139-48ea-b865-dce0da4b881f req-c84ddb70-9d4f-464b-8b07-0cb50e211360 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067744 Oct 28 10:07:15.599144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.599560 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1955/3934] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:15.607666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f86ffbfa-a9ed-4b42-9389-f64c7367ffc0 req-84062158-99ce-4e0d-bbff-de37b4af98b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e", "tag": "b2f7a560-4559-49a0-bdf6-4bce194bc3bc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:15.619239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f86ffbfa-a9ed-4b42-9389-f64c7367ffc0 req-84062158-99ce-4e0d-bbff-de37b4af98b2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.620109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f86ffbfa-a9ed-4b42-9389-f64c7367ffc0 req-84062158-99ce-4e0d-bbff-de37b4af98b2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.620727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f86ffbfa-a9ed-4b42-9389-f64c7367ffc0 req-84062158-99ce-4e0d-bbff-de37b4af98b2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.638631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f86ffbfa-a9ed-4b42-9389-f64c7367ffc0 req-84062158-99ce-4e0d-bbff-de37b4af98b2 service nova] Creating event network-changed:b2f7a560-4559-49a0-bdf6-4bce194bc3bc for instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e on n-h2-zed-1 Oct 28 10:07:15.645202 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f86ffbfa-a9ed-4b42-9389-f64c7367ffc0 req-84062158-99ce-4e0d-bbff-de37b4af98b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044078 Oct 28 10:07:15.646401 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1956/3935] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:15.651784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:15.652625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:15.659217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.659913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.660605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.661591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.662331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.662984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.681161 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] HTTP exception thrown: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Request method failure captured: Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 HTTP/1.1 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6l3fnqB10uSFDYp0bVakzpKuKxiTSF0T15Om64Kq2RcD3DD3ncsOT3iQJOd_1vCCl07RLH9Ve4rJ82ot3cFupatGFB4yZI25zYhhfndP59WCQgJt06aiPqOTmkLTxhCaGCwwIIMK_6R6uoiDxBl_ej0gj6j9KpVjyIvv9mcrBvOsCI Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e212a668cf47d38ef3b363ce7dbba4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e212a668cf47d38ef3b363ce7dbba4"}]}] Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestMultiNic-1194972485 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1f95d3b5d2334eefb1b5386fb8580780 Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3'} Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:15.683474 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:15.688710 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:15.688710 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:15.688710 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:15.688710 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:15.688710 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:15.688710 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:07:15.688710 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:15.690971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Returning 404 to user: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:15.692650 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a419de10-0037-4885-aacc-9138d8352841 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 404 len: 111 microversion: 2.1 time: 0.044969 Oct 28 10:07:15.693663 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1957/3936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:15 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:07:15.698855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:15.699592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:15.706176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.706880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.707563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.709268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.709725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.710321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.764197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:07:15.917563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7c07834c-aea1-4dfb-b90b-24069d772b70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 204 len: 0 microversion: 2.1 time: 0.221701 Oct 28 10:07:15.918748 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1958/3937] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:07:15 2022] DELETE /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:07:15.940044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:15.942368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:15.956440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.958206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.958876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:15.962297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:15.964697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:15.966270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:16.042648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:16.289494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:16.306517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:16.308124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:16.310098 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fcb34433-6b15-454b-84a6-028f26ddcb5b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.737287 Oct 28 10:07:16.311093 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1980/3938] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:15 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:16.316475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1343416804", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "153b4feb-5f46-4862-85be-edb054eb6bc9"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:16.382168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] validate_networks() for [('153b4feb-5f46-4862-85be-edb054eb6bc9', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:07:16.482670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:16.494017 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1af99707-f1f3-4580-8de5-fc2852152fa0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1313 microversion: 2.1 time: 0.573570 Oct 28 10:07:16.497905 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1959/3939] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:15 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:16.555697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:16.556332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:16.566918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:16.568106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:16.570044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:16.572095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:16.573301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:16.574531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:16.655597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:16.656100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:16.656575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:16.657057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lazy-loading 'fault' on Instance uuid 5203aa26-b915-49a2-8a42-f1edeb360238 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:07:16.718280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:16.727980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:16.730154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:16.730821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:16.732312 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a856002-193c-430f-ae05-5a07d395c8a8 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1348 microversion: 2.21 time: 0.181154 Oct 28 10:07:16.733273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1960/3940] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:16 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1348 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:16.738933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-139cd28d-b8f9-4489-8122-4f11ef4aee75 req-0413a4e3-7ec8-4e5a-8622-9030ca4d6556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c887bd71-f702-4d75-98af-df3ea11c7184", "name": "network-vif-unplugged", "status": "completed", "tag": "1a6d3ce1-8750-4f98-b746-5014ab5c01dd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:16.747635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:16.750029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-139cd28d-b8f9-4489-8122-4f11ef4aee75 req-0413a4e3-7ec8-4e5a-8622-9030ca4d6556 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:16.750863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-139cd28d-b8f9-4489-8122-4f11ef4aee75 req-0413a4e3-7ec8-4e5a-8622-9030ca4d6556 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:16.751560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-139cd28d-b8f9-4489-8122-4f11ef4aee75 req-0413a4e3-7ec8-4e5a-8622-9030ca4d6556 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:16.770675 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-139cd28d-b8f9-4489-8122-4f11ef4aee75 req-0413a4e3-7ec8-4e5a-8622-9030ca4d6556 service nova] Creating event network-vif-unplugged:1a6d3ce1-8750-4f98-b746-5014ab5c01dd for instance c887bd71-f702-4d75-98af-df3ea11c7184 on n-h1-zed-1 Oct 28 10:07:16.777681 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-139cd28d-b8f9-4489-8122-4f11ef4aee75 req-0413a4e3-7ec8-4e5a-8622-9030ca4d6556 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042382 Oct 28 10:07:16.778304 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1961/3941] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:17.352562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:17.354704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:17.384886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.386621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.387370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.390035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.390772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.391474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.712201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:07:17.712633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:07:17.713964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:07:17.715153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:07:17.715875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:07:17.728712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.729515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.730501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.731820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.734239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.735589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.761993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:07:17.770206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for user 90aefa22b02749e8a6b03d16378a0a6c and project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:07:17.786601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:07:17.790317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:07:17.850016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:17.868765 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ac84483d-f4de-4e31-af65-e53e999bb49a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554899 Oct 28 10:07:17.870549 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1981/3942] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:07:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:07:17.883102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:17.885088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:17.893302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:17.895016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.895718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.896344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.897310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.897941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.898598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.899134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:17.901723 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1076b03-0793-41f8-ac2e-ae4a175b587c tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.564489 Oct 28 10:07:17.906103 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1962/3943] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:17 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:17.932388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6f741ebb-0ebd-4b92-bd30-5306b34f6105 req-88043404-5ffb-451e-af2a-81e69dec88f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5203aa26-b915-49a2-8a42-f1edeb360238", "name": "network-vif-deleted", "tag": "cc1b65c8-e35b-439d-80c6-5bed3e67d362"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:17.947651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6f741ebb-0ebd-4b92-bd30-5306b34f6105 req-88043404-5ffb-451e-af2a-81e69dec88f5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.948233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6f741ebb-0ebd-4b92-bd30-5306b34f6105 req-88043404-5ffb-451e-af2a-81e69dec88f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.948743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6f741ebb-0ebd-4b92-bd30-5306b34f6105 req-88043404-5ffb-451e-af2a-81e69dec88f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.962762 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6f741ebb-0ebd-4b92-bd30-5306b34f6105 req-88043404-5ffb-451e-af2a-81e69dec88f5 service nova] Creating event network-vif-deleted:cc1b65c8-e35b-439d-80c6-5bed3e67d362 for instance 5203aa26-b915-49a2-8a42-f1edeb360238 on n-h2-zed-1 Oct 28 10:07:17.969005 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6f741ebb-0ebd-4b92-bd30-5306b34f6105 req-88043404-5ffb-451e-af2a-81e69dec88f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061169 Oct 28 10:07:17.970238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1963/3944] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:17.978938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:17.979908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:17.987341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.987919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.989705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:17.991341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:17.992790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:17.993582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:18.037355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:18.038733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:18.039547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:18.040401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lazy-loading 'fault' on Instance uuid 5203aa26-b915-49a2-8a42-f1edeb360238 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:07:18.229374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:18.243281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:18.244799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '46e60190fc7542aea2104d11446c2614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fe652e1ff264b89938f9c5b4b9c09c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:18.250641 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c9d30ba6-88f6-47bc-a617-2063717c232f tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 200 len: 1348 microversion: 2.21 time: 0.276584 Oct 28 10:07:18.251237 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1964/3945] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:17 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 1348 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:18.264559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92172d46-a0aa-46f5-baa0-071d78b82ff7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:18.268041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92172d46-a0aa-46f5-baa0-071d78b82ff7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:18.339293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:18.352801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e11d1df3-5d19-45a6-9a57-cfbda6215a56 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1313 microversion: 2.1 time: 0.480468 Oct 28 10:07:18.356659 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1982/3946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:17 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:18.473168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92172d46-a0aa-46f5-baa0-071d78b82ff7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:18.486457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92172d46-a0aa-46f5-baa0-071d78b82ff7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1208 microversion: 2.1 time: 0.229736 Oct 28 10:07:18.505050 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1965/3947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:18 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1208 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:18.930960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:18.932356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:18.940561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:18.941951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:18.942612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:18.943554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:18.944226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:18.944932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.281261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:19.282768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:19.299282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.300153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.300882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.301922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.303089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.305225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.325995 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] HTTP exception thrown: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Request method failure captured: Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 HTTP/1.1 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6m1akRndJ72ylMESu5yO_GLy3fzp7mZHbFImCO_ZIyfE6-jAP0yEvTEEd_zC9SrIoaY8fxa53F2m40BFgHkZELla6BbNTByoQL0J0RxZGEis4jzEclJnK5_mOH87VmvXdcW8mcc78g2Bk4nHu7Skko17h8IR_F-LXgwohfW6zDh3zM Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 8fe652e1ff264b89938f9c5b4b9c09c6 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "tempest-type-865860820", "name": "tempest-service-866756402", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8fe652e1ff264b89938f9c5b4b9c09c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "tempest-type-264725914", "name": "tempest-service-1014849130", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8fe652e1ff264b89938f9c5b4b9c09c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8fe652e1ff264b89938f9c5b4b9c09c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8fe652e1ff264b89938f9c5b4b9c09c6"}]}] Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 8fe652e1ff264b89938f9c5b4b9c09c6 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-InstanceActionsV221TestJSON-1850375493-project Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 46e60190fc7542aea2104d11446c2614 Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-InstanceActionsV221TestJSON-1850375493-project Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '5203aa26-b915-49a2-8a42-f1edeb360238'} Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:19.329829 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.338625 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.341589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Returning 404 to user: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:19.342833 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b3e27ebb-cf25-4c4e-afe2-705c0a623155 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 404 len: 111 microversion: 2.21 time: 0.068129 Oct 28 10:07:19.347097 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1966/3948] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:19 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:19.355706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '.version_select at 0x7fca32603820>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:19.357542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:19.369858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.370885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.373425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.374549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.375766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.376476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.492163 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7bf0697-3d6d-498a-ac3d-8ed71d7a4b4a tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.141262 Oct 28 10:07:19.492972 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1967/3949] 10.222.0.16 () {60 vars in 1337 bytes} [Fri Oct 28 10:07:19 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238/os-instance-actions => generated 611 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:07:19.505629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:19.506949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:19.511542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:19.516318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.517233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.517914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.518971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.520246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.521632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.521943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:19.530626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:19.539398 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d79f75f-d067-4fc5-8717-db743f173143 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.610249 Oct 28 10:07:19.570039 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1983/3950] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:18 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:19.577073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:19.577660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:19.596761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.598246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.601998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.603325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.604105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.604844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.626781 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] HTTP exception thrown: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Request method failure captured: Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 HTTP/1.1 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6m1akRndJ72ylMESu5yO_GLy3fzp7mZHbFImCO_ZIyfE6-jAP0yEvTEEd_zC9SrIoaY8fxa53F2m40BFgHkZELla6BbNTByoQL0J0RxZGEis4jzEclJnK5_mOH87VmvXdcW8mcc78g2Bk4nHu7Skko17h8IR_F-LXgwohfW6zDh3zM Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 8fe652e1ff264b89938f9c5b4b9c09c6 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "tempest-type-865860820", "name": "tempest-service-866756402", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8fe652e1ff264b89938f9c5b4b9c09c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "tempest-type-264725914", "name": "tempest-service-1014849130", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8fe652e1ff264b89938f9c5b4b9c09c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8fe652e1ff264b89938f9c5b4b9c09c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8fe652e1ff264b89938f9c5b4b9c09c6"}]}] Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 8fe652e1ff264b89938f9c5b4b9c09c6 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-InstanceActionsV221TestJSON-1850375493-project Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 46e60190fc7542aea2104d11446c2614 Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-InstanceActionsV221TestJSON-1850375493-project Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5203aa26-b915-49a2-8a42-f1edeb360238'} Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:19.629909 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:19.634982 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:19.638098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Returning 404 to user: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:19.639275 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25132d7a-bdcf-484a-8abe-00776cadd192 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 404 len: 111 microversion: 2.21 time: 0.067221 Oct 28 10:07:19.640446 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1984/3951] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:07:19 2022] DELETE /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:19.646581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:19.648059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:19.655316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.656248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.658451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.660163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:19.663133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:19.663919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:19.981284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:19.998972 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-531d9630-8cac-4a74-9ab1-91a1111944d8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1268 microversion: 2.1 time: 0.351146 Oct 28 10:07:19.999668 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1985/3952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:19 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1268 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:20.005359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:20.009218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] [instance: 5203aa26-b915-49a2-8a42-f1edeb360238] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:20.024710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:20.025698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:20.026406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:20.027492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:20.028125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:20.028796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:20.055921 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] HTTP exception thrown: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Request method failure captured: Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 HTTP/1.1 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6m1akRndJ72ylMESu5yO_GLy3fzp7mZHbFImCO_ZIyfE6-jAP0yEvTEEd_zC9SrIoaY8fxa53F2m40BFgHkZELla6BbNTByoQL0J0RxZGEis4jzEclJnK5_mOH87VmvXdcW8mcc78g2Bk4nHu7Skko17h8IR_F-LXgwohfW6zDh3zM Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.21 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 8fe652e1ff264b89938f9c5b4b9c09c6 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "tempest-type-865860820", "name": "tempest-service-866756402", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8fe652e1ff264b89938f9c5b4b9c09c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "tempest-type-264725914", "name": "tempest-service-1014849130", "endpoints": []}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8fe652e1ff264b89938f9c5b4b9c09c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8fe652e1ff264b89938f9c5b4b9c09c6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8fe652e1ff264b89938f9c5b4b9c09c6"}]}] Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 8fe652e1ff264b89938f9c5b4b9c09c6 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1850375493 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-InstanceActionsV221TestJSON-1850375493-project Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 46e60190fc7542aea2104d11446c2614 Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-InstanceActionsV221TestJSON-1850375493-project Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5203aa26-b915-49a2-8a42-f1edeb360238'} Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:20.064861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. Oct 28 10:07:20.074079 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:20.076932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] Returning 404 to user: Instance 5203aa26-b915-49a2-8a42-f1edeb360238 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:20.079478 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50dd91dc-667f-4742-b10b-b2ea4d0308e7 tempest-InstanceActionsV221TestJSON-1850375493 tempest-InstanceActionsV221TestJSON-1850375493-project] 10.222.0.16 "GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238" status: 404 len: 111 microversion: 2.21 time: 0.077296 Oct 28 10:07:20.080388 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1986/3953] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:19 2022] GET /compute/v2.1/servers/5203aa26-b915-49a2-8a42-f1edeb360238 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:20.093081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0267c459-2ba0-4113-bd97-5ff113e665fc req-ab773c21-50e4-4170-ac2f-ecab9873fa4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c887bd71-f702-4d75-98af-df3ea11c7184", "name": "network-vif-deleted", "tag": "1a6d3ce1-8750-4f98-b746-5014ab5c01dd"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:20.095851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:20.106559 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1e392b4-ae7e-4863-9a5a-6bc8e1df20ea tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1313 microversion: 2.1 time: 0.612409 Oct 28 10:07:20.111135 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1968/3954] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:19 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:20.145714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0267c459-2ba0-4113-bd97-5ff113e665fc req-ab773c21-50e4-4170-ac2f-ecab9873fa4f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:20.146665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0267c459-2ba0-4113-bd97-5ff113e665fc req-ab773c21-50e4-4170-ac2f-ecab9873fa4f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.040s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:20.147327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0267c459-2ba0-4113-bd97-5ff113e665fc req-ab773c21-50e4-4170-ac2f-ecab9873fa4f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:20.190488 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0267c459-2ba0-4113-bd97-5ff113e665fc req-ab773c21-50e4-4170-ac2f-ecab9873fa4f service nova] Creating event network-vif-deleted:1a6d3ce1-8750-4f98-b746-5014ab5c01dd for instance c887bd71-f702-4d75-98af-df3ea11c7184 on n-h1-zed-1 Oct 28 10:07:20.197774 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0267c459-2ba0-4113-bd97-5ff113e665fc req-ab773c21-50e4-4170-ac2f-ecab9873fa4f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107476 Oct 28 10:07:20.199443 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1987/3955] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:20.570115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:20.571237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:20.584567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:20.588316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:20.589236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:20.590640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:20.592361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:20.594666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:21.032503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:21.039308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:21.085275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:21.086069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:21.086756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:21.088421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:21.089154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:21.090872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:21.208106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:21.215650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:21.220273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:21.222969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:21.224391 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc0222ff-78f2-4aca-858e-f39621507778 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.660767 Oct 28 10:07:21.225651 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1969/3956] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:20 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:21.226376 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e563b61-c318-421d-88ef-5bd380e4573b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1266 microversion: 2.1 time: 0.202627 Oct 28 10:07:21.238787 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1988/3957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:21 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:21.244630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:21.245339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:21.253764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:21.254806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:21.255732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:21.256851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:21.257702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:21.259221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:21.517638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:21.532782 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc274eb5-5cff-4664-b08e-0c14cd0dc707 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1313 microversion: 2.1 time: 0.304715 Oct 28 10:07:21.533944 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1970/3958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:21 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:21.750720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-071ea2b9-26d8-4c1d-9c76-8a02d77f5a4d req-a09eaebc-743a-452f-8a80-f7d18abad9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e", "name": "network-vif-plugged", "status": "completed", "tag": "b2f7a560-4559-49a0-bdf6-4bce194bc3bc"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:21.794108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-071ea2b9-26d8-4c1d-9c76-8a02d77f5a4d req-a09eaebc-743a-452f-8a80-f7d18abad9fb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:21.795134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-071ea2b9-26d8-4c1d-9c76-8a02d77f5a4d req-a09eaebc-743a-452f-8a80-f7d18abad9fb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:21.795938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-071ea2b9-26d8-4c1d-9c76-8a02d77f5a4d req-a09eaebc-743a-452f-8a80-f7d18abad9fb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:21.821965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-071ea2b9-26d8-4c1d-9c76-8a02d77f5a4d req-a09eaebc-743a-452f-8a80-f7d18abad9fb service nova] Creating event network-vif-plugged:b2f7a560-4559-49a0-bdf6-4bce194bc3bc for instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e on n-h2-zed-1 Oct 28 10:07:21.829290 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-071ea2b9-26d8-4c1d-9c76-8a02d77f5a4d req-a09eaebc-743a-452f-8a80-f7d18abad9fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087885 Oct 28 10:07:21.830622 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1989/3959] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:07:22.259439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:22.260267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:22.262285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:22.263166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:22.286780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:22.293690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:22.294569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:22.297542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:22.297966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:22.299010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:22.299943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:22.300730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:22.302417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:22.304926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:22.308664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:22.310333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:22.901258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:22.905810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:22.910159 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2fb0892d-cc41-431d-b234-7c4d9ad8185b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.659969 Oct 28 10:07:22.915628 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1990/3960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:22 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:22.920608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:22.928457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:22.932138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:22.944664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:22.945442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:22.948671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:22.949147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:22.950396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:22.951341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:22.951979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:22.953397 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45fc9fb6-cd90-41f4-9a52-f0ff3129b0e1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.705031 Oct 28 10:07:22.954246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:22.967862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1971/3961] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:22 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:23.892501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e334e3a4-09a0-4dc3-9ac0-6c5308a73637 req-302bd28d-08b0-4f47-8c1f-e8d7fc83d34a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e88ec883-ff30-424e-a2d2-fc90e4c02680", "tag": "adf1e6cf-d135-47a4-9ee6-452314fdf24e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:23.907961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e334e3a4-09a0-4dc3-9ac0-6c5308a73637 req-302bd28d-08b0-4f47-8c1f-e8d7fc83d34a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:23.915685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e334e3a4-09a0-4dc3-9ac0-6c5308a73637 req-302bd28d-08b0-4f47-8c1f-e8d7fc83d34a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:23.920615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e334e3a4-09a0-4dc3-9ac0-6c5308a73637 req-302bd28d-08b0-4f47-8c1f-e8d7fc83d34a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:23.948877 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e334e3a4-09a0-4dc3-9ac0-6c5308a73637 req-302bd28d-08b0-4f47-8c1f-e8d7fc83d34a service nova] Creating event network-changed:adf1e6cf-d135-47a4-9ee6-452314fdf24e for instance e88ec883-ff30-424e-a2d2-fc90e4c02680 on n-h2-zed-1 Oct 28 10:07:23.961190 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e334e3a4-09a0-4dc3-9ac0-6c5308a73637 req-302bd28d-08b0-4f47-8c1f-e8d7fc83d34a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074125 Oct 28 10:07:23.965806 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1972/3962] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:23.990947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:23.991690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:24.028550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:24.029321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:24.029954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:24.030926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:24.035995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:24.036686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:24.046993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:24.576617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:24.588794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e177413-19e0-476b-a531-fd933dc4a2cb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1313 microversion: 2.1 time: 1.671830 Oct 28 10:07:24.593519 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1991/3963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:22 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1313 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:24.614296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:24.614935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:24.633664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:24.634795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:24.636398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:24.637423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:24.638381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:24.639093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:24.976288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:25.000203 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e6d8d01-1c7a-4717-9abc-8a108c49dae0 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 1.030869 Oct 28 10:07:25.004514 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1973/3964] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:23 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:25.615717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:25.617077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:25.626231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:25.631471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:25.632304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:25.635124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:25.640153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:25.641164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:25.647591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:25.669203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:25.676047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:25.679511 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a01b6ea-9a54-42f1-ab26-2fa122d14dde tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 1.084097 Oct 28 10:07:25.688693 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1992/3965] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:24 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:26.027655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:26.029045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:26.036739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:26.038109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:26.039610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:26.040531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:26.041211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:26.041814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:26.067846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:26.524661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:26.535660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-17e6a366-033a-4d5a-90ed-7a4a03cff3b1 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1501 microversion: 2.1 time: 0.922933 Oct 28 10:07:26.561423 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1974/3966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:25 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1501 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:26.585775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0d1dbd6-d6e5-4d06-8d4d-a9dcd88dba99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:26.598166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:26.603089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0d1dbd6-d6e5-4d06-8d4d-a9dcd88dba99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:26.604122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0d1dbd6-d6e5-4d06-8d4d-a9dcd88dba99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:26.605557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0d1dbd6-d6e5-4d06-8d4d-a9dcd88dba99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:26.614117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14cde00e-7bf8-4596-830e-312f9e466b6c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.588793 Oct 28 10:07:26.635697 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1993/3967] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:26 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:26.674248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-125243197", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "6622b88b-ee46-4b1c-9606-d7c3c043eb4c"}, {"uuid": "aaf28c6d-342b-49e3-a344-5dda48173476"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:26.726038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0d1dbd6-d6e5-4d06-8d4d-a9dcd88dba99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Going to try to stop instance {{(pid=128747) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:07:26.765157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] validate_networks() for [('6622b88b-ee46-4b1c-9606-d7c3c043eb4c', None, None, None, None, None), ('aaf28c6d-342b-49e3-a344-5dda48173476', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:07:26.792005 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0d1dbd6-d6e5-4d06-8d4d-a9dcd88dba99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e/action" status: 202 len: 0 microversion: 2.1 time: 0.229141 Oct 28 10:07:26.793433 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1975/3968] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:07:26 2022] POST /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:07:26.818327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:26.819310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:26.828311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:26.829240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:26.830127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:26.832532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:26.833291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:26.833996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:27.156926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:27.175358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:27.177651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:27.179248 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-06741eb6-0763-42c5-8231-2158596f7fe2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.384054 Oct 28 10:07:27.180677 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1976/3969] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:26 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:27.188687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:27.189643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:27.198941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:27.200351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:27.201163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:27.203383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:27.204235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:27.205674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:27.396770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:27.406946 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f38b10f2-f43e-463d-bb22-198356ff066b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.223306 Oct 28 10:07:27.407789 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1977/3970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:27 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:27.638192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:27.639534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:27.659636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:27.660494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:27.660962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:27.662051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:27.662533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:27.662981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:27.750292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:27.779845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:27.913999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:27.942652 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a337e53e-80f9-4114-afc5-b4f1da282465 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.308210 Oct 28 10:07:27.953649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1978/3971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:27 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:28.214231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:28.215468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:28.230774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:28.231891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:28.233525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:28.234860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:28.236233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:28.237101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:28.479221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:28.556452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:28.585306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:28.585306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:28.585306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da6717c2-858e-4296-891e-b0f80881214e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.379971 Oct 28 10:07:28.585306 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1979/3972] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:28 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:28.600067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:28.605744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:28.615419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:28.623478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:28.624115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:28.624963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:28.625499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:28.625998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:28.677163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:07:28.677712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:07:28.678393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:07:28.678908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:07:28.679558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:07:28.699745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:28.700327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:28.700842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:28.701830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:28.702734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:28.702958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:28.773557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Getting quotas for project 26e212a668cf47d38ef3b363ce7dbba4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:07:28.788252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Getting quotas for user 1f95d3b5d2334eefb1b5386fb8580780 and project 26e212a668cf47d38ef3b363ce7dbba4. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:07:28.833693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:07:28.836188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:07:28.949834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:28.969750 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65bbb293-fec1-4930-b212-77a6a0df035e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.383484 Oct 28 10:07:28.969750 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1980/3973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:28 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:28.989762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cecb2bf1-36be-4d0a-b8e3-dee540851caa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.317121 Oct 28 10:07:28.990705 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1994/3974] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:07:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:07:28.993860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:28.994747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:29.002595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-132499c1-eb23-499b-a170-499d80218f31 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:29.004021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-132499c1-eb23-499b-a170-499d80218f31 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:29.057269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:29.058297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:29.059996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:29.062119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:29.063063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:29.064840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:29.204723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-132499c1-eb23-499b-a170-499d80218f31 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:29.219060 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-132499c1-eb23-499b-a170-499d80218f31 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1212 microversion: 2.1 time: 0.218656 Oct 28 10:07:29.239094 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1995/3975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:28 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1212 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:29.454650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:29.468654 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a1ecae8-1456-491a-9e8d-a7d104baa2a8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.481976 Oct 28 10:07:29.469870 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1981/3976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:28 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:29.612793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:29.613434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:29.625706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:29.626240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:29.627880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:29.630423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:29.632304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:29.634207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:29.997322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:29.998863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:30.052556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:30.054371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:30.055725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:30.058959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:30.060727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:30.062987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:30.296836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:30.323733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:30.332970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:30.337636 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d494ea00-8d61-4153-9007-fcbbbd37b637 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.728098 Oct 28 10:07:30.357155 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1996/3977] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:29 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:30.376811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:30.378022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:30.393719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:30.394223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:30.399161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:30.402024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:30.404407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:30.405575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:30.407620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:30.433690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3980133-8c4f-402f-a4a0-298181ab6747 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.442910 Oct 28 10:07:30.443520 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1982/3978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:29 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:30.492787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:30.493166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:30.506813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:30.509218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:30.511156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:30.511987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:30.512892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:30.513638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:30.661102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:30.677020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16fb3db9-b052-45fc-83b4-5658c3fec5d5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1264 microversion: 2.1 time: 0.316466 Oct 28 10:07:30.679682 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1997/3979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:30 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1264 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:30.851998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:30.863453 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d205079b-d1db-44d9-82d7-78faaa64c26d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.375637 Oct 28 10:07:30.869256 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1983/3980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:30 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:31.378920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:31.379813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:31.394631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:31.395089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:31.404251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:31.405424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:31.411038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:31.411798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:31.470889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:31.472319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:31.486747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:31.490002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:31.490719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:31.491786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:31.492509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:31.494310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:32.055566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:32.084247 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02f12e51-cc73-4dd7-bcb3-ea4c2119e968 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.614218 Oct 28 10:07:32.085951 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1984/3981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:31 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:32.106190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:32.107143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:32.143214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:32.145429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:32.146780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:32.150707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:32.151575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:32.155393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:32.488251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:32.506943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:32.508797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:32.510504 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8be8b9ab-ffec-4573-809a-9ee27d16bf0f tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 1.137293 Oct 28 10:07:32.511478 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1998/3982] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:31 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:32.537190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:32.539966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:32.548244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:32.549278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:32.550709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:32.551705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:32.552564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:32.553557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:32.633434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:32.642418 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0362e89f-b959-4aa8-b616-903f86038f86 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1312 microversion: 2.1 time: 0.553816 Oct 28 10:07:32.645612 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1985/3983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:32 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1312 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:32.905157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:32.934606 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50046c6b-73f9-4544-a44e-1311118328a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.400637 Oct 28 10:07:32.946476 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 1999/3984] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:32 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:33.125240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:33.126156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:33.144121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:33.145146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:33.145919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:33.146832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:33.147620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:33.148227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:33.541221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:33.543837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:33.555296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:33.557223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:33.559449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:33.561628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:33.563679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:33.565879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:33.759021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:33.779876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e224202-73de-47b2-bb05-1a075347cf18 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.670363 Oct 28 10:07:33.782753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1986/3985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:33 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:33.793117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:33.794046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:33.807712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:33.808656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:33.809362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:33.810335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:33.811028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:33.812117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.186895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:34.202597 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-abc643e0-f123-4c7e-9f0e-c5a35e500372 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.418096 Oct 28 10:07:34.208367 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1987/3986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:33 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:34.228985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:34.232108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:34.246374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.247957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.248683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.250683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.250883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.251190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.552503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:34.569033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:34.571818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:34.573662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb06e7ed-b115-4bfe-a667-ff21b106b7d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 1.037501 Oct 28 10:07:34.575389 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2000/3987] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:33 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:34.583423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:34.586232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:34.594152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:34.608849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:34.617826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.619280 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d3dc9a8-75cc-472d-bfee-c862e220f298 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.407771 Oct 28 10:07:34.620408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1988/3988] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:34 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:34.630929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.630929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.630929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.630929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.630929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.638124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a9daa428-49c8-4cb3-b0a5-e1f8f3c4a57c req-059d344a-6230-4758-b7d1-5ed9dc8fcab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ec883-ff30-424e-a2d2-fc90e4c02680", "name": "network-vif-plugged", "status": "completed", "tag": "adf1e6cf-d135-47a4-9ee6-452314fdf24e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:34.682584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a9daa428-49c8-4cb3-b0a5-e1f8f3c4a57c req-059d344a-6230-4758-b7d1-5ed9dc8fcab2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.684465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a9daa428-49c8-4cb3-b0a5-e1f8f3c4a57c req-059d344a-6230-4758-b7d1-5ed9dc8fcab2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.685152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a9daa428-49c8-4cb3-b0a5-e1f8f3c4a57c req-059d344a-6230-4758-b7d1-5ed9dc8fcab2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.714706 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a9daa428-49c8-4cb3-b0a5-e1f8f3c4a57c req-059d344a-6230-4758-b7d1-5ed9dc8fcab2 service nova] Creating event network-vif-plugged:adf1e6cf-d135-47a4-9ee6-452314fdf24e for instance e88ec883-ff30-424e-a2d2-fc90e4c02680 on n-h2-zed-1 Oct 28 10:07:34.729951 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0bd2fce-8e48-4d21-a24b-f29f3acbf3e7 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.152819 Oct 28 10:07:34.730228 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a9daa428-49c8-4cb3-b0a5-e1f8f3c4a57c req-059d344a-6230-4758-b7d1-5ed9dc8fcab2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105311 Oct 28 10:07:34.738096 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2001/3990] 10.222.0.16 () {60 vars in 1343 bytes} [Fri Oct 28 10:07:34 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1/os-volume_attachments => generated 25 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:34.738270 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1989/3990] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:34.807128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:34.807786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:34.810078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:34.811319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:34.816634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.817206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.817803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.818517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.818969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.819511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.821521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.822389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.823117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.824012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:34.824651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:34.825304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:34.876931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:07:35.009243 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71259a22-0d3f-4d28-b956-643ae9c32283 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 204 len: 0 microversion: 2.20 time: 0.205968 Oct 28 10:07:35.011047 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2002/3991] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:07:34 2022] DELETE /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:07:35.192845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1513187101", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": "none"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:35.306940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:07:35.307357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:07:35.307832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:07:35.313509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:07:35.313975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:07:35.333685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.339196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.339681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.340464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.343706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.344149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.364410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.377125 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7877c1e8-8447-42f7-aaad-f8d670d28973 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.572367 Oct 28 10:07:35.384297 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1990/3992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:34 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:35.410942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:35.411894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Getting quotas for project 94c8f3e327e8486f912d15eafc4d659b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:07:35.412862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:35.434115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.434343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Getting quotas for user cef0dc360a764184a009d87d2bec9a28 and project 94c8f3e327e8486f912d15eafc4d659b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:07:35.435019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.436071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.437979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.438973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.439581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.456867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:07:35.461746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:07:35.539228 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edc773ff-f1e3-467a-b7f8-26ea79583fb3 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.526443 Oct 28 10:07:35.543670 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2003/3993] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 10:07:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:07:35.552797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:35.556174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:35.573865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.576957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.577714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.578806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.582047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.587063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.818290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.832289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.833777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.849993 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15b4122f-f2f6-441a-924c-95bfdcc629ec tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.463663 Oct 28 10:07:35.850661 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1991/3994] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:35 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:35.861664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e63d1347-f856-428d-9aa3-822a0a24c81a tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:35.865717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e63d1347-f856-428d-9aa3-822a0a24c81a tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:35.914836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.927214 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8626c51c-35b8-4c48-9e39-bc5d6308102e tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.382411 Oct 28 10:07:35.928001 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2004/3995] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:35 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:35.932816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:35.933696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:35.940309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.941147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.941811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.942766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.943445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.944094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.950426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e63d1347-f856-428d-9aa3-822a0a24c81a tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.966947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e63d1347-f856-428d-9aa3-822a0a24c81a tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.968622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e63d1347-f856-428d-9aa3-822a0a24c81a tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:35.969907 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e63d1347-f856-428d-9aa3-822a0a24c81a tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1281 microversion: 2.47 time: 0.118333 Oct 28 10:07:35.970697 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1992/3996] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:35 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:35.976101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:35.976723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:35.984127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.985154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.985609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:35.986327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:35.986791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:35.987261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:36.318555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:36.336798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:36.338863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:36.340751 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0fab1f3-28e2-4aa2-a704-cbd76d4ec144 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.411328 Oct 28 10:07:36.341659 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2005/3997] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:35 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:36.347722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-026d52f7-eaf3-4645-a6ec-d6231bdfda51 req-755a9ea4-51c6-4029-b975-6bfe4358abca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78", "tag": "1474c824-4f93-4487-81ec-7e12bbb67a69"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:36.358510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:36.373349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-026d52f7-eaf3-4645-a6ec-d6231bdfda51 req-755a9ea4-51c6-4029-b975-6bfe4358abca service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:36.373971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-026d52f7-eaf3-4645-a6ec-d6231bdfda51 req-755a9ea4-51c6-4029-b975-6bfe4358abca service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:36.374551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-026d52f7-eaf3-4645-a6ec-d6231bdfda51 req-755a9ea4-51c6-4029-b975-6bfe4358abca service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:36.384438 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4ba2cb8-7a9b-46a6-9d6c-6387857a1d7a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1308 microversion: 2.1 time: 0.411814 Oct 28 10:07:36.390226 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-026d52f7-eaf3-4645-a6ec-d6231bdfda51 req-755a9ea4-51c6-4029-b975-6bfe4358abca service nova] Creating event network-changed:1474c824-4f93-4487-81ec-7e12bbb67a69 for instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 on n-h1-zed-1 Oct 28 10:07:36.398619 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-026d52f7-eaf3-4645-a6ec-d6231bdfda51 req-755a9ea4-51c6-4029-b975-6bfe4358abca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055205 Oct 28 10:07:36.401061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2006/3999] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:36.402590 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1993/3999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:35 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1308 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:36.422579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:36.425535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:36.457086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:36.458928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:36.459528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:36.461182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:36.462292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:36.464372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:36.764322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1417431055", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "ff75e91c-c060-4730-8173-f88286544d31"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:36.846449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] validate_networks() for [('ff75e91c-c060-4730-8173-f88286544d31', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:07:37.013430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:37.022972 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2af5714b-b423-4ad1-97ad-342430874d9c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.619015 Oct 28 10:07:37.023570 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2007/4000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:36 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:37.039449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:37.040658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:37.053563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:37.056146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:37.056776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:37.063667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:37.064524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:37.064949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:37.394592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:37.404715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:37.406219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:37.413491 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d19ac403-7f0c-4544-8755-abed5c5e57f6 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1724 microversion: 2.20 time: 0.385642 Oct 28 10:07:37.415403 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2008/4001] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:37 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1724 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:37.422222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:37.426674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:37.444489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:37.446411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:37.454832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:37.456768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:37.457601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:37.458347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.188728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.197317 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d4fce65-749d-401f-afbb-2f275037d287 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.780597 Oct 28 10:07:38.205245 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2009/4002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:37 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:38.210678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:38.211288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:38.219031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:07:38.220137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:07:38.220853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:07:38.222125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:07:38.222444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.223014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:07:38.224576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.225570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.229292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.234748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.235563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.241665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.242247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.242794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.244462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.247502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.248044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.276453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Getting quotas for project 669c6c5d2876466193ec4abce33def69. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:07:38.282696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Getting quotas for user 6b0638e280d940d1ba1f3c78c02351c0 and project 669c6c5d2876466193ec4abce33def69. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:07:38.309467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Going to run 2 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:07:38.314039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 8a67c6e9-980e-4957-aadc-dc6c1e457279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:07:38.338950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.348009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.353751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.354965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15b56b6b-9397-4306-bc9f-0ba6ba4bba93 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1339 microversion: 2.47 time: 0.148117 Oct 28 10:07:38.368931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2010/4003] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:38 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1339 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:38.374683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=8a67c6e9-980e-4957-aadc-dc6c1e457279,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:07:38.377337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:38.377499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:38.397672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.398177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.398769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.399495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.399956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.400385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.429501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:38.457562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d45abf8-ef61-423f-b0b5-ca89ce3c9901 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.880980 Oct 28 10:07:38.459266 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1994/4004] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:07:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:07:38.464488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:38.465373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:38.475558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.477054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.477723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.478850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.479869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.480505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.836728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.864621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.879608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.885660 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd1d4067-c1ba-4c04-bb54-345e3798e0ed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.525204 Oct 28 10:07:38.886428 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2011/4005] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:38 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:38.902441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:38.904318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:38.904474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:38.930566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.931292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.932101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.932424 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2fe2e56b-bfbe-434c-b351-fe1166566da8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 200 len: 1486 microversion: 2.1 time: 0.468264 Oct 28 10:07:38.933257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.933894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.934488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:38.934983 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1995/4006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:38 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 1486 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:38.950940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-207bea19-36b4-4d01-8d22-191f2c17d592 req-cdcc2f3a-28f4-49fa-bbc9-afaf791f16e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78", "tag": "600e7588-77a9-49ef-8bad-3a0dd3571716"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:38.976734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-207bea19-36b4-4d01-8d22-191f2c17d592 req-cdcc2f3a-28f4-49fa-bbc9-afaf791f16e8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:38.981971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-207bea19-36b4-4d01-8d22-191f2c17d592 req-cdcc2f3a-28f4-49fa-bbc9-afaf791f16e8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:38.985091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-207bea19-36b4-4d01-8d22-191f2c17d592 req-cdcc2f3a-28f4-49fa-bbc9-afaf791f16e8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.017539 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-207bea19-36b4-4d01-8d22-191f2c17d592 req-cdcc2f3a-28f4-49fa-bbc9-afaf791f16e8 service nova] Creating event network-changed:600e7588-77a9-49ef-8bad-3a0dd3571716 for instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 on n-h1-zed-1 Oct 28 10:07:39.026204 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-207bea19-36b4-4d01-8d22-191f2c17d592 req-cdcc2f3a-28f4-49fa-bbc9-afaf791f16e8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088490 Oct 28 10:07:39.027609 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1996/4007] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:39.035259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:39.036825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:39.047748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.048557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.049324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.050755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.051384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.052005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.282577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:39.295292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:39.301265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:39.303334 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5f2937b-fa83-4d15-a1c4-209bf04730b2 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1656 microversion: 2.20 time: 0.273915 Oct 28 10:07:39.309081 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1997/4008] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:39 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1656 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:39.318894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:39.345566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:39.346397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Searching by: {'deleted': False, 'project_id': '669c6c5d2876466193ec4abce33def69'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:07:39.371398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:39.382201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-59b2e25a-ab49-4e5a-97bc-6edc4194a08f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.487940 Oct 28 10:07:39.383040 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2012/4009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:38 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:39.411546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-921953133"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:39.418747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:39.438204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.438715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.439168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.439910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.440942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.441378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.459397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.459920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.460455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.461118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.466400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.468642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.528580 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a21c2982-3f11-47f7-9a3a-e39045886611 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.216902 Oct 28 10:07:39.529262 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1998/4010] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:07:39 2022] GET /compute/v2.1/servers => generated 677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:39.557483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:39.558592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:39.577617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:39.580164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.583296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.585851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:39.586800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:39.587463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:39.588092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.042756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.063932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63b7a6bf-7998-4550-94b2-48b2eb39de35 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.522343 Oct 28 10:07:40.068148 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 1999/4011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:39 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:40.079668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:40.081880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:40.095539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.096047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.100529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.100700 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4f5de7f5-0261-43f5-9b56-b681abaf26d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680/action" status: 202 len: 0 microversion: 2.1 time: 0.716024 Oct 28 10:07:40.101511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.102740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.103255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.116121 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2013/4012] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:07:39 2022] POST /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680/action => generated 0 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:07:40.124583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0771f8c5-0882-4aca-b720-0d049ed5bd3c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:40.127180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0771f8c5-0882-4aca-b720-0d049ed5bd3c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:40.236185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0771f8c5-0882-4aca-b720-0d049ed5bd3c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.246495 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0771f8c5-0882-4aca-b720-0d049ed5bd3c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1220 microversion: 2.1 time: 0.128555 Oct 28 10:07:40.246968 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2014/4013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:40 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1220 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:40.251356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c9913b1c-b4dd-4f78-9d37-bcf71b3078da req-38920a45-a259-4d5b-b6fd-b6f574b699a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635cb96d-039d-4c62-9784-aa89b4b879d1", "name": "network-vif-deleted", "tag": "56677974-42d3-4fca-a764-dca3e5226c74"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:40.291428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c9913b1c-b4dd-4f78-9d37-bcf71b3078da req-38920a45-a259-4d5b-b6fd-b6f574b699a7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.291922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c9913b1c-b4dd-4f78-9d37-bcf71b3078da req-38920a45-a259-4d5b-b6fd-b6f574b699a7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.292359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c9913b1c-b4dd-4f78-9d37-bcf71b3078da req-38920a45-a259-4d5b-b6fd-b6f574b699a7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.296636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.319149 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c9913b1c-b4dd-4f78-9d37-bcf71b3078da req-38920a45-a259-4d5b-b6fd-b6f574b699a7 service nova] Creating event network-vif-deleted:56677974-42d3-4fca-a764-dca3e5226c74 for instance 635cb96d-039d-4c62-9784-aa89b4b879d1 on n-h1-zed-1 Oct 28 10:07:40.327463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c9913b1c-b4dd-4f78-9d37-bcf71b3078da req-38920a45-a259-4d5b-b6fd-b6f574b699a7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078837 Oct 28 10:07:40.340999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2015/4014] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:40.350656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:40.366928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:40.372030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.384203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.384516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.385242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.388694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.391583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.392653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.394884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.396546 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10df2033-5b0e-48d9-843d-e01de79fef56 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1339 microversion: 2.47 time: 0.326701 Oct 28 10:07:40.399461 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2000/4015] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:40 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1339 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:40.416086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6df3f5d-f9a4-4bfb-93d6-14391329fd04 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32f991f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:40.501542 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6df3f5d-f9a4-4bfb-93d6-14391329fd04 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.099978 Oct 28 10:07:40.513794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2001/4016] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:40 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:40.528589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:40.535401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:40.547744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.550293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.551428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.559027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.559768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.560486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.656470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.658265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.660285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.660898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lazy-loading 'fault' on Instance uuid 635cb96d-039d-4c62-9784-aa89b4b879d1 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:07:40.824380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.877160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.890218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f864f72343c84ff4a54ef0467bf34c04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71a60b6f0d084d349f2cd19041175d4b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.892388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12ef63b3-6daf-4916-99fa-62a786050897 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 200 len: 1372 microversion: 2.20 time: 0.377065 Oct 28 10:07:40.893694 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2002/4017] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:40 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 1372 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:40.900779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:40.901779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:40.910583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.911716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.912116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.913238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:40.914615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:40.916177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:40.961107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.971201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.976858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:40.978350 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8652dd99-fa5a-4415-bdbf-7a7cec60daf0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.635834 Oct 28 10:07:40.979013 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2016/4018] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:40 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:41.089043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:41.089993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:41.097147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.101961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.103298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.103885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.104347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.104779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.311505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:41.321715 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bed2bfd4-25ca-4b8b-a72a-3fc7f7291c2b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.425680 Oct 28 10:07:41.323068 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2003/4019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:40 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:41.342990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:41.348089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:41.360530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.362820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.363636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.364867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.366132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.369193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.393813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:41.405407 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a61cb3e-deaa-47fd-bcbe-a39d14324faa tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.320138 Oct 28 10:07:41.409349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2017/4020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:41 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:41.430292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:41.430909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:41.443863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.447466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.447966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.450546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.454613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.455469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.481112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:41.495433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe9e5b08-3772-47d7-a8e7-6d9f9eb7a316 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1216 microversion: 2.1 time: 0.167068 Oct 28 10:07:41.496285 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2004/4021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:41 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:41.517170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d594212-0d4c-401d-82df-9144a5d3de3d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32fb1ca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:41.602826 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d594212-0d4c-401d-82df-9144a5d3de3d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.089436 Oct 28 10:07:41.603422 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2005/4022] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:41 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:41.605515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:41.616332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:41.617908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:41.619161 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9afbe10b-106b-4b2a-87fc-1b7d1b701f8b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1339 microversion: 2.47 time: 0.194531 Oct 28 10:07:41.619823 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2018/4023] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:41 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:41.923381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:41.924277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:41.936852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.939181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.942607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.943499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:41.944089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:41.949243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:41.968331 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] HTTP exception thrown: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Request method failure captured: Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 HTTP/1.1 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fRMSM5ASEI6EmvF59pD4BS4INOGoweBlK-75gOf0wUUfOCsGaXxHQmThsIFE5ochsGej21hlubUrWSd9JFaCWVe_XTex6Orye1ah9Pb-FuPM6Rqt_Zn_4UnPMSXoj_7am0mwvm8UWa0KUAQwgqFm5ZnOL9Qif4TAOX9Bmr-xVga9A Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71a60b6f0d084d349f2cd19041175d4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71a60b6f0d084d349f2cd19041175d4b"}]}] Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f864f72343c84ff4a54ef0467bf34c04 Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '635cb96d-039d-4c62-9784-aa89b4b879d1'} Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:41.970500 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:41.978445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:41.980642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Returning 404 to user: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:41.981901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a070bb53-1f6f-4c59-966d-78b3cf9fdbe8 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 404 len: 111 microversion: 2.20 time: 0.063493 Oct 28 10:07:41.987235 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2006/4024] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:41 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:41.992212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dbc081df-cddf-4788-a2ef-8e3d548d69be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '.version_select at 0x7fca32ae1820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:42.014337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:42.030303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:42.039142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.039661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.040151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.040853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.041379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.041825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.046679 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dbc081df-cddf-4788-a2ef-8e3d548d69be tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378745262" status: 204 len: 0 microversion: 2.20 time: 0.058641 Oct 28 10:07:42.047595 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2019/4025] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 10:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378745262 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:07:42.311538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:42.325185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:42.326870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:42.328156 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-147a43a0-14f8-4e84-ab5f-fa8e13deb8b6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.319834 Oct 28 10:07:42.329807 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2007/4026] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:42 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:42.356770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:42.357446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:42.368863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.369436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.373318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.374070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.374537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.378677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.434635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:42.438187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:42.447543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.448533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.449702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.450608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.451412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.452117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.815227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:42.823611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3894fac-b672-4e06-a97e-23d9bd6b7de9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.394206 Oct 28 10:07:42.830463 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2008/4027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:42 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:42.832789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:42.840667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:42.841567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:42.855943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.856721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.857353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.858248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:42.858682 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-65321876-7d59-4619-8c65-06625b4b915b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.512098 Oct 28 10:07:42.859062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:42.859445 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2020/4028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:42 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:42.859957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:42.882946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9f0c244-c560-439e-8742-bde90194b24f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32a958b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:42.963039 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9f0c244-c560-439e-8742-bde90194b24f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.092274 Oct 28 10:07:42.963912 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2021/4029] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:42 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:42.978590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:42.984873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:42.985762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:42.987155 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bef944a2-3af8-4072-8b7d-c36f7eeadab9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1290 microversion: 2.1 time: 0.154924 Oct 28 10:07:42.987796 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2009/4030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:42 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:43.008191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:43.019905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.020574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.021234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.022140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.024024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.024687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.224785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:43.241915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:43.245939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:43.248544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a58fe45-e070-4286-bae3-bd7d1050ffc5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1360 microversion: 2.47 time: 0.270847 Oct 28 10:07:43.256194 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2022/4031] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:42 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1360 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:43.277220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-14368334"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:43.282956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:43.295558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.297910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.300014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.301108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.307037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.307612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.361079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:43.363103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:43.383122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.385733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.386398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.387490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.389272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.390277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.601673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:43.639913 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6f81ea2d-bcb5-4123-93d4-08abd110e2ad tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "POST /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c/action" status: 202 len: 52 microversion: 2.47 time: 0.366655 Oct 28 10:07:43.642000 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2010/4032] 10.222.0.16 () {62 vars in 1319 bytes} [Fri Oct 28 10:07:43 2022] POST /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c/action => generated 52 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 28 10:07:43.661148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:43.664005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:43.676446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.677885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.679350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.680336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.681664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.682322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.728618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:07:43.936207 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fbeeb6d0-1760-4542-b2e5-8341f7aa84d9 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 204 len: 0 microversion: 2.47 time: 0.282037 Oct 28 10:07:43.940803 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2011/4033] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:07:43 2022] DELETE /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:07:43.949839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:43.951048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:43.959021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.959775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.960235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:43.961124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:43.961636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:43.962154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:44.003477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.021936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.023639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.025224 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f55455f5-431c-4576-8442-db3dcd04324d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.671460 Oct 28 10:07:44.027282 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2023/4034] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:43 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:44.040383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:44.041572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:44.057233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:44.057730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:44.058291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:44.059124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:44.059568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:44.059993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:44.203701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.216936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6fe2c629-4196-4b53-8d41-d5acd2a2aecf tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.277748 Oct 28 10:07:44.218559 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2012/4035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:43 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:44.223911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:44.225020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:44.232448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:44.233257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:44.233931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:44.234891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:44.235707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:44.236422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:44.328346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.340014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.343050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.344682 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48092d92-a421-4826-b61f-354d378b403b tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1366 microversion: 2.47 time: 0.124735 Oct 28 10:07:44.345834 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2013/4036] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:44 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:44.354470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-73ac05ff-c2a1-48ea-bd5a-29bf8143e1e2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32fb1b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:44.406565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-73ac05ff-c2a1-48ea-bd5a-29bf8143e1e2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.059269 Oct 28 10:07:44.409332 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2014/4037] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:44 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:44.414514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:44.415501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:44.422098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:44.422603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:44.423052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:44.423798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:44.424813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:44.425305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:44.491720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.500616 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55158178-3450-4e12-a0c7-8ffbdac11768 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1278 microversion: 2.1 time: 0.092458 Oct 28 10:07:44.501259 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2015/4038] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:44 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:44.562886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:44.572065 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75508e5d-375f-4c34-a2e8-d4d099552c9e tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.536788 Oct 28 10:07:44.572956 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2024/4039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:44 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:45.055786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:45.056606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:45.072064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.074742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.075226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.080256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.083199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.084893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.244640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:45.245929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:45.262119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.268480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.269816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.271556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.272844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.277759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.371761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:45.456677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:45.470761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:45.477172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:45.482722 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c31fca33-57f4-4b29-981f-b41ee36549a0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.430948 Oct 28 10:07:45.483803 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2016/4040] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:45 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:45.496980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:45.498345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:45.508678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.513674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.514381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.515315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.515958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.516601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.688692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:45.699810 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-325c1e82-5fe4-4c28-bdfd-f2cfd2e14903 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.458993 Oct 28 10:07:45.723291 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2025/4041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:45 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:45.728627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-017c1a08-ef88-49cc-9112-9d4966da3495 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca329de4c0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:45.766713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:45.788303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:45.790336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:45.791746 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a51f5996-57b9-40e5-93e3-f9f8a2c5f031 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1366 microversion: 2.47 time: 0.306738 Oct 28 10:07:45.805919 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-017c1a08-ef88-49cc-9112-9d4966da3495 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.065976 Oct 28 10:07:45.805919 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2026/4042] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:45 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:45.813133 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2017/4043] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:45 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:45.818862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:45.822296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:45.822945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:45.823896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:45.830195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.831650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.832269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.833518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.834242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.834951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.839430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.841215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.841695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:45.844331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:45.845483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:45.858629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:46.068800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:46.079113 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea9d6761-b076-439a-aed8-a428f929bd1d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.264562 Oct 28 10:07:46.083545 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2018/4044] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:45 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:46.335911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:46.344654 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-260c1627-400e-42b0-bb70-8172f5a4c758 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.541125 Oct 28 10:07:46.351176 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2027/4045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:45 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:46.514564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:46.515190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:46.526881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4483ca9b-011d-4422-a484-f8883254ffdd req-9759ce9e-2979-41b1-80ef-cb7e6f6607ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c9901f-4f12-4d73-8021-65547c1d5a78", "tag": "f65af217-bea9-4c0c-bfcb-47d7c234e290"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:46.532863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:46.534073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:46.534546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:46.535305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:46.535753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:46.536192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:46.569517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4483ca9b-011d-4422-a484-f8883254ffdd req-9759ce9e-2979-41b1-80ef-cb7e6f6607ba service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:46.574516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4483ca9b-011d-4422-a484-f8883254ffdd req-9759ce9e-2979-41b1-80ef-cb7e6f6607ba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:46.576527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4483ca9b-011d-4422-a484-f8883254ffdd req-9759ce9e-2979-41b1-80ef-cb7e6f6607ba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:46.619457 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4483ca9b-011d-4422-a484-f8883254ffdd req-9759ce9e-2979-41b1-80ef-cb7e6f6607ba service nova] Creating event network-changed:f65af217-bea9-4c0c-bfcb-47d7c234e290 for instance e2c9901f-4f12-4d73-8021-65547c1d5a78 on n-h1-zed-1 Oct 28 10:07:46.636727 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4483ca9b-011d-4422-a484-f8883254ffdd req-9759ce9e-2979-41b1-80ef-cb7e6f6607ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117890 Oct 28 10:07:46.638704 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2028/4046] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:46.731405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:46.733904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:46.762560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:46.765015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:46.765470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:46.766201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:46.766654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:46.775133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.000191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.016641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.021074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.022521 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1bcc5c3a-e0f0-42cd-bf65-94ae638524cc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.512110 Oct 28 10:07:47.026835 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2019/4047] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:46 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:47.038944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e698eb6d-9909-401e-b67b-ccc7fbc9bb3b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32fb85e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:47.131543 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e698eb6d-9909-401e-b67b-ccc7fbc9bb3b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.103388 Oct 28 10:07:47.132863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2020/4048] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:47 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:47.145153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:47.145783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:47.164304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.164835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.172338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.173727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.174767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.175223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.177265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.197908 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e27d24bf-c6d5-48a2-80e9-d9b4436e9b76 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.470686 Oct 28 10:07:47.220452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2029/4049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:46 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:47.237445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:47.243455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:47.255138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.259012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.260324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.263504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.264269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.266554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.435588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.472232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.474078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.483754 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d63b572f-9f29-45ec-abc4-e925802755f5 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1366 microversion: 2.47 time: 0.349086 Oct 28 10:07:47.485634 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2021/4050] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:47 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1366 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:47.492601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:47.505866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:47.531767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.536374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.537625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.539770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.540415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.541709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.593880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] HTTP exception thrown: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Request method failure captured: Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 HTTP/1.1 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fRMSM5ASEI6EmvF59pD4BS4INOGoweBlK-75gOf0wUUfOCsGaXxHQmThsIFE5ochsGej21hlubUrWSd9JFaCWVe_XTex6Orye1ah9Pb-FuPM6Rqt_Zn_4UnPMSXoj_7am0mwvm8UWa0KUAQwgqFm5ZnOL9Qif4TAOX9Bmr-xVga9A Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71a60b6f0d084d349f2cd19041175d4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71a60b6f0d084d349f2cd19041175d4b"}]}] Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f864f72343c84ff4a54ef0467bf34c04 Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '635cb96d-039d-4c62-9784-aa89b4b879d1'} Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:47.599008 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.604595 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.616193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Returning 404 to user: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:47.620312 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff5feeea-fcba-4a54-b274-275b2e593bbf tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 404 len: 111 microversion: 2.20 time: 0.131515 Oct 28 10:07:47.628676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2022/4051] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:07:47 2022] DELETE /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:47.633647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:47.634262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:47.647141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.657685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.659057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.660049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.660756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.661450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.895168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.903591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:47.906069 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ccffedf-93af-4c2b-998d-92e66de0b534 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.683105 Oct 28 10:07:47.914826 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-79213ebb-c2ae-42e5-a788-92b1ea8f1bc1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.284953 Oct 28 10:07:47.915729 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2023/4052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:47 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:47.925597 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2030/4053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:47 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:47.929286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:47.930163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: 635cb96d-039d-4c62-9784-aa89b4b879d1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:47.941614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.942225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.942769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.943676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:47.944597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:47.946270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:47.978145 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] HTTP exception thrown: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Request method failure captured: Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 HTTP/1.1 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6fRMSM5ASEI6EmvF59pD4BS4INOGoweBlK-75gOf0wUUfOCsGaXxHQmThsIFE5ochsGej21hlubUrWSd9JFaCWVe_XTex6Orye1ah9Pb-FuPM6Rqt_Zn_4UnPMSXoj_7am0mwvm8UWa0KUAQwgqFm5ZnOL9Qif4TAOX9Bmr-xVga9A Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71a60b6f0d084d349f2cd19041175d4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71a60b6f0d084d349f2cd19041175d4b"}]}] Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f864f72343c84ff4a54ef0467bf34c04 Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '635cb96d-039d-4c62-9784-aa89b4b879d1'} Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.985288 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Returning 404 to user: Instance 635cb96d-039d-4c62-9784-aa89b4b879d1 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b7b32c8-1d31-4876-83fa-b466ecfab627 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1" status: 404 len: 111 microversion: 2.20 time: 0.070185 Oct 28 10:07:47.990648 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2024/4054] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:47 2022] GET /compute/v2.1/servers/635cb96d-039d-4c62-9784-aa89b4b879d1 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:48.053258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:48.054212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:48.080733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.081480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.082941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.084012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.084649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.085275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.148593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-71c92608-0352-4064-b836-5e6a061fda20 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3309b9d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:48.305744 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-71c92608-0352-4064-b836-5e6a061fda20 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.161273 Oct 28 10:07:48.309819 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2025/4055] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:48 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:48.317866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-dc646a5b-beb0-40b8-ad0a-47cb2dcd4380 req-9ae48f62-4a75-4308-bda6-ea41863cab44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a67c6e9-980e-4957-aadc-dc6c1e457279", "tag": "d8ef5135-fa60-4e41-8d6b-09420c2a4bbd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:48.344201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:48.354666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dc646a5b-beb0-40b8-ad0a-47cb2dcd4380 req-9ae48f62-4a75-4308-bda6-ea41863cab44 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.355272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dc646a5b-beb0-40b8-ad0a-47cb2dcd4380 req-9ae48f62-4a75-4308-bda6-ea41863cab44 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.355724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dc646a5b-beb0-40b8-ad0a-47cb2dcd4380 req-9ae48f62-4a75-4308-bda6-ea41863cab44 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.394567 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-dc646a5b-beb0-40b8-ad0a-47cb2dcd4380 req-9ae48f62-4a75-4308-bda6-ea41863cab44 service nova] Creating event network-changed:d8ef5135-fa60-4e41-8d6b-09420c2a4bbd for instance 8a67c6e9-980e-4957-aadc-dc6c1e457279 on n-h2-zed-1 Oct 28 10:07:48.412112 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-dc646a5b-beb0-40b8-ad0a-47cb2dcd4380 req-9ae48f62-4a75-4308-bda6-ea41863cab44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100220 Oct 28 10:07:48.412729 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2026/4056] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:48.439375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:48.443727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:48.459016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.461681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.463338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.464353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.467236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.482068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.575326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:48.601815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:48.608615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:48.613237 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a341e4b-add5-4247-98b2-eabad33848ec tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.563932 Oct 28 10:07:48.618549 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2031/4057] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:48 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:48.633066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e22a1f19-4a88-46e4-82ec-d301c0829a63 req-ab4e0068-8d5d-484f-9429-9f992ede073a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-plugged", "status": "completed", "tag": "18e409a1-6b35-42f6-a1c4-c5876cdcbabe"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:48.663212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e22a1f19-4a88-46e4-82ec-d301c0829a63 req-ab4e0068-8d5d-484f-9429-9f992ede073a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.676642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e22a1f19-4a88-46e4-82ec-d301c0829a63 req-ab4e0068-8d5d-484f-9429-9f992ede073a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.677146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e22a1f19-4a88-46e4-82ec-d301c0829a63 req-ab4e0068-8d5d-484f-9429-9f992ede073a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.686376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:48.713404 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e22a1f19-4a88-46e4-82ec-d301c0829a63 req-ab4e0068-8d5d-484f-9429-9f992ede073a service nova] Creating event network-vif-plugged:18e409a1-6b35-42f6-a1c4-c5876cdcbabe for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:48.722965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e22a1f19-4a88-46e4-82ec-d301c0829a63 req-ab4e0068-8d5d-484f-9429-9f992ede073a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102858 Oct 28 10:07:48.725703 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2032/4058] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:48.737330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:48.741299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:48.758914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.762432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.763051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.764710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.765837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.766455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.812712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:48.821464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83546273-cdaf-465a-bffa-7a3befc20fb9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.400883 Oct 28 10:07:48.822576 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2027/4059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:48 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:48.860308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:48.869175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:48.870614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:48.871755 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f04f4dc-a1cc-4a88-a164-fd52924fe0ee tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1366 microversion: 2.47 time: 0.140025 Oct 28 10:07:48.872715 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2033/4060] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:48 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1366 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:48.931406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:48.932031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:48.938444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:48.939977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:48.943441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.944937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.945600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.947654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.948413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.949175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.950982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.951604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.952134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:48.952957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:48.953750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:48.954429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:49.220001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:49.228866 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7327d8f9-7f2f-4359-8481-518fb52220d2 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.294560 Oct 28 10:07:49.235777 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2034/4061] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:48 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:49.245129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:49.259252 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0bb59f4-27a7-4e12-b9b3-035ee8d16304 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.330373 Oct 28 10:07:49.277878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2028/4062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:48 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:49.324023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-26f7cbda-5c4a-478e-841b-ed2a50d4f0ed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca328d6f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:49.399454 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-26f7cbda-5c4a-478e-841b-ed2a50d4f0ed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.079614 Oct 28 10:07:49.400269 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2035/4063] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:49 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:49.650107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:49.650748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:49.652838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:49.662917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:49.665619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:49.666202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:49.669834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:49.670639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:49.671283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:49.845847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:49.846845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:49.861289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:49.862202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:49.863053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:49.864023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:49.864737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:49.867518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:49.971846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:49.982644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:49.985756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:49.987894 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e09d47a0-4c83-4978-9f8f-1be6acf9618e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.342148 Oct 28 10:07:50.006323 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2029/4064] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:49 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:50.018442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:50.019536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:50.029188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:50.030116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:50.030636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:50.031752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:50.032064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:50.032567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:50.036133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:50.106944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:50.116373 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-20ce7c58-5cbb-4978-a761-ef2df8d1f493 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.276299 Oct 28 10:07:50.117533 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2036/4065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:49 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:50.129818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:50.139245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:50.141092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:50.142014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d6667d9-86cb-4ae6-b177-01e7c940261d tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1366 microversion: 2.47 time: 0.133531 Oct 28 10:07:50.142573 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2030/4066] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:50 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1366 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:50.259991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:50.262164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:50.267341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:50.273467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:50.273985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:50.274422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:50.275296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:50.275638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:50.276794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:50.289873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:50.290766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:50.305767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:50.306264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:50.306703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:50.307404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:50.307862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:50.308423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:50.482268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:50.493513 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b23aa9a-e072-401f-8e21-5b9fcc3ff58d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.238066 Oct 28 10:07:50.494596 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2037/4067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:50 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:50.500107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f04e2c6d-e028-46c8-be0b-3e779c800aaf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32915ca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:50.515523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:50.528988 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed28c7f4-a469-48b7-82fd-27af738cf241 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.243515 Oct 28 10:07:50.530021 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2031/4068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:50 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:50.550015 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f04e2c6d-e028-46c8-be0b-3e779c800aaf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.054309 Oct 28 10:07:50.550758 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2038/4069] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:50 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:50.741498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0aeca3d7-04d5-4d89-9970-b9981d43e474 req-3156fd8d-8476-45af-9fef-4c6b4db168f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ec883-ff30-424e-a2d2-fc90e4c02680", "name": "network-vif-plugged", "status": "completed", "tag": "adf1e6cf-d135-47a4-9ee6-452314fdf24e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:50.751454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0aeca3d7-04d5-4d89-9970-b9981d43e474 req-3156fd8d-8476-45af-9fef-4c6b4db168f1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:50.752031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0aeca3d7-04d5-4d89-9970-b9981d43e474 req-3156fd8d-8476-45af-9fef-4c6b4db168f1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:50.752630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0aeca3d7-04d5-4d89-9970-b9981d43e474 req-3156fd8d-8476-45af-9fef-4c6b4db168f1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:50.775936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0aeca3d7-04d5-4d89-9970-b9981d43e474 req-3156fd8d-8476-45af-9fef-4c6b4db168f1 service nova] Creating event network-vif-plugged:adf1e6cf-d135-47a4-9ee6-452314fdf24e for instance e88ec883-ff30-424e-a2d2-fc90e4c02680 on n-h2-zed-1 Oct 28 10:07:50.781243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0aeca3d7-04d5-4d89-9970-b9981d43e474 req-3156fd8d-8476-45af-9fef-4c6b4db168f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043210 Oct 28 10:07:50.782116 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2032/4070] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:51.015607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:51.016381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:51.023216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.023805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.024337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.025335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.025709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.026246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.140502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:51.141455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:51.149779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.150451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.151256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.152118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.152743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.153509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.272234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.286054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.287913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.290007 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d2e901d-fbb3-43ba-a6d5-a3b7e3ed4279 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.278331 Oct 28 10:07:51.290682 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2039/4071] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:51 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:51.296521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:51.297422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:51.303868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.304637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.305336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.306379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.307087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.307748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.350643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.362759 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f832c9c1-ce0b-4207-a051-ce89ab4df5ff tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.226370 Oct 28 10:07:51.368109 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2033/4072] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:51 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:51.402393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.413728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.416652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.421715 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d94797b3-bf82-4d5d-9c1f-9af99b279601 tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1366 microversion: 2.47 time: 0.129537 Oct 28 10:07:51.425654 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2040/4073] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:51 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:51.518420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:51.519168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:51.526433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.527236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.527791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.528616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.529216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.529758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.554783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:51.555415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:51.563389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.564005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.565079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.565810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:51.566275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:51.566709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:51.715629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.726816 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a085d97c-31f9-4d92-9f02-07233cfdf89e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.213049 Oct 28 10:07:51.727603 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2034/4074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:51 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:51.740534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:51.749145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b239538d-2135-4655-a3a6-7fc28c01da6b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3313aa60>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:51.749450 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f59ad10-5266-4038-91b3-d9959d15d112 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.198316 Oct 28 10:07:51.750570 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2041/4075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:51 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:51.812066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b239538d-2135-4655-a3a6-7fc28c01da6b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.073556 Oct 28 10:07:51.813829 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2035/4076] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:51 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:52.318299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:52.319370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:52.337622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.338314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.338931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.339923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.340597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.341227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.398210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:52.399507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:52.420119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.420979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.421975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.424752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.425313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.426734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.694876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:52.706240 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e63ee4c8-f1da-4a02-b11f-be0a53bb93ad tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.314087 Oct 28 10:07:52.717880 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2036/4077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:52 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:52.728236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:52.728874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:52.735112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.735600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.736050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.738037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.738787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.739423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.809196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.809966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.811295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.811939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lazy-loading 'fault' on Instance uuid 2d636ca2-3c5e-43bc-a276-35ec2b89958c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:07:52.892572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:52.905830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:52.907297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:52.908768 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0956c3a-424b-45eb-b75b-9e80b521d51e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.594737 Oct 28 10:07:52.919634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:52.937509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:52.939185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2042/4078] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:52 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:52.939939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cef0dc360a764184a009d87d2bec9a28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c8f3e327e8486f912d15eafc4d659b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:52.941418 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c204a80d-4664-4df9-9ed8-5b7f396ad54f tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 200 len: 1371 microversion: 2.47 time: 0.222282 Oct 28 10:07:52.952199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:52.956999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:52.957440 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2037/4079] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:52 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:52.970427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:52.971067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:52.974745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.977593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.978000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.978650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.978890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.979109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.980533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.981062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.981391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:52.981517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:52.982722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:52.984260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.043266 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] HTTP exception thrown: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Request method failure captured: Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 HTTP/1.1 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6fRMSM5ASEI6EmvF59pD4BS4INOGoweBlK-75gOf0wUUfOCsGaXxHQmThsIFE5ochsGej21hlubUrWSd9JFaCWVe_XTex6Orye1ah9Pb-FuPM6Rqt_Zn_4UnPMSXoj_7am0mwvm8UWa0KUAQwgqFm5ZnOL9Qif4TAOX9Bmr-xVga9A Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71a60b6f0d084d349f2cd19041175d4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71a60b6f0d084d349f2cd19041175d4b"}]}] Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f864f72343c84ff4a54ef0467bf34c04 Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f7831b2e-dc40-4e1b-981b-94cb7d1736f0'} Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:53.046738 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.054661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Returning 404 to user: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:53.059605 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-91fb0866-f858-4a14-9032-5fd27d6da596 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 404 len: 111 microversion: 2.20 time: 0.113700 Oct 28 10:07:53.060919 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2043/4080] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:07:52 2022] DELETE /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:53.093936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:53.098452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:53.124357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.125040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.126298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.130140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.131726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.134875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.324873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:53.342123 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0df9e688-113f-40f8-b25a-f4ce9ff22c74 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.375169 Oct 28 10:07:53.343438 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2038/4081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:52 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:53.348430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-104912ca-376e-4d3a-ac32-a2b4b2f5ba61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca33269b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:53.480841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:53.496134 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07681a2f-d412-4759-9de4-7777f3f6784c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.428326 Oct 28 10:07:53.497455 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2044/4082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:53 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:53.510146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:53.510773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] [instance: f7831b2e-dc40-4e1b-981b-94cb7d1736f0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:53.527865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.528633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.529239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.529965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.530444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.530882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.564979 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] HTTP exception thrown: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.587245 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-104912ca-376e-4d3a-ac32-a2b4b2f5ba61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.242440 Oct 28 10:07:53.588716 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2039/4083] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:53 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:53.595222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-57787e57-8ec0-441c-8c68-84335fa836b9 req-102c5aa9-dc53-4cb3-83bf-07e26969ead4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-plugged", "status": "completed", "tag": "89219c1b-a412-4b80-8647-05f0b7c942a2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:53.608336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-57787e57-8ec0-441c-8c68-84335fa836b9 req-102c5aa9-dc53-4cb3-83bf-07e26969ead4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.609302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-57787e57-8ec0-441c-8c68-84335fa836b9 req-102c5aa9-dc53-4cb3-83bf-07e26969ead4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.609997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-57787e57-8ec0-441c-8c68-84335fa836b9 req-102c5aa9-dc53-4cb3-83bf-07e26969ead4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Request method failure captured: Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 HTTP/1.1 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6fRMSM5ASEI6EmvF59pD4BS4INOGoweBlK-75gOf0wUUfOCsGaXxHQmThsIFE5ochsGej21hlubUrWSd9JFaCWVe_XTex6Orye1ah9Pb-FuPM6Rqt_Zn_4UnPMSXoj_7am0mwvm8UWa0KUAQwgqFm5ZnOL9Qif4TAOX9Bmr-xVga9A Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.20 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/71a60b6f0d084d349f2cd19041175d4b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_71a60b6f0d084d349f2cd19041175d4b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/71a60b6f0d084d349f2cd19041175d4b"}]}] Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 71a60b6f0d084d349f2cd19041175d4b Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-106984543 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f864f72343c84ff4a54ef0467bf34c04 Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeShelveTestJSON-106984543-project Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f7831b2e-dc40-4e1b-981b-94cb7d1736f0'} Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.611088 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] Returning 404 to user: Instance f7831b2e-dc40-4e1b-981b-94cb7d1736f0 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17faba71-259c-4c1c-80d6-fc1a29e507a0 tempest-AttachVolumeShelveTestJSON-106984543 tempest-AttachVolumeShelveTestJSON-106984543-project] 10.222.0.16 "GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0" status: 404 len: 111 microversion: 2.20 time: 0.114515 Oct 28 10:07:53.616286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2045/4084] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:53 2022] GET /compute/v2.1/servers/f7831b2e-dc40-4e1b-981b-94cb7d1736f0 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:53.640935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-57787e57-8ec0-441c-8c68-84335fa836b9 req-102c5aa9-dc53-4cb3-83bf-07e26969ead4 service nova] Creating event network-vif-plugged:89219c1b-a412-4b80-8647-05f0b7c942a2 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:53.648237 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-57787e57-8ec0-441c-8c68-84335fa836b9 req-102c5aa9-dc53-4cb3-83bf-07e26969ead4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056699 Oct 28 10:07:53.649480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2040/4085] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:53.731863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:53.732480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:53.739449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.742798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.745890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.746649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.747752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.748380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.939089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:53.940154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:53.953409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.954174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.954798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.956263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:53.956923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:53.962032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:53.964729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:53.976059 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c93dfb6-8da7-4873-9561-60bee6c0667f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.247962 Oct 28 10:07:53.976985 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2046/4086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:53 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:53.987103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:53.989741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] [instance: 2d636ca2-3c5e-43bc-a276-35ec2b89958c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:54.002723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:54.009577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:54.010336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:54.011310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:54.012035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:54.012700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:54.044080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] HTTP exception thrown: Instance 2d636ca2-3c5e-43bc-a276-35ec2b89958c could not be found. Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Request method failure captured: Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c HTTP/1.1 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6nm633jcQQGpXutr7EqYdH7cwjaDIzka11g2oIPl39n6twTmKEdGoYeP7eECLprSJibpGiQ-mL2t5siwPsJ1xAzTELPKxdn2LD-v2jzAdEzo3zE5Dy46f9IeXVg_-P2tciDEGmfMpYHM-A7i-g4A_6q21xo1zFa54-zls8ObgfdP4c Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.47 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 94c8f3e327e8486f912d15eafc4d659b Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersAaction247Test-247739197 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94c8f3e327e8486f912d15eafc4d659b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94c8f3e327e8486f912d15eafc4d659b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94c8f3e327e8486f912d15eafc4d659b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94c8f3e327e8486f912d15eafc4d659b"}]}] Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersAaction247Test-247739197 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 94c8f3e327e8486f912d15eafc4d659b Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersAaction247Test-247739197 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersAaction247Test-247739197-project Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: cef0dc360a764184a009d87d2bec9a28 Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersAaction247Test-247739197-project Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 2d636ca2-3c5e-43bc-a276-35ec2b89958c could not be found. Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2d636ca2-3c5e-43bc-a276-35ec2b89958c'} Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d636ca2-3c5e-43bc-a276-35ec2b89958c could not be found. Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d636ca2-3c5e-43bc-a276-35ec2b89958c could not be found. Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:07:54.046119 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:54.050979 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:07:54.050979 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:07:54.050979 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:07:54.050979 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:07:54.050979 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:07:54.050979 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d636ca2-3c5e-43bc-a276-35ec2b89958c could not be found. Oct 28 10:07:54.050979 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:07:54.059723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] Returning 404 to user: Instance 2d636ca2-3c5e-43bc-a276-35ec2b89958c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:07:54.060741 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5df32b0-be0e-4fbd-8212-396fdf3a2ced tempest-ServersAaction247Test-247739197 tempest-ServersAaction247Test-247739197-project] 10.222.0.16 "GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c" status: 404 len: 111 microversion: 2.47 time: 0.080013 Oct 28 10:07:54.061456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2047/4087] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:53 2022] GET /compute/v2.1/servers/2d636ca2-3c5e-43bc-a276-35ec2b89958c => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:07:54.355868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:54.368063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:54.369987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:54.383927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:54.387885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:54.391009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:54.392690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:54.395151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:54.396193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:54.397143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:54.398357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:54.404584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d587dd0-7ec7-43cf-8c62-4f3286abdd40 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.466526 Oct 28 10:07:54.407790 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2041/4088] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:53 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:07:54.524004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:54.524891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:54.559049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:54.560978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:54.561637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:54.562895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:54.563626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:54.564359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:54.771629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:54.786152 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7138ca99-e140-4a0f-a441-09065b9bae55 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.422042 Oct 28 10:07:54.787718 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2048/4089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:54 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:54.796318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cab97061-26cf-44fe-af16-925b1feba566 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca329edaf0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:54.883661 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cab97061-26cf-44fe-af16-925b1feba566 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.092351 Oct 28 10:07:54.884518 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2049/4090] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:54 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:55.001528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:55.003391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:55.014822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:55.015853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:55.016552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:55.018169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:55.021533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:55.022279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:55.058872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:55.069441 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-43b517c8-b084-48a2-9716-d5daeda18e01 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.549845 Oct 28 10:07:55.073399 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2042/4091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:54 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:55.249015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:55.259282 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5dbf40bc-ea9c-4203-9802-b4bc12f526be tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.260636 Oct 28 10:07:55.259977 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2050/4092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:54 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:55.434608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:55.435293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:55.447200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:55.447790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:55.448548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:55.449468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:55.451433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:55.452954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:55.738876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-plugged", "status": "completed", "tag": "a0323752-f69f-4f04-a247-644f13d40fbb"}, {"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-plugged", "status": "completed", "tag": "86e41076-3452-446c-a9c1-83159521c6f4"}, {"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-plugged", "status": "completed", "tag": "756d6a72-fb3d-4304-b156-82f6ea73f4be"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:55.760602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:55.763292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:55.763781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:55.791453 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] Creating event network-vif-plugged:a0323752-f69f-4f04-a247-644f13d40fbb for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:55.792864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] Creating event network-vif-plugged:86e41076-3452-446c-a9c1-83159521c6f4 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:55.794761 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] Creating event network-vif-plugged:756d6a72-fb3d-4304-b156-82f6ea73f4be for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:55.802209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-aa8d3061-8630-40bf-b708-71e876978b52 req-e92e6eef-1161-415b-a881-702f3f3f5331 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.068747 Oct 28 10:07:55.803304 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2051/4093] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:07:55.813932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:55.815217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:55.822423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:55.823183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:55.823834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:55.824741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:55.825467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:55.826070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:56.057422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:56.069769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d0f2178-6c82-4c32-96ca-5a73d3d1c4c3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.260464 Oct 28 10:07:56.070402 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2052/4094] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:55 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:56.088983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-599280dd-ef5f-400b-b9a0-88226d00e3c8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca329ca8b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:56.154823 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-599280dd-ef5f-400b-b9a0-88226d00e3c8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.080738 Oct 28 10:07:56.155604 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2053/4095] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:56 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:56.170461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:56.171299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:56.179340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:56.180266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:56.182285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:56.184265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:56.185690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:56.186543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:56.318480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:56.328721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:56.337546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:56.340522 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e93162d-0456-495b-9a6e-3dfbea20b193 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.910290 Oct 28 10:07:56.345194 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2043/4096] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:55 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:56.359662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:56.360650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:56.384701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:56.385793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:56.386507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:56.389580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:56.391676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:56.393593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:56.527995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:56.536660 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-877e9631-373e-4e35-b7f5-6bad63112324 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.371154 Oct 28 10:07:56.545411 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2054/4097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:56 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:56.800300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:56.809338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07520c1f-98fc-40c9-b8f2-d149eee98f1f tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.462240 Oct 28 10:07:56.809934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2044/4098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:56 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:57.094340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:57.094955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:57.107541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:57.107828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:57.108704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:57.109700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:57.112170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:57.112862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:57.172682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cd8de5f7-6dd0-41c6-9fb4-01296efac393 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca33ab11f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:57.290018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cd8de5f7-6dd0-41c6-9fb4-01296efac393 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.122280 Oct 28 10:07:57.292412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2045/4099] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:57 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:57.379806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:57.380936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:57.396769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:57.399956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:57.400831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:57.409802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:57.410703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:57.412208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:57.454097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:57.463470 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7dd9312c-fe68-4cdb-92c0-84e026669d0b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.372846 Oct 28 10:07:57.466938 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2055/4100] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:57 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:57.570791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:57.572100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:57.580996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:57.582311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:57.583058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:57.584297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:57.585184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:57.586035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:57.594980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:07:57.944441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:57.960327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5766a093-2251-4cbd-9bfd-a494fa034f00 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1511 microversion: 2.1 time: 0.386030 Oct 28 10:07:57.964513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2056/4101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:57 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:57.987713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:57.991731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:58.022155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:58.022661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:58.023327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:58.024151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:58.024622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:58.025088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:58.093614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:58.110725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:58.113107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:58.116279 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-654ac2c2-77f2-4117-9257-c9181b62f697 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.748865 Oct 28 10:07:58.119976 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2046/4102] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:57 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:58.159631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-plugged", "status": "completed", "tag": "50de4fb9-66ad-443a-b871-23446c4f34a8"}, {"server_uuid": "ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78", "name": "network-vif-plugged", "status": "completed", "tag": "600e7588-77a9-49ef-8bad-3a0dd3571716"}, {"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-plugged", "status": "completed", "tag": "f2bdd9a1-fd0b-40e6-b878-461476842b57"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:07:58.180191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:58.182618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:58.185520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:58.217529 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] Creating event network-vif-plugged:50de4fb9-66ad-443a-b871-23446c4f34a8 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:58.218046 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] Creating event network-vif-plugged:600e7588-77a9-49ef-8bad-3a0dd3571716 for instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 on n-h1-zed-1 Oct 28 10:07:58.222079 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] Creating event network-vif-plugged:f2bdd9a1-fd0b-40e6-b878-461476842b57 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:07:58.237967 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e526ea2a-535b-4ea4-90b1-6d338cbb57d5 req-f52abbec-0111-42c7-8241-cdb1cfaae36e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.116400 Oct 28 10:07:58.243577 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2047/4103] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:07:58.299795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:58.308260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ba8ba38-4459-42b1-90b7-c34f1fb13d25 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca33863790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:58.328444 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2da7ac31-274b-4283-99c0-66a372c188b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.359672 Oct 28 10:07:58.332943 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2057/4104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:57 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:58.382924 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ba8ba38-4459-42b1-90b7-c34f1fb13d25 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.078939 Oct 28 10:07:58.384215 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2048/4105] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:58 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:07:58.492060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:58.493399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:58.502386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:58.504459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:58.505945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:58.508037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:58.509902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:58.511502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:58.989417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:58.990417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:59.003556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.005915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.007763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.009887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.010579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.011892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.126309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:59.135913 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2889a1a-8980-4b63-bbb2-79b67660e044 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.648007 Oct 28 10:07:59.143100 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2058/4106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:58 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:59.160060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:59.160949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:59.167951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.172737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.174425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.179912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.180158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.180600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.567015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:59.585512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:59.602077 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-67a947d9-c575-498c-8f04-7869c342d0a9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1488 microversion: 2.1 time: 0.617633 Oct 28 10:07:59.620181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:59.620856 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2049/4107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:58 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1488 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:59.628343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:07:59.634402 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e224df3f-a8f1-4645-bf6b-8bc219f4a963 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1880 microversion: 2.32 time: 0.486701 Oct 28 10:07:59.635285 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2059/4108] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:07:59 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1880 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:07:59.637011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:59.640860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:59.657423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85153684-9af7-4c5e-8dff-3e5fd0a637ab tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32915280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:59.662159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.662912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.666812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.668939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.669613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.670221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.730567 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85153684-9af7-4c5e-8dff-3e5fd0a637ab tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.093618 Oct 28 10:07:59.740205 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2060/4109] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:07:59 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:07:59.740205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:59.740205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:59.746963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.747466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.747906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.748617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.749199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.749625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.787095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:07:59.898389 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-79c6f88b-1d86-4957-9adb-30ccd6363907 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 204 len: 0 microversion: 2.1 time: 0.163709 Oct 28 10:07:59.899893 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2061/4110] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:07:59 2022] DELETE /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:07:59.911493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:07:59.912211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:07:59.919588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.920378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.921055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:07:59.921970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:07:59.922608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:07:59.923232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:00.080591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:00.086127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:00.091549 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-33583a9c-23ee-4fd2-afe8-c0f5c4600944 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1494 microversion: 2.1 time: 0.186419 Oct 28 10:08:00.092935 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2062/4111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:59 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1494 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:00.102023 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1abd7503-9bda-4003-8414-e365b1affab3 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.477528 Oct 28 10:08:00.103073 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2050/4112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:07:59 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:00.166746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:00.167358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:00.184622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:00.185416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:00.186065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:00.187247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:00.187886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:00.188496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:00.278283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78", "name": "network-vif-plugged", "status": "completed", "tag": "1474c824-4f93-4487-81ec-7e12bbb67a69"}, {"server_uuid": "8a67c6e9-980e-4957-aadc-dc6c1e457279", "name": "network-vif-plugged", "status": "completed", "tag": "d8ef5135-fa60-4e41-8d6b-09420c2a4bbd"}, {"server_uuid": "e2c9901f-4f12-4d73-8021-65547c1d5a78", "name": "network-vif-plugged", "status": "completed", "tag": "f65af217-bea9-4c0c-bfcb-47d7c234e290"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:00.300981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:00.301750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:00.302335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:00.337811 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] Creating event network-vif-plugged:1474c824-4f93-4487-81ec-7e12bbb67a69 for instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 on n-h1-zed-1 Oct 28 10:08:00.338584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] Creating event network-vif-plugged:d8ef5135-fa60-4e41-8d6b-09420c2a4bbd for instance 8a67c6e9-980e-4957-aadc-dc6c1e457279 on n-h2-zed-1 Oct 28 10:08:00.339311 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] Creating event network-vif-plugged:f65af217-bea9-4c0c-bfcb-47d7c234e290 for instance e2c9901f-4f12-4d73-8021-65547c1d5a78 on n-h1-zed-1 Oct 28 10:08:00.358261 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c241bf27-c8ca-46fd-b39d-ee5f55661b13 req-885c4a46-9b6f-43e8-a482-27569ecd7c6d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.086656 Oct 28 10:08:00.361441 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2051/4113] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:00.457211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:00.483966 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8b5683e-21e0-4b43-9e52-851f9202933c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.319655 Oct 28 10:08:00.487828 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2063/4114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:00 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:00.663421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:00.664146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:00.691908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:00.692433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:00.692891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:00.693649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:00.694164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:00.694580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:00.752917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a1dd40df-5daf-4344-a4af-b11611d9e324 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca328ced30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:00.822524 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a1dd40df-5daf-4344-a4af-b11611d9e324 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.077728 Oct 28 10:08:00.830466 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2064/4115] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:00 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:01.080327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:01.093660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:01.096172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:01.097761 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-205a811b-62de-44b1-b9b3-64e87aa88f68 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2833 microversion: 2.32 time: 0.440214 Oct 28 10:08:01.098915 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2052/4116] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:08:00 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2833 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:08:01.129471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:01.130346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:01.138126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:01.138657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:01.149802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.150789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.151286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:01.152358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.188204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.188790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:01.190353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:01.192594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.193264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.193748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:01.212029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.215746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.216984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:01.245668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:01.490586 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1baef7df-f0b3-43c3-97eb-6f3e526da367 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.368444 Oct 28 10:08:01.491532 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2053/4117] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 10:08:01 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0/os-interface => generated 1831 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:08:01.496529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:01.497462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:01.509363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.514419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.515201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:01.516132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.516773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.519445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:01.917034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:01.941512 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-921fa555-fd42-454b-b788-fc57302d95a2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1494 microversion: 2.1 time: 0.815384 Oct 28 10:08:01.942750 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2065/4118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:01 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1494 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:01.959492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:01.960473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:01.968661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.981678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.982432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:01.983388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:01.984029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:01.984635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:02.365895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:02.385228 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c96e2d4-5ddf-4b9d-b0e8-e6bd9821121c tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1333 microversion: 2.1 time: 0.891365 Oct 28 10:08:02.386950 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2054/4119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:01 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1333 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:02.394161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-829b8af7-1861-4709-8d9d-8fa521270ac7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca335c68b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:02.505562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-829b8af7-1861-4709-8d9d-8fa521270ac7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.117077 Oct 28 10:08:02.514929 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2055/4120] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:02 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:02.718023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:02.727995 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-08808351-71e3-4aa4-98b7-1d0093310752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1320 microversion: 2.1 time: 0.783945 Oct 28 10:08:02.737560 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2066/4121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:01 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1320 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:02.971222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:02.972121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:02.987470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:02.988338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:02.989005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:02.990597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:02.995881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:02.996624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:03.408890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:03.410381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:03.424162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:03.426152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:03.427986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:03.429785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:03.431898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:03.434867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:03.806447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:03.816375 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ea907b0-5f4e-4290-a2a2-f03c380a5bd5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1666 microversion: 2.1 time: 0.411367 Oct 28 10:08:03.821754 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2067/4122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:03 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1666 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:03.831867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e86bed59-84f1-4ecc-9e8f-8a1eaaa85d0c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3296be50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:03.922112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e86bed59-84f1-4ecc-9e8f-8a1eaaa85d0c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.097292 Oct 28 10:08:03.929913 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2068/4123] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:03 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:03.942866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:03.943877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:03.958845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:03.959655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:03.963049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:03.965260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:03.968297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:03.969262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.038363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:04.048349 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ccf0f024-6f09-4c7b-b6b6-a1264e3825dd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1494 microversion: 2.1 time: 1.082509 Oct 28 10:08:04.049482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2056/4124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:02 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1494 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:04.072085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:04.072616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:04.086689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.087206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.087661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.088392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.088864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.097777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.166995 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c8080690-dd88-4dc2-9d1d-98ab72054405 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78/ips" status: 200 len: 177 microversion: 2.1 time: 0.111449 Oct 28 10:08:04.167989 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2057/4125] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:08:04 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78/ips => generated 177 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:04.188625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:04.193037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:04.203739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.207889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.212067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.213141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.213802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.214415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.272851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:04.425109 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6f57991-54a4-4767-b233-ace123d20ab5 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 204 len: 0 microversion: 2.1 time: 0.247481 Oct 28 10:08:04.429619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2058/4126] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:04 2022] DELETE /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:04.445113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:04.446438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:04.458632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.459330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.459981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.461052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.461779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.462380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.593026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:04.616267 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6bc12534-6b36-464b-8087-a21684f3c387 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 200 len: 1507 microversion: 2.1 time: 0.684579 Oct 28 10:08:04.622797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2069/4127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:03 2022] GET /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 1507 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:04.650966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:04.651942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 8a67c6e9-980e-4957-aadc-dc6c1e457279] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:04.659786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.660546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.661379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.662300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.664765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.665496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.824494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:04.833603 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22f7bb36-65ee-44ef-a651-d8e266389c60 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1672 microversion: 2.1 time: 0.396727 Oct 28 10:08:04.844966 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2059/4128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:04 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1672 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:04.852863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-834c9623-2aa5-4e6c-a2f0-f516ad7652b6 req-453b4217-be67-4fe1-a474-8fdd6c473b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e", "name": "network-vif-deleted", "tag": "b2f7a560-4559-49a0-bdf6-4bce194bc3bc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:04.867445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-834c9623-2aa5-4e6c-a2f0-f516ad7652b6 req-453b4217-be67-4fe1-a474-8fdd6c473b73 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:04.869590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-834c9623-2aa5-4e6c-a2f0-f516ad7652b6 req-453b4217-be67-4fe1-a474-8fdd6c473b73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:04.876939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-834c9623-2aa5-4e6c-a2f0-f516ad7652b6 req-453b4217-be67-4fe1-a474-8fdd6c473b73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:04.891125 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-834c9623-2aa5-4e6c-a2f0-f516ad7652b6 req-453b4217-be67-4fe1-a474-8fdd6c473b73 service nova] Creating event network-vif-deleted:b2f7a560-4559-49a0-bdf6-4bce194bc3bc for instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e on n-h2-zed-1 Oct 28 10:08:04.897461 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-834c9623-2aa5-4e6c-a2f0-f516ad7652b6 req-453b4217-be67-4fe1-a474-8fdd6c473b73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060487 Oct 28 10:08:04.911960 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2060/4129] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:04.948544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e74be6b-0c3b-4396-8e9e-bb3e5b775734 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca330c0280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:05.041501 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e74be6b-0c3b-4396-8e9e-bb3e5b775734 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.098304 Oct 28 10:08:05.043789 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2061/4130] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:04 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:05.085660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:05.086581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:05.124502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.125778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.127043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:05.128052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.128758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.129779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:05.175984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.178229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.178815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:05.179545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lazy-loading 'fault' on Instance uuid 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:08:05.289775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:05.303904 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52988719-ed46-43d4-967e-5152a545ce35 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 200 len: 1303 microversion: 2.1 time: 0.226690 Oct 28 10:08:05.306732 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2062/4131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:05 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 1303 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:05.315106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-765353cf-9c26-4523-83b4-9bf178e01fac req-1c521e46-f780-4e80-abbf-03ff817f4b5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "tag": "a0323752-f69f-4f04-a247-644f13d40fbb"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:05.346513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-765353cf-9c26-4523-83b4-9bf178e01fac req-1c521e46-f780-4e80-abbf-03ff817f4b5a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.346921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-765353cf-9c26-4523-83b4-9bf178e01fac req-1c521e46-f780-4e80-abbf-03ff817f4b5a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.347366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-765353cf-9c26-4523-83b4-9bf178e01fac req-1c521e46-f780-4e80-abbf-03ff817f4b5a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:05.379520 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-765353cf-9c26-4523-83b4-9bf178e01fac req-1c521e46-f780-4e80-abbf-03ff817f4b5a service nova] Creating event network-changed:a0323752-f69f-4f04-a247-644f13d40fbb for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:08:05.388742 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-765353cf-9c26-4523-83b4-9bf178e01fac req-1c521e46-f780-4e80-abbf-03ff817f4b5a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080412 Oct 28 10:08:05.396178 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2063/4132] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:05.700201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:05.713610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d34fb96-253e-4417-8813-f7ecfe6564dc tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/8a67c6e9-980e-4957-aadc-dc6c1e457279" status: 200 len: 1508 microversion: 2.1 time: 1.066664 Oct 28 10:08:05.733092 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2070/4133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:04 2022] GET /compute/v2.1/servers/8a67c6e9-980e-4957-aadc-dc6c1e457279 => generated 1508 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:05.756503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:05.757552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 8a67c6e9-980e-4957-aadc-dc6c1e457279] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:05.768197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.768701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.769177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:05.769905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.770367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.770801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:05.818026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 8a67c6e9-980e-4957-aadc-dc6c1e457279] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:05.888376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:05.892748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:05.929493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.930724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.931919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:05.933549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:05.934188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:05.934846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:06.012861 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ae7133d9-a091-435c-8711-a9114e1a104c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8a67c6e9-980e-4957-aadc-dc6c1e457279" status: 204 len: 0 microversion: 2.1 time: 0.260275 Oct 28 10:08:06.013687 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2064/4134] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:05 2022] DELETE /compute/v2.1/servers/8a67c6e9-980e-4957-aadc-dc6c1e457279 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:06.022779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:06.023371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:06.029835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:06.030335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:06.030836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:06.031554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:06.032016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:06.033089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:06.077208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: e2c9901f-4f12-4d73-8021-65547c1d5a78] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:06.256023 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d80b1a92-c9ab-406e-925a-f20ea48fcff7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78" status: 204 len: 0 microversion: 2.1 time: 0.236975 Oct 28 10:08:06.269398 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2065/4135] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:06 2022] DELETE /compute/v2.1/servers/e2c9901f-4f12-4d73-8021-65547c1d5a78 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:08:06.275898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7769efe-096d-457f-bfb4-fa9a9129195f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3802fc10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:06.337432 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7769efe-096d-457f-bfb4-fa9a9129195f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.066145 Oct 28 10:08:06.347992 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2066/4136] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:06 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:06.354591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:06.355592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:06.365957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:06.371123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:06.374247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:06.375232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:06.378287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:06.379876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:06.412843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e HTTP/1.1 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e'} Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:06.421997 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:06.428164 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:06.428164 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:06.428164 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:06.428164 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:06.428164 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:06.428164 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:06.428164 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:06.432469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:06.433890 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-91a627ca-d1e6-4c4f-8c1a-682b631b94de tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 404 len: 111 microversion: 2.1 time: 0.084574 Oct 28 10:08:06.442680 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2067/4137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:06 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:06.516236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:06.529454 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4c73d94-438b-4cd3-855c-3dab080a7ab9 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1672 microversion: 2.1 time: 0.672858 Oct 28 10:08:06.541416 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2071/4138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:05 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1672 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:06.605362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-478013137", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "ff75e91c-c060-4730-8173-f88286544d31"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:06.747149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] validate_networks() for [('ff75e91c-c060-4730-8173-f88286544d31', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:08:06.986078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-495923214", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa47211-0e93-41b2-a356-031426d3c83c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:07.249497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] validate_networks() for [('afa47211-0e93-41b2-a356-031426d3c83c', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:08:07.984174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:08:07.984660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:08:07.985118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:08:07.986163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:08:07.986892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:08:08.009029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:08.010499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:08.018648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:08.019769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:08.020443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:08.021326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:08.064566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Getting quotas for project 669c6c5d2876466193ec4abce33def69. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:08:08.080884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Getting quotas for user 6b0638e280d940d1ba1f3c78c02351c0 and project 669c6c5d2876466193ec4abce33def69. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:08:08.098811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Going to run 2 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:08:08.101528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:08:08.161660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=5cb03e9f-b38e-432e-acba-3046b4c7410f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:08:08.273727 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0245a01-3dae-4120-916d-c888b5d882e1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.676596 Oct 28 10:08:08.279760 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2068/4139] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:08:06 2022] POST /compute/v2.1/servers => generated 32 bytes in 1684 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 28 10:08:08.290795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d8b5b06b-efe0-4f22-8c0b-84a0d4997761 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca330dc310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:08.396402 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d8b5b06b-efe0-4f22-8c0b-84a0d4997761 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.114978 Oct 28 10:08:08.397442 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2069/4140] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:08 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:08.404885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:08.405823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:08.422457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:08.425329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:08.426075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:08.427355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:08.432884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:08.433721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:09.322633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:09.331989 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb3db6cc-3f60-4d59-bdea-881b839f3c52 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1651 microversion: 2.1 time: 0.932872 Oct 28 10:08:09.332594 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2070/4141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:08 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1651 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:09.356537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-9f717ae9-10b7-49b7-bfe1-4a7ac42bd0e2 req-12500aec-c96a-4187-a856-574b0b08e9a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78", "name": "network-vif-deleted", "tag": "600e7588-77a9-49ef-8bad-3a0dd3571716"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:09.385688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9f717ae9-10b7-49b7-bfe1-4a7ac42bd0e2 req-12500aec-c96a-4187-a856-574b0b08e9a5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:09.386464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9f717ae9-10b7-49b7-bfe1-4a7ac42bd0e2 req-12500aec-c96a-4187-a856-574b0b08e9a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:09.387138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9f717ae9-10b7-49b7-bfe1-4a7ac42bd0e2 req-12500aec-c96a-4187-a856-574b0b08e9a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:09.424065 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-9f717ae9-10b7-49b7-bfe1-4a7ac42bd0e2 req-12500aec-c96a-4187-a856-574b0b08e9a5 service nova] Creating event network-vif-deleted:600e7588-77a9-49ef-8bad-3a0dd3571716 for instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 on n-h1-zed-1 Oct 28 10:08:09.432328 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-9f717ae9-10b7-49b7-bfe1-4a7ac42bd0e2 req-12500aec-c96a-4187-a856-574b0b08e9a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098282 Oct 28 10:08:09.434010 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2071/4142] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:09.442436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:09.469770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:09.472411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Searching by: {'deleted': False, 'project_id': '669c6c5d2876466193ec4abce33def69'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:08:09.503389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:09.505311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:09.506441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:09.507578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:09.509456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:09.510266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:09.549757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:09.566755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:08:09.620042 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8d35aa30-0dae-4275-9b10-b9059ff8e2f1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.183680 Oct 28 10:08:09.631249 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2072/4143] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:08:09 2022] GET /compute/v2.1/servers => generated 1335 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:09.638594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29736855-181e-4bff-aab3-0b5f1a52a9dc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca330c0280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:09.734561 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29736855-181e-4bff-aab3-0b5f1a52a9dc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.101621 Oct 28 10:08:09.743084 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2073/4144] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:09 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:09.749378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8a1ae92c-3d6e-4ec4-b788-04c679a20116 req-0f814b8c-dca5-43a9-b92f-d5958f936e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78", "name": "network-vif-unplugged", "status": "completed", "tag": "1474c824-4f93-4487-81ec-7e12bbb67a69"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:09.774921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8a1ae92c-3d6e-4ec4-b788-04c679a20116 req-0f814b8c-dca5-43a9-b92f-d5958f936e47 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:09.776634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8a1ae92c-3d6e-4ec4-b788-04c679a20116 req-0f814b8c-dca5-43a9-b92f-d5958f936e47 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:09.777886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8a1ae92c-3d6e-4ec4-b788-04c679a20116 req-0f814b8c-dca5-43a9-b92f-d5958f936e47 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:09.816100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8a1ae92c-3d6e-4ec4-b788-04c679a20116 req-0f814b8c-dca5-43a9-b92f-d5958f936e47 service nova] Creating event network-vif-unplugged:1474c824-4f93-4487-81ec-7e12bbb67a69 for instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 on n-h1-zed-1 Oct 28 10:08:09.829731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8a1ae92c-3d6e-4ec4-b788-04c679a20116 req-0f814b8c-dca5-43a9-b92f-d5958f936e47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090061 Oct 28 10:08:09.830718 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2074/4145] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:09.839827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-792087a7-a960-4a64-8d79-8191d8b7b9dd tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:09.840567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-792087a7-a960-4a64-8d79-8191d8b7b9dd tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:09.982153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-792087a7-a960-4a64-8d79-8191d8b7b9dd tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:09.990530 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-792087a7-a960-4a64-8d79-8191d8b7b9dd tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1217 microversion: 2.1 time: 0.158553 Oct 28 10:08:09.991131 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2075/4146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:09 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:10.361183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:10.361979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:10.393268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:10.394903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:10.399117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:10.402465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:10.402830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:10.404174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:10.685571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:10.724204 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7641e1d2-9084-4a2f-ab53-a35589b370a2 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1451 microversion: 2.1 time: 0.366629 Oct 28 10:08:10.731052 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2076/4147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:10 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1451 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:10.762464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-24c8351f-ba8a-4e93-b642-85df4b0a9349 req-bbee6f3e-a878-4336-9ba6-61f957ad0adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a67c6e9-980e-4957-aadc-dc6c1e457279", "name": "network-vif-deleted", "tag": "d8ef5135-fa60-4e41-8d6b-09420c2a4bbd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:10.817284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-24c8351f-ba8a-4e93-b642-85df4b0a9349 req-bbee6f3e-a878-4336-9ba6-61f957ad0adf service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:10.817844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-24c8351f-ba8a-4e93-b642-85df4b0a9349 req-bbee6f3e-a878-4336-9ba6-61f957ad0adf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:10.818298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-24c8351f-ba8a-4e93-b642-85df4b0a9349 req-bbee6f3e-a878-4336-9ba6-61f957ad0adf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:10.858858 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-24c8351f-ba8a-4e93-b642-85df4b0a9349 req-bbee6f3e-a878-4336-9ba6-61f957ad0adf service nova] Creating event network-vif-deleted:d8ef5135-fa60-4e41-8d6b-09420c2a4bbd for instance 8a67c6e9-980e-4957-aadc-dc6c1e457279 on n-h2-zed-1 Oct 28 10:08:10.883235 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-24c8351f-ba8a-4e93-b642-85df4b0a9349 req-bbee6f3e-a878-4336-9ba6-61f957ad0adf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150269 Oct 28 10:08:10.886321 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2077/4148] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:10.900820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-32cb50ee-c159-4b61-b90c-8ae09d5b477e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca33684b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:10.989883 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-32cb50ee-c159-4b61-b90c-8ae09d5b477e tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.102411 Oct 28 10:08:10.991977 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2078/4149] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:10 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:11.019759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:11.020473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:11.038394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:11.038909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:11.039378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:11.040119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:11.045881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:11.046910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:11.277787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:11.281067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:08:11.281589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:08:11.281957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:08:11.282931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:08:11.283349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:08:11.298731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-27edd2c1-ca0c-4c0c-aeea-66f67c01dde6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1213 microversion: 2.1 time: 0.284368 Oct 28 10:08:11.304018 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2079/4150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:11 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:11.320530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:11.326104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:11.327300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:11.328422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:11.328604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:11.339362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:11.416986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:08:11.451629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Getting quotas for user 6859db32b98f4caba7379962eaef9de3 and project 9ebe8016f5094b2a856a520ad1e5d4cf. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:08:11.515632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:11.521629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:08:11.538136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:08:11.729824 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a04d18f3-4d63-46c2-bf70-9f1ee98abc99 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.743387 Oct 28 10:08:11.736271 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2072/4151] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:08:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 4755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:08:11.760724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:11.764020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:11.785090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:11.785676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:11.786090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:11.786980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:11.792137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:11.792662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:11.895650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:11.896218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:11.896669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:11.897224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lazy-loading 'fault' on Instance uuid ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:08:12.082601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f95d3b5d2334eefb1b5386fb8580780', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26e212a668cf47d38ef3b363ce7dbba4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:12.102516 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2fdd3680-277a-4960-9786-390186b1831b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 200 len: 1302 microversion: 2.1 time: 0.351199 Oct 28 10:08:12.116949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2073/4152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:11 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 1302 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:12.126631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8b54f7b3-6bfc-41bb-b6e5-f090ed6e56e3 req-8a30c9bb-ce83-41ed-bfdd-0f7546ef23a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78", "name": "network-vif-deleted", "tag": "1474c824-4f93-4487-81ec-7e12bbb67a69"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:12.173966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8b54f7b3-6bfc-41bb-b6e5-f090ed6e56e3 req-8a30c9bb-ce83-41ed-bfdd-0f7546ef23a5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:12.174534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8b54f7b3-6bfc-41bb-b6e5-f090ed6e56e3 req-8a30c9bb-ce83-41ed-bfdd-0f7546ef23a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:12.186988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8b54f7b3-6bfc-41bb-b6e5-f090ed6e56e3 req-8a30c9bb-ce83-41ed-bfdd-0f7546ef23a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:12.270672 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8b54f7b3-6bfc-41bb-b6e5-f090ed6e56e3 req-8a30c9bb-ce83-41ed-bfdd-0f7546ef23a5 service nova] Creating event network-vif-deleted:1474c824-4f93-4487-81ec-7e12bbb67a69 for instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 on n-h1-zed-1 Oct 28 10:08:12.293054 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8b54f7b3-6bfc-41bb-b6e5-f090ed6e56e3 req-8a30c9bb-ce83-41ed-bfdd-0f7546ef23a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182384 Oct 28 10:08:12.297339 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2074/4153] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:12.335156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6d8d5c83-9ca5-44f0-b420-eee31dc7a68a req-d1663777-c3a0-4bd4-ac22-aae1e8940b37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c9901f-4f12-4d73-8021-65547c1d5a78", "name": "network-vif-unplugged", "status": "completed", "tag": "f65af217-bea9-4c0c-bfcb-47d7c234e290"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:12.358238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6d8d5c83-9ca5-44f0-b420-eee31dc7a68a req-d1663777-c3a0-4bd4-ac22-aae1e8940b37 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:12.358872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6d8d5c83-9ca5-44f0-b420-eee31dc7a68a req-d1663777-c3a0-4bd4-ac22-aae1e8940b37 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:12.360764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6d8d5c83-9ca5-44f0-b420-eee31dc7a68a req-d1663777-c3a0-4bd4-ac22-aae1e8940b37 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:12.387258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:12.414098 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6d8d5c83-9ca5-44f0-b420-eee31dc7a68a req-d1663777-c3a0-4bd4-ac22-aae1e8940b37 service nova] Creating event network-vif-unplugged:f65af217-bea9-4c0c-bfcb-47d7c234e290 for instance e2c9901f-4f12-4d73-8021-65547c1d5a78 on n-h1-zed-1 Oct 28 10:08:12.435977 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6d8d5c83-9ca5-44f0-b420-eee31dc7a68a req-d1663777-c3a0-4bd4-ac22-aae1e8940b37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.125622 Oct 28 10:08:12.442775 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2075/4154] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:12.468919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e7f732c-acd4-4cfc-9eac-6daf5ba7b807 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca328a7790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:12.661765 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6e7f732c-acd4-4cfc-9eac-6daf5ba7b807 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.212494 Oct 28 10:08:12.663255 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2076/4155] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:12 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:12.679319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:12.694780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:12.739866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:12.740606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:12.741333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:12.749846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:12.754315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:12.757950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:12.964712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8de6fc9d-30b1-40a7-8bf4-9b2e8753c5fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:12.970349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8de6fc9d-30b1-40a7-8bf4-9b2e8753c5fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:13.084299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:13.126752 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5309cea-33ac-45d6-a241-2b6a2aa12d9e tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1287 microversion: 2.1 time: 0.456824 Oct 28 10:08:13.128160 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2077/4156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:12 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1287 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:13.154800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:13.155444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:13.191154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:13.191709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:13.192160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:13.201386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:13.201954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:13.210200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:13.267543 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] HTTP exception thrown: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Request method failure captured: Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 HTTP/1.1 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6l3fnqB10uSFDYp0bVakzpKuKxiTSF0T15Om64Kq2RcD3DD3ncsOT3iQJOd_1vCCl07RLH9Ve4rJ82ot3cFupatGFB4yZI25zYhhfndP59WCQgJt06aiPqOTmkLTxhCaGCwwIIMK_6R6uoiDxBl_ej0gj6j9KpVjyIvv9mcrBvOsCI Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e212a668cf47d38ef3b363ce7dbba4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e212a668cf47d38ef3b363ce7dbba4"}]}] Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1f95d3b5d2334eefb1b5386fb8580780 Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78'} Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:13.272368 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Returning 404 to user: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:13.282174 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70c228e8-291a-4e8b-b059-45d4ac9a983d tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 404 len: 111 microversion: 2.1 time: 0.135683 Oct 28 10:08:13.285457 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2078/4157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:13 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:13.523358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8de6fc9d-30b1-40a7-8bf4-9b2e8753c5fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:13.530920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8de6fc9d-30b1-40a7-8bf4-9b2e8753c5fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1214 microversion: 2.1 time: 1.789392 Oct 28 10:08:13.532457 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2080/4158] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:11 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1214 bytes in 1792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:13.680480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9a3f4893-4c83-47dd-89f5-0d2e6413ebda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca328a7280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:13.816451 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9a3f4893-4c83-47dd-89f5-0d2e6413ebda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.141691 Oct 28 10:08:13.819602 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2079/4159] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:13 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:14.156750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:14.168186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:14.189699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:14.193447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:14.194956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:14.196215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:14.196952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:14.197861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:14.358282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6cbb32de-8f4a-4c38-89d3-4ecc5f708fbc req-c41f197b-b036-4483-ad26-01de9c050632 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c9901f-4f12-4d73-8021-65547c1d5a78", "name": "network-vif-deleted", "tag": "f65af217-bea9-4c0c-bfcb-47d7c234e290"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:14.387215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cbb32de-8f4a-4c38-89d3-4ecc5f708fbc req-c41f197b-b036-4483-ad26-01de9c050632 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:14.388194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cbb32de-8f4a-4c38-89d3-4ecc5f708fbc req-c41f197b-b036-4483-ad26-01de9c050632 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:14.388659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cbb32de-8f4a-4c38-89d3-4ecc5f708fbc req-c41f197b-b036-4483-ad26-01de9c050632 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:14.426977 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6cbb32de-8f4a-4c38-89d3-4ecc5f708fbc req-c41f197b-b036-4483-ad26-01de9c050632 service nova] Creating event network-vif-deleted:f65af217-bea9-4c0c-bfcb-47d7c234e290 for instance e2c9901f-4f12-4d73-8021-65547c1d5a78 on n-h1-zed-1 Oct 28 10:08:14.437832 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6cbb32de-8f4a-4c38-89d3-4ecc5f708fbc req-c41f197b-b036-4483-ad26-01de9c050632 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081656 Oct 28 10:08:14.439864 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2080/4160] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:14.559780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:14.560788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:14.579257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:14.580537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:14.582186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:14.584314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:14.587566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:14.588095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:14.670619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:14.691932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-548eef74-449a-4032-9c25-0edd9ade3859 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1275 microversion: 2.1 time: 0.537157 Oct 28 10:08:14.696753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2081/4161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:14 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1275 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:14.835461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e866082d-c769-4271-9fb1-e9588e2212d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3313aca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:14.996330 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e866082d-c769-4271-9fb1-e9588e2212d1 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.165102 Oct 28 10:08:15.000095 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2082/4162] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:14 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:15.075963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:15.087764 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41ade944-ffe2-4569-afca-0a58d1cb8a4b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1266 microversion: 2.1 time: 0.535230 Oct 28 10:08:15.088637 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2081/4163] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:14 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1266 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:15.720363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:15.721720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:15.742366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:15.745681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:15.746427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:15.747643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:15.751901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:15.753331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:15.920210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:15.930733 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b7703b8a-4fa4-4bf6-a8a8-2773941599ec tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1275 microversion: 2.1 time: 0.213524 Oct 28 10:08:15.931839 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2083/4164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:15 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1275 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:16.017542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-215c56df-9a53-4ab4-92f2-83dcdb8fa85d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32915d30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:16.101935 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-215c56df-9a53-4ab4-92f2-83dcdb8fa85d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.090079 Oct 28 10:08:16.102703 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2082/4165] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:16 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:16.127650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:16.128817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:16.139049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:16.139863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:16.141077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:16.143995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:16.144680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:16.145703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:16.312503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:16.325191 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d41cd6c-302d-4788-886d-be2fb5a6ec96 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1272 microversion: 2.1 time: 0.210703 Oct 28 10:08:16.362315 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2084/4166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:16 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:16.957544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:16.958238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:16.970521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:16.971128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:16.971795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:16.972735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:16.981404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:16.982178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:17.118245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f50d6185-fdbf-4371-a9af-6c5f191e4651 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca330b00d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:17.189760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:17.196352 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f50d6185-fdbf-4371-a9af-6c5f191e4651 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1413 microversion: 2.1 time: 0.082227 Oct 28 10:08:17.202470 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2085/4167] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:17 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:17.222356 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-219ec23b-1e52-49c0-b825-b3a113e4cf7b tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1275 microversion: 2.1 time: 0.261081 Oct 28 10:08:17.229295 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2083/4168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:16 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1275 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:17.356947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:17.358213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:17.377284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:17.378957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:17.379418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:17.380173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:17.384014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:17.384749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:17.660030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:17.674657 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9c870cee-1ab7-4a39-b785-a26e560215b5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1272 microversion: 2.1 time: 0.325429 Oct 28 10:08:17.677734 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2086/4169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:17 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1272 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:18.215294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0b0a0b8-c46e-4370-bf40-92b3acb8f842 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca33295d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:18.303063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1526024922", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:18.307058 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0b0a0b8-c46e-4370-bf40-92b3acb8f842 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1422 microversion: 2.1 time: 0.085395 Oct 28 10:08:18.308820 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2087/4170] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:18 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1422 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:18.323642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:18.324824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:18.336040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:18.337014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:18.337778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:18.343315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:18.343944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:18.344538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:18.399219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] validate_networks() for [('8aa252f7-bd8d-4157-9afa-f608e246a5d1', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:08:18.855352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:18.864352 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02ce1716-f88c-46bb-8bb2-b2c480d6a31c tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 0.551292 Oct 28 10:08:18.877370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2088/4171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:18 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:19.367768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d0d8eaf-c0ba-4015-94d9-e651e66fc0cf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3802faf0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:19.440034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d0d8eaf-c0ba-4015-94d9-e651e66fc0cf tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 200 len: 1422 microversion: 2.1 time: 0.561052 Oct 28 10:08:19.442399 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2089/4172] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:08:18 2022] GET /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 1422 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:19.453957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:19.458203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:19.474913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:19.476377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:19.479029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:19.479992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:19.481841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:19.483414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:19.524481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:20.215146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:20.231173 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55baa888-3661-4a04-8973-54b406a7e61a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1314 microversion: 2.1 time: 0.785199 Oct 28 10:08:20.233457 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2090/4173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:19 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1314 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:20.253460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-564896105", "imageRef": "239bb313-8497-4786-83f5-f35826c57e31", "flavorRef": "452", "networks": [{"uuid": "153b4feb-5f46-4862-85be-edb054eb6bc9"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:20.395782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] validate_networks() for [('153b4feb-5f46-4862-85be-edb054eb6bc9', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:08:20.574671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:08:20.575346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:08:20.575894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:08:20.577721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:08:20.578205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:08:20.629425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:20.630237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:20.633200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:20.634945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:20.635665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:20.636340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:20.679331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Getting quotas for project 938d52ca99bf461d9175ab267ef56ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:08:20.687272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Getting quotas for user 05b11268812b415bbe36c1980bea37b6 and project 938d52ca99bf461d9175ab267ef56ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:08:20.704247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:08:20.707206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:08:20.785471 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b388d6a2-295b-4eb9-a868-2b32b907830d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.081023 Oct 28 10:08:20.786138 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2084/4174] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:08:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:08:20.799576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:20.800332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:20.810088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:20.810919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:20.811987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:20.814513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:20.816433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:20.817584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:21.670043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:21.682394 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-02b37557-3fc7-46a5-a669-d437be5b1689 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 0.895161 Oct 28 10:08:21.696581 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2085/4175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:20 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:21.709027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1c918548-4297-4da1-a728-c9d83d813d43 req-1da07839-a20a-4c75-b6b4-36ad8e449f5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5cb03e9f-b38e-432e-acba-3046b4c7410f", "tag": "d750eb4d-fa0f-4c10-b576-391a4900929b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:21.738139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1c918548-4297-4da1-a728-c9d83d813d43 req-1da07839-a20a-4c75-b6b4-36ad8e449f5f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:21.741281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1c918548-4297-4da1-a728-c9d83d813d43 req-1da07839-a20a-4c75-b6b4-36ad8e449f5f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:21.742013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1c918548-4297-4da1-a728-c9d83d813d43 req-1da07839-a20a-4c75-b6b4-36ad8e449f5f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:21.778364 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1c918548-4297-4da1-a728-c9d83d813d43 req-1da07839-a20a-4c75-b6b4-36ad8e449f5f service nova] Creating event network-changed:d750eb4d-fa0f-4c10-b576-391a4900929b for instance 5cb03e9f-b38e-432e-acba-3046b4c7410f on n-h2-zed-1 Oct 28 10:08:21.785115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1c918548-4297-4da1-a728-c9d83d813d43 req-1da07839-a20a-4c75-b6b4-36ad8e449f5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087089 Oct 28 10:08:21.786392 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2086/4176] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:21.792969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:21.799169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:21.819558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:21.820420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:21.822941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:21.823974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:21.833596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:21.842768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.119842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:22.136208 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de0158f2-311e-4450-bc23-0477aebc981f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1218 microversion: 2.1 time: 0.343969 Oct 28 10:08:22.136849 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2087/4177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:21 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1218 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:22.144354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:22.145513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:22.154128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.154860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.155517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.156267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.157353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.158670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.643825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:08:22.645707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:08:22.647031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:08:22.648070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:08:22.649100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:08:22.652009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:22.662793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:22.678949 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a12b0de-764f-4abd-bb3a-ba04a109bef5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1314 microversion: 2.1 time: 0.538621 Oct 28 10:08:22.694398 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2088/4178] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:22 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:22.694398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:22.694398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:22.697439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.698298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.699009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.704677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.707168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.708855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.710567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.712530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.713967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.716842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.717505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.718014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.780850 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] HTTP exception thrown: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:22.786560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Request method failure captured: Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 HTTP/1.1 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6l3fnqB10uSFDYp0bVakzpKuKxiTSF0T15Om64Kq2RcD3DD3ncsOT3iQJOd_1vCCl07RLH9Ve4rJ82ot3cFupatGFB4yZI25zYhhfndP59WCQgJt06aiPqOTmkLTxhCaGCwwIIMK_6R6uoiDxBl_ej0gj6j9KpVjyIvv9mcrBvOsCI Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e212a668cf47d38ef3b363ce7dbba4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e212a668cf47d38ef3b363ce7dbba4"}]}] Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1f95d3b5d2334eefb1b5386fb8580780 Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78'} Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:22.795252 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:22.802330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:22.806751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for user 90aefa22b02749e8a6b03d16378a0a6c and project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:08:22.808567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Returning 404 to user: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:22.811129 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9819de25-8acb-472a-8665-f9ef8171d3b6 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 404 len: 111 microversion: 2.1 time: 0.129447 Oct 28 10:08:22.813301 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2089/4179] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:22 2022] DELETE /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:22.821783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-75d53b5c-6919-47a1-82ab-7b6c7e0656ce req-90e2f1d7-1f88-49ac-9443-4a3785f5d1d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba6f859-ba36-4284-aac6-e3132c7ddf69", "tag": "12fcfc51-3199-4ef0-a014-6e2cae1501c7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:22.836565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-75d53b5c-6919-47a1-82ab-7b6c7e0656ce req-90e2f1d7-1f88-49ac-9443-4a3785f5d1d7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.837548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-75d53b5c-6919-47a1-82ab-7b6c7e0656ce req-90e2f1d7-1f88-49ac-9443-4a3785f5d1d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.838203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-75d53b5c-6919-47a1-82ab-7b6c7e0656ce req-90e2f1d7-1f88-49ac-9443-4a3785f5d1d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.838652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:08:22.845394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='239bb313-8497-4786-83f5-f35826c57e31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:08:22.869264 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-75d53b5c-6919-47a1-82ab-7b6c7e0656ce req-90e2f1d7-1f88-49ac-9443-4a3785f5d1d7 service nova] Creating event network-changed:12fcfc51-3199-4ef0-a014-6e2cae1501c7 for instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 on n-h2-zed-1 Oct 28 10:08:22.877361 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-75d53b5c-6919-47a1-82ab-7b6c7e0656ce req-90e2f1d7-1f88-49ac-9443-4a3785f5d1d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062532 Oct 28 10:08:22.878211 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2090/4180] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:22.898385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:22.899566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:22.908695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.909935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.914050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.915070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:22.916392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:22.917153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:22.978013 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-216d049d-2fa9-4a03-a564-e0733b07e591 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.737262 Oct 28 10:08:22.989493 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2091/4181] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:08:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:08:23.012066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:23.012730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:23.033996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.034889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.035907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.037827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.038521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.039730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.065055 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] HTTP exception thrown: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Request method failure captured: Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 HTTP/1.1 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6l3fnqB10uSFDYp0bVakzpKuKxiTSF0T15Om64Kq2RcD3DD3ncsOT3iQJOd_1vCCl07RLH9Ve4rJ82ot3cFupatGFB4yZI25zYhhfndP59WCQgJt06aiPqOTmkLTxhCaGCwwIIMK_6R6uoiDxBl_ej0gj6j9KpVjyIvv9mcrBvOsCI Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e212a668cf47d38ef3b363ce7dbba4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e212a668cf47d38ef3b363ce7dbba4"}]}] Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1f95d3b5d2334eefb1b5386fb8580780 Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78'} Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:23.067024 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Returning 404 to user: Instance ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c18ba4d-dc6a-4309-88c9-ac0c208a96ef tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78" status: 404 len: 111 microversion: 2.1 time: 0.078709 Oct 28 10:08:23.074070 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2092/4182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:22 2022] GET /compute/v2.1/servers/ac4f47a0-8ed6-4e8b-9a25-b8961ebbcb78 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:23.077650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-089b3113-af45-4401-b9b9-a2fc2607e330 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:23.077650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-089b3113-af45-4401-b9b9-a2fc2607e330 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:23.185209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-089b3113-af45-4401-b9b9-a2fc2607e330 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:23.204169 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-089b3113-af45-4401-b9b9-a2fc2607e330 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1207 microversion: 2.1 time: 0.132016 Oct 28 10:08:23.225905 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2093/4183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:23 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1207 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:23.238170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:23.238744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:23.253095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.253613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.254068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.254804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.261299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.264153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.310869 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] HTTP exception thrown: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Request method failure captured: Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 HTTP/1.1 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6l3fnqB10uSFDYp0bVakzpKuKxiTSF0T15Om64Kq2RcD3DD3ncsOT3iQJOd_1vCCl07RLH9Ve4rJ82ot3cFupatGFB4yZI25zYhhfndP59WCQgJt06aiPqOTmkLTxhCaGCwwIIMK_6R6uoiDxBl_ej0gj6j9KpVjyIvv9mcrBvOsCI Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e212a668cf47d38ef3b363ce7dbba4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e212a668cf47d38ef3b363ce7dbba4"}]}] Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1f95d3b5d2334eefb1b5386fb8580780 Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3'} Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:23.314201 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.320215 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.326660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Returning 404 to user: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:23.327912 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-36d3e997-75eb-446c-a85f-b3e215cf7792 tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 404 len: 111 microversion: 2.1 time: 0.100866 Oct 28 10:08:23.331303 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2094/4184] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:23 2022] DELETE /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:23.342818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:23.346220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:23.360571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.377780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.379801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.386498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.388528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.390688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.728332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:23.744229 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bfb17d7d-eaac-4627-b075-ca116e43bb6b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1272 microversion: 2.1 time: 0.410281 Oct 28 10:08:23.745117 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2095/4185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:23 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1272 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:23.757562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:23.759576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] [instance: 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:23.780959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.781296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.787582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.791929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.792758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.793635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.851316 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] HTTP exception thrown: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Request method failure captured: Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 HTTP/1.1 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6l3fnqB10uSFDYp0bVakzpKuKxiTSF0T15Om64Kq2RcD3DD3ncsOT3iQJOd_1vCCl07RLH9Ve4rJ82ot3cFupatGFB4yZI25zYhhfndP59WCQgJt06aiPqOTmkLTxhCaGCwwIIMK_6R6uoiDxBl_ej0gj6j9KpVjyIvv9mcrBvOsCI Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/26e212a668cf47d38ef3b363ce7dbba4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_26e212a668cf47d38ef3b363ce7dbba4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/26e212a668cf47d38ef3b363ce7dbba4"}]}] Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 26e212a668cf47d38ef3b363ce7dbba4 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestMultiNic-1194972485 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1f95d3b5d2334eefb1b5386fb8580780 Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestMultiNic-1194972485-project Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3'} Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:23.861611 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.869626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:23.869626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:23.869626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:23.869626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:23.869626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:23.869626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. Oct 28 10:08:23.869626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:23.870792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] Returning 404 to user: Instance 8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:23.870968 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04425da0-b597-474b-aa4b-158e796da74b tempest-ServersTestMultiNic-1194972485 tempest-ServersTestMultiNic-1194972485-project] 10.222.0.16 "GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3" status: 404 len: 111 microversion: 2.1 time: 0.124513 Oct 28 10:08:23.882352 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2096/4186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:23 2022] GET /compute/v2.1/servers/8f5ad630-28d1-4a6d-a180-7f48f9d8c2a3 => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:23.894591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:23.895253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:23.900576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:23.919745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.920385 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7cbdd925-c05e-449e-a650-9f7ef784fdc6 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 1.027158 Oct 28 10:08:23.924815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2091/4187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:22 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:23.925147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.925512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:23.926281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:23.926761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:23.927203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:24.040333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-099a383a-9b7b-4dff-add8-f27d64742abb req-079df40d-7804-46d0-a2ed-91a113ab3184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ec883-ff30-424e-a2d2-fc90e4c02680", "name": "network-vif-unplugged", "status": "completed", "tag": "adf1e6cf-d135-47a4-9ee6-452314fdf24e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:24.071263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-099a383a-9b7b-4dff-add8-f27d64742abb req-079df40d-7804-46d0-a2ed-91a113ab3184 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:24.072449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-099a383a-9b7b-4dff-add8-f27d64742abb req-079df40d-7804-46d0-a2ed-91a113ab3184 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:24.073277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-099a383a-9b7b-4dff-add8-f27d64742abb req-079df40d-7804-46d0-a2ed-91a113ab3184 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:24.127461 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-099a383a-9b7b-4dff-add8-f27d64742abb req-079df40d-7804-46d0-a2ed-91a113ab3184 service nova] Creating event network-vif-unplugged:adf1e6cf-d135-47a4-9ee6-452314fdf24e for instance e88ec883-ff30-424e-a2d2-fc90e4c02680 on n-h2-zed-1 Oct 28 10:08:24.179941 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-099a383a-9b7b-4dff-add8-f27d64742abb req-079df40d-7804-46d0-a2ed-91a113ab3184 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111040 Oct 28 10:08:24.179941 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2092/4188] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:08:24.231707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:24.232972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:24.270439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:24.272576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:24.273284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:24.274419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:24.275251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:24.275959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:24.417757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:24.432543 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aa1b9b56-41b4-4da2-8e39-fdf1cf4783c7 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1203 microversion: 2.1 time: 0.204965 Oct 28 10:08:24.440147 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2093/4189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:24 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1203 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:24.772250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:24.773179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:24.785883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:24.786588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:24.787209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:24.788125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:24.791041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:24.792099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:24.876555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:24.891474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1fc3c0e-dc58-41ae-b47e-805477a8dbcb tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1314 microversion: 2.1 time: 1.007885 Oct 28 10:08:24.892078 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2097/4190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:23 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1314 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:24.934566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:24.949940 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bb2b67d9-0c8d-4e65-b049-7b111544bc35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1272 microversion: 2.1 time: 0.182487 Oct 28 10:08:24.954600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:24.955241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:24.956108 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2094/4191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:24 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:25.001656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.002166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:25.002653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:25.003379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.003846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:25.004286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:25.071301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f734063f-4ec6-451f-96ea-817327312a7e req-e20e5f90-19e3-4f8b-bba3-cdb1fa447248 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630", "tag": "1d5e133c-a746-4733-8c83-dd66495a2534"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:25.087264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f734063f-4ec6-451f-96ea-817327312a7e req-e20e5f90-19e3-4f8b-bba3-cdb1fa447248 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.092439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f734063f-4ec6-451f-96ea-817327312a7e req-e20e5f90-19e3-4f8b-bba3-cdb1fa447248 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:25.093270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f734063f-4ec6-451f-96ea-817327312a7e req-e20e5f90-19e3-4f8b-bba3-cdb1fa447248 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:25.112863 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f734063f-4ec6-451f-96ea-817327312a7e req-e20e5f90-19e3-4f8b-bba3-cdb1fa447248 service nova] Creating event network-changed:1d5e133c-a746-4733-8c83-dd66495a2534 for instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 on n-h1-zed-1 Oct 28 10:08:25.130778 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f734063f-4ec6-451f-96ea-817327312a7e req-e20e5f90-19e3-4f8b-bba3-cdb1fa447248 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063489 Oct 28 10:08:25.132058 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2095/4192] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:25.463103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:25.466864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:25.509290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.512472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:25.513751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:25.517524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.518021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:25.523768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:25.721843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:25.735961 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53afbe98-17b0-4f6a-bf60-ddeab232a117 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1267 microversion: 2.1 time: 0.278800 Oct 28 10:08:25.739625 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2096/4193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:25 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1267 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:25.850590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:25.861294 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d6f4dd3-7f15-433b-9ed7-03a741705b5f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 0.911112 Oct 28 10:08:25.874387 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2098/4194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:24 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:25.921865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:25.923349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:25.932299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.933119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:25.933561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:25.934469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.935307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:25.936641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:25.987380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:25.988729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:25.998863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:25.999775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:26.000471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:26.002065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:26.002761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:26.003985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:26.897261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:26.908108 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e91ccf80-070b-4bca-bd76-4c710522e1ef tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1314 microversion: 2.1 time: 0.993050 Oct 28 10:08:26.933978 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2097/4195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:25 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1314 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:26.940598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:26.941457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:26.958953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:26.967519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-36302249-b628-46ca-91b8-461770686ef3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.986115 Oct 28 10:08:26.967771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:26.968559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:26.969385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:26.970409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:26.971133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:26.971749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:26.986182 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2099/4196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:25 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:26.994514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:26.995467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:27.028067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:27.028582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:27.033685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:27.034536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:27.035026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:27.035470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:27.200052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:27.213167 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba334a6b-09b6-4bc3-9cdd-5600da65fa8b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1265 microversion: 2.1 time: 0.277820 Oct 28 10:08:27.215899 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2098/4197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:26 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:27.533083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:27.542460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f52ae722-ce70-4e3a-b487-8a2d752beae1 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 0.554966 Oct 28 10:08:27.565015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2100/4198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:26 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:27.942869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:27.943468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:27.952741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:27.957777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:27.958295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:27.959049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:27.959535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:27.959959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:27.998429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:27.999209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:28.010826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:28.011365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:28.011795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:28.025081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:28.025967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:28.029213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:28.730583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:28.749816 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-afccdb17-15ad-4c7c-9304-199fa8c7adff tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1314 microversion: 2.1 time: 0.810684 Oct 28 10:08:28.751009 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2099/4199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:27 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1314 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:28.766041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-71d5323c-b24f-4a17-80c5-ddd64ce56253 req-e9aa9dad-b707-43d0-a89b-6cdfad2725f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb03e9f-b38e-432e-acba-3046b4c7410f", "name": "network-vif-plugged", "status": "completed", "tag": "d750eb4d-fa0f-4c10-b576-391a4900929b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:28.786218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-71d5323c-b24f-4a17-80c5-ddd64ce56253 req-e9aa9dad-b707-43d0-a89b-6cdfad2725f6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:28.789236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-71d5323c-b24f-4a17-80c5-ddd64ce56253 req-e9aa9dad-b707-43d0-a89b-6cdfad2725f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:28.791370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-71d5323c-b24f-4a17-80c5-ddd64ce56253 req-e9aa9dad-b707-43d0-a89b-6cdfad2725f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:28.820312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-71d5323c-b24f-4a17-80c5-ddd64ce56253 req-e9aa9dad-b707-43d0-a89b-6cdfad2725f6 service nova] Creating event network-vif-plugged:d750eb4d-fa0f-4c10-b576-391a4900929b for instance 5cb03e9f-b38e-432e-acba-3046b4c7410f on n-h2-zed-1 Oct 28 10:08:28.834224 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-71d5323c-b24f-4a17-80c5-ddd64ce56253 req-e9aa9dad-b707-43d0-a89b-6cdfad2725f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081183 Oct 28 10:08:28.840170 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2100/4200] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:28.846950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:28.853580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:28.875057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:28.875901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:28.880625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:28.881789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:28.882709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:28.884933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:28.924870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:29.384115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:29.392852 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-449bef21-03ee-4313-9cd9-8338024cf510 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1265 microversion: 2.1 time: 0.551098 Oct 28 10:08:29.421649 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2101/4201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:28 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1265 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:29.432833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:29.433630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:29.457593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:29.460608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:29.462253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:29.463570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:29.464365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:29.468361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:30.483404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:30.491917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:30.500105 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f9b134c9-2ada-44c1-a99c-4c6a995e043a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 2.500870 Oct 28 10:08:30.517518 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2101/4202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:27 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:30.522914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:30.523807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:30.535617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:30.536433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:30.539305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:30.541957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:30.542739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:30.543708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:30.659594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:30.697909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:30.826030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:30.867935 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-acd97398-955a-438d-a4d3-dd803fba9aa5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 1.443288 Oct 28 10:08:30.869135 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2102/4203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:29 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:30.880779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:30.889431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:30.902234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:30.902744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:30.904857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:30.905803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:30.906979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:30.909249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:31.105181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:31.115565 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5fa5ec40-9cc6-467a-8495-84f9c78d8cf8 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1265 microversion: 2.1 time: 0.244866 Oct 28 10:08:31.116340 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2103/4204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:30 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:31.142882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5d76a0e3-6be0-457a-9129-5f95ad0477d4 req-3c92b806-eeb8-4d54-8a33-5d226ea8370a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630", "name": "network-vif-plugged", "status": "completed", "tag": "1d5e133c-a746-4733-8c83-dd66495a2534"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:31.163215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5d76a0e3-6be0-457a-9129-5f95ad0477d4 req-3c92b806-eeb8-4d54-8a33-5d226ea8370a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:31.171691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5d76a0e3-6be0-457a-9129-5f95ad0477d4 req-3c92b806-eeb8-4d54-8a33-5d226ea8370a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:31.172271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5d76a0e3-6be0-457a-9129-5f95ad0477d4 req-3c92b806-eeb8-4d54-8a33-5d226ea8370a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:31.204016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5d76a0e3-6be0-457a-9129-5f95ad0477d4 req-3c92b806-eeb8-4d54-8a33-5d226ea8370a service nova] Creating event network-vif-plugged:1d5e133c-a746-4733-8c83-dd66495a2534 for instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 on n-h1-zed-1 Oct 28 10:08:31.212334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5d76a0e3-6be0-457a-9129-5f95ad0477d4 req-3c92b806-eeb8-4d54-8a33-5d226ea8370a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075465 Oct 28 10:08:31.212967 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2104/4205] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:31.529448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:31.530133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:31.547251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:31.547856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:31.548184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:31.559440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:31.560271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:31.568673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:32.479583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:32.503212 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa53a396-112e-4f2e-b65e-2919940dd247 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.974291 Oct 28 10:08:32.507906 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2105/4206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:31 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:32.519180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e86159c9-05d2-4a45-a551-6e078945c794 req-e8164bf6-3931-414f-a568-c58c2b1eebe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7e21d82-9a2a-4d89-abdc-fc2d45a105bc", "tag": "18506e65-cc13-42db-99b0-94064c314c3e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:32.528001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:32.555037 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3091ae47-a765-4081-8084-8f46c1b9ebc5 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1314 microversion: 2.1 time: 2.019000 Oct 28 10:08:32.555819 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2102/4207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:30 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1314 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:32.560825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:32.578570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:32.581097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e86159c9-05d2-4a45-a551-6e078945c794 req-e8164bf6-3931-414f-a568-c58c2b1eebe8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:32.583531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e86159c9-05d2-4a45-a551-6e078945c794 req-e8164bf6-3931-414f-a568-c58c2b1eebe8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:32.588852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e86159c9-05d2-4a45-a551-6e078945c794 req-e8164bf6-3931-414f-a568-c58c2b1eebe8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:32.629111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:32.632969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:32.633522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:32.634421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:32.634996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:32.635473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:32.637509 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e86159c9-05d2-4a45-a551-6e078945c794 req-e8164bf6-3931-414f-a568-c58c2b1eebe8 service nova] Creating event network-changed:18506e65-cc13-42db-99b0-94064c314c3e for instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc on n-h1-zed-1 Oct 28 10:08:32.660446 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e86159c9-05d2-4a45-a551-6e078945c794 req-e8164bf6-3931-414f-a568-c58c2b1eebe8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146955 Oct 28 10:08:32.661754 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2106/4208] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:32.681357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:32.684136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:32.703334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:32.705021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:32.705780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:32.707002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:32.710238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:32.710943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:32.774827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:33.199824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=18 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:33.856860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:33.873571 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-511e5ed1-a60b-4f7a-8a8b-7940bfc7355c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 1.204812 Oct 28 10:08:33.874468 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2107/4209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:32 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:33.888030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8cf834d3-a5e7-4da0-a241-0149542920d5 req-f28469aa-5c65-4a16-8c65-65a545a841df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba6f859-ba36-4284-aac6-e3132c7ddf69", "name": "network-vif-plugged", "status": "completed", "tag": "12fcfc51-3199-4ef0-a014-6e2cae1501c7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:33.894994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8cf834d3-a5e7-4da0-a241-0149542920d5 req-f28469aa-5c65-4a16-8c65-65a545a841df service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:33.895585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8cf834d3-a5e7-4da0-a241-0149542920d5 req-f28469aa-5c65-4a16-8c65-65a545a841df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:33.896241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8cf834d3-a5e7-4da0-a241-0149542920d5 req-f28469aa-5c65-4a16-8c65-65a545a841df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:33.917631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8cf834d3-a5e7-4da0-a241-0149542920d5 req-f28469aa-5c65-4a16-8c65-65a545a841df service nova] Creating event network-vif-plugged:12fcfc51-3199-4ef0-a014-6e2cae1501c7 for instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 on n-h2-zed-1 Oct 28 10:08:33.926028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8cf834d3-a5e7-4da0-a241-0149542920d5 req-f28469aa-5c65-4a16-8c65-65a545a841df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049700 Oct 28 10:08:33.926740 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2108/4210] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:33.934178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:33.935216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:33.959345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:33.960002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:33.960552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:33.961405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:33.962094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:33.962734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:34.107862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:34.121910 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b91a0295-1498-49b8-a507-f73e0ef7ccd4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 1.560227 Oct 28 10:08:34.123163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2103/4211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:32 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:34.147552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:34.148779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:34.175091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:34.179525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:34.213204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:34.217515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:34.220312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:34.221772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:34.235527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:34.257996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5daae184-d06e-4941-83df-14a34ac175de tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.329768 Oct 28 10:08:34.258771 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2109/4212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:33 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:34.899758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:34.900685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:34.925805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:34.927175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:34.930643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:34.931563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:34.932302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:34.932897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:35.106442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:35.109584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f7168d1d-8ed4-4837-9ecd-8f9744407ba8 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1314 microversion: 2.1 time: 0.985076 Oct 28 10:08:35.126454 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2104/4213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:34 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1314 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:35.151269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:35.153138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:35.185465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:35.187575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:35.188474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:35.197226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:35.198850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:35.200283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:35.860521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:35.889712 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-54b4443d-0448-458a-a2fc-6dbebfb1c5f5 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1317 microversion: 2.1 time: 0.745823 Oct 28 10:08:35.891037 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2105/4214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:35 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1317 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:35.908332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:35.908972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:35.939832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:35.948249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:35.951489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:35.959209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:35.961244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:35.967178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:36.398594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:36.408512 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c699f670-e7a3-4915-a9ce-67e6df6403ef tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 1.514019 Oct 28 10:08:36.420470 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2110/4215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:34 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:36.425666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:36.440768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:36.484483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:36.487943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:36.489488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:36.492022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:36.500381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:36.503465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:36.698568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:36.714976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b534b5c0-1958-42ae-b162-d2805b85e294 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.821396 Oct 28 10:08:36.717564 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2106/4216] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:35 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:36.733357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fe116806-928f-40e2-857d-59a0cd7dcc6b req-346d3102-26e6-4c43-ba3f-75087e269546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e38e519-0d1d-4852-b07a-c41967f5bc3a", "tag": "97d4acdd-0ae8-4e40-8930-7a789bdd3aad"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:36.773351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fe116806-928f-40e2-857d-59a0cd7dcc6b req-346d3102-26e6-4c43-ba3f-75087e269546 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:36.775112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fe116806-928f-40e2-857d-59a0cd7dcc6b req-346d3102-26e6-4c43-ba3f-75087e269546 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:36.775834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fe116806-928f-40e2-857d-59a0cd7dcc6b req-346d3102-26e6-4c43-ba3f-75087e269546 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:36.813332 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fe116806-928f-40e2-857d-59a0cd7dcc6b req-346d3102-26e6-4c43-ba3f-75087e269546 service nova] Creating event network-changed:97d4acdd-0ae8-4e40-8930-7a789bdd3aad for instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a on n-h1-zed-1 Oct 28 10:08:36.830683 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fe116806-928f-40e2-857d-59a0cd7dcc6b req-346d3102-26e6-4c43-ba3f-75087e269546 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107433 Oct 28 10:08:36.832742 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2107/4217] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:36.923221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:36.925434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:36.942881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:36.945469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:36.946657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:36.949210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:36.950861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:36.952300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.266187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:37.274565 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9b11bc3-a378-4d1a-8ed5-55b3375dacf3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1502 microversion: 2.1 time: 0.852679 Oct 28 10:08:37.275376 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2111/4218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:36 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1502 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:37.299908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:37.301361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:37.307858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.308603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.309260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.310193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.310849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.311690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.312337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:37.321482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bbb529fc-8115-4282-90b4-4d5f1cc79ed4 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 200 len: 1504 microversion: 2.1 time: 0.407994 Oct 28 10:08:37.324324 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2108/4219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:36 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 1504 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:37.341659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lazy-loading 'flavor' on Instance uuid f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:08:37.349945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:37.350797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:37.358716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.359655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.360323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.361646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.362362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.363005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.464557 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce95e0c6-5f81-475a-a798-cebf2fd67a20 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "POST /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630/action" status: 202 len: 0 microversion: 2.1 time: 0.167740 Oct 28 10:08:37.466923 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2112/4220] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:08:37 2022] POST /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:08:37.477344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:37.478278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:37.486755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.487260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.487707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.488419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.488869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.489319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.558907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:37.568627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4f1fa18-f36d-4e92-8019-8a72e82b4879 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f" status: 200 len: 1504 microversion: 2.1 time: 0.222926 Oct 28 10:08:37.569249 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2109/4221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:37 2022] GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:37.603323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:37.603974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:37.613559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.614147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.614565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.615537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.616175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.617649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.800223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:37.800831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:37.809653 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e08dc9d1-bc7d-416f-aba9-9aa84d0be3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 0.341775 Oct 28 10:08:37.811479 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2113/4222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:37 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:37.811881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d10ab68-a092-4302-8a2b-fcfa9977bf70 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1510 microversion: 2.1 time: 0.235823 Oct 28 10:08:37.813734 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2110/4223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:37 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:37.817302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:37.817726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:37.820962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:37.827261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:37.829752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.830202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.830648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.831364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.831819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.832245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.839122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.840265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.841775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.844867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:37.847094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:37.847633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:37.863875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:38.008282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:38.043287 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c27fe9b-e882-4c29-a0de-715765357dc9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f" status: 204 len: 0 microversion: 2.1 time: 0.229984 Oct 28 10:08:38.044555 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2114/4224] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:37 2022] DELETE /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:38.055455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:38.056395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:38.073040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.074049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.077014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:38.080857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.081616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.082277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:38.133989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:38.165282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:38.177373 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb0f82d1-4ce1-47e6-b881-16125cae3dee tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.362266 Oct 28 10:08:38.181212 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2111/4225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:37 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:38.223973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:38.421030 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9abb7bac-6c27-4c8e-be5f-1d20403abd2d tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 204 len: 0 microversion: 2.1 time: 0.369961 Oct 28 10:08:38.437588 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2115/4226] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:38 2022] DELETE /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:38.450486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:38.454290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:38.471345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.474967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.477334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:38.481404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.483268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.485157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:38.836179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:38.837505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:38.844472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.848429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.849341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:38.850286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.851791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.852386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:38.923400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:38.933969 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-60d24bdd-5e75-4e8f-a8e2-9858290f46c7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f" status: 200 len: 1510 microversion: 2.1 time: 0.490589 Oct 28 10:08:38.935236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2112/4227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:38 2022] GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f => generated 1510 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:38.942120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:38.942989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:38.949913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.950500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.951029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:38.951671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:38.952134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:38.952604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:39.493406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:39.503565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c4f0ffc-2c75-453c-bc3b-e5266fe53534 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 0.566480 Oct 28 10:08:39.506974 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2113/4228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:38 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:39.521864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:39.527912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:39.548849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:39.549414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:39.549879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:39.550630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:39.551107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:39.551552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:39.846146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:39.855514 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bbdb5c2-fd07-476a-9cac-990966d15f2f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.345040 Oct 28 10:08:39.856717 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2114/4229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:39 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:39.899808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:39.912106 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84b3f2b9-7d00-494f-a900-8b4af0eb8030 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1510 microversion: 2.1 time: 1.080705 Oct 28 10:08:39.925290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2116/4230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:38 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1510 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:39.968395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:39.969729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:39.983753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:39.984270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:39.984718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:39.985671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:39.986139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:39.986579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:40.325105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:40.335403 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a543b4f1-36e4-407c-8247-5a9be9d1d2d3 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f" status: 200 len: 1510 microversion: 2.1 time: 0.371449 Oct 28 10:08:40.337936 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2115/4231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:39 2022] GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f => generated 1510 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:40.533778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:40.534616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:40.544611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:40.545448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:40.546039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:40.548052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:40.549098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:40.550489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:40.855409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:40.865238 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9e09c742-3b07-4161-ab40-48785e75eb38 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 0.337143 Oct 28 10:08:40.885222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:40.885883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:40.886415 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2117/4232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:40 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:40.907039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:40.907487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:40.907934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:40.908715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:40.909260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:40.917110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:40.938046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:40.940121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:40.948525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:40.950082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:40.957767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:40.960006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:40.960491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:40.962814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:41.416456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:41.434015 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b5c3c9d3-a7d5-4665-84cb-92b68fb67799 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.556642 Oct 28 10:08:41.434629 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2116/4233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:40 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:41.453343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:41.455534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:41.464194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:41.464845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:41.466078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:41.466931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:41.467417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:41.469091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:41.812316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:41.824529 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3eadfd30-94b3-45c8-8933-6a63e847d73f tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1493 microversion: 2.1 time: 0.890961 Oct 28 10:08:41.833054 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2118/4234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:40 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1493 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:41.842308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-691d4bb7-beac-4bbc-819b-763de13f70cd req-2ef3fad9-5d66-4e50-9fa3-5a46d6245d07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e21d82-9a2a-4d89-abdc-fc2d45a105bc", "name": "network-vif-plugged", "status": "completed", "tag": "18506e65-cc13-42db-99b0-94064c314c3e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:41.863613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-691d4bb7-beac-4bbc-819b-763de13f70cd req-2ef3fad9-5d66-4e50-9fa3-5a46d6245d07 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:41.865374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-691d4bb7-beac-4bbc-819b-763de13f70cd req-2ef3fad9-5d66-4e50-9fa3-5a46d6245d07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:41.866114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-691d4bb7-beac-4bbc-819b-763de13f70cd req-2ef3fad9-5d66-4e50-9fa3-5a46d6245d07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:41.881944 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-691d4bb7-beac-4bbc-819b-763de13f70cd req-2ef3fad9-5d66-4e50-9fa3-5a46d6245d07 service nova] Creating event network-vif-plugged:18506e65-cc13-42db-99b0-94064c314c3e for instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc on n-h1-zed-1 Oct 28 10:08:41.893954 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-691d4bb7-beac-4bbc-819b-763de13f70cd req-2ef3fad9-5d66-4e50-9fa3-5a46d6245d07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059052 Oct 28 10:08:41.895453 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2119/4235] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:41.902313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:41.903112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:41.913538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:41.915127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:41.915795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:41.917079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:41.917851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:41.918619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:41.980085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:41.996714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:42.011243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22b83f03-9fbc-4b3e-be9a-617054dd22a7 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f" status: 200 len: 1510 microversion: 2.1 time: 0.575314 Oct 28 10:08:42.022660 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2117/4236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:41 2022] GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f => generated 1510 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:42.022660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:42.029821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:42.044238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:42.047232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:42.047991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:42.049784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:42.053597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:42.054321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:42.146649 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d467248d-491e-44ec-9cbd-f6b6d1494f6b tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 204 len: 0 microversion: 2.1 time: 0.248803 Oct 28 10:08:42.147683 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2120/4237] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:41 2022] DELETE /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:42.162124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:42.163342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:42.171923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:42.172794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:42.173458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:42.174537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:42.175219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:42.175907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:42.502775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:42.518429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e9a93a7d-758a-4dfa-9265-ed320780d9f0 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1499 microversion: 2.1 time: 0.365467 Oct 28 10:08:42.519039 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2121/4238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:42 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1499 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:42.523692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:42.524301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:42.532510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:42.533038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:42.533539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:42.534237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:42.534812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:42.535335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:42.957320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:42.972026 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06d3c226-a614-4610-8be0-0c1be704cd61 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.450219 Oct 28 10:08:42.973204 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2122/4239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:42 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:42.978443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9994dcfe-db29-4ab8-9361-b473622d20c9 req-65b2ad11-960c-40f7-918d-483ded5e541b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba6f859-ba36-4284-aac6-e3132c7ddf69", "name": "network-vif-deleted", "tag": "12fcfc51-3199-4ef0-a014-6e2cae1501c7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:43.006005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9994dcfe-db29-4ab8-9361-b473622d20c9 req-65b2ad11-960c-40f7-918d-483ded5e541b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:43.007129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9994dcfe-db29-4ab8-9361-b473622d20c9 req-65b2ad11-960c-40f7-918d-483ded5e541b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:43.007129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9994dcfe-db29-4ab8-9361-b473622d20c9 req-65b2ad11-960c-40f7-918d-483ded5e541b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:43.026722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:43.034957 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9994dcfe-db29-4ab8-9361-b473622d20c9 req-65b2ad11-960c-40f7-918d-483ded5e541b service nova] Creating event network-vif-deleted:12fcfc51-3199-4ef0-a014-6e2cae1501c7 for instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 on n-h2-zed-1 Oct 28 10:08:43.047283 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1af1df96-8893-45ed-99dc-e075d724e3f2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 1.032484 Oct 28 10:08:43.051531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2118/4240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:42 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:43.060346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5fe3fd69-9daa-4b26-b900-d9a920d4e71a req-b7c074f8-586d-434c-8b10-f3f0869f70a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5cb03e9f-b38e-432e-acba-3046b4c7410f", "name": "network-vif-deleted", "tag": "d750eb4d-fa0f-4c10-b576-391a4900929b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:43.073280 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9994dcfe-db29-4ab8-9361-b473622d20c9 req-65b2ad11-960c-40f7-918d-483ded5e541b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083276 Oct 28 10:08:43.080390 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2123/4241] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:43.088602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:43.089347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:43.093591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5fe3fd69-9daa-4b26-b900-d9a920d4e71a req-b7c074f8-586d-434c-8b10-f3f0869f70a5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:43.097635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5fe3fd69-9daa-4b26-b900-d9a920d4e71a req-b7c074f8-586d-434c-8b10-f3f0869f70a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:43.097635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5fe3fd69-9daa-4b26-b900-d9a920d4e71a req-b7c074f8-586d-434c-8b10-f3f0869f70a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:43.105455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:43.106388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:43.107543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:43.119475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:43.120303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:43.120894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:43.123820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:43.132116 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5fe3fd69-9daa-4b26-b900-d9a920d4e71a req-b7c074f8-586d-434c-8b10-f3f0869f70a5 service nova] Creating event network-vif-deleted:d750eb4d-fa0f-4c10-b576-391a4900929b for instance 5cb03e9f-b38e-432e-acba-3046b4c7410f on n-h2-zed-1 Oct 28 10:08:43.157333 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5fe3fd69-9daa-4b26-b900-d9a920d4e71a req-b7c074f8-586d-434c-8b10-f3f0869f70a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097714 Oct 28 10:08:43.160097 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2119/4242] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:43.221316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0638e280d940d1ba1f3c78c02351c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669c6c5d2876466193ec4abce33def69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:43.230311 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de0faabc-25a5-4549-b035-a517211ca0e9 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f" status: 200 len: 1302 microversion: 2.1 time: 0.147011 Oct 28 10:08:43.244977 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2124/4243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:43 2022] GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f => generated 1302 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:43.549871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:43.551331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:43.564116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:43.565886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:43.566736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:43.567506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:43.568368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:43.571066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:43.978024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:43.989981 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-290bab6c-6d70-4ef5-9e33-43bf20d3f8bc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1499 microversion: 2.1 time: 0.445783 Oct 28 10:08:43.991868 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2120/4244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:43 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1499 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:44.004110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:44.004793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:44.020694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.021356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.021661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.022380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.022841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.023277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.070998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:44.071624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:44.081222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.081740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.085576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.086560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.089237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.089960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.313611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:44.324012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50c7e813-15a9-4d27-acc0-60261da6ab3f tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1314 microversion: 2.1 time: 0.326566 Oct 28 10:08:44.346094 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2125/4245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:43 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:44.354580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:44.355206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 5cb03e9f-b38e-432e-acba-3046b4c7410f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:44.369882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.378463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.379036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.379806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.380287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.380743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.403908 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] HTTP exception thrown: Instance 5cb03e9f-b38e-432e-acba-3046b4c7410f could not be found. Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Request method failure captured: Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f HTTP/1.1 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6no3YvqHOExBU_S9vqRDA4KS9DMk6nABnlPhBGIDVkIc5258Me8H1He5aJ3m6mDRQFwDmM_65Ys6PZQjFWDhkONKxNyZf7n9GIYDIgCrgequQC-zIDwdzWGtHuFfn396Fg9ZuQMh7E1GbN1pfgszVkptKUTr6Bm46kpUFIJdRWe6b8 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 669c6c5d2876466193ec4abce33def69 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-MultipleCreateTestJSON-654360963 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/669c6c5d2876466193ec4abce33def69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/669c6c5d2876466193ec4abce33def69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_669c6c5d2876466193ec4abce33def69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/669c6c5d2876466193ec4abce33def69"}]}] Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-MultipleCreateTestJSON-654360963 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 669c6c5d2876466193ec4abce33def69 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-MultipleCreateTestJSON-654360963 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-MultipleCreateTestJSON-654360963-project Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6b0638e280d940d1ba1f3c78c02351c0 Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-MultipleCreateTestJSON-654360963-project Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5cb03e9f-b38e-432e-acba-3046b4c7410f could not be found. Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5cb03e9f-b38e-432e-acba-3046b4c7410f'} Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5cb03e9f-b38e-432e-acba-3046b4c7410f could not be found. Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5cb03e9f-b38e-432e-acba-3046b4c7410f could not be found. Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:44.406349 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.411207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:44.411207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:44.411207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:44.411207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:44.411207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:44.411207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5cb03e9f-b38e-432e-acba-3046b4c7410f could not be found. Oct 28 10:08:44.411207 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.411949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Returning 404 to user: Instance 5cb03e9f-b38e-432e-acba-3046b4c7410f could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:44.413080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15e1dd66-9948-4ca3-b376-0d137b73a752 tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f" status: 404 len: 111 microversion: 2.1 time: 0.065887 Oct 28 10:08:44.414707 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2126/4246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:44 2022] GET /compute/v2.1/servers/5cb03e9f-b38e-432e-acba-3046b4c7410f => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:44.431003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:44.431822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] [instance: 0ba6f859-ba36-4284-aac6-e3132c7ddf69] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:44.441895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.442737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.443879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.444970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:44.445966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:44.446716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:44.467187 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] HTTP exception thrown: Instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 could not be found. Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Request method failure captured: Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 HTTP/1.1 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6no3YvqHOExBU_S9vqRDA4KS9DMk6nABnlPhBGIDVkIc5258Me8H1He5aJ3m6mDRQFwDmM_65Ys6PZQjFWDhkONKxNyZf7n9GIYDIgCrgequQC-zIDwdzWGtHuFfn396Fg9ZuQMh7E1GbN1pfgszVkptKUTr6Bm46kpUFIJdRWe6b8 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 669c6c5d2876466193ec4abce33def69 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-MultipleCreateTestJSON-654360963 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/669c6c5d2876466193ec4abce33def69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/669c6c5d2876466193ec4abce33def69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_669c6c5d2876466193ec4abce33def69", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/669c6c5d2876466193ec4abce33def69"}]}] Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-MultipleCreateTestJSON-654360963 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 669c6c5d2876466193ec4abce33def69 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-MultipleCreateTestJSON-654360963 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-MultipleCreateTestJSON-654360963-project Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6b0638e280d940d1ba1f3c78c02351c0 Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-MultipleCreateTestJSON-654360963-project Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 could not be found. Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '0ba6f859-ba36-4284-aac6-e3132c7ddf69'} Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 could not be found. Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 could not be found. Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:44.470132 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.473813 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:44.473813 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:44.473813 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:44.473813 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:44.473813 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:44.473813 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 could not be found. Oct 28 10:08:44.473813 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:44.474986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] Returning 404 to user: Instance 0ba6f859-ba36-4284-aac6-e3132c7ddf69 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:44.477571 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfe0dd6d-565a-4988-9448-12b99238f90f tempest-MultipleCreateTestJSON-654360963 tempest-MultipleCreateTestJSON-654360963-project] 10.222.0.16 "GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69" status: 404 len: 111 microversion: 2.1 time: 0.058162 Oct 28 10:08:44.478659 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2127/4247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:44 2022] GET /compute/v2.1/servers/0ba6f859-ba36-4284-aac6-e3132c7ddf69 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:44.578082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:44.589210 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-137614b1-51a5-49fd-9917-c14c97c825df tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 0.521474 Oct 28 10:08:44.607208 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2121/4248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:44 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:45.020390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:45.021249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:45.031127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.031829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.032448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.033330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.033933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.034743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.353451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:45.354188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:45.365962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.367409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.368159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.369215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.369912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.370635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.614073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:45.628544 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5ae2b04-0d62-4710-8e93-108f684563ff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1500 microversion: 2.1 time: 0.279965 Oct 28 10:08:45.633645 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2122/4249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:45 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1500 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:45.645125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1d232f9a-f54d-4f06-bc93-7cf4c30c1813 req-90a59afd-3d97-4ee5-b7b2-d1675309ad78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630", "name": "network-vif-deleted", "tag": "1d5e133c-a746-4733-8c83-dd66495a2534"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:45.658776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859db32b98f4caba7379962eaef9de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ebe8016f5094b2a856a520ad1e5d4cf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:45.675329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d232f9a-f54d-4f06-bc93-7cf4c30c1813 req-90a59afd-3d97-4ee5-b7b2-d1675309ad78 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.676677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d232f9a-f54d-4f06-bc93-7cf4c30c1813 req-90a59afd-3d97-4ee5-b7b2-d1675309ad78 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.677433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d232f9a-f54d-4f06-bc93-7cf4c30c1813 req-90a59afd-3d97-4ee5-b7b2-d1675309ad78 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.679892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7fd5cf7-6eb6-4f2c-84f6-9565281e2c61 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 200 len: 1457 microversion: 2.1 time: 0.668036 Oct 28 10:08:45.696592 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1d232f9a-f54d-4f06-bc93-7cf4c30c1813 req-90a59afd-3d97-4ee5-b7b2-d1675309ad78 service nova] Creating event network-vif-deleted:1d5e133c-a746-4733-8c83-dd66495a2534 for instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 on n-h1-zed-1 Oct 28 10:08:45.701011 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2128/4250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:45 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 1457 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:45.704379 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1d232f9a-f54d-4f06-bc93-7cf4c30c1813 req-90a59afd-3d97-4ee5-b7b2-d1675309ad78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069260 Oct 28 10:08:45.707033 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2123/4251] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:45.714933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:45.715344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:45.716067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:45.718830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:45.724603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.725177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.725867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.726777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.727672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.728424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.728991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.729329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.730099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.731257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.732349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.733112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.800373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lazy-loading 'flavor' on Instance uuid c7e21d82-9a2a-4d89-abdc-fc2d45a105bc {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:08:45.949986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc055c4f-7451-42f8-9c72-b9053ff8780a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "POST /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc/action" status: 200 len: 32 microversion: 2.1 time: 0.240996 Oct 28 10:08:45.959464 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2124/4252] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:08:45 2022] POST /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:08:45.972095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:45.973373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:45.990675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.996262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:45.997111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:45.998603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:45.999871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.001941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.267402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:46.279827 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b7c5fcb-af08-4b80-b610-e18996b700c8 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.317753 Oct 28 10:08:46.281437 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2125/4253] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:45 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:46.302760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0dc09593-1e21-47db-a157-20e1fb3c5088 req-32632518-ffff-4870-a703-abe0c7775649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e38e519-0d1d-4852-b07a-c41967f5bc3a", "name": "network-vif-plugged", "status": "completed", "tag": "97d4acdd-0ae8-4e40-8930-7a789bdd3aad"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:46.316034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0dc09593-1e21-47db-a157-20e1fb3c5088 req-32632518-ffff-4870-a703-abe0c7775649 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.316533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0dc09593-1e21-47db-a157-20e1fb3c5088 req-32632518-ffff-4870-a703-abe0c7775649 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.317346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0dc09593-1e21-47db-a157-20e1fb3c5088 req-32632518-ffff-4870-a703-abe0c7775649 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.334156 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0dc09593-1e21-47db-a157-20e1fb3c5088 req-32632518-ffff-4870-a703-abe0c7775649 service nova] Creating event network-vif-plugged:97d4acdd-0ae8-4e40-8930-7a789bdd3aad for instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a on n-h1-zed-1 Oct 28 10:08:46.340977 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0dc09593-1e21-47db-a157-20e1fb3c5088 req-32632518-ffff-4870-a703-abe0c7775649 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041703 Oct 28 10:08:46.341751 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2126/4254] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:46.584476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:46.596298 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e2fdbc4-4ccd-467a-af81-76dc1204390b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 0.893909 Oct 28 10:08:46.601948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2129/4255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:45 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:46.713201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:46.714063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:46.730067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.730575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.738832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.741764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.742271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.742726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.768508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 HTTP/1.1 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630'} Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.773805 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:46.777112 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef8844f4-3790-4cee-8d3d-206c58c9cd3d tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 404 len: 111 microversion: 2.1 time: 0.070361 Oct 28 10:08:46.782357 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2127/4256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:46 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:46.787654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:46.788036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:46.800480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.801008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.801866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.802172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.802631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.803062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.829117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 HTTP/1.1 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630'} Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:46.832160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.835380 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.838037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:46.840979 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e784f773-d791-4850-8dd2-c49a1a00d7dc tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 404 len: 111 microversion: 2.1 time: 0.055349 Oct 28 10:08:46.845007 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2130/4257] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:46 2022] DELETE /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:46.850463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:46.851083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:46.857579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.858254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.858866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.860004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.860662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.861429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.880515 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 HTTP/1.1 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630'} Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.882830 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.887917 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.887917 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.887917 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.887917 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:46.887917 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:46.887917 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. Oct 28 10:08:46.887917 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.891372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:46.892844 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c26805a6-d602-4532-b74b-5ca331af351a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630" status: 404 len: 111 microversion: 2.1 time: 0.046874 Oct 28 10:08:46.894082 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2128/4258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:46 2022] GET /compute/v2.1/servers/f6754b0c-6b10-4eb9-a0e3-8ce8dd8d3630 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:46.902698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:46.903211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:46.910704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.911666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.912118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.912888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.913376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.914188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.930956 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e HTTP/1.1 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e'} Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:46.932974 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:46.937877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:46.940012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:46.941500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-45791269-6c70-4aa1-8ab6-c53b32b28da2 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 404 len: 111 microversion: 2.1 time: 0.043000 Oct 28 10:08:46.951815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2131/4259] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:46 2022] DELETE /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:46.962742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:46.963372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:46.973878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.974711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.976333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:46.977830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:46.978524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:46.979177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.002257 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e HTTP/1.1 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e'} Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.004393 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.008427 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.008427 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.008427 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.008427 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:47.008427 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:47.008427 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. Oct 28 10:08:47.008427 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.010529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:47.012197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2662bd79-87fe-4b90-8d73-5e897d4d4b40 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e" status: 404 len: 111 microversion: 2.1 time: 0.054713 Oct 28 10:08:47.017446 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2129/4260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:46 2022] GET /compute/v2.1/servers/05a2baa3-c7bf-4f8f-9737-c2b5c76efa3e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:47.022136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.022638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.032707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.037587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.038063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.038800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.039435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.040206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.076847 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf HTTP/1.1 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '3d20727e-4105-4bbe-8e93-a3960f8330bf'} Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:47.080776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.084022 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.086267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:47.090089 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-23f6e50d-acbe-4a46-99f7-0287a75013c3 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 404 len: 111 microversion: 2.1 time: 0.070529 Oct 28 10:08:47.092948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2132/4261] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:47 2022] DELETE /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:47.100221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.101024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3d20727e-4105-4bbe-8e93-a3960f8330bf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.111225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.111738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.112230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.113848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.116753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.117534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.150937 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf HTTP/1.1 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '3d20727e-4105-4bbe-8e93-a3960f8330bf'} Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.153422 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.156897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 3d20727e-4105-4bbe-8e93-a3960f8330bf could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:47.158462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5232766b-3827-45b2-a2c3-45402dcc3acd tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf" status: 404 len: 111 microversion: 2.1 time: 0.062701 Oct 28 10:08:47.164319 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2130/4262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:47 2022] GET /compute/v2.1/servers/3d20727e-4105-4bbe-8e93-a3960f8330bf => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:47.170540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.171600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.211756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.217709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.221127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.222080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.228484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.234271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.278666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c HTTP/1.1 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'b6668c6d-d735-4d74-9844-4555e56b8f1c'} Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:47.285135 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.289312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.292334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:47.295655 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4cedbda-4273-40c5-8aee-c8667b7893fa tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 404 len: 111 microversion: 2.1 time: 0.130805 Oct 28 10:08:47.299523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2133/4263] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:47 2022] DELETE /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:08:47.312865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.314198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b6668c6d-d735-4d74-9844-4555e56b8f1c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.317686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.318345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.327040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.327650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.328009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.328133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.328814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.329127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.329338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.329832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.330501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.332286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.333152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.334194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.365122 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c HTTP/1.1 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'b6668c6d-d735-4d74-9844-4555e56b8f1c'} Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.367099 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.370401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.370401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.370401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.370401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:47.370401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:47.370401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. Oct 28 10:08:47.370401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.372884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance b6668c6d-d735-4d74-9844-4555e56b8f1c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:47.375376 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd721795-67fe-4da2-9b66-2d81393b6d59 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c" status: 404 len: 111 microversion: 2.1 time: 0.067609 Oct 28 10:08:47.376345 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2134/4264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:47 2022] GET /compute/v2.1/servers/b6668c6d-d735-4d74-9844-4555e56b8f1c => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:47.385752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.391659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.398309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.398861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.399539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.400447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.401144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.402011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.429620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc HTTP/1.1 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc'} Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:47.446237 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.449554 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.453646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:47.454976 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-baa864f9-b63b-4944-8658-47685e21cbf9 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 404 len: 111 microversion: 2.1 time: 0.073140 Oct 28 10:08:47.457515 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2135/4265] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:47 2022] DELETE /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:47.470717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.471946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.486849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.488222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.488878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.490506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.491186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.492669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.511437 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc HTTP/1.1 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc'} Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:47.514189 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ddd39f7-e85c-4a55-afd8-bfa66db1fdaf tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc" status: 404 len: 111 microversion: 2.1 time: 0.056078 Oct 28 10:08:47.518715 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2136/4266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:47 2022] GET /compute/v2.1/servers/b3ff9c4c-ccdb-470e-bf8b-86c9167bfabc => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:08:47.624082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:47.625374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:47.639032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.639534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.640030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.640748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:47.663467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:47.664050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:47.737936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:47.803012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:47.824024 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-76bf468b-6c5a-4e1f-8f4b-c35a20d5b713 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.518493 Oct 28 10:08:47.850084 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2131/4267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:47 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:48.604296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:48.615660 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9be4fd92-03f8-4295-ad63-e83bc93a01f5 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1307 microversion: 2.1 time: 0.995707 Oct 28 10:08:48.616258 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2137/4268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:47 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1307 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:48.856788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:48.859248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:48.876040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:48.876608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:48.877104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:48.878015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:48.878842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:48.879438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:49.225555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:49.238208 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ccd7b983-ae59-442e-9d78-fa324f1e7973 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.385174 Oct 28 10:08:49.239209 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2132/4269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:48 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:49.513080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:49.514314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:49.526892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:49.527704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:49.528421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:49.529326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:49.531148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:49.535822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:49.641739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:49.642731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:49.653442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:49.655564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:49.656207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:49.658732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:49.659847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:49.660987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:50.398855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:50.408151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f082084-1443-469f-9016-9baaaeb5ee61 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1486 microversion: 2.1 time: 0.772772 Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2133/4270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:49 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1486 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:50.427735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:50.646147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:50.668947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:50.678405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:50.681402 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bec3d818-b5d8-4c09-8673-b23969b97d65 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2951 microversion: 2.32 time: 1.172465 Oct 28 10:08:50.682377 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2138/4271] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:08:49 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2951 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:08:50.696728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:50.710679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d1f374e-36a9-4485-9137-33619dc6b3c9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.299232 Oct 28 10:08:50.715664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:50.716270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:50.717381 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2134/4272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:50 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:50.737837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:50.738675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:50.746997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:50.747649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:50.748198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:50.749615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:50.751432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:50.752137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:50.770241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:50.770814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:50.773252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:50.774173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:50.775015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:50.776552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:50.803963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:51.002316 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf6aa0da-84d0-41f4-b34d-2793b0b2644c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 204 len: 0 microversion: 2.1 time: 0.303105 Oct 28 10:08:51.005287 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2139/4273] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:50 2022] DELETE /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:51.016713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:51.020260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:51.047929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:51.050314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:51.056879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:51.057989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:51.059370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:51.060361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:51.407874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b14540d7-9e7d-467a-82ca-6a4bb2d3904b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0/os-interface" status: 200 len: 1831 microversion: 2.32 time: 0.687846 Oct 28 10:08:51.409056 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2135/4274] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 10:08:50 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0/os-interface => generated 1831 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:08:51.581877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:51.593463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee5a7734-e474-4a9e-be1f-6c28ab838114 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1492 microversion: 2.1 time: 0.582116 Oct 28 10:08:51.614579 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2140/4275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:51 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1492 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:51.750420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:51.751743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:51.769046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:51.771739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:51.773629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:51.775622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:51.777707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:51.779266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:52.139186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:52.151314 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-68017d99-34e9-44f5-ab8a-23e9c6c58a65 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.409117 Oct 28 10:08:52.153203 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2136/4276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:51 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:52.647146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:52.648702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:52.662031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:52.663106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:52.663843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:52.664798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:52.665518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:52.666162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:53.181125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:53.183060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:53.197588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:53.199789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:53.201240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:53.205148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:53.208968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:53.209765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:53.288128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:53.309049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-368dfa94-b398-4acf-ad4a-1aee713db6d2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1492 microversion: 2.1 time: 0.689726 Oct 28 10:08:53.331239 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2141/4277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:52 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1492 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:53.982092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:54.000377 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dabd3c27-c8fb-4b67-adea-cb3cef557896 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.820885 Oct 28 10:08:54.002689 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2137/4278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:53 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:54.233940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-966e2c54-412f-404b-95e1-aaa0628b2b47 req-44c82200-f60f-4211-b9ea-604eda9fa31e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e38e519-0d1d-4852-b07a-c41967f5bc3a", "name": "network-vif-deleted", "tag": "97d4acdd-0ae8-4e40-8930-7a789bdd3aad"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:54.250249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-966e2c54-412f-404b-95e1-aaa0628b2b47 req-44c82200-f60f-4211-b9ea-604eda9fa31e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.251529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-966e2c54-412f-404b-95e1-aaa0628b2b47 req-44c82200-f60f-4211-b9ea-604eda9fa31e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.252890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-966e2c54-412f-404b-95e1-aaa0628b2b47 req-44c82200-f60f-4211-b9ea-604eda9fa31e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.271716 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-966e2c54-412f-404b-95e1-aaa0628b2b47 req-44c82200-f60f-4211-b9ea-604eda9fa31e service nova] Creating event network-vif-deleted:97d4acdd-0ae8-4e40-8930-7a789bdd3aad for instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a on n-h1-zed-1 Oct 28 10:08:54.290129 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-966e2c54-412f-404b-95e1-aaa0628b2b47 req-44c82200-f60f-4211-b9ea-604eda9fa31e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061489 Oct 28 10:08:54.296289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2142/4279] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:08:54.335929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:54.336555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:54.354215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.357514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.359575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.367739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.368663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.369392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.454160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:54.457492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:54.486312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.487329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.488003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.491130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.492785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.493222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.566874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:54.569581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:54.572263 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.579640 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da382dc1-9850-48ec-a713-1f5e56fda91d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 200 len: 1292 microversion: 2.1 time: 0.247463 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 HTTP/1.1 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '3233b1da-fccc-4e96-923f-859d06eb3be8'} Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:54.580371 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.583628 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.584208 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2138/4280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:54 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 1292 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:54.585821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:54.586928 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a9a26e4-ee73-4774-9e3a-53ba4d5e3a5c tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 404 len: 111 microversion: 2.1 time: 0.138643 Oct 28 10:08:54.589562 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2143/4281] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:54 2022] DELETE /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:54.597136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:54.597650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: 3233b1da-fccc-4e96-923f-859d06eb3be8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:54.647068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.647674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.648018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.648741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.664580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.665116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.706108 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 HTTP/1.1 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '3233b1da-fccc-4e96-923f-859d06eb3be8'} Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.712986 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.716362 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.716362 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.716362 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.716362 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:54.716362 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:54.716362 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. Oct 28 10:08:54.716362 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.721195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance 3233b1da-fccc-4e96-923f-859d06eb3be8 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:54.722388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-840b018b-8284-455e-9365-e5a30f34322a tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8" status: 404 len: 111 microversion: 2.1 time: 0.129873 Oct 28 10:08:54.726812 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2139/4282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:54 2022] GET /compute/v2.1/servers/3233b1da-fccc-4e96-923f-859d06eb3be8 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:54.735044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:54.735748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:54.751633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.752456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.753195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.754146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.754798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.755420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.787035 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f HTTP/1.1 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'a8b89ee9-c206-400e-8c38-fea96f43859f'} Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:54.788891 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.792128 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.794439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:54.796054 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a7c42fa-5590-4273-9556-c176283f4764 tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 404 len: 111 microversion: 2.1 time: 0.065507 Oct 28 10:08:54.799458 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2144/4283] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:54 2022] DELETE /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:54.805587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:54.806687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] [instance: a8b89ee9-c206-400e-8c38-fea96f43859f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:54.824564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.825502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.826173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.827118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:54.827794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:54.828418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:54.853961 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] HTTP exception thrown: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Request method failure captured: Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f HTTP/1.1 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jdovcp1IRGwmx0q23OrgfIsCHLE7V8J7Dmr9NYUKf2BSm0K8JReUVFtPt5Qylaaew_ki8JqBAxqPp6Ebj6CVl9MqdmGu4Irg1OZszrvOFdOj-Ppe1vV6Zd-YH-r9issPNKEeWSkrRp7GTpJfed20hRian1HPt2LjuyuUzaodfvzY4 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9ebe8016f5094b2a856a520ad1e5d4cf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9ebe8016f5094b2a856a520ad1e5d4cf", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9ebe8016f5094b2a856a520ad1e5d4cf"}]}] Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9ebe8016f5094b2a856a520ad1e5d4cf Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1848694951 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 6859db32b98f4caba7379962eaef9de3 Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1848694951-project Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a8b89ee9-c206-400e-8c38-fea96f43859f'} Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:54.855656 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.860277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:54.860277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:54.860277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:54.860277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:54.860277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:54.860277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. Oct 28 10:08:54.860277 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:54.863212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] Returning 404 to user: Instance a8b89ee9-c206-400e-8c38-fea96f43859f could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:54.864224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37f4681b-e978-4ddc-b188-0f9016c96eac tempest-DeleteServersTestJSON-1848694951 tempest-DeleteServersTestJSON-1848694951-project] 10.222.0.16 "GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f" status: 404 len: 111 microversion: 2.1 time: 0.062484 Oct 28 10:08:54.867126 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2140/4284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:54 2022] GET /compute/v2.1/servers/a8b89ee9-c206-400e-8c38-fea96f43859f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:55.027746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:55.028655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:55.038168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:55.048482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:55.049193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:55.057315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:55.058560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:55.059246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:55.608616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:55.610886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:55.623049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:55.629163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:55.632654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:55.633942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:55.634842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:55.635755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:55.654738 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a HTTP/1.1 Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7e38e519-0d1d-4852-b07a-c41967f5bc3a'} Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:55.658272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:08:55.661682 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:08:55.661682 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:08:55.661682 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:08:55.661682 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:08:55.661682 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:08:55.661682 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:08:55.663999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:08:55.665964 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d760102d-1085-48fd-a064-eaf6a70856f4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 404 len: 111 microversion: 2.1 time: 0.061756 Oct 28 10:08:55.667077 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2141/4285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:55 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:08:55.680221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d183670b-acfb-4e75-88d6-220cf0f9e134 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca330b0d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:56.710736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:56.722308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec85e90b-79e4-4639-835d-ae178abbb907 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 1.698211 Oct 28 10:08:56.738450 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2145/4286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:55 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 1715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:08:57.015685 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d183670b-acfb-4e75-88d6-220cf0f9e134 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 204 len: 0 microversion: 2.1 time: 1.343599 Oct 28 10:08:57.016279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2142/4287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:55 2022] DELETE /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 0 bytes in 1345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:08:57.025685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:57.026386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:57.034499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:57.047810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:57.048527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:57.049567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:57.050332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:57.051000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:57.095898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:08:57.250674 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-79e5fd97-1dca-432e-91bd-014b01732b91 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 204 len: 0 microversion: 2.1 time: 0.229317 Oct 28 10:08:57.252316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2146/4288] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:08:57 2022] DELETE /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:08:57.519218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1234265500", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "153b4feb-5f46-4862-85be-edb054eb6bc9"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:08:57.622628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] validate_networks() for [('153b4feb-5f46-4862-85be-edb054eb6bc9', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:08:57.753448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:57.754442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:57.770018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:57.770516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:57.772157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:57.774109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:57.778293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:57.779189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:58.339863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:58.350645 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5addc8e1-9e2b-48ad-bb32-b8bffa4590bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.601557 Oct 28 10:08:58.356866 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2147/4289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:57 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:58.440123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:08:58.440813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:08:58.441338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:08:58.441762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:08:58.442334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:08:58.462035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:58.463148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:58.464103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:58.469604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:58.471022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:58.471941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:58.507574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:08:58.513842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Getting quotas for user 90aefa22b02749e8a6b03d16378a0a6c and project cd6225eaaa5f4d4db1afcb9c6ffeeb3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:08:58.527190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:08:58.529810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:08:58.629245 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa319723-2fec-4fbd-8469-5c9f7947637c tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.115402 Oct 28 10:08:58.642619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2143/4290] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:08:58.644016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e257bfb3-86bf-4909-8bf2-b2d9d9ea8f70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:58.645388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e257bfb3-86bf-4909-8bf2-b2d9d9ea8f70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:58.804807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e257bfb3-86bf-4909-8bf2-b2d9d9ea8f70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:08:58.816610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e257bfb3-86bf-4909-8bf2-b2d9d9ea8f70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1208 microversion: 2.1 time: 0.176175 Oct 28 10:08:58.818435 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2148/4291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:58 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1208 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:08:59.394776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:59.400228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:59.442055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:59.442595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:59.447130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:59.450995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:59.465028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:59.468740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:59.844467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:08:59.845169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:08:59.856916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:08:59.870432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:59.871126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:59.879321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:08:59.883138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:08:59.886391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:08:59.890140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:00.080838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:00.094274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e26f655-c5dd-4268-8ddb-5efc30cc82dd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.711892 Oct 28 10:09:00.110095 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2144/4292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:59 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:00.169664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:00.190123 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a39c4822-de64-4003-b426-20b6ce27e899 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1260 microversion: 2.1 time: 0.350549 Oct 28 10:09:00.193095 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2149/4293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:08:59 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1260 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:00.493626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fe7c5ff1-18e5-4181-ac1e-c25d1a242e1e req-d6775319-62c4-4596-b49e-9cf0c8168b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e88ec883-ff30-424e-a2d2-fc90e4c02680", "name": "network-vif-deleted", "tag": "adf1e6cf-d135-47a4-9ee6-452314fdf24e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:00.523315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fe7c5ff1-18e5-4181-ac1e-c25d1a242e1e req-d6775319-62c4-4596-b49e-9cf0c8168b3b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:00.524607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fe7c5ff1-18e5-4181-ac1e-c25d1a242e1e req-d6775319-62c4-4596-b49e-9cf0c8168b3b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:00.525445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fe7c5ff1-18e5-4181-ac1e-c25d1a242e1e req-d6775319-62c4-4596-b49e-9cf0c8168b3b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:00.548598 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fe7c5ff1-18e5-4181-ac1e-c25d1a242e1e req-d6775319-62c4-4596-b49e-9cf0c8168b3b service nova] Creating event network-vif-deleted:adf1e6cf-d135-47a4-9ee6-452314fdf24e for instance e88ec883-ff30-424e-a2d2-fc90e4c02680 on n-h2-zed-1 Oct 28 10:09:00.558272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fe7c5ff1-18e5-4181-ac1e-c25d1a242e1e req-d6775319-62c4-4596-b49e-9cf0c8168b3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075535 Oct 28 10:09:00.565263 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2145/4294] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:09:01.120307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:01.121853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:01.137793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:01.139590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:01.140779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:01.145873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:01.146544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:01.147175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:01.220351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:01.221496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:01.268357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:01.272037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:01.272538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:01.278627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:01.281874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:01.288279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:01.488107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:01.500288 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f3e227e-84dc-4787-8258-7c002a2b9cda tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1266 microversion: 2.1 time: 0.286147 Oct 28 10:09:01.522579 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2146/4295] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:01 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1266 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:01.547324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:01.564203 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1cb4783d-6fd9-4944-9900-0e810367d3b9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.447919 Oct 28 10:09:01.570694 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2150/4296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:01 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:02.532005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:02.532644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:02.546931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:02.547481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:02.547888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:02.548609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:02.553279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:02.555943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:02.733683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:02.743004 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0515586c-2755-4673-868f-80aa5005f51b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1266 microversion: 2.1 time: 0.216267 Oct 28 10:09:02.748086 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2151/4297] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:02 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:02.755560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:02.758373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:02.774460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:02.776071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:02.778081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:02.779297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:02.782262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:02.783102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:02.871154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3843368-b749-4575-84cc-8a5435724a3b tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-152615522", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:02.875163 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d3843368-b749-4575-84cc-8a5435724a3b tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] HTTP exception thrown: min_count must be <= max_count Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3843368-b749-4575-84cc-8a5435724a3b tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Request method failure captured: Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 183 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6o9o1VIMqF5f-FWptsVeYeLbqn5XFT1Y_VodheZK5FlI9a4bVW7VzKfCVpmo3rcakHuuXgyjg62ClyGdj0UVQYZvx-yvBbkJM1CcjeXjHb2giu0HxDgBD5PMOTM6DVRL4hdYGXwEuFPUTVQiWtI45dodp3JqUVaY4JxSv7jpFarDG4 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db5a7e70c534021893d95bf2ae5a7d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db5a7e70c534021893d95bf2ae5a7d8"}]}] Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 59dbe73883424ac29253f33bb681f622 Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-152615522", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: exception: min_count must be <= max_count Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-152615522', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 28 10:09:02.885808 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:02.891332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3843368-b749-4575-84cc-8a5435724a3b tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Returning 400 to user: min_count must be <= max_count {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:02.891332 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3843368-b749-4575-84cc-8a5435724a3b tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.442776 Oct 28 10:09:02.891332 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2147/4298] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 444 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:09:03.040646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4da8ce76-d4c7-4c5a-ba63-023714afe715 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-510190912", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "max_count": 0}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4da8ce76-d4c7-4c5a-ba63-023714afe715 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Request method failure captured: Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 167 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6o9o1VIMqF5f-FWptsVeYeLbqn5XFT1Y_VodheZK5FlI9a4bVW7VzKfCVpmo3rcakHuuXgyjg62ClyGdj0UVQYZvx-yvBbkJM1CcjeXjHb2giu0HxDgBD5PMOTM6DVRL4hdYGXwEuFPUTVQiWtI45dodp3JqUVaY4JxSv7jpFarDG4 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db5a7e70c534021893d95bf2ae5a7d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db5a7e70c534021893d95bf2ae5a7d8"}]}] Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 59dbe73883424ac29253f33bb681f622 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-510190912", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "max_count": 0}} Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-510190912', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'max_count': 0}}} Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 0 Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:09:03.053223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.056483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4da8ce76-d4c7-4c5a-ba63-023714afe715 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:03.057417 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4da8ce76-d4c7-4c5a-ba63-023714afe715 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021266 Oct 28 10:09:03.061024 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2148/4299] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 10:09:03.211335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0346f035-7f7b-40de-bc09-b551e83d7557 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-641645313", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "max_count": 2.5}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0346f035-7f7b-40de-bc09-b551e83d7557 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Request method failure captured: Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 169 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6o9o1VIMqF5f-FWptsVeYeLbqn5XFT1Y_VodheZK5FlI9a4bVW7VzKfCVpmo3rcakHuuXgyjg62ClyGdj0UVQYZvx-yvBbkJM1CcjeXjHb2giu0HxDgBD5PMOTM6DVRL4hdYGXwEuFPUTVQiWtI45dodp3JqUVaY4JxSv7jpFarDG4 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db5a7e70c534021893d95bf2ae5a7d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db5a7e70c534021893d95bf2ae5a7d8"}]}] Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 59dbe73883424ac29253f33bb681f622 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-641645313", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "max_count": 2.5}} Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-641645313', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'max_count': 2.5}}} Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:09:03.219203 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0346f035-7f7b-40de-bc09-b551e83d7557 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:03.223553 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0346f035-7f7b-40de-bc09-b551e83d7557 tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.019295 Oct 28 10:09:03.238666 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2149/4300] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:09:03.427501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:03.436861 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ed94d0b1-587b-4554-990e-e7b1f6629e83 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.686205 Oct 28 10:09:03.441984 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2152/4301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:02 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:03.467088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9338db8-3fee-458e-ad43-2975c5696d1c tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1084125352", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 0}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9338db8-3fee-458e-ad43-2975c5696d1c tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Request method failure captured: Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 168 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6o9o1VIMqF5f-FWptsVeYeLbqn5XFT1Y_VodheZK5FlI9a4bVW7VzKfCVpmo3rcakHuuXgyjg62ClyGdj0UVQYZvx-yvBbkJM1CcjeXjHb2giu0HxDgBD5PMOTM6DVRL4hdYGXwEuFPUTVQiWtI45dodp3JqUVaY4JxSv7jpFarDG4 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db5a7e70c534021893d95bf2ae5a7d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db5a7e70c534021893d95bf2ae5a7d8"}]}] Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 59dbe73883424ac29253f33bb681f622 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1084125352", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 0}} Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1084125352', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'min_count': 0}}} Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 0 Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:09:03.477191 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9338db8-3fee-458e-ad43-2975c5696d1c tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:03.480657 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e9338db8-3fee-458e-ad43-2975c5696d1c tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.021752 Oct 28 10:09:03.484453 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2150/4302] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:09:03.600889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-815aec4e-a651-4ddc-9da6-e43bce89cb8a tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-20169762", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 2.5}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-815aec4e-a651-4ddc-9da6-e43bce89cb8a tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Request method failure captured: Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 168 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6o9o1VIMqF5f-FWptsVeYeLbqn5XFT1Y_VodheZK5FlI9a4bVW7VzKfCVpmo3rcakHuuXgyjg62ClyGdj0UVQYZvx-yvBbkJM1CcjeXjHb2giu0HxDgBD5PMOTM6DVRL4hdYGXwEuFPUTVQiWtI45dodp3JqUVaY4JxSv7jpFarDG4 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1db5a7e70c534021893d95bf2ae5a7d8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1db5a7e70c534021893d95bf2ae5a7d8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1db5a7e70c534021893d95bf2ae5a7d8"}]}] Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 1db5a7e70c534021893d95bf2ae5a7d8 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1856159159 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 59dbe73883424ac29253f33bb681f622 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1856159159-project Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-20169762", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "min_count": 2.5}} Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-20169762', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'min_count': 2.5}}} Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 2.5 Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:09:03.605839 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 28 10:09:03.610826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:03.619639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-815aec4e-a651-4ddc-9da6-e43bce89cb8a tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:03.620716 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-815aec4e-a651-4ddc-9da6-e43bce89cb8a tempest-MultipleCreateNegativeTestJSON-1856159159 tempest-MultipleCreateNegativeTestJSON-1856159159-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.025069 Oct 28 10:09:03.622553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2153/4303] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:09:03.772575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:03.773252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:03.783453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:03.784282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:03.786607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:03.794736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:03.797612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:03.799761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:04.380301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:04.395356 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-963d953e-51c9-401f-b9f4-6af328960850 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 0.627501 Oct 28 10:09:04.398228 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2151/4304] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:03 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:04.464985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:04.465603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:04.484867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:04.485603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:04.486190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:04.487476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:04.488119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:04.488706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:04.997604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-80194a5d-0c54-4aee-b81d-9fd1937b3323 req-dfbbbad4-f5cf-479c-9616-489941e0e579 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5b578f1-a97a-40f8-835d-5a1c192422c7", "tag": "d6b52121-f22c-4439-9b7a-ffd9aa973a53"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:05.023923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80194a5d-0c54-4aee-b81d-9fd1937b3323 req-dfbbbad4-f5cf-479c-9616-489941e0e579 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:05.025514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80194a5d-0c54-4aee-b81d-9fd1937b3323 req-dfbbbad4-f5cf-479c-9616-489941e0e579 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:05.026281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80194a5d-0c54-4aee-b81d-9fd1937b3323 req-dfbbbad4-f5cf-479c-9616-489941e0e579 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:05.049224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-80194a5d-0c54-4aee-b81d-9fd1937b3323 req-dfbbbad4-f5cf-479c-9616-489941e0e579 service nova] Creating event network-changed:d6b52121-f22c-4439-9b7a-ffd9aa973a53 for instance a5b578f1-a97a-40f8-835d-5a1c192422c7 on n-h2-zed-1 Oct 28 10:09:05.065062 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-80194a5d-0c54-4aee-b81d-9fd1937b3323 req-dfbbbad4-f5cf-479c-9616-489941e0e579 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076969 Oct 28 10:09:05.066010 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2152/4305] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:09:05.074950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:05.081686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:05.091206 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3d99f6ad-0e20-4784-bfcc-a74d0ead58bd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.630771 Oct 28 10:09:05.091821 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2154/4306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:04 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:05.423976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:05.424776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:05.436888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:05.440886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:05.441982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:05.446143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:05.446636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:05.447075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:05.892341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:05.909726 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5f3c7988-5403-4606-8fcb-46df8f92ca37 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 0.491877 Oct 28 10:09:05.910331 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2153/4307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:05 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:06.122702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:06.128203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:06.140615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:06.141527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:06.142321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:06.143436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:06.144165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:06.145066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:06.711842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:06.729812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-747b1397-7d8d-4ec6-920f-a7886312d3c7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.611251 Oct 28 10:09:06.731033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2155/4308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:06 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:06.937932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:06.938737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:06.949616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:06.950300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:06.950935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:06.952955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:06.960933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:06.961724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:07.318510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:07.342338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3cc3e196-58e9-42cb-885f-46d645723079 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 0.409695 Oct 28 10:09:07.345697 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2154/4309] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:06 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:07.759234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:07.759996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:07.771739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:07.772566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:07.773536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:07.774798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:07.775394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:07.775909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:08.349934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:08.366799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:08.367739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:08.371874 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0739d069-eec7-4990-864d-99b2166b2c39 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.621046 Oct 28 10:09:08.380042 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2156/4310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:07 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:08.395086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:08.395710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:08.396228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:08.397159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:08.397839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:08.398627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:08.493475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:08.521103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:08.977651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:08.985983 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0ac613d-dcb4-4d1f-80ec-de25a440d46a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 0.623107 Oct 28 10:09:08.986647 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2155/4311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:08 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:09.406515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:09.407978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:09.424589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:09.428777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:09.429856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:09.430512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:09.431431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:09.432740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:09.436292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:09.763117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:09.775958 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f86fa6f7-d512-4f35-8b79-834fb53dd20b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.375694 Oct 28 10:09:09.778789 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2157/4312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:09 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:10.015313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:10.016685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:10.034381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:10.037101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:10.039691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:10.043278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:10.044561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:10.046051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:10.394083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:10.403696 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-766c834f-bac5-4de5-baf6-73b854d46869 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 0.396375 Oct 28 10:09:10.420774 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2156/4313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:10 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:10.802626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:10.803919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:10.812815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:10.825891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:10.829286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:10.830306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:10.831980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:10.834048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:11.379122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:11.394063 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62941981-8801-465a-834f-9d8782ee067b tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.594788 Oct 28 10:09:11.395937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2158/4314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:10 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:11.438541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:11.439175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:11.448722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:11.450227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:11.450979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:11.452532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:11.453289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:11.454094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:12.341085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:12.353943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0041ba64-c6a5-40a2-b9ff-c98542f138fc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 0.919574 Oct 28 10:09:12.395121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2157/4315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:11 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:12.420343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:12.421083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:12.446240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:12.447059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:12.447863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:12.449297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:12.450087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:12.453652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:13.162461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:13.174068 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8350313f-6614-4bf3-ae9d-d4754bdbb1a6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.758956 Oct 28 10:09:13.193573 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2159/4316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:12 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:13.382383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:13.384527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:13.391937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-78964dfa-a06c-482f-b46c-38d7b8a4fee2 req-ecb9ea36-7003-4e61-95a3-b8dbf7d8059d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b578f1-a97a-40f8-835d-5a1c192422c7", "name": "network-vif-plugged", "status": "completed", "tag": "d6b52121-f22c-4439-9b7a-ffd9aa973a53"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:13.426656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:13.429806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:13.431328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:13.433653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-78964dfa-a06c-482f-b46c-38d7b8a4fee2 req-ecb9ea36-7003-4e61-95a3-b8dbf7d8059d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:13.435022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:13.436579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-78964dfa-a06c-482f-b46c-38d7b8a4fee2 req-ecb9ea36-7003-4e61-95a3-b8dbf7d8059d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:13.437194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-78964dfa-a06c-482f-b46c-38d7b8a4fee2 req-ecb9ea36-7003-4e61-95a3-b8dbf7d8059d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:13.437557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:13.452202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:13.507282 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-78964dfa-a06c-482f-b46c-38d7b8a4fee2 req-ecb9ea36-7003-4e61-95a3-b8dbf7d8059d service nova] Creating event network-vif-plugged:d6b52121-f22c-4439-9b7a-ffd9aa973a53 for instance a5b578f1-a97a-40f8-835d-5a1c192422c7 on n-h2-zed-1 Oct 28 10:09:13.520680 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-78964dfa-a06c-482f-b46c-38d7b8a4fee2 req-ecb9ea36-7003-4e61-95a3-b8dbf7d8059d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133350 Oct 28 10:09:13.524001 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2160/4317] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:09:14.206277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:14.207226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:14.227111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:14.227927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:14.229077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:14.230045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:14.231424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:14.232812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:14.496353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:14.512675 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea2ef3fd-8f74-472c-b699-1a4c4a56524f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 1.135734 Oct 28 10:09:14.513629 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2158/4318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:13 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:14.802103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:14.812233 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4687687-7aa4-4cce-93c3-de196386427d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.613288 Oct 28 10:09:14.815286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2161/4319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:14 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:15.538242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:15.538879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:15.551038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:15.558468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:15.559814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:15.561463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:15.572341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:15.572820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:15.842605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:15.843421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:15.870460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:15.874636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:15.876169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:15.881101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:15.883614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:15.886469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:16.348936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:16.357967 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c7561901-27e6-4204-ad85-ce058aeb6a43 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1308 microversion: 2.1 time: 0.824246 Oct 28 10:09:16.367057 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2159/4320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:15 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1308 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:16.506978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:16.520687 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c047f791-768d-4be6-b313-88a1a04e7f35 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1506 microversion: 2.1 time: 0.683009 Oct 28 10:09:16.522544 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2162/4321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:15 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:17.406886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:17.410224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:17.424617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:17.425552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:17.428525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:17.431371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:17.434702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:17.436221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:17.546404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:17.547925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:17.572671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:17.573602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:17.574862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:17.577442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:17.578141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:17.578801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:18.016635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:18.027096 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d0fdf97-55e7-4b3b-9005-05b8dd78baf1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1486 microversion: 2.1 time: 0.484572 Oct 28 10:09:18.028407 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2163/4322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:17 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1486 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:18.078498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:18.088709 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55aa9252-0e2d-4de9-9e38-2845d003db99 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1487 microversion: 2.1 time: 0.698560 Oct 28 10:09:18.089921 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2160/4323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:17 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1487 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:18.124412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-52290454"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:18.124412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:18.140934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:18.145849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:18.149380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:18.153719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:18.154764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:18.155216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:18.295996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-707884383", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:18.550475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] validate_networks() for [('8aa252f7-bd8d-4157-9afa-f608e246a5d1', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:09:18.641574 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3faefa07-2138-4674-844f-ffbbfc25f37b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "POST /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7/action" status: 202 len: 0 microversion: 2.1 time: 0.528883 Oct 28 10:09:18.643399 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2164/4324] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:09:18 2022] POST /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:09:18.664664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-26a59bd8-47c2-4291-80a9-ac901ac0a0fd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3270c670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:18.786879 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-26a59bd8-47c2-4291-80a9-ac901ac0a0fd tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8" status: 200 len: 1412 microversion: 2.1 time: 0.135803 Oct 28 10:09:18.787800 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2165/4325] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:18 2022] GET /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8 => generated 1412 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:18.806624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b011b434-2d50-4923-a4f1-2063ff9a5c4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca327a8a60>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:18.891741 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b011b434-2d50-4923-a4f1-2063ff9a5c4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8" status: 200 len: 1412 microversion: 2.1 time: 0.090054 Oct 28 10:09:18.892348 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2166/4326] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:18 2022] GET /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8 => generated 1412 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:18.908296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c61ee8e3-1b1c-491e-b144-96ddcaed5d2b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca327163a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:19.323723 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c61ee8e3-1b1c-491e-b144-96ddcaed5d2b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8" status: 204 len: 0 microversion: 2.1 time: 0.420891 Oct 28 10:09:19.324281 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2167/4327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:18 2022] DELETE /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:09:19.332874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2075e25c-6934-4577-be0d-f5265ef757a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3270c5e0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:19.368603 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-2075e25c-6934-4577-be0d-f5265ef757a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Image not found. Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2075e25c-6934-4577-be0d-f5265ef757a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8 HTTP/1.1 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2682654d-897c-420e-947a-5ebd897df9b8'} Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2682654d-897c-420e-947a-5ebd897df9b8 Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 28 10:09:19.371248 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2682654d-897c-420e-947a-5ebd897df9b8 could not be found. Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2075e25c-6934-4577-be0d-f5265ef757a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2075e25c-6934-4577-be0d-f5265ef757a9 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8" status: 404 len: 62 microversion: 2.1 time: 0.043816 Oct 28 10:09:19.376486 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2168/4328] 10.222.0.16 () {58 vars in 1233 bytes} [Fri Oct 28 10:09:19 2022] GET /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 28 10:09:19.381972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:19.385387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:19.415754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:19.420015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:19.420658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:19.421578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:19.422185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:19.422914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:20.015867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:20.034067 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a4d429f8-cc27-4eaf-b4e3-199970e99cc4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1499 microversion: 2.1 time: 0.656045 Oct 28 10:09:20.035939 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2169/4329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:19 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1499 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:20.550692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:09:20.551135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:09:20.551547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:09:20.551978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:09:20.552442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:09:20.562041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:20.603697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:20.603802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:20.604188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:20.605796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:20.606281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:20.606750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:20.677296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Getting quotas for project 938d52ca99bf461d9175ab267ef56ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:09:20.693921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Getting quotas for user 05b11268812b415bbe36c1980bea37b6 and project 938d52ca99bf461d9175ab267ef56ae5. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:09:20.740037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:09:20.748130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:09:20.876137 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-810acf63-daf8-40e5-b3ba-a827e9c3f5b1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.584422 Oct 28 10:09:20.877510 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2161/4330] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 2587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:09:20.889236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7c0479a-9352-4b34-91cb-c243ab9db325 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:20.890098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7c0479a-9352-4b34-91cb-c243ab9db325 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:21.047525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7c0479a-9352-4b34-91cb-c243ab9db325 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:21.057830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:21.059635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:21.070691 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7c0479a-9352-4b34-91cb-c243ab9db325 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1213 microversion: 2.1 time: 0.186377 Oct 28 10:09:21.076028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:21.088938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:21.088938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:21.088938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:21.088938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:21.088938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:21.089474 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2170/4331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:20 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1213 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:21.840758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:21.857567 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e98f08b8-9139-4ebb-b529-70a9a44705ea tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1505 microversion: 2.1 time: 0.803212 Oct 28 10:09:21.858293 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2162/4332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:21 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1505 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:22.104345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:22.105148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:22.117289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:22.126032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:22.131480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:22.137075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:22.137985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:22.139869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:22.149364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1113067734", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:22.260863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] validate_networks() for [('898144ba-162d-4ebb-861c-688fbac5830b', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:09:22.399031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:22.421729 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65b98248-e4d6-4963-abd7-bfa991f9e3fd tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1209 microversion: 2.1 time: 0.322647 Oct 28 10:09:22.422796 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2163/4333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:22 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1209 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:22.776658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-331b7846-9853-4728-94ac-739dba2dfc92 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Action: 'create', calling method: .version_select at 0x7fca385f40d0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:22.812632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-331b7846-9853-4728-94ac-739dba2dfc92 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Getting quotas for project e5d457e3c222434cafad30e44c02a42a. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:09:22.829372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-331b7846-9853-4728-94ac-739dba2dfc92 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Getting quotas for user 8ebcf3f5f6914d0bb0511b8844198d51 and project e5d457e3c222434cafad30e44c02a42a. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:09:22.925866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-331b7846-9853-4728-94ac-739dba2dfc92 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Getting quotas for project e5d457e3c222434cafad30e44c02a42a. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:09:22.941656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-331b7846-9853-4728-94ac-739dba2dfc92 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Getting quotas for user 8ebcf3f5f6914d0bb0511b8844198d51 and project e5d457e3c222434cafad30e44c02a42a. Resources: {'server_groups'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:09:22.967783 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-331b7846-9853-4728-94ac-739dba2dfc92 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] 10.222.0.16 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.310634 Oct 28 10:09:22.968895 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2164/4334] 10.222.0.16 () {62 vars in 1214 bytes} [Fri Oct 28 10:09:22 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:09:22.977235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:22.980284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:22.996159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:23.003217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:23.003938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:23.004831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:23.005468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:23.006059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:23.069434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:09:23.070136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:09:23.070780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:09:23.071511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:09:23.072078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:09:23.085918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:23.086664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:23.087259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:23.088185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:23.088855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:23.089643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:23.110328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for project 80974eba622d4830886ec598e50cad90. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:09:23.116647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for user f4dc1824197d40e58d0dfdc8f55ab72d and project 80974eba622d4830886ec598e50cad90. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:09:23.131230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:09:23.133965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:09:23.204788 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e334900e-7828-4fe0-ba19-31f475030a3f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.217722 Oct 28 10:09:23.213755 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2171/4335] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:09:23.220532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ca60f9d-20e3-4d48-a1e1-aadef419e193 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:23.234972 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ca60f9d-20e3-4d48-a1e1-aadef419e193 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.018698 Oct 28 10:09:23.237390 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2172/4336] 10.222.0.16 () {60 vars in 1193 bytes} [Fri Oct 28 10:09:23 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:09:23.257143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c37f540-30a0-4730-97ae-55a9565692eb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:23.258263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c37f540-30a0-4730-97ae-55a9565692eb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:23.376875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c37f540-30a0-4730-97ae-55a9565692eb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:23.395650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c37f540-30a0-4730-97ae-55a9565692eb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1222 microversion: 2.1 time: 0.156118 Oct 28 10:09:23.396724 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2173/4337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:23 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:23.414919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dffeb5a4-e25b-4e7d-9403-3a4f542052a5 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:23.434130 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dffeb5a4-e25b-4e7d-9403-3a4f542052a5 tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] 10.222.0.16 "GET /compute/v2.1/os-server-groups/d6433d9f-ed25-4753-8797-4902c0fe3fd5" status: 200 len: 235 microversion: 2.64 time: 0.034437 Oct 28 10:09:23.443068 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2174/4338] 10.222.0.16 () {60 vars in 1304 bytes} [Fri Oct 28 10:09:23 2022] GET /compute/v2.1/os-server-groups/d6433d9f-ed25-4753-8797-4902c0fe3fd5 => generated 235 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:09:23.452378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:23.453752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:23.482435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:23.485442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:23.488808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:23.490966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:23.491752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:23.492412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:23.517897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:23.541100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-94c9fb39-8c2d-48cd-a2cd-008eeec6c02a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1505 microversion: 2.1 time: 0.566818 Oct 28 10:09:23.543528 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2165/4339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:22 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1505 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:23.590277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1084a5e-74da-4d94-994a-5196b009a2bc tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:23.635793 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d1084a5e-74da-4d94-994a-5196b009a2bc tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d6433d9f-ed25-4753-8797-4902c0fe3fd5" status: 204 len: 0 microversion: 2.64 time: 0.080981 Oct 28 10:09:23.636845 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2166/4340] 10.222.0.16 () {60 vars in 1307 bytes} [Fri Oct 28 10:09:23 2022] DELETE /compute/v2.1/os-server-groups/d6433d9f-ed25-4753-8797-4902c0fe3fd5 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:09:23.645206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-986098957", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:23.647314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:23.661551 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dc099df4-9855-4fa3-933d-7a89078ec1db tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1271 microversion: 2.1 time: 0.212678 Oct 28 10:09:23.662509 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2175/4341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:23 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1271 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:23.699856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cdd2c61-d301-43b6-8c57-e596cead32ca tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:23.731623 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8cdd2c61-d301-43b6-8c57-e596cead32ca tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] HTTP exception thrown: Instance group d6433d9f-ed25-4753-8797-4902c0fe3fd5 could not be found. Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cdd2c61-d301-43b6-8c57-e596cead32ca tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Request method failure captured: Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/os-server-groups/d6433d9f-ed25-4753-8797-4902c0fe3fd5 HTTP/1.1 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6pS4jj8tRA4n88H9RcmX1_sRJZOvQihjpdZk8F83GKddbm2Sg7ymXimTOtNMEtI5onXm4OX3GanSvv_WOesBRuvGYDe_3GGT6wZDvatjwgiaHyLRW8mj3_H5PD9T-soooJRTKZ1wgZnr3EpnW8zSgP9T3leiUZLHtPXml9k-KnqraI Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.64 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e5d457e3c222434cafad30e44c02a42a Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerGroup264TestJSON-2124419395 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5d457e3c222434cafad30e44c02a42a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e5d457e3c222434cafad30e44c02a42a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e5d457e3c222434cafad30e44c02a42a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e5d457e3c222434cafad30e44c02a42a"}]}] Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerGroup264TestJSON-2124419395 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e5d457e3c222434cafad30e44c02a42a Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerGroup264TestJSON-2124419395 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerGroup264TestJSON-2124419395-project Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8ebcf3f5f6914d0bb0511b8844198d51 Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerGroup264TestJSON-2124419395-project Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance group d6433d9f-ed25-4753-8797-4902c0fe3fd5 could not be found. Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'd6433d9f-ed25-4753-8797-4902c0fe3fd5'} Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d6433d9f-ed25-4753-8797-4902c0fe3fd5 could not be found. Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d6433d9f-ed25-4753-8797-4902c0fe3fd5 could not be found. Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:23.737316 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:23.740834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:23.740834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:23.740834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:23.740834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:23.740834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d6433d9f-ed25-4753-8797-4902c0fe3fd5 could not be found. Oct 28 10:09:23.740834 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:23.742980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cdd2c61-d301-43b6-8c57-e596cead32ca tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] Returning 404 to user: Instance group d6433d9f-ed25-4753-8797-4902c0fe3fd5 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:23.746201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8cdd2c61-d301-43b6-8c57-e596cead32ca tempest-ServerGroup264TestJSON-2124419395 tempest-ServerGroup264TestJSON-2124419395-project] 10.222.0.16 "DELETE /compute/v2.1/os-server-groups/d6433d9f-ed25-4753-8797-4902c0fe3fd5" status: 404 len: 117 microversion: 2.64 time: 0.054670 Oct 28 10:09:23.749918 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2176/4342] 10.222.0.16 () {60 vars in 1307 bytes} [Fri Oct 28 10:09:23 2022] DELETE /compute/v2.1/os-server-groups/d6433d9f-ed25-4753-8797-4902c0fe3fd5 => generated 117 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:09:23.778076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] validate_networks() for [('898144ba-162d-4ebb-861c-688fbac5830b', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:09:24.570059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:24.570840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:24.599190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:24.599686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:24.606438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:24.609545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:24.611656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:24.612135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:25.250602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:25.264526 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ada333d-06f8-41c1-98b5-fd77b8bfff71 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1505 microversion: 2.1 time: 0.698774 Oct 28 10:09:25.268339 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2177/4343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:24 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1505 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:25.283651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:25.288766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:25.312951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:25.313715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:25.315882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:25.317375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:25.319558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:25.323065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:25.723783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:25.739935 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-540bef3d-fe47-49f9-a718-bbb6e3a383f7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1271 microversion: 2.1 time: 0.468450 Oct 28 10:09:25.767402 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2178/4344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:25 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1271 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:26.290629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:26.291438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:26.303841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:26.303941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:26.304316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:26.305095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:26.305549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:26.305977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:27.625360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:27.650189 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea46c469-2be1-4f05-8643-c18c3bd5614d tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1487 microversion: 2.1 time: 1.363282 Oct 28 10:09:27.663828 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2179/4345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:26 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1487 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:27.704891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:27.705890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:27.730084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:27.732483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:27.733433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:27.734475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:27.735862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:27.736896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:27.796893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:27.880511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:09:27.881591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:09:27.882283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:09:27.883282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:09:27.884227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:09:27.911412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:27.912165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:27.912823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:27.916014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:27.916717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:27.917359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:27.946079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:27.959333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for project 80974eba622d4830886ec598e50cad90. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:09:27.966220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for user f4dc1824197d40e58d0dfdc8f55ab72d and project 80974eba622d4830886ec598e50cad90. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:09:27.992478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:09:27.997892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:09:28.108048 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5a50cea1-da05-450a-bf90-97f27068045a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.469447 Oct 28 10:09:28.113127 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2167/4346] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:09:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 4475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:09:28.123773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:28.125602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:28.148746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:28.149558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:28.164377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:28.168211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:28.171017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:28.172289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:28.227453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:09:28.405494 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e51cfe3-f788-4c4f-8cb3-d2d55ce29009 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 204 len: 0 microversion: 2.1 time: 0.289285 Oct 28 10:09:28.409289 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2168/4347] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:09:28 2022] DELETE /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:28.420973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-306c1f9f-e3de-42d0-a35a-1680bdd937a6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:28.422098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-306c1f9f-e3de-42d0-a35a-1680bdd937a6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:28.468193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:28.483665 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5c05f22-368d-4b69-a94c-14838b980a54 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 0.812874 Oct 28 10:09:28.484312 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2180/4348] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:27 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:28.496364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6571ffed-4c5e-47c4-8910-39b448debd27 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3276f8b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:28.551282 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6571ffed-4c5e-47c4-8910-39b448debd27 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Image not found. Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6571ffed-4c5e-47c4-8910-39b448debd27 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8 HTTP/1.1 Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2682654d-897c-420e-947a-5ebd897df9b8'} Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2682654d-897c-420e-947a-5ebd897df9b8 to delete Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2682654d-897c-420e-947a-5ebd897df9b8 could not be found. Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:28.553434 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:09:28.559292 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:28.562339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6571ffed-4c5e-47c4-8910-39b448debd27 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:28.563371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6571ffed-4c5e-47c4-8910-39b448debd27 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8" status: 404 len: 62 microversion: 2.1 time: 0.078120 Oct 28 10:09:28.567852 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2181/4349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:28 2022] DELETE /compute/v2.1/images/2682654d-897c-420e-947a-5ebd897df9b8 => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:09:28.574865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:28.577589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:28.605935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:28.607954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:28.608575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:28.609731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:28.612483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:28.614566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:28.670653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:09:28.740842 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Instance is already in deleting state, ignoring this request Oct 28 10:09:28.742040 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb19758a-cf87-4624-8ae2-6b1b5d7b1c86 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 204 len: 0 microversion: 2.1 time: 0.172808 Oct 28 10:09:28.742782 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2182/4350] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:09:28 2022] DELETE /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:09:28.753772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:28.754633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:28.762561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:28.763262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:28.763860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:28.764982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:28.765664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:28.766248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:28.850209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-306c1f9f-e3de-42d0-a35a-1680bdd937a6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:28.894465 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-306c1f9f-e3de-42d0-a35a-1680bdd937a6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1221 microversion: 2.1 time: 0.480381 Oct 28 10:09:28.895100 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2169/4351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:28 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1221 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:29.461948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:29.477080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-318a8d8f-60a0-4f82-bc07-25a97ad782ce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1493 microversion: 2.1 time: 0.728808 Oct 28 10:09:29.494278 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2183/4352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:28 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1493 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:29.517742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:29.520629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:29.546537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:29.548782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:29.551182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:29.553931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:29.554548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:29.554896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:29.921008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:29.921433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:29.933192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:29.933822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:29.934286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:29.935880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:29.936664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:29.936857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:30.096069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:30.111133 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2f67d232-89c4-4564-b7bf-449f17a3b3bd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1273 microversion: 2.1 time: 0.195244 Oct 28 10:09:30.115578 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2184/4353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:29 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1273 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:30.466919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:30.477803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7621b81-582a-4c6a-a0c1-796322776087 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 0.965671 Oct 28 10:09:30.478408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2170/4354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:29 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:30.507298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:30.508415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:30.511964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:30.547051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:30.550124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:30.552400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:30.555537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:30.563411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:30.564147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:31.143356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:31.143989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:31.171104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:31.171513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:31.171969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:31.172701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:31.176834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:31.177397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:31.464274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:31.480580 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d6dfb3a-2c2b-4847-b277-90715332cb54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1279 microversion: 2.1 time: 0.340460 Oct 28 10:09:31.494015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2171/4355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:31 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1279 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:31.503533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4d65ceda-3a66-4249-be92-e3c0d1868e92 req-71fab9e3-1bed-4888-b7a1-40419edc9460 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2fc0eda-b280-4d7f-88a8-39888fdffe5f", "tag": "716b824f-debf-4e76-8b9a-909e7223940b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:31.524942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4d65ceda-3a66-4249-be92-e3c0d1868e92 req-71fab9e3-1bed-4888-b7a1-40419edc9460 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:31.525455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4d65ceda-3a66-4249-be92-e3c0d1868e92 req-71fab9e3-1bed-4888-b7a1-40419edc9460 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:31.525896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4d65ceda-3a66-4249-be92-e3c0d1868e92 req-71fab9e3-1bed-4888-b7a1-40419edc9460 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:31.551811 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4d65ceda-3a66-4249-be92-e3c0d1868e92 req-71fab9e3-1bed-4888-b7a1-40419edc9460 service nova] Creating event network-changed:716b824f-debf-4e76-8b9a-909e7223940b for instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f on n-h1-zed-1 Oct 28 10:09:31.561078 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4d65ceda-3a66-4249-be92-e3c0d1868e92 req-71fab9e3-1bed-4888-b7a1-40419edc9460 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065712 Oct 28 10:09:31.562379 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2172/4356] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:09:31.569257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:31.570297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:31.579768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:31.580756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:31.581658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:31.582660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:31.583669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:31.584327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:31.836945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:31.853153 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-927c1ef0-4fc7-475a-bb50-eeee15f14580 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1493 microversion: 2.1 time: 1.349920 Oct 28 10:09:31.854953 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2185/4357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:30 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1493 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:32.456363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:32.465448 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7604e606-d233-4ea4-9451-cff69c9e9667 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 0.901289 Oct 28 10:09:32.477106 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2173/4358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:31 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:32.517561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:32.518825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:32.531591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:32.533828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:32.536013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:32.536968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:32.543616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:32.544482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:32.744369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:32.757451 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef88fbda-d8c1-450e-abb8-08c9cf7e8bf6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1279 microversion: 2.1 time: 0.245499 Oct 28 10:09:32.763072 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2186/4359] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:32 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1279 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:32.881444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:32.882071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:32.896831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:32.897410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:32.897863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:32.902008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:32.903933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:32.904695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:33.501755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:33.502380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:33.506026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:33.514204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:33.528704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:33.529759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:33.530612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:33.532204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:33.532204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:33.534838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:33.562763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:33.591155 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-473c638a-fc36-4e20-b2cf-fc8d437ecdf2 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1493 microversion: 2.1 time: 0.712606 Oct 28 10:09:33.591915 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2174/4360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:32 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1493 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:33.786415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:33.787045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:33.796215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:33.797023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:33.797635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:33.798537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:33.799480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:33.800112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:34.197886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:34.211034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4701e72d-1c98-4161-b464-81d4e1746e1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1279 microversion: 2.1 time: 0.428849 Oct 28 10:09:34.211726 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2175/4361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:33 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1279 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:34.617262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:34.617994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:34.628260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:34.629961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:34.630772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:34.631726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:34.632482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:34.633324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:34.775776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:34.807324 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f0c90d4d-c3c0-4ae6-936e-54146d51a679 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 1.309425 Oct 28 10:09:34.808020 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2187/4362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:33 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:34.900766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90aefa22b02749e8a6b03d16378a0a6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd6225eaaa5f4d4db1afcb9c6ffeeb3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:34.919743 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df972d6b-e7df-4ecf-88cc-97813abc7dce tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 200 len: 1451 microversion: 2.1 time: 0.302827 Oct 28 10:09:34.925228 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2176/4363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:34 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 1451 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:35.172423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-10f6b132-75ec-4570-a6fc-a8414743652c req-7891d383-391f-458e-92a7-05bae7cc359f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5b578f1-a97a-40f8-835d-5a1c192422c7", "name": "network-vif-deleted", "tag": "d6b52121-f22c-4439-9b7a-ffd9aa973a53"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:35.223714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-10f6b132-75ec-4570-a6fc-a8414743652c req-7891d383-391f-458e-92a7-05bae7cc359f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:35.224450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-10f6b132-75ec-4570-a6fc-a8414743652c req-7891d383-391f-458e-92a7-05bae7cc359f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:35.238553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:35.240842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:35.258967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-10f6b132-75ec-4570-a6fc-a8414743652c req-7891d383-391f-458e-92a7-05bae7cc359f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:35.301028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:35.303423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:35.304061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:35.305724 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-10f6b132-75ec-4570-a6fc-a8414743652c req-7891d383-391f-458e-92a7-05bae7cc359f service nova] Creating event network-vif-deleted:d6b52121-f22c-4439-9b7a-ffd9aa973a53 for instance a5b578f1-a97a-40f8-835d-5a1c192422c7 on n-h2-zed-1 Oct 28 10:09:35.305871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:35.306198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:35.306642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:35.323254 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-10f6b132-75ec-4570-a6fc-a8414743652c req-7891d383-391f-458e-92a7-05bae7cc359f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171557 Oct 28 10:09:35.324243 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2188/4364] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:09:35.714867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-366ecc75-e9d2-432f-a3a5-50ba95777e36 req-1ede22ee-415f-4fdb-b813-cba7210ceab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1830271f-4c7c-4e75-9170-db188cfc0b75", "tag": "de443f28-add0-435c-a727-abade52c6278"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:35.748800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-366ecc75-e9d2-432f-a3a5-50ba95777e36 req-1ede22ee-415f-4fdb-b813-cba7210ceab8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:35.749574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-366ecc75-e9d2-432f-a3a5-50ba95777e36 req-1ede22ee-415f-4fdb-b813-cba7210ceab8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:35.750208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-366ecc75-e9d2-432f-a3a5-50ba95777e36 req-1ede22ee-415f-4fdb-b813-cba7210ceab8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:35.773308 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-366ecc75-e9d2-432f-a3a5-50ba95777e36 req-1ede22ee-415f-4fdb-b813-cba7210ceab8 service nova] Creating event network-changed:de443f28-add0-435c-a727-abade52c6278 for instance 1830271f-4c7c-4e75-9170-db188cfc0b75 on n-h2-zed-1 Oct 28 10:09:35.782298 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-366ecc75-e9d2-432f-a3a5-50ba95777e36 req-1ede22ee-415f-4fdb-b813-cba7210ceab8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075721 Oct 28 10:09:35.784701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2189/4365] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:09:35.841073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:35.849191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:35.933701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:35.935846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:35.936749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:35.949599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:35.951297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.001618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.125248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:36.140686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ced50428-f0c0-457a-a473-d08e3a24115a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.906640 Oct 28 10:09:36.143783 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2177/4366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:35 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:36.155628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.159832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: a5b578f1-a97a-40f8-835d-5a1c192422c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.168443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:36.181605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.183899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.185935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.190039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.193319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.193784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.234338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance a5b578f1-a97a-40f8-835d-5a1c192422c7 could not be found. Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 HTTP/1.1 Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a5b578f1-a97a-40f8-835d-5a1c192422c7 could not be found. Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a5b578f1-a97a-40f8-835d-5a1c192422c7'} Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5b578f1-a97a-40f8-835d-5a1c192422c7 could not be found. Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5b578f1-a97a-40f8-835d-5a1c192422c7 could not be found. Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.237160 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.243369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.243369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.243369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.243369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.243369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5b578f1-a97a-40f8-835d-5a1c192422c7 could not be found. Oct 28 10:09:36.243369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.244933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance a5b578f1-a97a-40f8-835d-5a1c192422c7 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.246109 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e62df47-3d7c-4f39-9cf4-ad141df3aaf3 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7" status: 404 len: 111 microversion: 2.1 time: 0.100064 Oct 28 10:09:36.246984 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2178/4367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:36 2022] GET /compute/v2.1/servers/a5b578f1-a97a-40f8-835d-5a1c192422c7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:36.258248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.259949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.276002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.289716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.290521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.291690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.292671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.293374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.320803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a HTTP/1.1 Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7e38e519-0d1d-4852-b07a-c41967f5bc3a'} Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:36.322660 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.326372 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.335584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.337554 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-955db3cd-e28f-4b33-97c1-5381a30d7a4a tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 404 len: 111 microversion: 2.1 time: 0.083728 Oct 28 10:09:36.338860 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2179/4368] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:09:36 2022] DELETE /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:36.347228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.347851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 7e38e519-0d1d-4852-b07a-c41967f5bc3a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.354215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.354919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.355522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.357082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.357703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.358295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.387751 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a HTTP/1.1 Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7e38e519-0d1d-4852-b07a-c41967f5bc3a'} Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.389870 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.394224 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.394224 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.394224 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.394224 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.394224 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. Oct 28 10:09:36.394224 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.395331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance 7e38e519-0d1d-4852-b07a-c41967f5bc3a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.397064 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7b2337e9-c086-4684-8ff4-17ba3f4fc19b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a" status: 404 len: 111 microversion: 2.1 time: 0.053557 Oct 28 10:09:36.401287 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2180/4369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:36 2022] GET /compute/v2.1/servers/7e38e519-0d1d-4852-b07a-c41967f5bc3a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:36.415402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42c328bb-9ce6-43fc-9369-3cbc4c9cad70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3ba081f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.459270 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-42c328bb-9ce6-43fc-9369-3cbc4c9cad70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Image not found. Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42c328bb-9ce6-43fc-9369-3cbc4c9cad70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 HTTP/1.1 Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '239bb313-8497-4786-83f5-f35826c57e31'} Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 239bb313-8497-4786-83f5-f35826c57e31 to delete Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 239bb313-8497-4786-83f5-f35826c57e31 could not be found. Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.462818 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:09:36.468050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.474965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42c328bb-9ce6-43fc-9369-3cbc4c9cad70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.475967 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-42c328bb-9ce6-43fc-9369-3cbc4c9cad70 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31" status: 404 len: 62 microversion: 2.1 time: 0.070934 Oct 28 10:09:36.476865 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2181/4370] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:36 2022] DELETE /compute/v2.1/images/239bb313-8497-4786-83f5-f35826c57e31 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:09:36.485417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.485932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.504684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.505275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.505726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.506453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.509709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.510227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.535635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:36.548508 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-be5a4098-998e-4996-aec3-3f52cecf17bb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 0.720778 Oct 28 10:09:36.549158 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2190/4371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:35 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:36.556743 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 HTTP/1.1 Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e88ec883-ff30-424e-a2d2-fc90e4c02680'} Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:36.563082 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.567455 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.572724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.574222 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b3284c74-a16b-4d02-811a-4012c82360b4 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 404 len: 111 microversion: 2.1 time: 0.093631 Oct 28 10:09:36.576676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2182/4372] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:09:36 2022] DELETE /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:09:36.590472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.591780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: e88ec883-ff30-424e-a2d2-fc90e4c02680] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.609954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.621794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.622531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.623719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.624340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.624972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.646722 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 HTTP/1.1 Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e88ec883-ff30-424e-a2d2-fc90e4c02680'} Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.655459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance e88ec883-ff30-424e-a2d2-fc90e4c02680 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-30485a29-ce26-4b44-9a79-b52d2aa11eed tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680" status: 404 len: 111 microversion: 2.1 time: 0.077492 Oct 28 10:09:36.659627 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2191/4373] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:36 2022] GET /compute/v2.1/servers/e88ec883-ff30-424e-a2d2-fc90e4c02680 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:36.668390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-790bf7d8-3377-4227-8f83-04fdfbfb20ab tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca3309b550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.727571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-790bf7d8-3377-4227-8f83-04fdfbfb20ab tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Image not found. Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-790bf7d8-3377-4227-8f83-04fdfbfb20ab tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be HTTP/1.1 Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4698fefe-99e4-4a00-9808-056c42b870be'} Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4698fefe-99e4-4a00-9808-056c42b870be to delete Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4698fefe-99e4-4a00-9808-056c42b870be could not be found. Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.729394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:09:36.734269 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.735825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-790bf7d8-3377-4227-8f83-04fdfbfb20ab tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.737383 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-790bf7d8-3377-4227-8f83-04fdfbfb20ab tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be" status: 404 len: 62 microversion: 2.1 time: 0.073872 Oct 28 10:09:36.737383 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2183/4374] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:36 2022] DELETE /compute/v2.1/images/4698fefe-99e4-4a00-9808-056c42b870be => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:09:36.745004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.745433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.758767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.759266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.759705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.760479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.760956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.761379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.795733 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 HTTP/1.1 Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'c887bd71-f702-4d75-98af-df3ea11c7184'} Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:36.806503 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94f13da4-56dc-46ff-82d3-116f59982897 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 404 len: 111 microversion: 2.1 time: 0.067333 Oct 28 10:09:36.810911 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2192/4375] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:09:36 2022] DELETE /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:36.822299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.824159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: c887bd71-f702-4d75-98af-df3ea11c7184] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.845708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.848017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.851532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.854100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.856560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.861553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.893822 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 HTTP/1.1 Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'c887bd71-f702-4d75-98af-df3ea11c7184'} Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.897692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.902112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.902112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.902112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.902112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.902112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. Oct 28 10:09:36.902112 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.904184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance c887bd71-f702-4d75-98af-df3ea11c7184 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.906930 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dca6543-d143-40f0-8984-3e8c2643cfdc tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184" status: 404 len: 111 microversion: 2.1 time: 0.089262 Oct 28 10:09:36.908055 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2184/4376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:36 2022] GET /compute/v2.1/servers/c887bd71-f702-4d75-98af-df3ea11c7184 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:36.915920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-571dedce-7038-4c88-bd89-c4db9fc43a02 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca32451700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.949697 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-571dedce-7038-4c88-bd89-c4db9fc43a02 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Image not found. Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-571dedce-7038-4c88-bd89-c4db9fc43a02 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 HTTP/1.1 Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: exception: Image not found. Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1b014c53-1679-4e7f-b4f8-e219b12633b9'} Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1b014c53-1679-4e7f-b4f8-e219b12633b9 to delete Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1b014c53-1679-4e7f-b4f8-e219b12633b9 could not be found. Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.951479 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-571dedce-7038-4c88-bd89-c4db9fc43a02 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Image not found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:36.955513 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-571dedce-7038-4c88-bd89-c4db9fc43a02 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9" status: 404 len: 62 microversion: 2.1 time: 0.041352 Oct 28 10:09:36.961897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:36.962402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:36.965266 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2193/4377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:36 2022] DELETE /compute/v2.1/images/1b014c53-1679-4e7f-b4f8-e219b12633b9 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:09:36.982397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.982799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.983245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:36.983959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:36.984421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:36.984853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.011763 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c HTTP/1.1 Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '15ca8e5c-539b-4bca-801a-66238374918c'} Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:37.013618 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.017721 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.024944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:37.026583 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f117bb21-bad4-4429-8ecd-0237294ccf1b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 404 len: 111 microversion: 2.1 time: 0.068672 Oct 28 10:09:37.034676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2185/4378] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:09:36 2022] DELETE /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:37.041086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:37.042010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 15ca8e5c-539b-4bca-801a-66238374918c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:37.052062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.052849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.053681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.054593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.055239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.055857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.072082 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c HTTP/1.1 Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '15ca8e5c-539b-4bca-801a-66238374918c'} Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.074008 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.077671 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.077671 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.077671 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:37.077671 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:37.077671 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. Oct 28 10:09:37.077671 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.082461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance 15ca8e5c-539b-4bca-801a-66238374918c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:37.083691 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4530c9aa-e5c6-4fc7-8365-5f577ee49078 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c" status: 404 len: 111 microversion: 2.1 time: 0.047199 Oct 28 10:09:37.093108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-869ca07d-eb4d-4906-8a91-42307de54230 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '.version_select at 0x7fca33059af0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:37.099571 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2194/4379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:37 2022] GET /compute/v2.1/servers/15ca8e5c-539b-4bca-801a-66238374918c => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:37.134290 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-869ca07d-eb4d-4906-8a91-42307de54230 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Image not found. Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-869ca07d-eb4d-4906-8a91-42307de54230 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada HTTP/1.1 Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: exception: Image not found. Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0a3440fa-faf0-4e58-81c1-e86b0c761ada'} Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0a3440fa-faf0-4e58-81c1-e86b0c761ada to delete Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0a3440fa-faf0-4e58-81c1-e86b0c761ada could not be found. Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.136220 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-869ca07d-eb4d-4906-8a91-42307de54230 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Image not found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:37.142017 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-869ca07d-eb4d-4906-8a91-42307de54230 tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada" status: 404 len: 62 microversion: 2.1 time: 0.049023 Oct 28 10:09:37.146189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:37.146691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:37.149727 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2186/4380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:37 2022] DELETE /compute/v2.1/images/0a3440fa-faf0-4e58-81c1-e86b0c761ada => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:09:37.160523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.161146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.161595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.162337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.162791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.163220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.170396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:37.171018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:37.183108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.189721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.190444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.191413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.213811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.219581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.235777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 HTTP/1.1 Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2d06442d-74eb-4207-9362-555ed34ffa32'} Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:37.241270 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.244774 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.252396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:37.256352 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a393fb08-450b-49d3-b2ef-c91f7bcec43b tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 404 len: 111 microversion: 2.1 time: 0.113892 Oct 28 10:09:37.260400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2195/4381] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:09:37 2022] DELETE /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:37.272114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:37.273887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] [instance: 2d06442d-74eb-4207-9362-555ed34ffa32] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:37.286553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.290507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.292451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.295596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.297019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.300034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.343733 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] HTTP exception thrown: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Request method failure captured: Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 HTTP/1.1 Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6jl_RH2xiVtaiQqMHjU1gBPAzPuLIXpQUjKD3qEGwJLYP5rvLBdSE4pZqQxhcmPmOcqp7R6YdtkPgQAcSbOzzGbe47yZPaVhd3vzRAFsHfXNsplom4v3xKYC81_QhY7EuWpNPZBBun1M-AWNxyajzJQfR_1UdNz-_KRTvqG7GmXloo Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_cd6225eaaa5f4d4db1afcb9c6ffeeb3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/cd6225eaaa5f4d4db1afcb9c6ffeeb3a"}]}] Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: cd6225eaaa5f4d4db1afcb9c6ffeeb3a Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ImagesTestJSON-1660298014 Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90aefa22b02749e8a6b03d16378a0a6c Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ImagesTestJSON-1660298014-project Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2d06442d-74eb-4207-9362-555ed34ffa32'} Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.346988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:37.351361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:37.351361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:37.351361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:37.351361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:37.351361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. Oct 28 10:09:37.351361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:37.354213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] Returning 404 to user: Instance 2d06442d-74eb-4207-9362-555ed34ffa32 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:37.356475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e74b7c02-e8aa-4dc1-b747-97613fd4829f tempest-ImagesTestJSON-1660298014 tempest-ImagesTestJSON-1660298014-project] 10.222.0.16 "GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32" status: 404 len: 111 microversion: 2.1 time: 0.091310 Oct 28 10:09:37.364396 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2196/4382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:37 2022] GET /compute/v2.1/servers/2d06442d-74eb-4207-9362-555ed34ffa32 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:09:37.577271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:37.578347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:37.604383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.606555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.607861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.608839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:37.613224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:37.616562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:37.870593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:37.887652 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-380e0d52-f7da-4c8b-a5ec-50f74c37516f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.713923 Oct 28 10:09:37.888604 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2187/4383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:37 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:38.908404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:38.911759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:38.913060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:38.921515 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-290e3e0f-8272-421c-a4c2-a0d35ab6ad44 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 1.349873 Oct 28 10:09:38.923776 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2197/4384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:37 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:38.924774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:38.929540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=22 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:38.933877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:38.936761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:38.937425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:38.940314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:38.942566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:38.945206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:39.537005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:39.548491 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6bd9e0fa-5e51-4674-a6bc-8e404d6eeae1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.640968 Oct 28 10:09:39.549448 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2188/4385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:38 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:39.957326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:39.958075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:39.966054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:39.966659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:39.967109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:39.967894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:39.968411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:39.968997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:40.147568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-40a6fbff-37e4-47a6-bc51-30b38b13b3de req-1b9ca35f-86ba-408d-a378-be0b8f345092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fc0eda-b280-4d7f-88a8-39888fdffe5f", "name": "network-vif-plugged", "status": "completed", "tag": "716b824f-debf-4e76-8b9a-909e7223940b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:40.163934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-40a6fbff-37e4-47a6-bc51-30b38b13b3de req-1b9ca35f-86ba-408d-a378-be0b8f345092 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:40.168187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-40a6fbff-37e4-47a6-bc51-30b38b13b3de req-1b9ca35f-86ba-408d-a378-be0b8f345092 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:40.168897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-40a6fbff-37e4-47a6-bc51-30b38b13b3de req-1b9ca35f-86ba-408d-a378-be0b8f345092 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:40.196335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-40a6fbff-37e4-47a6-bc51-30b38b13b3de req-1b9ca35f-86ba-408d-a378-be0b8f345092 service nova] Creating event network-vif-plugged:716b824f-debf-4e76-8b9a-909e7223940b for instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f on n-h1-zed-1 Oct 28 10:09:40.212888 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-40a6fbff-37e4-47a6-bc51-30b38b13b3de req-1b9ca35f-86ba-408d-a378-be0b8f345092 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069157 Oct 28 10:09:40.214442 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2189/4386] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:09:40.292658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-00a54cf2-fffd-4484-8654-2a5a0750e890 req-a9beaff2-92c3-437b-8b59-9b5b6fd70b22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8d40318-f07b-4972-bd7b-2424b794d6de", "tag": "af6dcfb6-7754-4fff-858c-07a6a63b6732"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:40.330232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-00a54cf2-fffd-4484-8654-2a5a0750e890 req-a9beaff2-92c3-437b-8b59-9b5b6fd70b22 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:40.331489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-00a54cf2-fffd-4484-8654-2a5a0750e890 req-a9beaff2-92c3-437b-8b59-9b5b6fd70b22 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:40.332092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-00a54cf2-fffd-4484-8654-2a5a0750e890 req-a9beaff2-92c3-437b-8b59-9b5b6fd70b22 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:40.347340 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-00a54cf2-fffd-4484-8654-2a5a0750e890 req-a9beaff2-92c3-437b-8b59-9b5b6fd70b22 service nova] Creating event network-changed:af6dcfb6-7754-4fff-858c-07a6a63b6732 for instance d8d40318-f07b-4972-bd7b-2424b794d6de on n-h1-zed-1 Oct 28 10:09:40.352825 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-00a54cf2-fffd-4484-8654-2a5a0750e890 req-a9beaff2-92c3-437b-8b59-9b5b6fd70b22 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067531 Oct 28 10:09:40.354110 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2190/4387] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:09:40.572327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:40.573193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:40.585986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:40.586493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:40.586930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:40.603598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:40.604361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:40.605047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:40.641617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:40.662196 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d5c62b1-4911-4269-98ba-129f2da77e4c tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 0.714636 Oct 28 10:09:40.664222 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2198/4388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:39 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:41.079085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:41.092398 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b09a2542-b582-4ed0-9873-d68c20ae492f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.522800 Oct 28 10:09:41.112804 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2191/4389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:40 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:41.695063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:41.710574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:41.718697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:41.719439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:41.722454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:41.725928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:41.728840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:41.730212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:42.132593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:42.133260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:42.171730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:42.172263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:42.172716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:42.179593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:42.180099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:42.180546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:42.466865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:42.469808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:42.479983 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-549a3a3a-883f-4a60-b71e-32e27f3d4c4a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.363883 Oct 28 10:09:42.493918 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2192/4390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:42 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:42.712885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:42.724802 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-863e2372-fe9f-4ad3-83a8-f7fdb0069ca4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1313 microversion: 2.1 time: 1.036229 Oct 28 10:09:42.725945 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2199/4391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:41 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1313 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:43.504522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:43.505178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:43.516288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:43.516799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:43.517296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:43.518020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:43.518485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:43.518921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:43.749772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:43.750422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:43.770097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:43.770591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:43.771218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:43.772144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:43.773449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:43.774139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:43.982314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:43.994919 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92686dc0-2ee9-4d2d-ba01-014750f48514 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.494244 Oct 28 10:09:44.001199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2193/4392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:43 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:44.635663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:44.647640 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1180c1b0-17fd-49e4-9d65-ab427d0da698 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1500 microversion: 2.1 time: 0.902312 Oct 28 10:09:44.661366 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2200/4393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:43 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1500 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:44.671549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:44.673882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:44.680946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:44.681438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:44.682073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:44.682945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:44.683565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:44.684678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:44.711338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lazy-loading 'flavor' on Instance uuid a2fc0eda-b280-4d7f-88a8-39888fdffe5f {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:09:44.808070 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c12abe33-a784-49f9-b051-b522abbdd620 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "POST /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f/action" status: 200 len: 32 microversion: 2.1 time: 0.140572 Oct 28 10:09:44.810381 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2194/4394] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:09:44 2022] POST /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:09:44.824933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:44.826979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:44.839461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:44.848299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:44.848760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:44.849541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:44.850135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:44.850569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:45.030833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:45.039013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:45.054027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:45.055521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:45.057427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:45.061144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:45.061860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:45.062525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:45.362042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:45.375800 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75e03c20-11ea-4f3b-9ad9-556924ec3cac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.351987 Oct 28 10:09:45.377350 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2195/4395] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:45 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:45.625921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:45.636757 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12c26eeb-a5bd-42e7-9ddd-dd04146d9a49 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.820206 Oct 28 10:09:45.638530 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2201/4396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:44 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:46.157765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c9628d7c-a554-4727-b047-4eebbfca68c4 req-0d44ca31-a504-4c72-bc3d-e83a2afd342b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1830271f-4c7c-4e75-9170-db188cfc0b75", "name": "network-vif-plugged", "status": "completed", "tag": "de443f28-add0-435c-a727-abade52c6278"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:46.178871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c9628d7c-a554-4727-b047-4eebbfca68c4 req-0d44ca31-a504-4c72-bc3d-e83a2afd342b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:46.186378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c9628d7c-a554-4727-b047-4eebbfca68c4 req-0d44ca31-a504-4c72-bc3d-e83a2afd342b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:46.187001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c9628d7c-a554-4727-b047-4eebbfca68c4 req-0d44ca31-a504-4c72-bc3d-e83a2afd342b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:46.206952 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c9628d7c-a554-4727-b047-4eebbfca68c4 req-0d44ca31-a504-4c72-bc3d-e83a2afd342b service nova] Creating event network-vif-plugged:de443f28-add0-435c-a727-abade52c6278 for instance 1830271f-4c7c-4e75-9170-db188cfc0b75 on n-h2-zed-1 Oct 28 10:09:46.214819 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c9628d7c-a554-4727-b047-4eebbfca68c4 req-0d44ca31-a504-4c72-bc3d-e83a2afd342b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062026 Oct 28 10:09:46.222070 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2196/4397] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:09:46.401501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:46.402116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:46.413940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:46.421232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:46.421797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:46.422733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:46.425271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:46.425742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:46.457939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:09:46.665101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:46.666023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:46.691630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:46.694809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:46.695318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:46.697815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:46.700255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:46.700730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:46.972160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:46.986157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3987a3e1-d2c9-4585-96eb-52e6f7e674ea tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.327261 Oct 28 10:09:46.986761 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2197/4398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:46 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:09:47.172896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:47.189481 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1354d7bb-1a8e-4d9d-bca9-4552c16b298b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.791671 Oct 28 10:09:47.190085 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2202/4399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:46 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:48.013930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:48.014642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:48.024168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:48.030000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:48.030468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:48.031287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:48.031770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:48.032207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:48.216514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:48.217863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:48.228612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:48.232595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:48.233168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:48.233972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:48.234509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:48.240662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:48.446537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:48.456262 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8babced7-c252-4784-a6ef-6dfb8a854989 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.244082 Oct 28 10:09:48.468950 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2203/4400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:48 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:48.741999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:48.757474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d55b0e36-c9f5-4643-aa58-2fa76e120441 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.745711 Oct 28 10:09:48.760412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2198/4401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:48 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:49.485104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:49.486922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:49.501654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:49.502930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:49.503688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:49.504567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:49.505486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:49.506036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:49.557549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8c883752-8216-4173-8efa-79c5ecf9c13d req-f280c18f-b026-4f5d-a7da-59c608e13a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d40318-f07b-4972-bd7b-2424b794d6de", "name": "network-vif-plugged", "status": "completed", "tag": "af6dcfb6-7754-4fff-858c-07a6a63b6732"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:49.572147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8c883752-8216-4173-8efa-79c5ecf9c13d req-f280c18f-b026-4f5d-a7da-59c608e13a18 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:49.573046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8c883752-8216-4173-8efa-79c5ecf9c13d req-f280c18f-b026-4f5d-a7da-59c608e13a18 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:49.573732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8c883752-8216-4173-8efa-79c5ecf9c13d req-f280c18f-b026-4f5d-a7da-59c608e13a18 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:49.590760 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8c883752-8216-4173-8efa-79c5ecf9c13d req-f280c18f-b026-4f5d-a7da-59c608e13a18 service nova] Creating event network-vif-plugged:af6dcfb6-7754-4fff-858c-07a6a63b6732 for instance d8d40318-f07b-4972-bd7b-2424b794d6de on n-h1-zed-1 Oct 28 10:09:49.598831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8c883752-8216-4173-8efa-79c5ecf9c13d req-f280c18f-b026-4f5d-a7da-59c608e13a18 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045740 Oct 28 10:09:49.600255 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2199/4402] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:09:49.802542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:49.805021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:49.815234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:49.816088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:49.817006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:49.818887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:49.819683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:49.820314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:50.373137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:50.384020 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1597c8ea-97c6-4cb7-84f2-cba8f91e0d3d tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.604006 Oct 28 10:09:50.396592 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2200/4403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:49 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:50.668713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:50.715880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b2aeb464-afe8-4dd6-bc59-28283b9761d2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 1.232339 Oct 28 10:09:50.724354 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2204/4404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:49 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:51.423843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:51.424467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:51.431627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:51.454002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:51.460465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:51.462541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:51.468670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:51.469516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:51.744698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:51.745585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:51.758012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:51.764673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:51.765614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:51.766902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:51.767650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:51.768309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:52.204674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:52.217178 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a83ed22-1fa0-4c3e-9701-758d67a0597c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1321 microversion: 2.1 time: 0.476621 Oct 28 10:09:52.223894 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2205/4405] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:51 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:52.804057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:52.833153 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b243b57b-2a1d-41fc-b361-211dab257d04 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 1.412953 Oct 28 10:09:52.835091 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2201/4406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:51 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:53.182314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Calling method '.version_select at 0x7fca3260a9d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:53.202306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:53.203052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:53.203802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:53.205237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:53.205887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:53.206621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:53.236436 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34e1e53a-9882-410c-b222-6df55c6a4ef3 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] 10.222.0.16 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.291036 Oct 28 10:09:53.237726 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2206/4407] 10.222.0.16 () {58 vars in 1122 bytes} [Fri Oct 28 10:09:52 2022] GET /compute/v2.1/limits => generated 511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:09:53.256265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:53.257750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:53.269444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:53.273405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:53.273931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:53.274765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:53.275411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:53.277972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:53.327639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1458142744", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:53.462301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:09:53.939700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Getting quotas for project b9f4721cf3f24aa88d37e97742262ac7. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:09:53.949277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Getting quotas for user e6c8a25f1acc4df29ce6ad74c372b8ef and project b9f4721cf3f24aa88d37e97742262ac7. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:09:53.990938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:53.995767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 28 10:09:53.999990 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2a55c6ce-dbdd-48e1-aee4-3fe06853b9d8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1514 microversion: 2.1 time: 0.754080 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Request method failure captured: Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 1752 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6pw36O7uFnxqReMX3y7dXb2digJlGBd64T7MLGYYO9TDBHJq8qzKNTT4MoUlGURkMeBWqjKRDqmWoMMwHaa73w38w_lel2sXnZOAIoVi0MzVgosjSwPmFCuySlYsQ37dahC7rjEt5Z4UG2iPKI9JXsIiOrWNQMNPCc_rLvy8x8Nf54 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: b9f4721cf3f24aa88d37e97742262ac7 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1804102096 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9f4721cf3f24aa88d37e97742262ac7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/b9f4721cf3f24aa88d37e97742262ac7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_b9f4721cf3f24aa88d37e97742262ac7", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/b9f4721cf3f24aa88d37e97742262ac7"}]}] Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1804102096 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: b9f4721cf3f24aa88d37e97742262ac7 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1804102096 Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: e6c8a25f1acc4df29ce6ad74c372b8ef Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1458142744", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:09:54.001673 n-d-zed-1 devstack@n-api.service[128748]: exception: Maximum number of metadata items exceeds 128 Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1458142744', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:54.003890 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 28 10:09:54.012783 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:09:54.014773 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2202/4408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:53 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1514 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:54.016284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:09:54.018203 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfc78afc-8904-4af8-915f-291d99f22fa9 tempest-AbsoluteLimitsNegativeTestJSON-1804102096 tempest-AbsoluteLimitsNegativeTestJSON-1804102096-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.695216 Oct 28 10:09:54.022318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:54.026958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:54.028996 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2207/4409] 10.222.0.16 () {60 vars in 1148 bytes} [Fri Oct 28 10:09:53 2022] POST /compute/v2.1/servers => generated 87 bytes in 706 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:09:54.046800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:09:54.069632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:54.077194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:54.077707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:54.078150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:54.088502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:54.094544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:54.095013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:54.099008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:54.103157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:54.103790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:54.107890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:54.108703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:54.109395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:54.199585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'flavor' on Instance uuid d8d40318-f07b-4972-bd7b-2424b794d6de {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:09:54.433382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6a503967-1d4f-40c5-a2f5-2badac0dc07c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action" status: 200 len: 32 microversion: 2.1 time: 0.402914 Oct 28 10:09:54.433999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2208/4410] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:09:54 2022] POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action => generated 32 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:09:54.474698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:54.478370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:54.499028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:54.499582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:54.501130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:54.505076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:54.506071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:54.507840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:54.594976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:54.610003 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9478e7af-af1a-4eb8-933f-4bb2b7124c42 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.604715 Oct 28 10:09:54.638453 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2203/4411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:54 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:55.327138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:55.361325 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca16a033-ada9-40f1-8df4-cf2a127dfbe8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.903452 Oct 28 10:09:55.363546 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2209/4412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:54 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:55.646138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:55.647390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:55.663335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:55.664921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:55.665372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:55.672846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:55.673576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:55.674041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:56.386538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:56.387798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:56.399880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:56.408151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:56.408838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:56.409990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:56.410448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:56.411076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:56.631099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:56.647523 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a419c82f-a54b-4146-801c-c4f9be4cd802 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 1.004882 Oct 28 10:09:56.650486 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2204/4413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:55 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:56.987960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:57.007676 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ae16c30-a9a1-434a-85eb-27e0d5fc721b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.625748 Oct 28 10:09:57.012221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2210/4414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:56 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:57.691244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:57.692750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:57.719076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:57.720345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:57.724299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:57.729545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:57.730931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:57.733362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:58.035156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:58.036351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:58.055740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:58.066966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:58.067669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:58.068623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:58.069321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:58.069918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:58.884869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:58.908400 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6aed4a64-276f-4d29-9746-c2fa7ce7c1c6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.877793 Oct 28 10:09:58.910982 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2211/4415] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:58 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:59.018724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:09:59.031676 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f03e86d-b4f9-406d-991d-4c655053d714 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 1.356044 Oct 28 10:09:59.056465 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2205/4416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:57 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:09:59.931908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:09:59.932455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:09:59.947007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:59.952863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:59.953631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:09:59.956185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:09:59.957134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:09:59.957840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:00.061234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:00.061946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:00.074688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:00.080103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:00.081722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:00.082449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:00.083033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:00.083788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:00.464088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:00.474209 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3d4d305-18aa-498b-94c5-b8a94d94bc63 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.417986 Oct 28 10:10:00.494120 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2206/4417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:00 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:00.670069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:00.681751 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-54d21772-ec90-419c-a008-7207c5bf535c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.753847 Oct 28 10:10:00.683824 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2212/4418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:09:59 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:00.775038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-522038999", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "beeb4ee1-7eb7-464e-a636-34bcc49097b5"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:00.853743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] validate_networks() for [('beeb4ee1-7eb7-464e-a636-34bcc49097b5', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:10:01.505483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:01.506962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:01.515804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=66 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:01.517773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:01.519139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:01.520069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:01.521404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:01.522397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:01.523226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:01.945177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:10:01.946908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:10:01.947658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:10:01.948286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:10:01.949252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:10:01.965986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:01.981384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:01.982426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:01.983478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:01.984975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:01.986650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:02.047206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Getting quotas for project 049f7aef45f441358e772bdaf76bdcd9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:10:02.059861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Getting quotas for user bd44565079024214b972eaa04d77e2fb and project 049f7aef45f441358e772bdaf76bdcd9. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:10:02.110963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:02.126909 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f192e65e-d43d-4f34-b601-2ce695ea28d0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.629989 Oct 28 10:10:02.127487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:10:02.127867 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2213/4419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:01 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:02.141273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:02.141273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:02.149607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:10:02.162055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:02.162591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:02.163032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:02.164043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:02.164511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:02.164960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:02.246865 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3f34f75-34a8-4fed-b0ae-1113fcf55489 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.750111 Oct 28 10:10:02.248122 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2207/4420] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 10:10:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1753 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:10:02.259286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0317e251-891f-4104-97fa-d996935aaa60 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:02.262333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0317e251-891f-4104-97fa-d996935aaa60 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:02.441749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0317e251-891f-4104-97fa-d996935aaa60 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:02.455923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0317e251-891f-4104-97fa-d996935aaa60 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:02.457895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0317e251-891f-4104-97fa-d996935aaa60 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:02.462433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0317e251-891f-4104-97fa-d996935aaa60 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1261 microversion: 2.26 time: 0.207111 Oct 28 10:10:02.466513 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2208/4421] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:02 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1261 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:03.009910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:03.019199 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15686fa8-f82d-4fd8-a5c6-cb8b9e588e21 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.890191 Oct 28 10:10:03.026289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2214/4422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:02 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:03.155849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:03.164947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:03.187932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:03.188700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:03.189330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:03.190353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:03.190994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:03.191431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:03.493708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:03.496040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:03.499035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:03.518234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:03.518761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:03.519341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:03.521517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:03.522042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:03.522476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:03.797039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:03.821483 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a9e1e3f6-0c04-4dd9-8a55-0c4aa71346ba tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.666478 Oct 28 10:10:03.824739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2209/4423] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:03 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:03.987039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:04.051741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:04.054676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:04.055315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:04.083987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:04.085874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:04.086448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:04.087455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:04.087730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:04.090360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:04.091211 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ee87a55-e2d6-49a9-9ac0-7bfab143c20e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1313 microversion: 2.26 time: 0.602549 Oct 28 10:10:04.092229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:04.092993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:04.093238 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2215/4424] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:03 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1313 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:04.125407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:04.441713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:04.464926 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-982c18bd-5e41-40f6-a888-f29e6d428434 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.418754 Oct 28 10:10:04.471857 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2210/4425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:04 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:04.849450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:04.850564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:04.863804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:04.864637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:04.865373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:04.866290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:04.866946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:04.868696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:05.123917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:05.124582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:05.134998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:05.135508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:05.138881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:05.142405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:05.142974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:05.143920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:05.317591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:05.334607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:05.336205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:05.337555 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-943804d3-f101-40f5-9049-c562990cf280 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1319 microversion: 2.26 time: 0.219513 Oct 28 10:10:05.342984 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2211/4426] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:05 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:05.438944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:05.452742 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-64507304-f7d6-466f-ba14-2c67c9f44a53 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.608384 Oct 28 10:10:05.458103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2216/4427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:04 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:05.496313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:05.498402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:05.512778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:05.514210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:05.517397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:05.523081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:05.523586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:05.524807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:06.383685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:06.384862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:06.403579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:06.404739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:06.406121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:06.410384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:06.411147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:06.412677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:06.732296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:06.749333 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25015041-3826-42ad-885e-30a926d12f03 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 1.257295 Oct 28 10:10:06.750852 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2212/4428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:05 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:06.779878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:06.780551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:06.810707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:06.813026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:06.814498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:06.815426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:06.816811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:06.819387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:06.820143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:07.157332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:07.178242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:07.185775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:07.187784 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1562688a-d489-4f13-98d2-8fdda308d4d6 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1319 microversion: 2.26 time: 0.817757 Oct 28 10:10:07.188522 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2217/4429] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:06 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1319 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:07.784573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:07.785586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:07.804739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:07.805263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:07.812188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:07.813568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:07.814240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:07.814894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:08.169430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:08.183508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc5fc205-b6c4-4c40-adb1-1c903808c489 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 1.412115 Oct 28 10:10:08.184201 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2213/4430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:06 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:08.222844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:08.223478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:08.236340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:08.236857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:08.237352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:08.243163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:08.243895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:08.246961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:08.432337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:08.436638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:08.441417 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2328a3ad-e471-4b85-b143-35ff095bd8c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.662953 Oct 28 10:10:08.465666 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2218/4431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:07 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:09.165586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:09.179897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:09.181561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:09.188761 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bed66667-f74a-466a-ae53-0a0bc505568f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1361 microversion: 2.26 time: 0.969918 Oct 28 10:10:09.189544 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2214/4432] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:08 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1361 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:09.218904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:09.219403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:09.229815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:09.234026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:09.234831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:09.239328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:09.240048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:09.246211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:09.466498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:09.467211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:09.483468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:09.491525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:09.493395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:09.494330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:09.494792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:09.495790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:09.855436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:09.867857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-33c36d09-3c40-4e24-921d-c030cd51c6ab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.405351 Oct 28 10:10:09.868817 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2215/4433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:09 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:09.889680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-edc32d3b-add5-409e-8085-f5ad60c375b5 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Action: 'create', calling method: .version_select at 0x7fca3b8cbaf0>, body: {"keypair": {"name": "tempest-keypair-209114133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGOy4xnqgZ/twGfeK4wU4zKrUHIxHzlRG9Ie3/3dckmtw0I9cSakJijZkEUVJWQaj8obRw7wjE1Pb54IdSJjxdGf0Qgg1W8e5lhCE0UZVAJWQ1G0s1c53b/92pBXvhzegw=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:09.942716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:09.953363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-edc32d3b-add5-409e-8085-f5ad60c375b5 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Getting quotas for project adb7eccfe81e41db93216cb0441db339. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:10:09.959980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eec4c86c-90c0-49cc-a0a5-9a137d7f8552 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.745547 Oct 28 10:10:09.973862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-edc32d3b-add5-409e-8085-f5ad60c375b5 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Getting quotas for user 0a40eaa5eefa439bb590a7511814f61c and project adb7eccfe81e41db93216cb0441db339. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:10:09.981308 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2219/4434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:09 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:10.030185 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-edc32d3b-add5-409e-8085-f5ad60c375b5 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.160191 Oct 28 10:10:10.030822 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2216/4435] 10.222.0.16 () {62 vars in 1200 bytes} [Fri Oct 28 10:10:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 161 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 28 10:10:10.219821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:10.220684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:10.229099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:10.230346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:10.230952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:10.231882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:10.232503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:10.233165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:10.568498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b73c31f4-c005-4f21-8337-14ddb8574699 req-fcf5bf96-701f-4458-9a5f-fc42a5e117e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6", "tag": "dcacfe5c-a7a1-4400-adc9-f9dc3aaac24c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:10.607216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b73c31f4-c005-4f21-8337-14ddb8574699 req-fcf5bf96-701f-4458-9a5f-fc42a5e117e4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:10.607983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b73c31f4-c005-4f21-8337-14ddb8574699 req-fcf5bf96-701f-4458-9a5f-fc42a5e117e4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:10.608505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b73c31f4-c005-4f21-8337-14ddb8574699 req-fcf5bf96-701f-4458-9a5f-fc42a5e117e4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:10.633482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b73c31f4-c005-4f21-8337-14ddb8574699 req-fcf5bf96-701f-4458-9a5f-fc42a5e117e4 service nova] Creating event network-changed:dcacfe5c-a7a1-4400-adc9-f9dc3aaac24c for instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 on n-h2-zed-1 Oct 28 10:10:10.643513 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b73c31f4-c005-4f21-8337-14ddb8574699 req-fcf5bf96-701f-4458-9a5f-fc42a5e117e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077035 Oct 28 10:10:10.646125 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2217/4436] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:10.899114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:10.900344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:10.910201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:10.910949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:10.911603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:10.912568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:10.913205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:10.913794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:11.245320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:11.256111 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a69c868-bee0-4b41-8532-bf6994fc364a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.364026 Oct 28 10:10:11.263025 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2218/4437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:10 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:11.269380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:11.272140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:11.289386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:11.290389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:11.291102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:11.295873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:11.296535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:11.297395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:11.311735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:11.324047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:11.332732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:11.333997 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cef17ba0-f5f6-4e48-967e-07f7bd3d180f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1361 microversion: 2.26 time: 1.118246 Oct 28 10:10:11.334588 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2220/4438] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:10 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1361 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:11.671177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:11.680033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a266446-43e4-4ad1-8d4f-f40235be7abe tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.415591 Oct 28 10:10:11.680620 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2219/4439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:11 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:12.266898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e170d45c-f459-4273-9ace-fe332af642c5 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-2122641348", "availability_zone": "foo_zone"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:12.270812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.aggregate [None req-e170d45c-f459-4273-9ace-fe332af642c5 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Generated uuid beb159d5-55a3-4066-9fde-27f4c08bc726 for aggregate {{(pid=128748) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 28 10:10:12.287562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:12.288193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:12.290325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:12.298361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:12.305185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:12.308661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:12.312092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:12.316748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:12.317455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:12.359994 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e170d45c-f459-4273-9ace-fe332af642c5 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.217274 Oct 28 10:10:12.367094 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2221/4440] 10.222.0.16 () {60 vars in 1164 bytes} [Fri Oct 28 10:10:12 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:12.381107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:12.381719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:12.405198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:12.405708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:12.406159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:12.406890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:12.407348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:12.407830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:12.950996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:12.959973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:12.965846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:12.967087 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec17fdac-b34a-433c-a786-d6d473ac79e7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1361 microversion: 2.26 time: 0.598963 Oct 28 10:10:12.969571 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2222/4441] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:12 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:12.977959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b322697-f38a-4e15-b960-07b8c9183b89 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:13.032870 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b322697-f38a-4e15-b960-07b8c9183b89 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.058563 Oct 28 10:10:13.033842 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2223/4442] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 10:10:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:13.044125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:13.045011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:13.062154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:13.062949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:13.063563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:13.064446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:13.065115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:13.065996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:13.206448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:13.237040 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-672d77a8-ae6d-4269-809e-e64e6141b155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.951199 Oct 28 10:10:13.239874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2220/4443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:12 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:13.254355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:13.279710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:13.280315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:13.280779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:13.281601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:13.287096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:13.287702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:13.360280 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da5da877-24f1-41f1-9fd2-0a1db720634b tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 374 microversion: 2.1 time: 0.112108 Oct 28 10:10:13.361036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2221/4444] 10.222.0.16 () {58 vars in 1176 bytes} [Fri Oct 28 10:10:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 374 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:13.375448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca23c43a-9456-4074-a017-1bac79686689 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:13.387563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca23c43a-9456-4074-a017-1bac79686689 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.018353 Oct 28 10:10:13.392831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2222/4445] 10.222.0.16 () {58 vars in 1143 bytes} [Fri Oct 28 10:10:13 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:13.404781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc081753-8c24-4137-9cff-308cf328432f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-zed-1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:13.435889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc081753-8c24-4137-9cff-308cf328432f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:13.436512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc081753-8c24-4137-9cff-308cf328432f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:13.437068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc081753-8c24-4137-9cff-308cf328432f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:13.580116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:13.588638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fdc40a0f-5be2-45ef-9f68-fa51a800c6bf tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.553515 Oct 28 10:10:13.633378 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2224/4446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:13 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:14.005053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:14.009202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:14.056302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:14.058215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:14.059369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:14.061190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:14.065977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:14.067015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:14.149056 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc081753-8c24-4137-9cff-308cf328432f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 307 microversion: 2.1 time: 0.748228 Oct 28 10:10:14.151015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2223/4447] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 10:10:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 307 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:14.166375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce250e93-289d-45e6-9ad5-b0c956d7f4a2 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:14.183686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce250e93-289d-45e6-9ad5-b0c956d7f4a2 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 307 microversion: 2.1 time: 0.022022 Oct 28 10:10:14.186160 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2224/4448] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:10:14 2022] GET /compute/v2.1/os-aggregates/19 => generated 307 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:14.199705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e8b7ed5d-bd81-45e4-abdf-9625cce098e6 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1367759847", "availability_zone": "foo_zone"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:14.283060 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e8b7ed5d-bd81-45e4-abdf-9625cce098e6 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 339 microversion: 2.1 time: 0.089244 Oct 28 10:10:14.293773 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2225/4449] 10.222.0.16 () {60 vars in 1173 bytes} [Fri Oct 28 10:10:14 2022] PUT /compute/v2.1/os-aggregates/19 => generated 339 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:14.299031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:14.299789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:14.310994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:14.311507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:14.312062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:14.314065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:14.314976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:14.315299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:14.601407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:14.614803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1da1f31-f6a3-40c0-8134-f170e3cbca4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1524 microversion: 2.1 time: 0.319439 Oct 28 10:10:14.616377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2226/4450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:14 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1524 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:14.624409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d3cca4e-f3fb-4bbb-ae5f-7a0d7261dd4f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:14.667392 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d3cca4e-f3fb-4bbb-ae5f-7a0d7261dd4f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 353 microversion: 2.1 time: 0.048731 Oct 28 10:10:14.669193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2227/4451] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 10:10:14 2022] POST /compute/v2.1/os-aggregates/19/action => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:14.687042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1897608302", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "b139738a-5dea-4b4e-bc5e-6059fa335d64"}, {"port": "b922098b-e4fa-4e1d-8a01-0c34d14ff2fa", "tag": "port-1"}, {"port": "e44943a6-b60e-4807-827d-3c63f8934012", "tag": "port-2"}, {"uuid": "7772d240-96ff-41f1-b92b-8ac8175fd4f0", "tag": "net-1"}, {"uuid": "7772d240-96ff-41f1-b92b-8ac8175fd4f0"}, {"uuid": "c7f80254-71fd-40b2-b8d5-deaf5a6de07d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c7f80254-71fd-40b2-b8d5-deaf5a6de07d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "e1eaefd1-1b14-49f8-80bc-02091c78cdce", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "bc386423-e112-42cd-afba-8bf2558986ae", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "d5f61b68-8c80-4048-83d0-bb487a3691b3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--411245610"}], "key_name": "tempest-keypair-209114133", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:14.892598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] validate_networks() for [('b139738a-5dea-4b4e-bc5e-6059fa335d64', None, None, None, None, None), (None, None, 'b922098b-e4fa-4e1d-8a01-0c34d14ff2fa', None, None, None), (None, None, 'e44943a6-b60e-4807-827d-3c63f8934012', None, None, None), ('7772d240-96ff-41f1-b92b-8ac8175fd4f0', None, None, None, None, None), ('7772d240-96ff-41f1-b92b-8ac8175fd4f0', None, None, None, None, None), ('c7f80254-71fd-40b2-b8d5-deaf5a6de07d', '10.2.2.100', None, None, None, None), ('c7f80254-71fd-40b2-b8d5-deaf5a6de07d', '10.2.2.200', None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:10:15.053588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:15.063503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:15.080434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:15.081990 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e986b455-74d4-4aeb-a11b-e1ccb4bf9fcd tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1361 microversion: 2.26 time: 1.086526 Oct 28 10:10:15.083914 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2225/4452] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:13 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1361 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:15.115167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:15.116046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:15.123869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:15.124699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:15.125366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:15.126314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:15.126918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:15.127495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:15.551184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:15.560578 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c58791dc-390f-4cba-8489-5175a38e03d9 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1510 microversion: 2.1 time: 0.452890 Oct 28 10:10:15.561207 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2226/4453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:15 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1510 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:15.576285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3264d500-b353-4a6a-88bb-228591aee05f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:15.615209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3264d500-b353-4a6a-88bb-228591aee05f tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 353 microversion: 2.1 time: 0.052917 Oct 28 10:10:15.618378 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2227/4454] 10.222.0.16 () {58 vars in 1152 bytes} [Fri Oct 28 10:10:15 2022] GET /compute/v2.1/os-aggregates/19 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:15.630019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-501b6c57-0e5f-470a-acb8-ee009f2c6392 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-zed-1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:15.650293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-501b6c57-0e5f-470a-acb8-ee009f2c6392 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:15.650887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-501b6c57-0e5f-470a-acb8-ee009f2c6392 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:15.651745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-501b6c57-0e5f-470a-acb8-ee009f2c6392 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:15.829196 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-501b6c57-0e5f-470a-acb8-ee009f2c6392 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.202630 Oct 28 10:10:15.830183 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2228/4455] 10.222.0.16 () {60 vars in 1194 bytes} [Fri Oct 28 10:10:15 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:15.836499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:15.837598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:15.848647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:15.849598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:15.851295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:15.852499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:15.853203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:15.854006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:16.322110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:16.332324 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dad29167-49fe-43a7-a3d4-2553a01a58c0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.500887 Oct 28 10:10:16.337284 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2229/4456] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:15 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:16.490932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d2cc115e-2fb8-499e-a942-fcf59714ac11 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Action: 'create', calling method: .version_select at 0x7fca3276ff70>, body: {"keypair": {"name": "tempest-keypair-1563450963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhHf8Tv1ZXYYbkV3/8ZUV0Gapu8AsWAlV76YWCfbGvqTeRt85ZTYpMoUlEQOQiK1oHAPmM/yEBbpY1cPdmqJ9rx9CIi90ZoJmsPXNh+U2tGpoc7Dk8qP6JKGlJReUZRZA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:16.509220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d2cc115e-2fb8-499e-a942-fcf59714ac11 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Getting quotas for project 332f1ee007fd480f9a7c2e23c309ec31. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:10:16.516037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d2cc115e-2fb8-499e-a942-fcf59714ac11 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Getting quotas for user 606397ab27814a67887f1b47f8602adf and project 332f1ee007fd480f9a7c2e23c309ec31. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:10:16.556008 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d2cc115e-2fb8-499e-a942-fcf59714ac11 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217335 Oct 28 10:10:16.556869 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2230/4457] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:10:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:16.562546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-24c4caac-661a-49eb-82f8-c7601eb75747 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:16.601654 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-24c4caac-661a-49eb-82f8-c7601eb75747 tempest-TestAggregatesBasicOps-2076962134 tempest-TestAggregatesBasicOps-2076962134-project-admin] 10.222.0.16 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.043436 Oct 28 10:10:16.603699 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2231/4458] 10.222.0.16 () {58 vars in 1155 bytes} [Fri Oct 28 10:10:16 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 28 10:10:16.612040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:16.613621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:16.622735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:16.623615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:16.624219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:16.625292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:16.626166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:16.626975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:17.382793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:17.393333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:17.394846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:17.396024 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71c2be52-d3aa-4927-8b28-bc041884fac7 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1361 microversion: 2.26 time: 0.791067 Oct 28 10:10:17.396593 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2232/4459] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:16 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1361 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:17.402296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:17.402920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:17.418754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:17.419276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:17.419787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:17.420531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:17.423956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:17.424453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:17.685224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:17.696410 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25b56408-8e69-4bd8-a8fa-f5e168e1d908 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1486 microversion: 2.1 time: 0.298585 Oct 28 10:10:17.697390 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2233/4460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:17 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1486 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:17.702188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:17.702818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:17.708726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:17.709235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:17.709916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:17.710780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:17.711391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:17.711965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.051035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:18.060328 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b18e917-7169-47c2-ab25-e298e638159f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.361722 Oct 28 10:10:18.076804 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2234/4461] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:17 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:18.081916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:18.082459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:18.095811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.096226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.096853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.097609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.098079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.098511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.283017 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-02a6aef8-e51f-4b1a-9da2-4b092923c018 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "POST /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f/action" status: 202 len: 0 microversion: 2.1 time: 0.204726 Oct 28 10:10:18.285771 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2235/4462] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:10:18 2022] POST /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:10:18.299622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:18.300363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:18.313047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.317193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.317712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.318523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.319928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.322261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.814465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:10:18.815708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:10:18.818582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:10:18.821213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:10:18.822070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:10:18.837151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.837971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.839331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.840350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.841107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.842875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.871134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Getting quotas for project adb7eccfe81e41db93216cb0441db339. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:10:18.880892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Getting quotas for user 0a40eaa5eefa439bb590a7511814f61c and project adb7eccfe81e41db93216cb0441db339. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:10:18.881498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:18.894817 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b48c8e5e-ec81-442d-a557-2f6839339e21 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1494 microversion: 2.1 time: 0.603435 Oct 28 10:10:18.895442 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2236/4463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:18 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1494 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:18.910843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:18.911476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:18.927797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.928305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.928846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:18.929586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:18.931594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:18.935704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:19.105866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:10:19.109591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='e1eaefd1-1b14-49f8-80bc-02091c78cdce',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='bc386423-e112-42cd-afba-8bf2558986ae',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d5f61b68-8c80-4048-83d0-bb487a3691b3',volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:10:19.305499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:19.319650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:19.325369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:19.326848 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e846a017-cc48-47db-afed-115e65b05874 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1361 microversion: 2.26 time: 0.430451 Oct 28 10:10:19.341430 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2237/4464] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:18 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1361 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:19.356239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-94465dab-60a0-4b81-95e5-fb0d7376999b req-66c5fc75-9269-4ae4-875a-66230a636038 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6", "name": "network-vif-plugged", "status": "completed", "tag": "dcacfe5c-a7a1-4400-adc9-f9dc3aaac24c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:19.387188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-94465dab-60a0-4b81-95e5-fb0d7376999b req-66c5fc75-9269-4ae4-875a-66230a636038 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:19.387597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-94465dab-60a0-4b81-95e5-fb0d7376999b req-66c5fc75-9269-4ae4-875a-66230a636038 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:19.388066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-94465dab-60a0-4b81-95e5-fb0d7376999b req-66c5fc75-9269-4ae4-875a-66230a636038 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:19.416707 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-94465dab-60a0-4b81-95e5-fb0d7376999b req-66c5fc75-9269-4ae4-875a-66230a636038 service nova] Creating event network-vif-plugged:dcacfe5c-a7a1-4400-adc9-f9dc3aaac24c for instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 on n-h2-zed-1 Oct 28 10:10:19.426671 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-94465dab-60a0-4b81-95e5-fb0d7376999b req-66c5fc75-9269-4ae4-875a-66230a636038 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083651 Oct 28 10:10:19.427286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2238/4465] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:19.437129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:19.444750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:19.457971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:19.458766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:19.459394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:19.460396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:19.460724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:19.461194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:19.795246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-707d3d54-496b-449d-8f38-7defc36dc6f8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 5.124216 Oct 28 10:10:19.797549 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2228/4466] 10.222.0.16 () {62 vars in 1189 bytes} [Fri Oct 28 10:10:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 5128 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:10:19.821157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-760c1808-4723-4e3b-b1a8-f809a5c9e031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:19.821791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-760c1808-4723-4e3b-b1a8-f809a5c9e031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:20.010152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-760c1808-4723-4e3b-b1a8-f809a5c9e031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.037358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-760c1808-4723-4e3b-b1a8-f809a5c9e031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.039148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-760c1808-4723-4e3b-b1a8-f809a5c9e031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.040465 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-760c1808-4723-4e3b-b1a8-f809a5c9e031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1285 microversion: 2.42 time: 0.230038 Oct 28 10:10:20.042174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2229/4467] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:19 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:20.056989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:20.060288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:20.077550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:20.078056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:20.079768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:20.080503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:20.080989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:20.081422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:20.137375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.158208 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-78e78c19-21a3-4e81-8452-5faff83a2526 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.729675 Oct 28 10:10:20.161108 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2239/4468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:19 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:20.357848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:20.359348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:20.374229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:20.376776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:20.379003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:20.381348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:20.388013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:20.389081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:20.462663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:20.619069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.631068 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b8faca7-2c24-448a-a402-543f5fdbebb3 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1494 microversion: 2.1 time: 0.585133 Oct 28 10:10:20.634226 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2230/4469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:20 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1494 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:20.715568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.730107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.731572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:20.732743 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-844333ff-6a3f-4b2e-aaf9-2debcc2d368a tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1361 microversion: 2.26 time: 0.379506 Oct 28 10:10:20.733353 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2240/4470] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:20 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1361 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:20.999460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-326890528", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "0f4a39bf-d058-4d43-941c-a3ce137ecb5e"}], "security_groups": [{"name": "tempest-securitygroup--332933679"}], "key_name": "tempest-keypair-1563450963", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:21.069469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:21.070081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:21.077548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:21.078282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:21.078733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:21.087670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:21.088290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:21.088783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:21.433321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] validate_networks() for [('0f4a39bf-d058-4d43-941c-a3ce137ecb5e', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:10:21.626910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:21.643730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:21.646665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:21.648889 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4337dd36-446f-4923-a6c3-a9276c79ccb8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1527 microversion: 2.42 time: 0.583399 Oct 28 10:10:21.674871 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2241/4471] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:21 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1527 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:21.684617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:21.688104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:21.705962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:21.706473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:21.706919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:21.707641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:21.720433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:21.721034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.108375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:22.126368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd97a31c-e2ff-40e7-8a1c-0827447ddca5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.449718 Oct 28 10:10:22.127385 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2242/4472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:21 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:22.133452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:22.134820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:22.148676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.149535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.150663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.152284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.152993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.153646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.350189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Getting quotas for project 332f1ee007fd480f9a7c2e23c309ec31. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:10:22.365634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:22.366972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Getting quotas for user 606397ab27814a67887f1b47f8602adf and project 332f1ee007fd480f9a7c2e23c309ec31. Resources: dict_keys(['metadata_items']) {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:10:22.379701 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29034ee3-1881-4aa7-bdf7-9ed02c2a87c6 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1500 microversion: 2.1 time: 0.250662 Oct 28 10:10:22.380297 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2243/4473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:22 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1500 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:22.394311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:22.397031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:22.402394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:10:22.404104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:10:22.407472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:10:22.409993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:10:22.411322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:10:22.412332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.415273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.415903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.418762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.419056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:22.419239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.419671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.430867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.431374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.434962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.435777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.436257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.436700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.490879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Getting quotas for project 332f1ee007fd480f9a7c2e23c309ec31. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:10:22.498606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Getting quotas for user 606397ab27814a67887f1b47f8602adf and project 332f1ee007fd480f9a7c2e23c309ec31. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:10:22.514252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:10:22.517169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:10:22.622823 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83346886-95e8-4641-b340-5ffa37d0b3a1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.631515 Oct 28 10:10:22.632122 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2231/4474] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:10:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:10:22.638643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:22.639484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:22.649878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.651705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.652613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.653863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.654550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.655226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.715488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:10:22.875550 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8727b390-c97b-4e4c-801d-9f859ae32fa1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 204 len: 0 microversion: 2.1 time: 0.240535 Oct 28 10:10:22.876583 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2232/4475] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:10:22 2022] DELETE /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:10:22.894352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a2cdfb7-1ff9-4336-95aa-545139bac634 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:22.895849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a2cdfb7-1ff9-4336-95aa-545139bac634 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:22.931089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:22.953780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:22.956077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:22.957698 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-37dcaff3-7a5f-4fd5-83df-17e51fba606d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1544 microversion: 2.26 time: 0.571088 Oct 28 10:10:22.958606 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2244/4476] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:22 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1544 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:22.964327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:22.965038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:22.982036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.982617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.983131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:22.983967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:22.984625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:22.985352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.044577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a2cdfb7-1ff9-4336-95aa-545139bac634 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:23.055144 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a2cdfb7-1ff9-4336-95aa-545139bac634 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1269 microversion: 2.1 time: 0.170901 Oct 28 10:10:23.056456 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2233/4477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:22 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1269 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:23.062438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.063304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:23.090041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.090552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.091001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.094931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.095606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.096345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.159776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:23.186996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:23.188580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:23.191271 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f2cfb26-4c25-475e-9029-9e512fa28a8e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1583 microversion: 2.42 time: 0.230209 Oct 28 10:10:23.193276 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2245/4478] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:22 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1583 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:23.198907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca3276f430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.210102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.212479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.214291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.220063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:23.228413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:23.244448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.246283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.249474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.251614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.253541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.254190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.310792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.312303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.313592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.328731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.329624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.330307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.337095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:23.350945 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d0b3dfb3-be2e-4d16-8703-a43104caa3a1 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.292663 Oct 28 10:10:23.351575 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2234/4479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:23 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:23.358485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.360538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:23.369027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.370827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.371572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.372596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.373352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.373982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.392078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:23.406357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:23.432852 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-00663071-b7a6-473c-8c9e-db3927d0782d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1815237592" status: 201 len: 0 microversion: 2.26 time: 0.237902 Oct 28 10:10:23.435630 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2246/4480] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 10:10:23 2022] PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1815237592 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 10:10:23.447583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9955ac6-2135-43ac-9822-cacfd56f1671 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca32326af0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.467462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9955ac6-2135-43ac-9822-cacfd56f1671 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.471609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9955ac6-2135-43ac-9822-cacfd56f1671 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.475846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9955ac6-2135-43ac-9822-cacfd56f1671 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.501938 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9955ac6-2135-43ac-9822-cacfd56f1671 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1815237592" status: 204 len: 0 microversion: 2.26 time: 0.060519 Oct 28 10:10:23.508047 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2247/4481] 10.222.0.16 () {60 vars in 1361 bytes} [Fri Oct 28 10:10:23 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1815237592 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 10:10:23.520288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca32323f70>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.539170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.540592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.543799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.545645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:23.558705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.561211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.561741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.563492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.564606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.565695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.617280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.619177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.619818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.648659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:23.671467 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf4cf3ab-5afe-4083-88d0-ce96c96454e2 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 204 len: 0 microversion: 2.26 time: 0.159064 Oct 28 10:10:23.672475 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2248/4482] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 10:10:23 2022] DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:10:23.675782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:23.684701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b0b4b43-65e5-4646-b6bd-21d51d0b8f81 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca32323820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.698431 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-156fd333-f63b-41fe-8c98-03d5beefd6fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.345414 Oct 28 10:10:23.700109 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2235/4483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:23 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:23.702104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b0b4b43-65e5-4646-b6bd-21d51d0b8f81 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.702787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b0b4b43-65e5-4646-b6bd-21d51d0b8f81 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.703552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b0b4b43-65e5-4646-b6bd-21d51d0b8f81 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.718806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b0b4b43-65e5-4646-b6bd-21d51d0b8f81 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 200 len: 12 microversion: 2.26 time: 0.039902 Oct 28 10:10:23.719807 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2249/4484] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 10:10:23 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 12 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:23.732437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca3b9a3790>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.745569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.746074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.746525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.747106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:23.755385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.756261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.757008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.758350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.759030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.759689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.807962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.808659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.809527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.826446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.827188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.827855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.878769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:23.910859 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5bdbddc-0527-4ce0-8c69-5f40f6b66687 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-505981000" status: 201 len: 0 microversion: 2.26 time: 0.181237 Oct 28 10:10:23.915863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2236/4485] 10.222.0.16 () {62 vars in 1377 bytes} [Fri Oct 28 10:10:23 2022] PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-505981000 => generated 0 bytes in 189 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 28 10:10:23.924758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46f3e722-2808-43b2-8126-4f0fe1af8542 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca32335310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.936577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46f3e722-2808-43b2-8126-4f0fe1af8542 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.937861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46f3e722-2808-43b2-8126-4f0fe1af8542 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.938533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46f3e722-2808-43b2-8126-4f0fe1af8542 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.952809 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46f3e722-2808-43b2-8126-4f0fe1af8542 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 200 len: 35 microversion: 2.26 time: 0.033119 Oct 28 10:10:23.954216 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2250/4486] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 10:10:23 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 35 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:23.965580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca3b90e550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:23.979291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.980123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.980833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.982062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:23.990364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.990900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.991552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:23.992496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:23.993107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:23.993600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.027853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.030065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.046196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.082987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.083607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:24.102717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:24.107625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.108138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.108584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.109357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.113082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.116332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.139027 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-edb11e19-bb62-4250-af1f-bf21e1c9e18f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-505981000" status: 204 len: 0 microversion: 2.26 time: 0.178454 Oct 28 10:10:24.143878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2237/4487] 10.222.0.16 () {60 vars in 1361 bytes} [Fri Oct 28 10:10:23 2022] DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-505981000 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 10:10:24.151042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1354368c-e661-4d4e-905c-7631603718d0 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca32d0adc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.161853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1354368c-e661-4d4e-905c-7631603718d0 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.162348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1354368c-e661-4d4e-905c-7631603718d0 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.162797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1354368c-e661-4d4e-905c-7631603718d0 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.174833 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1354368c-e661-4d4e-905c-7631603718d0 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 200 len: 12 microversion: 2.26 time: 0.029272 Oct 28 10:10:24.181870 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2238/4488] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 10:10:24 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:24.189648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca327c8ca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.198618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.199126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.199572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.200088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:24.209322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.209936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.210442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.213413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.214063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.214515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.304275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.304992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.305708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.324772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:24.335999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:24.346924 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1899960-d796-40b6-b90b-e1412bcc3e4c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1321 microversion: 2.1 time: 0.266304 Oct 28 10:10:24.352008 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2251/4489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:24 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:24.368257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.368961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:24.376714 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c69f726-507c-49f1-8321-71b81b5b354c tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 204 len: 0 microversion: 2.26 time: 0.193008 Oct 28 10:10:24.380390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.380950 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2239/4490] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 10:10:24 2022] DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:10:24.387177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.387935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.388951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.389631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.393167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.393761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.398724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:24.407495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.408187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.408886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.409785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.410557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.411267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.557040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:24.588082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:24.591864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:24.603131 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-86e66ca5-e6a2-4af2-bcba-f67c1f0c65d7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1583 microversion: 2.42 time: 0.238519 Oct 28 10:10:24.603807 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2252/4491] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:24 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1583 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:24.629606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca32323820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.668566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.670467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.670917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.675611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:24.687312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.688192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.689511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.690604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.691355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.692000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.719391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:24.735098 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cd0196d5-83d7-41c0-82ef-3cd4f2e11983 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.351096 Oct 28 10:10:24.737763 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2240/4492] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:24 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:24.752088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.755867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:24.770418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.772175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.773931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.775607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.777319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.779667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.805628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.806134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.806577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.839659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.840673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.841366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.911027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:24.947010 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6ed814a1-c216-4563-8bf6-a080b43d3fdb tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1786930870" status: 201 len: 0 microversion: 2.26 time: 0.341549 Oct 28 10:10:24.948094 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2253/4493] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 10:10:24 2022] PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1786930870 => generated 0 bytes in 344 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 10:10:24.961492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca32361b80>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:24.981866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.983015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.983482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.983975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:24.996395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.996917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.997544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:24.998269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:24.998730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:24.999163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.057612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:25.092699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.093263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.093738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.125277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.125567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.127844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.191778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:25.222536 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfb151fd-6422-4093-b3c5-b171c17e8656 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1222252949" status: 201 len: 0 microversion: 2.26 time: 0.269153 Oct 28 10:10:25.224048 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2254/4494] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 10:10:24 2022] PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1222252949 => generated 0 bytes in 271 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 28 10:10:25.239745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca3260a940>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.259135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.259780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.262119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.262831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.272475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.273135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.273707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.275135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.275824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.276416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.287036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:25.306313 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9f36a24d-7e73-460f-a1ea-4d0d4a546614 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.567117 Oct 28 10:10:25.325842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.326547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.327180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.328233 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2241/4495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:24 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:25.365204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:25.380521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.381734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.383275 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f79e73af-6eaa-4aee-989d-9bcd27dd7b61 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 204 len: 0 microversion: 2.26 time: 0.152926 Oct 28 10:10:25.384946 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2255/4496] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 10:10:25 2022] DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:10:25.397463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.398426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-111ff13e-8e22-4cbf-bf10-ee92c914c50e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca327a8430>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.399942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.404128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.409249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.409841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.411732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.413606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-111ff13e-8e22-4cbf-bf10-ee92c914c50e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.414301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-111ff13e-8e22-4cbf-bf10-ee92c914c50e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.414964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-111ff13e-8e22-4cbf-bf10-ee92c914c50e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.429690 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-111ff13e-8e22-4cbf-bf10-ee92c914c50e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 200 len: 12 microversion: 2.26 time: 0.039533 Oct 28 10:10:25.430606 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2256/4497] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 10:10:25 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:25.441692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca322e39d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.452465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.453779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.455538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.456254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.463991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.464748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.465479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.471029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.472053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.472986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.499923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:25.508421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.509800 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b2f136c6-6f7a-43a2-a1eb-850ce9d5a848 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1327 microversion: 2.1 time: 0.138940 Oct 28 10:10:25.509923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.518293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.522747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2242/4498] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:25 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1327 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:25.538045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:25.558720 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-66bec378-4e64-4e09-b671-d8fa0d946b22 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 204 len: 0 microversion: 2.26 time: 0.121521 Oct 28 10:10:25.566969 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2257/4499] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 10:10:25 2022] DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:10:25.569981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca3b9c08b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.590061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.590555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.591379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.591518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.600194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.600699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.601832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.602267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.602950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.603219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.634157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.635227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.642010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.642583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.642700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.643215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.643327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.644349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.644477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.645002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.645560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.655077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.655579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.656021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.681848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:25.697209 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e945b23b-61d2-4fb6-9120-98c5a9e3b241 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1371527523" status: 201 len: 0 microversion: 2.26 time: 0.131590 Oct 28 10:10:25.698584 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2243/4500] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 10:10:25 2022] PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1371527523 => generated 0 bytes in 134 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 10:10:25.709093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca335c6b80>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.720269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.720767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.721256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.721738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.727155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.727633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.728074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.728779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.729331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.729762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.757861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.758347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.758795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.768454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.769000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.769420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.780341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:25.792865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:25.793091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:25.794726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:25.795990 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ceca8797-38c5-4851-b4fb-cafe7390c49c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1583 microversion: 2.42 time: 0.165731 Oct 28 10:10:25.810176 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2258/4501] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:25 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1583 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:25.821885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3563e0b3-1757-45da-abbf-05b592c8317f tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1895960724" status: 201 len: 0 microversion: 2.26 time: 0.117130 Oct 28 10:10:25.822601 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2244/4502] 10.222.0.16 () {62 vars in 1380 bytes} [Fri Oct 28 10:10:25 2022] PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags/tempest-tag-1895960724 => generated 0 bytes in 119 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 28 10:10:25.827936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:25.827936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.831285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.831788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.832236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.832980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.833443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.833871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.837447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Action: 'update_all', calling method: .version_select at 0x7fca3b9c9310>, body: {"tags": ["tempest-tag-1246812347", "tempest-tag-694437044"]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:25.863460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.864219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.864830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.868087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:25.880844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.881350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.882817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.883540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.884247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.884878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.934637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3,nova_cell1:RELEASE=3,nova_cell1:DELETE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:25.942423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:25.943239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:25.943904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:25.967316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:25.990936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-523b07cf-2da0-4394-9bdd-5cc1c62a9c0d tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 200 len: 61 microversion: 2.26 time: 0.161881 Oct 28 10:10:25.991706 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2245/4503] 10.222.0.16 () {62 vars in 1312 bytes} [Fri Oct 28 10:10:25 2022] PUT /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 61 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:26.002557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-746e7055-33c3-4848-8337-f839d6591018 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca3323c5e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:26.027083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-746e7055-33c3-4848-8337-f839d6591018 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.027585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-746e7055-33c3-4848-8337-f839d6591018 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.028037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-746e7055-33c3-4848-8337-f839d6591018 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.056019 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-746e7055-33c3-4848-8337-f839d6591018 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 200 len: 61 microversion: 2.26 time: 0.057369 Oct 28 10:10:26.057093 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2246/4504] 10.222.0.16 () {60 vars in 1292 bytes} [Fri Oct 28 10:10:25 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 61 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:26.068217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '.version_select at 0x7fca3b8ddd30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:26.086630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.087134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.087589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.088078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:26.095386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.095885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.096336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.097096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.097782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.098221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.131507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.132970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.133498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.151874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'flavor' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:26.168208 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-73339f8e-f0d3-4a44-b48b-3198ed531345 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags" status: 204 len: 0 microversion: 2.26 time: 0.104175 Oct 28 10:10:26.169247 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2247/4505] 10.222.0.16 () {60 vars in 1295 bytes} [Fri Oct 28 10:10:26 2022] DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6/tags => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:10:26.190719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:26.195186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:26.204885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.210216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.210826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.211826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.216124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.216633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.252057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:10:26.371216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:26.384134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-498d3157-3593-476b-8eb1-9ff95c1485ec tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 204 len: 0 microversion: 2.26 time: 0.206093 Oct 28 10:10:26.389214 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2248/4506] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:10:26 2022] DELETE /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:10:26.396989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:26.397937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:26.403775 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bbef4b71-7763-4970-bce9-03cc6f871bff tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.583488 Oct 28 10:10:26.404703 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2259/4507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:25 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:26.409584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:26.422224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.422726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.423098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:26.423469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.424286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.424800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.425276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.429986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.430680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.431259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.432651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.433414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.433999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.524128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:26.740484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:26.750065 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e23fc820-1bc7-4842-8c15-8a3e695a4799 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.359282 Oct 28 10:10:26.761377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2249/4508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:26 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:26.773108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:26.773662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:26.780710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.781372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.781861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.782742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.783327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.783863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.894617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:26.905802 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7017a920-205a-4d9c-9c7f-006188d45922 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1327 microversion: 2.1 time: 0.143329 Oct 28 10:10:26.921659 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2250/4509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:26 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1327 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:26.932230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:26.933394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:26.940849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.941630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.949940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:26.950898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:26.951592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:26.952297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:27.033186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:27.043919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:27.046091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:27.047428 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4dc99de2-c9b8-40e2-a649-f79b3f3ab282 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1593 microversion: 2.42 time: 0.120837 Oct 28 10:10:27.053101 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2251/4510] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:26 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1593 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:27.428018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:27.428641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:27.435289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:27.435868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:27.436418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:27.437658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:27.437658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:27.438552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:27.466578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:27.482522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:27.487994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:27.490232 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2f5cf06-4146-468b-8c1b-17edf719a0da tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1550 microversion: 2.26 time: 1.084126 Oct 28 10:10:27.491378 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2260/4511] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:26 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1550 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:27.691786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:27.712531 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6223eb95-1907-4d3d-b8ab-f65f80c2d8a4 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1506 microversion: 2.1 time: 0.288377 Oct 28 10:10:27.720264 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2252/4512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:27 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:27.781491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:27.787749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:27.812532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:27.813403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:27.816462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:27.817791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:27.818462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:27.819123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:27.931183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:27.932806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:27.945076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:27.945900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:27.947350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:27.949214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:27.950126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:27.950793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:28.219343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:28.237984 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-829ce3d6-d3f7-4b7d-a51b-42a454d90407 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.464111 Oct 28 10:10:28.239204 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2261/4513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:27 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:28.244159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:28.245099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:28.258566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:28.259353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:28.269717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:28.270760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:28.271242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:28.271683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:28.483507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:28.500060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:28.501859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:28.503222 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a061ded-4783-4136-aa04-10afa252ef16 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1593 microversion: 2.42 time: 0.262690 Oct 28 10:10:28.508635 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2262/4514] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:28 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1593 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:28.515722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:28.519745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:28.540422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:28.541872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:28.542817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:28.543785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:28.544491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:28.545179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:28.869907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:28.878434 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15425cff-0c6c-4802-87f1-f6bc32f3f871 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.954509 Oct 28 10:10:28.893341 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2253/4515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:27 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:28.899005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:28.900087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:28.906780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:28.907278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:28.907711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:28.908410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:28.908860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:28.909328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.035167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:29.055454 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-538abef3-a3ce-4887-adc9-efe1d4af7333 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1464 microversion: 2.1 time: 0.158075 Oct 28 10:10:29.056330 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2254/4516] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:28 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1464 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:29.083285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e82cd8a4-e106-4376-aab1-7058aafa5d50 req-bea31fa8-0b17-4523-aae9-c9a16c6ccb77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2fc0eda-b280-4d7f-88a8-39888fdffe5f", "name": "network-vif-deleted", "tag": "716b824f-debf-4e76-8b9a-909e7223940b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:29.118170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e82cd8a4-e106-4376-aab1-7058aafa5d50 req-bea31fa8-0b17-4523-aae9-c9a16c6ccb77 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:29.119714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e82cd8a4-e106-4376-aab1-7058aafa5d50 req-bea31fa8-0b17-4523-aae9-c9a16c6ccb77 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:29.122477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e82cd8a4-e106-4376-aab1-7058aafa5d50 req-bea31fa8-0b17-4523-aae9-c9a16c6ccb77 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.140459 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e82cd8a4-e106-4376-aab1-7058aafa5d50 req-bea31fa8-0b17-4523-aae9-c9a16c6ccb77 service nova] Creating event network-vif-deleted:716b824f-debf-4e76-8b9a-909e7223940b for instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f on n-h1-zed-1 Oct 28 10:10:29.160957 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e82cd8a4-e106-4376-aab1-7058aafa5d50 req-bea31fa8-0b17-4523-aae9-c9a16c6ccb77 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098402 Oct 28 10:10:29.162313 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2255/4517] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:29.235814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:29.257785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:29.259354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:29.261367 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8b3f171-89e1-43d6-a4a7-1dfed1d13b5e tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1550 microversion: 2.26 time: 0.749521 Oct 28 10:10:29.267650 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2263/4518] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:28 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1550 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:29.269287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:29.270294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:29.311256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:29.312565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:29.316454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.323216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:29.324727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:29.325303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.535364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:29.536084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:29.556210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:29.556724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:29.557714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.558619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:29.559490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:29.560074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.701695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:29.731481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:29.735602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:29.745294 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-388fa5b5-4ef3-433a-9b71-71ce48e28bd3 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1593 microversion: 2.42 time: 0.210818 Oct 28 10:10:29.747923 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2264/4519] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:29 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1593 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:29.905871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:29.906706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:29.918276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:29.919742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:29.921146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.930438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:29.931610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:29.932568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:29.997988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:30.012243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8e04f34-3663-4a22-85c1-6a0427f26fb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1520 microversion: 2.1 time: 0.752492 Oct 28 10:10:30.013187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2256/4520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:29 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1520 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:30.057558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-56fd30a9-c548-4b4d-88b2-648db72a439c req-b67cff7b-590a-48c0-85e6-3fa8c4778775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6", "name": "network-vif-deleted", "tag": "dcacfe5c-a7a1-4400-adc9-f9dc3aaac24c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:30.073386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-56fd30a9-c548-4b4d-88b2-648db72a439c req-b67cff7b-590a-48c0-85e6-3fa8c4778775 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.078194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-56fd30a9-c548-4b4d-88b2-648db72a439c req-b67cff7b-590a-48c0-85e6-3fa8c4778775 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.081838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-56fd30a9-c548-4b4d-88b2-648db72a439c req-b67cff7b-590a-48c0-85e6-3fa8c4778775 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.137034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-56fd30a9-c548-4b4d-88b2-648db72a439c req-b67cff7b-590a-48c0-85e6-3fa8c4778775 service nova] Creating event network-vif-deleted:dcacfe5c-a7a1-4400-adc9-f9dc3aaac24c for instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 on n-h2-zed-1 Oct 28 10:10:30.147977 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-56fd30a9-c548-4b4d-88b2-648db72a439c req-b67cff7b-590a-48c0-85e6-3fa8c4778775 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094055 Oct 28 10:10:30.149207 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2257/4521] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:30.158082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:30.161753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:30.183371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.216664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.220813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.221833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.224356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.225022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.325953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.326732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.327435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.328152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lazy-loading 'fault' on Instance uuid a2fc0eda-b280-4d7f-88a8-39888fdffe5f {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:30.614629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:30.637460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65fdd74e-669a-44f2-bb7f-0a50c182e01a tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 200 len: 1303 microversion: 2.1 time: 0.486721 Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2258/4522] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:30 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 1303 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.652850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.712628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:30.727586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.729426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.734444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.735146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lazy-loading 'fault' on Instance uuid 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:30.813742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:30.835039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:30.842555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bd44565079024214b972eaa04d77e2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '049f7aef45f441358e772bdaf76bdcd9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:30.846095 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19c64237-4afa-451c-a513-4c2ca4ee7b43 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 200 len: 1351 microversion: 2.26 time: 0.205208 Oct 28 10:10:30.847985 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2259/4523] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:30 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 1351 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:30.875993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:30.876630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:30.897201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.897819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.898278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.899038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:30.899506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:30.899946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:30.910718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:31.066386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:31.087464 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c85c9ad-4a38-433e-a9a4-bb8e8e0fb313 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 1.184264 Oct 28 10:10:31.092197 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2265/4524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:29 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:31.109723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:31.110584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:31.118844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.120139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.120752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.121842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.122650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.123224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.254668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:31.276273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:31.277745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:31.278912 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74233224-6067-4665-b438-74c2818e8c2a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1660 microversion: 2.42 time: 0.414052 Oct 28 10:10:31.279740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2260/4525] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:30 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1660 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:31.579630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:31.615138 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0f0b92f9-b20f-4e7d-92fd-735d5cbf472c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1500 microversion: 2.1 time: 0.518346 Oct 28 10:10:31.617164 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2266/4526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:31 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1500 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:31.640796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:31.641459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:31.650371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.651415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.651878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.652583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.653079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.653504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.659972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:31.660488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: a2fc0eda-b280-4d7f-88a8-39888fdffe5f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:31.673618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.674350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.674819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.677055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.679806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.680397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.707650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] HTTP exception thrown: Instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f could not be found. Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Request method failure captured: Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f HTTP/1.1 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6oRc59YP_TSNsmG3c3nywvJcByK2crDcWkS3Rd9mr8RZ5mzXzgtn8ySVqyo2ov0UH12tmhJC4aY2Tt2PXDpo0Uon9ttoktzOMQreKSKCRGV9eC1oOtGHJmNvmTzUeuo1KTPdIrHnCj-0npzHkVlQzg6-HFNoFyMwnRsv3GSHT2PKOA Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 938d52ca99bf461d9175ab267ef56ae5 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerRescueTestJSON-783993548 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938d52ca99bf461d9175ab267ef56ae5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938d52ca99bf461d9175ab267ef56ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_938d52ca99bf461d9175ab267ef56ae5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/938d52ca99bf461d9175ab267ef56ae5"}]}] Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerRescueTestJSON-783993548 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 938d52ca99bf461d9175ab267ef56ae5 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerRescueTestJSON-783993548 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerRescueTestJSON-783993548-project Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 05b11268812b415bbe36c1980bea37b6 Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerRescueTestJSON-783993548-project Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f could not be found. Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'a2fc0eda-b280-4d7f-88a8-39888fdffe5f'} Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f could not be found. Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f could not be found. Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:31.709758 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.714344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:31.714344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:31.714344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:31.714344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:10:31.714344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:10:31.714344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f could not be found. Oct 28 10:10:31.714344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.716878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Returning 404 to user: Instance a2fc0eda-b280-4d7f-88a8-39888fdffe5f could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:10:31.718016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3bd53646-6f7e-4b28-8439-902ebc87a941 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f" status: 404 len: 111 microversion: 2.1 time: 0.062352 Oct 28 10:10:31.719151 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2267/4527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:31 2022] GET /compute/v2.1/servers/a2fc0eda-b280-4d7f-88a8-39888fdffe5f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:10:31.726945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:31.727717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:31.734340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.735276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.735905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.736824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.737487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.738098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.766519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:10:31.802239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:31.878844 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe255ea0-b171-4846-ab7b-cbf0905ccfbb tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 204 len: 0 microversion: 2.1 time: 0.154915 Oct 28 10:10:31.880872 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2268/4528] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:10:31 2022] DELETE /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:10:31.887508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:31.888624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] [instance: 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:31.899195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.900102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.900796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.902078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.902834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.903483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.924363 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] HTTP exception thrown: Instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 could not be found. Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Request method failure captured: Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 HTTP/1.1 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6p3AXtp9Pa4noRMW8Sm6t1a8Qz2Nbeujaarq92JSYORrbgLxta1J_lG-1dRAnLTyvTm6-FlNJvbBDBJpLHmCLVCwxqyxNL6n904oHhxnmG0Yfu7mF-ZQVLJ2mTpy_Ykwxdmjnb2QBEwIXS-_h2m4GC9eyq7o1lv09NQhIgkXLFrR_g Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.26 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 049f7aef45f441358e772bdaf76bdcd9 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerTagsTestJSON-2104458236 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/049f7aef45f441358e772bdaf76bdcd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/049f7aef45f441358e772bdaf76bdcd9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_049f7aef45f441358e772bdaf76bdcd9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/049f7aef45f441358e772bdaf76bdcd9"}]}] Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerTagsTestJSON-2104458236 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 049f7aef45f441358e772bdaf76bdcd9 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerTagsTestJSON-2104458236 Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerTagsTestJSON-2104458236-project Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: bd44565079024214b972eaa04d77e2fb Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerTagsTestJSON-2104458236-project Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 could not be found. Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6'} Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 could not be found. Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 could not be found. Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:31.926784 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.933166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:31.933166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:31.933166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:31.933166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:10:31.933166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:10:31.933166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 could not be found. Oct 28 10:10:31.933166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:31.935161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] Returning 404 to user: Instance 7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:10:31.936477 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bbc53476-1e7b-4168-aeca-5f8a0d7dde76 tempest-ServerTagsTestJSON-2104458236 tempest-ServerTagsTestJSON-2104458236-project] 10.222.0.16 "GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6" status: 404 len: 111 microversion: 2.26 time: 0.053970 Oct 28 10:10:31.937758 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2269/4529] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:31 2022] GET /compute/v2.1/servers/7dfa8507-4e3b-4993-8d39-6b2f7dedb4e6 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:10:31.942617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:31.943531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:31.952445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.954053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.955048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:31.956006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:31.956713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:31.957711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.019244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:32.028309 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d4d89b9b-6371-4040-9075-817e296a1d5c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1516 microversion: 2.1 time: 0.392138 Oct 28 10:10:32.029033 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2261/4530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:31 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1516 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:32.053037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da33c243-2d72-4540-96e0-d5d40f0bac9b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:32.056020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da33c243-2d72-4540-96e0-d5d40f0bac9b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d33d5d2a-5f99-4713-8b03-39404873a683] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:32.063075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-da33c243-2d72-4540-96e0-d5d40f0bac9b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Instance d33d5d2a-5f99-4713-8b03-39404873a683 could not be found. Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da33c243-2d72-4540-96e0-d5d40f0bac9b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/d33d5d2a-5f99-4713-8b03-39404873a683/action HTTP/1.1 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 14 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: {"rescue": {}} Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance d33d5d2a-5f99-4713-8b03-39404873a683 could not be found. Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd33d5d2a-5f99-4713-8b03-39404873a683', 'body': {'rescue': {}}} Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d33d5d2a-5f99-4713-8b03-39404873a683 could not be found. Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d33d5d2a-5f99-4713-8b03-39404873a683 could not be found. Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:32.069258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d33d5d2a-5f99-4713-8b03-39404873a683 could not be found. Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da33c243-2d72-4540-96e0-d5d40f0bac9b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 404 to user: Instance d33d5d2a-5f99-4713-8b03-39404873a683 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:10:32.076700 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da33c243-2d72-4540-96e0-d5d40f0bac9b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/d33d5d2a-5f99-4713-8b03-39404873a683/action" status: 404 len: 111 microversion: 2.1 time: 0.026952 Oct 28 10:10:32.082225 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2262/4531] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:10:32 2022] POST /compute/v2.1/servers/d33d5d2a-5f99-4713-8b03-39404873a683/action => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:10:32.090303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:32.090850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:32.111810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.112318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.112759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.120983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.121488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.121935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.261719 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95e8fe31-22a8-4785-97a7-c9ff61850f5e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action" status: 202 len: 0 microversion: 2.1 time: 0.174420 Oct 28 10:10:32.284714 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2263/4532] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:10:32 2022] POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:10:32.295046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:32.295923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:32.303210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.303809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.304697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.305813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.306482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.307176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.468406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:32.689847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:32.701215 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bdf6e36f-c72b-4a6a-b654-6f88f389f029 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1492 microversion: 2.1 time: 0.761799 Oct 28 10:10:32.702054 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2270/4533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:31 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1492 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:32.709314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:32.711043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:32.718356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.722039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.722799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.724295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.725573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.726355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.907163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:32.920804 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb67a27a-7969-4814-8b49-eec0564568e7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.630284 Oct 28 10:10:32.922450 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2264/4534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:32 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:32.930983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:32.932320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:32.940054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.940873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.941800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:32.942737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:32.943418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:32.944087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.072775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=32 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:33.250285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:33.269247 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbfcacc0-d661-46b4-b4f8-73e05e9f850a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1501 microversion: 2.1 time: 0.564374 Oct 28 10:10:33.270300 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2271/4535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:32 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1501 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:33.315620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1eb5bd92-5a7d-44cf-97a0-3444ddc61b7a req-b3863f57-5c91-46a5-a5de-df8698b70c3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7125d713-46a2-4e28-b8c2-1292c02ed056", "tag": "479e4855-3935-4ebe-86b4-036fcd3b204a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:33.346491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1eb5bd92-5a7d-44cf-97a0-3444ddc61b7a req-b3863f57-5c91-46a5-a5de-df8698b70c3e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.346987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1eb5bd92-5a7d-44cf-97a0-3444ddc61b7a req-b3863f57-5c91-46a5-a5de-df8698b70c3e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.347433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1eb5bd92-5a7d-44cf-97a0-3444ddc61b7a req-b3863f57-5c91-46a5-a5de-df8698b70c3e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.385658 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1eb5bd92-5a7d-44cf-97a0-3444ddc61b7a req-b3863f57-5c91-46a5-a5de-df8698b70c3e service nova] Creating event network-changed:479e4855-3935-4ebe-86b4-036fcd3b204a for instance 7125d713-46a2-4e28-b8c2-1292c02ed056 on n-h2-zed-1 Oct 28 10:10:33.398188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1eb5bd92-5a7d-44cf-97a0-3444ddc61b7a req-b3863f57-5c91-46a5-a5de-df8698b70c3e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087011 Oct 28 10:10:33.399505 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2272/4536] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:33.415577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:33.418637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:33.425746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.426517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.427268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.429196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.438034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.438745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.474870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'flavor' on Instance uuid 1830271f-4c7c-4e75-9170-db188cfc0b75 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:33.491212 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Cannot 'rescue' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state paused Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action HTTP/1.1 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 14 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: {"rescue": {}} Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'rescue' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state paused Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1830271f-4c7c-4e75-9170-db188cfc0b75', 'body': {'rescue': {}}} Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 in vm_state paused. Cannot rescue while the instance is in this state. Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state paused Oct 28 10:10:33.494779 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state paused Oct 28 10:10:33.500507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:33.503623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 409 to user: Cannot 'rescue' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state paused {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:10:33.504719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49f7450d-7193-442c-88d9-d9aa5fff1362 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action" status: 409 len: 144 microversion: 2.1 time: 0.102136 Oct 28 10:10:33.510262 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2273/4537] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:10:33 2022] POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action => generated 144 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:10:33.520106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:33.520886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:33.529486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.530199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.531056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.532189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.532870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.533644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.635685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:33.646690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:33.655080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:33.665120 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-594cd43d-4d96-4f40-b8e7-3814198b79f2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1706 microversion: 2.42 time: 0.741142 Oct 28 10:10:33.666810 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2265/4538] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:32 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1706 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:33.684093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b185d1f-a6da-47c0-b1d4-6122406e2ea1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action" status: 202 len: 0 microversion: 2.1 time: 0.168791 Oct 28 10:10:33.685326 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2274/4539] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:10:33 2022] POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:10:33.701471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:33.702653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:33.726385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:33.729089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:33.743448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.745942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.747667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.752370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.753393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.754411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.755102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.757060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.758652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:33.759019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:33.760422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:33.762157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:34.131667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:34.148217 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46efcfb5-27b0-432d-91eb-6f8b696bac1e tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1492 microversion: 2.1 time: 0.427364 Oct 28 10:10:34.160935 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2275/4540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:33 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1492 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:34.166859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:34.171044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:34.178611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:34.179385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:34.180023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:34.180950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:34.181635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:34.182566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:34.334070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:34.358613 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ad114d3-d378-49d5-b70a-1b7cca220651 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1508 microversion: 2.1 time: 0.667447 Oct 28 10:10:34.359982 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2266/4541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:33 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1508 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:34.568338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:34.582321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c13f0c46-bf07-47fd-addc-3b0a7ddb6c56 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.430563 Oct 28 10:10:34.583533 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2276/4542] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:34 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:34.695818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:34.697540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:34.706197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:34.722007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:34.722953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:34.723921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:34.724577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:34.725235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:35.173296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:35.173916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:35.194632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:35.195215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:35.195996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:35.199265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:35.199822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:35.200468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:35.536667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:35.563043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:35.564509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:35.565755 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-283d290a-8763-46c3-87f5-cb86bdbdd093 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1752 microversion: 2.42 time: 0.874021 Oct 28 10:10:35.592315 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2267/4543] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:34 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1752 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:35.605302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:35.606059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:35.613584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:35.614411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:35.614930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:35.615988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:35.616449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:35.616883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:36.128841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:36.138408 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-38470efe-ed71-48bc-8649-abce240764db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1508 microversion: 2.1 time: 0.544527 Oct 28 10:10:36.158666 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2268/4544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:35 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1508 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:36.163659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:36.164287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:36.190291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:36.191157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:36.199992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:36.201372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:36.202068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:36.203068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:36.541679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:36.550894 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ae8861a5-6ee0-4ebb-9424-b16a1b94ed5f tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.390976 Oct 28 10:10:36.573632 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2269/4545] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:36 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:36.598124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-74a1b6c0-e191-4637-82f4-f343f2245bea req-f8d556bc-ee07-4abd-811c-d02d8ca70de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7e21d82-9a2a-4d89-abdc-fc2d45a105bc", "name": "network-vif-deleted", "tag": "18506e65-cc13-42db-99b0-94064c314c3e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:36.629381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-74a1b6c0-e191-4637-82f4-f343f2245bea req-f8d556bc-ee07-4abd-811c-d02d8ca70de0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:36.629862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-74a1b6c0-e191-4637-82f4-f343f2245bea req-f8d556bc-ee07-4abd-811c-d02d8ca70de0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:36.630301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-74a1b6c0-e191-4637-82f4-f343f2245bea req-f8d556bc-ee07-4abd-811c-d02d8ca70de0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:36.687135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05b11268812b415bbe36c1980bea37b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938d52ca99bf461d9175ab267ef56ae5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:36.690565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-74a1b6c0-e191-4637-82f4-f343f2245bea req-f8d556bc-ee07-4abd-811c-d02d8ca70de0 service nova] Creating event network-vif-deleted:18506e65-cc13-42db-99b0-94064c314c3e for instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc on n-h1-zed-1 Oct 28 10:10:36.698735 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-128de6bb-48af-42ed-9d3e-d40821dd0ea7 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 200 len: 1492 microversion: 2.1 time: 1.529071 Oct 28 10:10:36.702372 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2277/4546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:35 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 1492 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:36.702986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-74a1b6c0-e191-4637-82f4-f343f2245bea req-f8d556bc-ee07-4abd-811c-d02d8ca70de0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126032 Oct 28 10:10:36.705746 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2270/4547] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:36.712766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:36.715970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:36.731718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:36.732553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:36.734265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:36.737007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:36.737735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:36.739420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:37.176030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:37.176643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:37.186260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:37.187090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:37.187753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:37.189104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:37.191835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:37.192581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:37.495088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:37.507346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:37.525029 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-17b074c1-df00-4d6e-82bf-a9d1fa0f9944 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1516 microversion: 2.1 time: 0.351876 Oct 28 10:10:37.525742 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2271/4548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:37 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1516 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:37.527863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:37.530222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:37.531843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec12da75-dfb1-41e0-bf2a-8403cef2c031 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1798 microversion: 2.42 time: 0.827957 Oct 28 10:10:37.532403 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2278/4549] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:36 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1798 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:37.592536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:37.599887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:37.616474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:37.621070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:37.623695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:37.628925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:37.629694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:37.630359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:37.722003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:37.723317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] [instance: c7e21d82-9a2a-4d89-abdc-fc2d45a105bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:37.732610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:37.733420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:37.735571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:37.736648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:37.737371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:37.747709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:37.772830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] HTTP exception thrown: Instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc could not be found. Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Request method failure captured: Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc HTTP/1.1 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6oRc59YP_TSNsmG3c3nywvJcByK2crDcWkS3Rd9mr8RZ5mzXzgtn8ySVqyo2ov0UH12tmhJC4aY2Tt2PXDpo0Uon9ttoktzOMQreKSKCRGV9eC1oOtGHJmNvmTzUeuo1KTPdIrHnCj-0npzHkVlQzg6-HFNoFyMwnRsv3GSHT2PKOA Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 938d52ca99bf461d9175ab267ef56ae5 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerRescueTestJSON-783993548 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938d52ca99bf461d9175ab267ef56ae5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/938d52ca99bf461d9175ab267ef56ae5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_938d52ca99bf461d9175ab267ef56ae5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/938d52ca99bf461d9175ab267ef56ae5"}]}] Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerRescueTestJSON-783993548 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 938d52ca99bf461d9175ab267ef56ae5 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerRescueTestJSON-783993548 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerRescueTestJSON-783993548-project Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 05b11268812b415bbe36c1980bea37b6 Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerRescueTestJSON-783993548-project Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc could not be found. Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'c7e21d82-9a2a-4d89-abdc-fc2d45a105bc'} Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc could not be found. Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc could not be found. Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:37.774917 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:37.779374 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:37.779374 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:37.779374 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:37.779374 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:10:37.779374 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:10:37.779374 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc could not be found. Oct 28 10:10:37.779374 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:10:37.791771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] Returning 404 to user: Instance c7e21d82-9a2a-4d89-abdc-fc2d45a105bc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:10:37.793073 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f24b8335-e856-49f2-a75c-d66553796ff0 tempest-ServerRescueTestJSON-783993548 tempest-ServerRescueTestJSON-783993548-project] 10.222.0.16 "GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc" status: 404 len: 111 microversion: 2.1 time: 0.074882 Oct 28 10:10:37.794198 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2279/4550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:37 2022] GET /compute/v2.1/servers/c7e21d82-9a2a-4d89-abdc-fc2d45a105bc => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:10:38.367059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:38.376578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d6b7cbfc-09fe-40d9-8bbd-bc9ebd8a98ae tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.787902 Oct 28 10:10:38.381650 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2272/4551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:37 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:38.563799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:38.564795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:38.571970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:38.592746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:38.593508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:38.595081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:38.595781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:38.596454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:39.407704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:39.408465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:39.429027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:39.429695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:39.430256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:39.431097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:39.432192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:39.432720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:39.450457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:39.467974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:39.470133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:39.470576 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ecaf7795-6784-4b48-b172-47b2a68a7987 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1844 microversion: 2.42 time: 0.911310 Oct 28 10:10:39.471131 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2280/4552] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:38 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1844 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:40.185348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:40.200672 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aead3984-ed20-4591-abcf-562eaab21723 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.796724 Oct 28 10:10:40.214086 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2273/4553] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:39 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:40.374505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:40.377877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:40.385743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:40.386454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:40.387075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:40.387945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:40.388553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:40.389152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:40.418321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'flavor' on Instance uuid 1830271f-4c7c-4e75-9170-db188cfc0b75 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:10:40.499174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:40.499793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:40.512519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:40.519375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:40.519938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:40.520704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:40.523051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:40.523785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:40.555636 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-591c4b25-9176-445b-9401-738d560ad043 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action" status: 200 len: 32 microversion: 2.1 time: 0.187319 Oct 28 10:10:40.556214 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2281/4554] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:10:40 2022] POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:10:40.591457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:40.603651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:40.611198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:40.612217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:40.613111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:40.614076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:40.614862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:40.615524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:40.991324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:41.006850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:41.013730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:41.021662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d14c2021-6841-4692-86f2-305ec17a3994 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.453893 Oct 28 10:10:41.026604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:41.029005 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4dce6e47-3031-457e-b9ed-615fce3a2b0b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1844 microversion: 2.42 time: 0.534871 Oct 28 10:10:41.031488 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2274/4555] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:40 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1844 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:41.046249 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2282/4556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:40 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:41.062525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b76d6288-cf16-4da7-8c27-5a8443b1fcbb req-f4a1a6bd-3f8a-424e-912e-a4e02c9ce886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7125d713-46a2-4e28-b8c2-1292c02ed056", "name": "network-vif-plugged", "status": "completed", "tag": "479e4855-3935-4ebe-86b4-036fcd3b204a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:41.088281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b76d6288-cf16-4da7-8c27-5a8443b1fcbb req-f4a1a6bd-3f8a-424e-912e-a4e02c9ce886 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:41.094454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b76d6288-cf16-4da7-8c27-5a8443b1fcbb req-f4a1a6bd-3f8a-424e-912e-a4e02c9ce886 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:41.095023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b76d6288-cf16-4da7-8c27-5a8443b1fcbb req-f4a1a6bd-3f8a-424e-912e-a4e02c9ce886 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:41.128794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b76d6288-cf16-4da7-8c27-5a8443b1fcbb req-f4a1a6bd-3f8a-424e-912e-a4e02c9ce886 service nova] Creating event network-vif-plugged:479e4855-3935-4ebe-86b4-036fcd3b204a for instance 7125d713-46a2-4e28-b8c2-1292c02ed056 on n-h2-zed-1 Oct 28 10:10:41.145180 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b76d6288-cf16-4da7-8c27-5a8443b1fcbb req-f4a1a6bd-3f8a-424e-912e-a4e02c9ce886 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101808 Oct 28 10:10:41.152872 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2283/4557] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:41.229050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:41.229672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:41.234089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7ba27f8c-4200-4738-87e6-e4e1ab50add0 req-fee8ae6d-8ecb-44cc-9a37-56d8d6ceb769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "de2afbc8-eb77-48b4-a449-9c49dee3933e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:41.242022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:41.249322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:41.250079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:41.251017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:41.251652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:41.252253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:41.260651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7ba27f8c-4200-4738-87e6-e4e1ab50add0 req-fee8ae6d-8ecb-44cc-9a37-56d8d6ceb769 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:41.261199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7ba27f8c-4200-4738-87e6-e4e1ab50add0 req-fee8ae6d-8ecb-44cc-9a37-56d8d6ceb769 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:41.261648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7ba27f8c-4200-4738-87e6-e4e1ab50add0 req-fee8ae6d-8ecb-44cc-9a37-56d8d6ceb769 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:41.269279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:41.282871 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7ba27f8c-4200-4738-87e6-e4e1ab50add0 req-fee8ae6d-8ecb-44cc-9a37-56d8d6ceb769 service nova] Creating event network-changed:de2afbc8-eb77-48b4-a449-9c49dee3933e for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:10:41.298168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7ba27f8c-4200-4738-87e6-e4e1ab50add0 req-fee8ae6d-8ecb-44cc-9a37-56d8d6ceb769 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068776 Oct 28 10:10:41.301096 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2284/4558] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:41.962003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:41.975124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0417b6c-30a2-4a4f-bb9d-79ee1c72e466 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.749001 Oct 28 10:10:41.990511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2275/4559] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:41 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:42.072810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:42.073735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:42.076271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:42.079963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:42.083792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:42.084300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:42.084738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:42.085529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:42.085976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:42.095309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:42.103958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:42.106838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:42.109504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:42.110800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:42.114500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:42.115391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:42.569448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:42.586500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:42.594754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:42.595979 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9de27aa7-d73b-4738-a0bf-5e4f4ec4ba18 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1865 microversion: 2.42 time: 0.531457 Oct 28 10:10:42.596550 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2285/4560] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:42 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1865 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:42.801230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:42.816328 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fa043703-1436-45d1-830d-2af106093593 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.748694 Oct 28 10:10:42.817621 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2276/4561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:42 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:43.012858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:43.013835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:43.020645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:43.021440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:43.022067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:43.022997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:43.023644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:43.024248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:43.428794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8bb64f12-f434-4232-a860-9722279adb20 req-71609b7a-4df2-4137-8985-0777e187a4df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "b922098b-e4fa-4e1d-8a01-0c34d14ff2fa"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:43.453757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8bb64f12-f434-4232-a860-9722279adb20 req-71609b7a-4df2-4137-8985-0777e187a4df service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:43.454560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8bb64f12-f434-4232-a860-9722279adb20 req-71609b7a-4df2-4137-8985-0777e187a4df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:43.456625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8bb64f12-f434-4232-a860-9722279adb20 req-71609b7a-4df2-4137-8985-0777e187a4df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:43.489339 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8bb64f12-f434-4232-a860-9722279adb20 req-71609b7a-4df2-4137-8985-0777e187a4df service nova] Creating event network-changed:b922098b-e4fa-4e1d-8a01-0c34d14ff2fa for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:10:43.504064 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8bb64f12-f434-4232-a860-9722279adb20 req-71609b7a-4df2-4137-8985-0777e187a4df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078723 Oct 28 10:10:43.505298 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2277/4562] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:43.625550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:43.626657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:43.634567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:43.635466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:43.636151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:43.637147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:43.637826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:43.638472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:43.663809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:43.930560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:43.946724 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0ea52aa-624e-4504-a4ed-06481fcc5300 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1394 microversion: 2.1 time: 0.937767 Oct 28 10:10:43.948033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2286/4563] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:43 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1394 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:43.958015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:43.961738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:43.978066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:43.979216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:43.980089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:43.980970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:43.981540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:43.982068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:44.205053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:44.216744 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-faecc467-493d-4b75-9918-810b6765de15 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.265867 Oct 28 10:10:44.225233 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2287/4564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:43 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:44.957828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:44.972718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:44.974135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:44.979239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:44.985375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:44.986945 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1be78684-5976-44c4-b6c1-d1da95321c3a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1886 microversion: 2.42 time: 1.366182 Oct 28 10:10:44.988699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2278/4565] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:43 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1886 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:10:44.989453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:44.996610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:44.997435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:45.002516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:45.003676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:45.004634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:45.005372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:45.244733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:45.246267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:45.257001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:45.257967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:45.258579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:45.259857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:45.260576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:45.261196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:45.381861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:45.390267 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4bfe8cd9-9c5f-449c-a673-4756d616f625 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1575 microversion: 2.1 time: 0.422277 Oct 28 10:10:45.390902 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2288/4566] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:44 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1575 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:45.422744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:45.423635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:45.431498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:45.432398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:45.433044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:45.433928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:45.435135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:45.436001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:45.658241 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6ee25bc1-f975-4385-8aa8-a913fdb04d1d tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.240534 Oct 28 10:10:45.659400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2289/4567] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:10:45 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056/os-interface => generated 285 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:45.664888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-3ef082b9-d03e-4550-8134-6e518e9d09c5 req-9f559bcd-1154-410c-9553-83f86ea24d67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "e44943a6-b60e-4807-827d-3c63f8934012"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:45.678305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3ef082b9-d03e-4550-8134-6e518e9d09c5 req-9f559bcd-1154-410c-9553-83f86ea24d67 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:45.679083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3ef082b9-d03e-4550-8134-6e518e9d09c5 req-9f559bcd-1154-410c-9553-83f86ea24d67 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:45.679685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3ef082b9-d03e-4550-8134-6e518e9d09c5 req-9f559bcd-1154-410c-9553-83f86ea24d67 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:45.694706 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-3ef082b9-d03e-4550-8134-6e518e9d09c5 req-9f559bcd-1154-410c-9553-83f86ea24d67 service nova] Creating event network-changed:e44943a6-b60e-4807-827d-3c63f8934012 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:10:45.700763 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-3ef082b9-d03e-4550-8134-6e518e9d09c5 req-9f559bcd-1154-410c-9553-83f86ea24d67 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039876 Oct 28 10:10:45.702126 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2290/4568] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:45.957058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:45.965931 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e7cbbb7-1fd0-497c-8c0e-f94933007aa0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.727350 Oct 28 10:10:45.966849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2279/4569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:45 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:46.019642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:46.021137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:46.039184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:46.040185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:46.041633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:46.043257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:46.044043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:46.045059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:46.598916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:46.613801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:46.615794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:46.617334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15dd97ff-c9f0-4667-b6b7-aca140f4b6ba tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1886 microversion: 2.42 time: 0.603602 Oct 28 10:10:46.629868 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2291/4570] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:46 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1886 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:46.991723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:46.992345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:47.001412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:47.002160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:47.002778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:47.004119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:47.004754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:47.005408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:47.502480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:47.518401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4029d06-e97e-4803-bf3a-7590741c5ecf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.530443 Oct 28 10:10:47.521057 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2280/4571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:46 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:47.653030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:47.655522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:47.667238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:47.668260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:47.668952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:47.670115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:47.670803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:47.671500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:47.770390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-395891e0-68ef-43df-aab9-a08f6ffe037f req-998d2003-9eb5-4a25-9082-6325556da486 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "dfd265f1-657c-455b-be7a-5d2815a9c1a9"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:47.798737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-395891e0-68ef-43df-aab9-a08f6ffe037f req-998d2003-9eb5-4a25-9082-6325556da486 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:47.799260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-395891e0-68ef-43df-aab9-a08f6ffe037f req-998d2003-9eb5-4a25-9082-6325556da486 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:47.799703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-395891e0-68ef-43df-aab9-a08f6ffe037f req-998d2003-9eb5-4a25-9082-6325556da486 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:47.824171 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-395891e0-68ef-43df-aab9-a08f6ffe037f req-998d2003-9eb5-4a25-9082-6325556da486 service nova] Creating event network-changed:dfd265f1-657c-455b-be7a-5d2815a9c1a9 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:10:47.835755 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-395891e0-68ef-43df-aab9-a08f6ffe037f req-998d2003-9eb5-4a25-9082-6325556da486 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067179 Oct 28 10:10:47.837920 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2281/4572] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:48.550727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:48.552946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:48.566761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:48.578069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:48.579548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:48.607850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:48.609672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:48.610349 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb889738-1b4c-4a0a-a9c7-7179d3de2a4a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1886 microversion: 2.42 time: 0.963516 Oct 28 10:10:48.611522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:48.613025 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2292/4573] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:47 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1886 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:48.613500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:48.614901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:48.615592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:49.041647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:49.059845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e7f2817d-8bf7-4251-9427-ccfaaf2d97a7 tempest-ExtensionsTest-506212892 tempest-ExtensionsTest-506212892-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:49.062004 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e7f2817d-8bf7-4251-9427-ccfaaf2d97a7 tempest-ExtensionsTest-506212892 tempest-ExtensionsTest-506212892-project] 10.222.0.16 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.208011 Oct 28 10:10:49.063887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2293/4574] 10.222.0.16 () {58 vars in 1170 bytes} [Fri Oct 28 10:10:48 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:49.068096 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3106f654-b900-4088-abfb-d29a9bf1caab tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.513474 Oct 28 10:10:49.071322 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2282/4575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:48 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:49.075599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:49.076466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:49.085921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c24043a2-f1ba-4d0d-9859-f0ca03340c03 tempest-ExtensionsTest-506212892 tempest-ExtensionsTest-506212892-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:49.088823 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c24043a2-f1ba-4d0d-9859-f0ca03340c03 tempest-ExtensionsTest-506212892 tempest-ExtensionsTest-506212892-project] 10.222.0.16 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.014074 Oct 28 10:10:49.092084 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2283/4576] 10.222.0.16 () {58 vars in 1134 bytes} [Fri Oct 28 10:10:49 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:10:49.093648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:49.094356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:49.095631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:49.096522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:49.097202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:49.097783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:49.648213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:49.648760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:49.664368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:49.664868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:49.665410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:49.666801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:49.667419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:49.668227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:49.802086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:49.811233 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9c22c529-f872-4021-8432-ede9d455ac88 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1575 microversion: 2.1 time: 0.744679 Oct 28 10:10:49.824931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2294/4577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:49 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1575 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:50.099698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:50.100411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:50.107836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:50.108607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:50.109255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:50.110253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:50.110902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:50.111582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:50.175798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:50.189848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:50.192365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:50.194034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9204540f-cfdf-46bc-b57d-1d683a118e00 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.554283 Oct 28 10:10:50.210120 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2284/4578] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:49 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:50.311305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-230fb970-60bf-441f-bf8c-367b31c42dea req-57aad34f-7bd6-4838-b219-5023ce3d8b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "4077fb51-e3aa-4216-aa06-7e391c67c8a3"}, {"name": "network-changed", "server_uuid": "7125d713-46a2-4e28-b8c2-1292c02ed056", "tag": "479e4855-3935-4ebe-86b4-036fcd3b204a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:50.322423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-230fb970-60bf-441f-bf8c-367b31c42dea req-57aad34f-7bd6-4838-b219-5023ce3d8b4d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:50.323360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-230fb970-60bf-441f-bf8c-367b31c42dea req-57aad34f-7bd6-4838-b219-5023ce3d8b4d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:50.323979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-230fb970-60bf-441f-bf8c-367b31c42dea req-57aad34f-7bd6-4838-b219-5023ce3d8b4d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:50.341669 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-230fb970-60bf-441f-bf8c-367b31c42dea req-57aad34f-7bd6-4838-b219-5023ce3d8b4d service nova] Creating event network-changed:4077fb51-e3aa-4216-aa06-7e391c67c8a3 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:10:50.342197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-230fb970-60bf-441f-bf8c-367b31c42dea req-57aad34f-7bd6-4838-b219-5023ce3d8b4d service nova] Creating event network-changed:479e4855-3935-4ebe-86b4-036fcd3b204a for instance 7125d713-46a2-4e28-b8c2-1292c02ed056 on n-h2-zed-1 Oct 28 10:10:50.353276 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-230fb970-60bf-441f-bf8c-367b31c42dea req-57aad34f-7bd6-4838-b219-5023ce3d8b4d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045343 Oct 28 10:10:50.354175 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2285/4579] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:50.686860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:50.695236 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-27ba5cc0-df21-4e3b-ace2-e23dae7d5444 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.599315 Oct 28 10:10:50.697384 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2295/4580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:50 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:51.224225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:51.225867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:51.232860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:51.233653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:51.234268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:51.235515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:51.236132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:51.236706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:51.647635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:51.659091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:51.661147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:51.663247 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-86212fe8-f6e0-46b6-84a8-f64b8bb3e9db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.443924 Oct 28 10:10:51.664142 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2286/4581] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:51 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:51.730201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:51.731478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:51.741535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:51.745632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:51.749630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:51.750816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:51.756172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:51.756844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:52.090770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:52.104388 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-697f9ae2-9088-4b05-9bdb-c7f1bc6c5451 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.386348 Oct 28 10:10:52.118870 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2296/4582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:51 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:52.372752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-423b5d39-bcc6-4062-a4fd-3346a898b1a2 req-91d2ef27-5c2e-4707-bbd6-eb2bec7cf657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "6b84c793-0c92-4ac1-beea-4590074f979a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:52.379658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-854651611", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "044aa2e8-131d-4f5a-bab2-07d05c9d3952"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:52.394065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-423b5d39-bcc6-4062-a4fd-3346a898b1a2 req-91d2ef27-5c2e-4707-bbd6-eb2bec7cf657 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:52.396843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-423b5d39-bcc6-4062-a4fd-3346a898b1a2 req-91d2ef27-5c2e-4707-bbd6-eb2bec7cf657 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:52.397438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-423b5d39-bcc6-4062-a4fd-3346a898b1a2 req-91d2ef27-5c2e-4707-bbd6-eb2bec7cf657 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:52.423597 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-423b5d39-bcc6-4062-a4fd-3346a898b1a2 req-91d2ef27-5c2e-4707-bbd6-eb2bec7cf657 service nova] Creating event network-changed:6b84c793-0c92-4ac1-beea-4590074f979a for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:10:52.430046 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-423b5d39-bcc6-4062-a4fd-3346a898b1a2 req-91d2ef27-5c2e-4707-bbd6-eb2bec7cf657 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063232 Oct 28 10:10:52.431837 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2297/4583] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:10:52.461845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] validate_networks() for [('044aa2e8-131d-4f5a-bab2-07d05c9d3952', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:10:52.693549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:52.694337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:52.705231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:52.710709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:52.711262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:52.713546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:52.714196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:52.714846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:52.979544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:52.988755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:52.990147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:52.991302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ccd654c-6830-4d08-80a1-6f6b8f28e01b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.302981 Oct 28 10:10:52.991874 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2298/4584] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:52 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:53.139585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:53.141443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:53.153777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:53.154958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:53.157139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:53.158866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:53.159906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:53.160495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:53.398144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:53.413049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4856f08-b3ca-41e8-bdc7-433e8df7cc26 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.282212 Oct 28 10:10:53.414044 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2299/4585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:53 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:53.768294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:10:53.769701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:10:53.770349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:10:53.771290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:10:53.771875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:10:53.792920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:53.794078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:53.794700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:53.796886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:53.797895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:53.800086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:53.851484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Getting quotas for project bd304d4926d34ba085d1a1f1bd0b7fdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:10:53.868830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Getting quotas for user 26ff90455642401986673d1abae1bf16 and project bd304d4926d34ba085d1a1f1bd0b7fdd. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:10:53.883178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:10:53.886316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:10:53.943624 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6b4e169-9109-436e-888f-60d6c3e06c56 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.736719 Oct 28 10:10:53.945081 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2287/4586] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:10:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:10:53.958495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7cc06b59-2d58-4948-b79a-4ec22455aeec tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:53.959411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7cc06b59-2d58-4948-b79a-4ec22455aeec tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:54.018648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:54.019445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:54.032007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:54.032745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:54.033440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:54.036264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:54.036860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:54.039542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:54.238818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7cc06b59-2d58-4948-b79a-4ec22455aeec tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:54.251315 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7cc06b59-2d58-4948-b79a-4ec22455aeec tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1214 microversion: 2.1 time: 0.297784 Oct 28 10:10:54.252810 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2300/4587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:53 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:54.445530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:54.447554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:54.466542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:54.467602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:54.468424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:54.469751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:54.472277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:54.472958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:54.499745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:54.516715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:54.518206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:54.519398 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-347a6518-1227-4983-a7ab-42a35445b6ab tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.505372 Oct 28 10:10:54.538272 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2288/4588] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:54 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:54.538272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-da2f7312-994c-4dad-ad24-af6680004893 req-b7a9d332-32a4-4e1e-88ea-13ffc0b61f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "215c1213-38f4-44cc-a7d1-25422a75052c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:54.551445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-da2f7312-994c-4dad-ad24-af6680004893 req-b7a9d332-32a4-4e1e-88ea-13ffc0b61f66 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:54.551938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-da2f7312-994c-4dad-ad24-af6680004893 req-b7a9d332-32a4-4e1e-88ea-13ffc0b61f66 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:54.552373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-da2f7312-994c-4dad-ad24-af6680004893 req-b7a9d332-32a4-4e1e-88ea-13ffc0b61f66 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:54.568651 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-da2f7312-994c-4dad-ad24-af6680004893 req-b7a9d332-32a4-4e1e-88ea-13ffc0b61f66 service nova] Creating event network-changed:215c1213-38f4-44cc-a7d1-25422a75052c for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:10:54.576066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-da2f7312-994c-4dad-ad24-af6680004893 req-b7a9d332-32a4-4e1e-88ea-13ffc0b61f66 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053908 Oct 28 10:10:54.577293 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2289/4589] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:54.742968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:54.753571 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15b7a12f-93d1-438d-9c11-f135e69fed1c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.316601 Oct 28 10:10:54.755896 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2301/4590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:54 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:55.280105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:55.280808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:55.287986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:55.288739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:55.289540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:55.290558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:55.291106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:55.291774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:55.421970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:55.430962 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-598bfe3a-0b2d-4843-8a35-740749d59d69 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1266 microversion: 2.1 time: 0.156185 Oct 28 10:10:55.441609 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2290/4591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:55 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:55.547174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:55.547907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:55.554971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:55.555473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:55.556168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:55.557093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:55.557716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:55.558314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:55.780609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:55.781551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:55.788701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:55.789708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:55.791048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:55.792004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:55.792845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:55.793661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:55.867486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:55.881273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:55.883499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:55.888712 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef896147-a80f-4443-b59e-f6cd4c3e2794 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.345286 Oct 28 10:10:55.890717 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2302/4592] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:55 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:56.458846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:56.463109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:56.474669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:56.476378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:56.478077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:56.481152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:56.482071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:56.485306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:56.559672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:56.569956 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a1f9946-f239-4276-8061-2415ecfe2e61 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.793312 Oct 28 10:10:56.573617 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2291/4593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:55 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:56.712710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:56.722340 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-00e4cc65-99b2-48ce-87f6-ae3aead3f506 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1274 microversion: 2.1 time: 0.268919 Oct 28 10:10:56.722925 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2303/4594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:56 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1274 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:10:56.917640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:56.918785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:56.925926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:56.926809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:56.927608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:56.928713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:56.929593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:56.930355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:57.606551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:57.608072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:57.633682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:57.634255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:57.634694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:57.646094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:57.646993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:57.647633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:57.725613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:57.737450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:57.749595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:57.750890 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-210fb555-1297-4f7e-b68f-456d30b47315 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.837782 Oct 28 10:10:57.751472 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2292/4595] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:56 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:57.762111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:57.762736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:57.785096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:57.785600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:57.786235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:57.790706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:57.791512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:57.792115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:57.947931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:57.963056 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f736bcf6-41db-49e0-800e-3cf644f9b320 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1502 microversion: 2.1 time: 0.365702 Oct 28 10:10:57.965122 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2304/4596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:57 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1502 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:58.356297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:58.367975 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-69f553b2-69d7-4afb-b8e6-157eab2bc325 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.607576 Oct 28 10:10:58.381732 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2293/4597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:57 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:58.394490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc7b4111-52bf-434d-9879-09c68b9a1a86"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:58.397203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:58.403901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.404641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.405301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.406215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.406839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.407447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.435089 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Cannot 'attach_volume' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state rescued Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/os-volume_attachments HTTP/1.1 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 74 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: {"volumeAttachment": {"volumeId": "cc7b4111-52bf-434d-9879-09c68b9a1a86"}} Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: exception: Cannot 'attach_volume' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state rescued Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': '1830271f-4c7c-4e75-9170-db188cfc0b75', 'body': {'volumeAttachment': {'volumeId': 'cc7b4111-52bf-434d-9879-09c68b9a1a86'}}} Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 28 10:10:58.438845 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state rescued Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state rescued Oct 28 10:10:58.443903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:10:58.445826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 409 to user: Cannot 'attach_volume' instance 1830271f-4c7c-4e75-9170-db188cfc0b75 while it is in vm_state rescued {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:10:58.447251 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d80d87f-4ca6-4578-9e15-fa6eddc3c9fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064423 Oct 28 10:10:58.448513 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2294/4598] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:10:58 2022] POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:10:58.459724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:58.460524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:58.479484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.480280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.480922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.481889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.482744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.483444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.513792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:58.514633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:58.529069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.530440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.531070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.534402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.535479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.539652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.592258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:10:58.613850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:10:58.664462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4dbb662-7668-4edc-8610-3df1b170bcf9 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action" status: 202 len: 0 microversion: 2.1 time: 0.211308 Oct 28 10:10:58.665187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2295/4599] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:10:58 2022] POST /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:10:58.679951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:58.684267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:58.698885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.701707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.702176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.702928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.705749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.706228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.808415 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb7148b8-b9d9-475f-b4c7-9e81d158ebbc tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 204 len: 0 microversion: 2.32 time: 0.841830 Oct 28 10:10:58.809290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2305/4600] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:10:57 2022] DELETE /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:10:58.820942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c2a6a627-f512-40ea-beae-3559f7f0db3f req-7096899b-7238-4b40-b917-0204ac03c575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d8acb44-2123-4b22-b57e-c3f6f3aeb48c", "tag": "f0a5b54d-d218-4043-9120-d3849ec0d14e"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:10:58.848227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c2a6a627-f512-40ea-beae-3559f7f0db3f req-7096899b-7238-4b40-b917-0204ac03c575 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.849471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c2a6a627-f512-40ea-beae-3559f7f0db3f req-7096899b-7238-4b40-b917-0204ac03c575 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.851353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c2a6a627-f512-40ea-beae-3559f7f0db3f req-7096899b-7238-4b40-b917-0204ac03c575 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.865258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c2a6a627-f512-40ea-beae-3559f7f0db3f req-7096899b-7238-4b40-b917-0204ac03c575 service nova] Creating event network-changed:f0a5b54d-d218-4043-9120-d3849ec0d14e for instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c on n-h2-zed-1 Oct 28 10:10:58.874010 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c2a6a627-f512-40ea-beae-3559f7f0db3f req-7096899b-7238-4b40-b917-0204ac03c575 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058921 Oct 28 10:10:58.875052 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2306/4601] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:10:58.881718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:58.882751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:58.890503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.890503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.890946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:58.892709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:58.894357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:58.895431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:59.247204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.263593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.266944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.269144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-36ffaeb1-9ded-4b3a-8830-863c008e4c82 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.392565 Oct 28 10:10:59.271222 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2307/4602] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:58 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:59.277332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:59.278208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:59.288553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:59.289443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:59.290953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:59.291917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:59.292827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:59.293532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:59.569136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.580136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.581926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.583204 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d6469fb-217c-4158-b099-963ab75aecab tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2957 microversion: 2.32 time: 0.310643 Oct 28 10:10:59.583937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2308/4603] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:10:59 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2957 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:10:59.588529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:10:59.590050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:10:59.605587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:59.606380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:59.607054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:59.608123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:10:59.608853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:10:59.609465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:10:59.765852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.774551 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34b9d342-307a-48cb-9b44-fc456dd45c45 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.189562 Oct 28 10:10:59.775129 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2309/4604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:59 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:10:59.801856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:10:59.810631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-97188aa8-099e-4efd-9c1e-ef999cc0e5ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1510 microversion: 2.1 time: 1.139969 Oct 28 10:10:59.811478 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2296/4605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:10:58 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1510 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:00.298621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:00.300015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:00.309974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:00.310746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:00.311397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:00.312347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:00.313063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:00.313749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:00.611626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:00.612835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:00.624326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:00.627720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:00.628670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:00.629738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:00.632307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:00.633352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:00.648778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:00.663079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:00.665021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:00.678628 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96c0d294-e31a-40f1-8840-9b303eebe80f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.374686 Oct 28 10:11:00.679887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2310/4606] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:00 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:00.800996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:00.801931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:00.815752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:00.818661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:00.819233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:00.820287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:00.829487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:00.830165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:01.090879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:01.095112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:01.107783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:01.116531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:01.119607 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5131e7b5-af45-45bc-bb59-c62431da9070 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2957 microversion: 2.32 time: 0.511973 Oct 28 10:11:01.123432 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2297/4607] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:00 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2957 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:01.143347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:01.144743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:01.155473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:01.157324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:01.157780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:01.158742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:01.160590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:01.161107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:01.165358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:01.262069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:01.272610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b958133-bc5e-4898-b73a-4c905a214803 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.476144 Oct 28 10:11:01.273525 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2311/4608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:00 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:01.707392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:01.709778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:01.725945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:01.726667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:01.727299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:01.728700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:01.729361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:01.733531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:02.169104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:02.179629 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24603241-9e86-4102-bf91-b2daa5199da3 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1510 microversion: 2.1 time: 1.054360 Oct 28 10:11:02.180224 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2298/4609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:01 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1510 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:02.191888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:02.197147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:02.209291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:02.209807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:02.210244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:02.210956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:02.211413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:02.211876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:02.458909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:02.483781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:02.486185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:02.487587 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c93ce9d-deac-428e-a611-23f85f90c6e2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.784464 Oct 28 10:11:02.488659 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2312/4610] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:01 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:02.494349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:02.495172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:02.501832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:02.502664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:02.503431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:02.504439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:02.505280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:02.506098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:02.882237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:02.899980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:02.903016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:02.904775 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fa8a672-761b-4350-9b55-8d3318204503 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2957 microversion: 2.32 time: 0.716837 Oct 28 10:11:02.905400 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2299/4611] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:02 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2957 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:03.206890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:03.208214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:03.224559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:03.225180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:03.225893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:03.226633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:03.227096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:03.228099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:03.433232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:03.443299 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2bc77340-8022-47fd-9899-48a5856666d2 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.953370 Oct 28 10:11:03.444013 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2313/4612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:02 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:03.531318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:03.532041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:03.539490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:03.540371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:03.540865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:03.541815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:03.542330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:03.542987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:03.586263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:03.595982 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-86cabbf8-1e18-4f2e-87d5-39ea42d4cc8a tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1510 microversion: 2.1 time: 0.392942 Oct 28 10:11:03.608224 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2300/4613] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:03 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1510 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:03.936944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:03.937767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:03.949341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:03.950518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:03.953030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:03.954295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:03.954991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:03.956779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:03.957523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:03.958185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:04.092183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:04.104659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:04.114030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:04.115706 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a137cfdd-2043-454b-9b39-e7ef730b7d57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.604373 Oct 28 10:11:04.118650 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2314/4614] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:03 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:04.472038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:04.472925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:04.474958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:04.485947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:04.486638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:04.487337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:04.491315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:04.491961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:04.492542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:04.779163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:04.795070 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-193c148d-2516-41ef-a24f-4bd3fbb40249 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.328432 Oct 28 10:11:04.795986 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2315/4615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:04 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:04.801207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:04.801829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:04.808469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:04.816512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:04.817015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:04.817462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:04.818179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:04.818642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:04.819075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:04.828092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:04.832365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:04.838162 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f1145e7-e8a6-4b1a-8b4f-dd6cb7808f4b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2957 microversion: 2.32 time: 0.902336 Oct 28 10:11:04.853717 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2301/4616] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:03 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2957 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:05.126560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:05.137250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-937cff57-bf75-4144-9786-6cb8078c7b74 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1510 microversion: 2.1 time: 0.340076 Oct 28 10:11:05.144603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-302b0f7e-2fd0-44b5-b793-daaab35c3ba8 req-cac75ede-8b5e-461c-b3ea-6314ed759569 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-unplugged", "status": "completed", "tag": "18e409a1-6b35-42f6-a1c4-c5876cdcbabe"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:05.148956 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2316/4617] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:04 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1510 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:05.190075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-302b0f7e-2fd0-44b5-b793-daaab35c3ba8 req-cac75ede-8b5e-461c-b3ea-6314ed759569 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:05.191907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-302b0f7e-2fd0-44b5-b793-daaab35c3ba8 req-cac75ede-8b5e-461c-b3ea-6314ed759569 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:05.195029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-302b0f7e-2fd0-44b5-b793-daaab35c3ba8 req-cac75ede-8b5e-461c-b3ea-6314ed759569 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:05.235929 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-302b0f7e-2fd0-44b5-b793-daaab35c3ba8 req-cac75ede-8b5e-461c-b3ea-6314ed759569 service nova] Creating event network-vif-unplugged:18e409a1-6b35-42f6-a1c4-c5876cdcbabe for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:05.251702 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-302b0f7e-2fd0-44b5-b793-daaab35c3ba8 req-cac75ede-8b5e-461c-b3ea-6314ed759569 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.395283 Oct 28 10:11:05.255870 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2302/4618] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:05.269513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:05.272080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:05.292624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:05.294627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:05.295274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:05.297420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:05.299217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:05.300248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:05.510620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1879076333", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "99600157-ce93-4ec4-a82a-4a75b2abd468"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:05.602140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:11:05.862023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:05.878261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:05.893636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:05.895401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a8ee7291-854e-493e-ab07-1220466eaada tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.638153 Oct 28 10:11:05.896432 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2303/4619] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:05 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:05.913598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:05.914335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:05.924118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:05.926363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:05.930279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:05.932560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:05.933413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:05.934322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:06.577560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:11:06.578108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:11:06.579161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:11:06.579727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:11:06.580403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:11:06.600875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:06.601943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:06.602655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:06.603652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:06.605452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:06.606920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:06.680785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:11:06.689820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:11:06.717584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:11:06.720665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:11:06.811706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:06.826059 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a0af033-b460-40a6-bf4a-abd3ff1b2d5e tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.928418 Oct 28 10:11:06.832447 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2304/4620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:05 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:06.838180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:06.843105 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-42d535e9-44e2-46a6-a62e-19cc0d18beb8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.692938 Oct 28 10:11:06.845733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:06.850684 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2317/4621] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:11:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:11:06.855909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:06.856818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:06.864982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:06.865861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:06.867316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:06.868757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:06.869649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:06.870298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:06.880190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:06.881713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:06.882302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:06.889537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:06.890861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:06.893234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:07.191435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:07.204659 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb870da3-a757-442e-ba1a-db7e2ca3be53 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1516 microversion: 2.1 time: 0.352403 Oct 28 10:11:07.207025 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2318/4622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:06 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:07.224477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bf8f061-3081-4c89-a5ff-692dd58a4f71 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:07.224477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6bf8f061-3081-4c89-a5ff-692dd58a4f71 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:07.469838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6bf8f061-3081-4c89-a5ff-692dd58a4f71 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:07.489406 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6bf8f061-3081-4c89-a5ff-692dd58a4f71 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1193 microversion: 2.1 time: 0.280297 Oct 28 10:11:07.492070 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2319/4623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:07 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1193 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:07.500446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:07.502271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:07.522838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:07.523642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:07.525206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:07.526129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:07.527280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:07.528635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:07.619744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:07.633083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:07.636246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:07.638413 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d4c63d3-f5cc-42d3-b783-edc37bcb5fe1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2915 microversion: 2.32 time: 0.804330 Oct 28 10:11:07.666631 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2305/4624] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:06 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2915 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:07.674872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-unplugged", "status": "completed", "tag": "50de4fb9-66ad-443a-b871-23446c4f34a8"}, {"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-unplugged", "status": "completed", "tag": "f2bdd9a1-fd0b-40e6-b878-461476842b57"}, {"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-unplugged", "status": "completed", "tag": "89219c1b-a412-4b80-8647-05f0b7c942a2"}, {"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-unplugged", "status": "completed", "tag": "a0323752-f69f-4f04-a247-644f13d40fbb"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:07.690103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:07.691451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:07.692098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:07.728976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Creating event network-vif-unplugged:50de4fb9-66ad-443a-b871-23446c4f34a8 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:07.729857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Creating event network-vif-unplugged:f2bdd9a1-fd0b-40e6-b878-461476842b57 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:07.730622 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Creating event network-vif-unplugged:89219c1b-a412-4b80-8647-05f0b7c942a2 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:07.732049 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] Creating event network-vif-unplugged:a0323752-f69f-4f04-a247-644f13d40fbb for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:07.748284 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fcfc5d8d-cd90-4a36-a7a5-3d6294874283 req-d0ef1154-2bca-4828-b2cb-4b2a9a6d1bfb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.076988 Oct 28 10:11:07.753319 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2306/4625] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:07.865201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:07.866702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:07.881724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:07.885718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:07.886577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:07.887544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:07.889603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:07.890062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:08.434198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:08.458018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:08.460996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:08.462455 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07369792-d46d-4e16-8576-1ddd9b04c318 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.968301 Oct 28 10:11:08.468146 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2320/4626] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:07 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:08.521539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:08.522156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:08.535186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:08.535996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:08.541642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:08.543224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:08.543855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:08.551323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:08.630900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:08.643599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4851a7fe-c801-45bd-b338-183fd60d5dc8 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.786538 Oct 28 10:11:08.644665 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2307/4627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:07 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:08.676328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:08.676981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:08.694110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:08.694657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:08.695011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:08.701043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:08.701644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:08.702107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:08.836299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:08.850814 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4745185e-bde3-47e5-98bd-404db058f6b4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1245 microversion: 2.1 time: 0.335034 Oct 28 10:11:08.861790 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2321/4628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:08 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1245 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:09.153395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b44d8db8-f946-456e-be23-951f9f9cb3ea req-62d3ccaa-4537-4c12-a736-88973427825f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-deleted", "tag": "a0323752-f69f-4f04-a247-644f13d40fbb"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:09.167053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b44d8db8-f946-456e-be23-951f9f9cb3ea req-62d3ccaa-4537-4c12-a736-88973427825f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:09.167531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b44d8db8-f946-456e-be23-951f9f9cb3ea req-62d3ccaa-4537-4c12-a736-88973427825f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:09.178271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b44d8db8-f946-456e-be23-951f9f9cb3ea req-62d3ccaa-4537-4c12-a736-88973427825f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:09.192267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:09.211315 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b44d8db8-f946-456e-be23-951f9f9cb3ea req-62d3ccaa-4537-4c12-a736-88973427825f service nova] Creating event network-vif-deleted:a0323752-f69f-4f04-a247-644f13d40fbb for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:09.212602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:09.223731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:09.225881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1051d4f-dfb8-4a9a-ac08-9e42be126aed tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2868 microversion: 2.32 time: 0.553912 Oct 28 10:11:09.232175 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b44d8db8-f946-456e-be23-951f9f9cb3ea req-62d3ccaa-4537-4c12-a736-88973427825f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086037 Oct 28 10:11:09.236480 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2322/4629] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:11:09.257210 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2308/4630] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:08 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2868 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:09.498860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:09.500253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:09.514138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:09.520591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:09.521378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:09.522436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:09.523068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:09.523785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:09.540580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:09.678792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:09.680342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:09.691021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:09.692740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:09.696768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:09.698241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:09.699729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:09.700400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:09.940523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:09.953663 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-54279e7a-3719-4764-b5ba-8fe47ffea9db tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.279940 Oct 28 10:11:09.954750 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2309/4631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:09 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:09.973376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8de394cd-0fef-4ea7-aa64-06d3610f2182 req-a0bb23b2-d1f4-42c0-8e3d-f0fe68b1ef5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d8acb44-2123-4b22-b57e-c3f6f3aeb48c", "name": "network-vif-plugged", "status": "completed", "tag": "f0a5b54d-d218-4043-9120-d3849ec0d14e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:09.985701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8de394cd-0fef-4ea7-aa64-06d3610f2182 req-a0bb23b2-d1f4-42c0-8e3d-f0fe68b1ef5d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:09.986616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8de394cd-0fef-4ea7-aa64-06d3610f2182 req-a0bb23b2-d1f4-42c0-8e3d-f0fe68b1ef5d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:09.987303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8de394cd-0fef-4ea7-aa64-06d3610f2182 req-a0bb23b2-d1f4-42c0-8e3d-f0fe68b1ef5d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:10.005147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8de394cd-0fef-4ea7-aa64-06d3610f2182 req-a0bb23b2-d1f4-42c0-8e3d-f0fe68b1ef5d service nova] Creating event network-vif-plugged:f0a5b54d-d218-4043-9120-d3849ec0d14e for instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c on n-h2-zed-1 Oct 28 10:11:10.018700 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8de394cd-0fef-4ea7-aa64-06d3610f2182 req-a0bb23b2-d1f4-42c0-8e3d-f0fe68b1ef5d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060564 Oct 28 10:11:10.019881 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2310/4632] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:10.029311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:10.030323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:10.038300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:10.039036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:10.039717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:10.040594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:10.041951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:10.042580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:10.220852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:10.239224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8221fff3-ddff-4d29-bea7-586882189f4a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1251 microversion: 2.1 time: 0.217667 Oct 28 10:11:10.246864 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2311/4633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:10 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1251 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:10.272577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:10.273697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:10.283154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:10.284175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:10.286042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:10.288347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:10.289845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:10.290394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:10.500424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:10.515111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:10.516645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:10.517796 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5eed6c33-146c-46d4-abd4-b65c0cbb1768 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 1.023124 Oct 28 10:11:10.522977 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2323/4634] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:09 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:10.528323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ecf5280-6f16-4353-8038-3e9574d1f14d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'create', calling method: .version_select at 0x7fca323261f0>, body: {"keypair": {"name": "tempest-keypair-1960140666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKbdBE1PBLKozand6NTSprycsIDYOWiLdp3HjVNtjuXVI4mmAuutOYzPNiiR7ovnQaeJD6Qmwaby3av7O2pVyoh52zeTuw1OMr134VVdR/6bvXPQM16TpcTh5QCmaqkFg=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:10.563987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9ecf5280-6f16-4353-8038-3e9574d1f14d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for project 80974eba622d4830886ec598e50cad90. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:11:10.572589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9ecf5280-6f16-4353-8038-3e9574d1f14d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for user f4dc1824197d40e58d0dfdc8f55ab72d and project 80974eba622d4830886ec598e50cad90. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:11:10.603237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:10.647485 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ecf5280-6f16-4353-8038-3e9574d1f14d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122774 Oct 28 10:11:10.649995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2324/4635] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:11:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:10.740819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:10.756305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:10.759160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:10.760456 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24114b47-8995-41bd-88d6-b427ce221548 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2582 microversion: 2.32 time: 0.492975 Oct 28 10:11:10.780774 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2312/4636] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:10 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2582 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:10.981494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:10.982246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:10.999225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.000374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.001055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.002137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.002803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.003482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.273369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:11.274279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:11.290249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.292871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.295040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.297106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.297999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.299474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.480621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:11.491216 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5f76a821-7155-4a38-9f3f-e162725a1431 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1251 microversion: 2.1 time: 0.223764 Oct 28 10:11:11.493180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2313/4637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:11 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1251 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:11.499981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-09b71801-9bad-4133-8e86-d3b30fcbb90f req-b98e9349-7016-4394-8beb-84163ed29da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-deleted", "tag": "18e409a1-6b35-42f6-a1c4-c5876cdcbabe"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:11.514823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-09b71801-9bad-4133-8e86-d3b30fcbb90f req-b98e9349-7016-4394-8beb-84163ed29da6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.515442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-09b71801-9bad-4133-8e86-d3b30fcbb90f req-b98e9349-7016-4394-8beb-84163ed29da6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.516276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-09b71801-9bad-4133-8e86-d3b30fcbb90f req-b98e9349-7016-4394-8beb-84163ed29da6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.532027 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-09b71801-9bad-4133-8e86-d3b30fcbb90f req-b98e9349-7016-4394-8beb-84163ed29da6 service nova] Creating event network-vif-deleted:18e409a1-6b35-42f6-a1c4-c5876cdcbabe for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:11.540291 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-09b71801-9bad-4133-8e86-d3b30fcbb90f req-b98e9349-7016-4394-8beb-84163ed29da6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044611 Oct 28 10:11:11.541688 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2314/4638] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:11.548989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:11.550098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:11.559006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.559700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.561378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.563536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.564718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.565359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.626206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:11.641410 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-951df523-9d61-477f-9880-45909a07e40b tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1314 microversion: 2.1 time: 0.666108 Oct 28 10:11:11.643033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2325/4639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:10 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:11.797147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:11.798065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:11.823361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.825487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.827689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:11.828824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:11.830619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:11.832138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:12.064616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:12.076991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:12.079898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:12.081600 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e90f8a11-bdf1-44db-8514-ce10bd987ae9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.538465 Oct 28 10:11:12.096929 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2315/4640] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:11 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:12.332046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:12.352270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:12.353992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:12.355486 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-008979db-0954-4d23-866c-6cb2215a61f2 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2421 microversion: 2.32 time: 0.564582 Oct 28 10:11:12.371006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2326/4641] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:11 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2421 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:12.515681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:12.516998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:12.525776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:12.526633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:12.527309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:12.528397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:12.529137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:12.529833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:12.667017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:12.667775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:12.675795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:12.676300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:12.676989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:12.677937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:12.678637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:12.679239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:12.954565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:12.970767 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa315748-119f-4960-8b55-e92e0eb1e249 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.458432 Oct 28 10:11:12.985934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2316/4642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:12 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:13.095501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:13.110389 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd28e63a-5867-451c-a898-b98b0cc25244 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1501 microversion: 2.1 time: 0.448225 Oct 28 10:11:13.111714 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2327/4643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:12 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1501 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:13.112968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:13.113586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:13.128419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.128956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.129390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.130093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.130554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.130976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.136117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:13.140361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:13.141640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:13.153796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.154677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.155387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.156795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.157541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.158710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.493258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:13.525808 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7828dd1c-1304-4dae-be0d-799183d98226 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1501 microversion: 2.1 time: 0.391062 Oct 28 10:11:13.527726 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2328/4644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:13 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1501 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:13.556970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:13.558021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:13.567746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.568724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.569370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.570300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.571573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.572229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.590791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:13.608850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:13.610388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:13.611562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e403ee8b-d729-439d-adfe-cd7e8f35ae42 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.502441 Oct 28 10:11:13.612743 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2317/4645] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:13 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:13.618119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:13.618456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:13.651099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.651616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.652063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.652945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.653276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.653715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.709492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lazy-loading 'flavor' on Instance uuid 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:11:13.833739 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45e64bce-55df-4554-ac91-3147b4a6ebcf tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action" status: 202 len: 0 microversion: 2.1 time: 0.218908 Oct 28 10:11:13.850891 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2318/4646] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:11:13 2022] POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:11:13.873088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b39ce748-0b99-42d3-8658-b3e7cebc7d12 req-afae1c86-15bf-4693-a6c9-4857e9393143 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-deleted", "tag": "f2bdd9a1-fd0b-40e6-b878-461476842b57"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:13.891456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b39ce748-0b99-42d3-8658-b3e7cebc7d12 req-afae1c86-15bf-4693-a6c9-4857e9393143 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.891943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b39ce748-0b99-42d3-8658-b3e7cebc7d12 req-afae1c86-15bf-4693-a6c9-4857e9393143 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.892375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b39ce748-0b99-42d3-8658-b3e7cebc7d12 req-afae1c86-15bf-4693-a6c9-4857e9393143 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.917679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b39ce748-0b99-42d3-8658-b3e7cebc7d12 req-afae1c86-15bf-4693-a6c9-4857e9393143 service nova] Creating event network-vif-deleted:f2bdd9a1-fd0b-40e6-b878-461476842b57 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:13.924327 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b39ce748-0b99-42d3-8658-b3e7cebc7d12 req-afae1c86-15bf-4693-a6c9-4857e9393143 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063063 Oct 28 10:11:13.925439 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2319/4647] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:13.930930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:13.932342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:13.942540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.943042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.943486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.944200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:13.944658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:13.945134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:13.982811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:13.997833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:14.010851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:14.012144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73bcb8f9-5757-4718-8057-1bb4414d8a74 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 2327 microversion: 2.32 time: 0.467739 Oct 28 10:11:14.024931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2329/4648] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:13 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 2327 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:14.024931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:14.024931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:14.036578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:14.037117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:14.037567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:14.038285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:14.038749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:14.039186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:14.444889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:14.462317 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e63dd63-5576-449b-9179-e8654bf04f04 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.446557 Oct 28 10:11:14.463752 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2330/4649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:14 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:14.641441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:14.642058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:14.648563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:14.649619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:14.650065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:14.650765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:14.651214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:14.651647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:14.697155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:14.709277 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f14d710-a609-45f9-ace9-ca567fea8603 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1509 microversion: 2.1 time: 0.782431 Oct 28 10:11:14.717732 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2320/4650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:13 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1509 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:14.911847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-921529059", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "898144ba-162d-4ebb-861c-688fbac5830b"}], "security_groups": [{"name": "tempest-securitygroup--507599780"}], "key_name": "tempest-keypair-1960140666", "user_data": "}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:15.197143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] validate_networks() for [('898144ba-162d-4ebb-861c-688fbac5830b', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:11:15.427780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:15.439449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:15.444445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:15.446272 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e9d94deb-8a98-490c-9c14-b602a4e86d1c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.808169 Oct 28 10:11:15.447025 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2331/4651] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:14 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:15.454026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:15.454978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:15.462335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:15.463574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:15.464201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:15.465114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:15.465906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:15.466665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:15.569327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:15.580477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:15.582616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:15.584176 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-739c81aa-883c-477d-9a8c-6c33da397a00 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.136050 Oct 28 10:11:15.598770 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2332/4652] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:15 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:15.613070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:15.614097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:15.625132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:15.625996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:15.626731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:15.627814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:15.628791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:15.629980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:15.791828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:15.802618 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d210e528-f9c1-4aae-a7e9-f3c1f352177e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.202392 Oct 28 10:11:15.803927 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2333/4653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:15 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:15.810089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:15.810965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:15.818031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:15.818813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:15.819423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:15.820376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:15.821201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:15.822048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:15.996029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:16.004932 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6fef6025-3edb-48e4-995d-01f2ed10139f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1492 microversion: 2.1 time: 0.198583 Oct 28 10:11:16.017152 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2334/4654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:15 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1492 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:16.017152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-deleted", "tag": "50de4fb9-66ad-443a-b871-23446c4f34a8"}, {"name": "network-changed", "server_uuid": "336847cd-072d-42f3-a542-6a73704691fe", "tag": "f06df1b9-ba73-4597-acde-8f79a062e40c"}, {"server_uuid": "466e1816-46a1-4a12-b363-9e02d94fa7c0", "name": "network-vif-deleted", "tag": "89219c1b-a412-4b80-8647-05f0b7c942a2"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:16.029881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.030560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.037400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.066230 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] Creating event network-vif-deleted:50de4fb9-66ad-443a-b871-23446c4f34a8 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:16.066593 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] Creating event network-changed:f06df1b9-ba73-4597-acde-8f79a062e40c for instance 336847cd-072d-42f3-a542-6a73704691fe on n-h2-zed-1 Oct 28 10:11:16.067368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] Creating event network-vif-deleted:89219c1b-a412-4b80-8647-05f0b7c942a2 for instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 on n-h1-zed-1 Oct 28 10:11:16.105065 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-56a9c4b9-b319-4e68-9a83-834aa6e9666b req-4e70b64a-65be-4c11-89c6-f77ca51b62ae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.089862 Oct 28 10:11:16.114456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2335/4655] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:16.117129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:11:16.117686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:11:16.118175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:11:16.118667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:11:16.119155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:11:16.121324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:16.122090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:16.128895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.129468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.129914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.131785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.132288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.132713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.135545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.136182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.140024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.141034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.141715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.142331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.187120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for project 80974eba622d4830886ec598e50cad90. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:11:16.194412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Getting quotas for user f4dc1824197d40e58d0dfdc8f55ab72d and project 80974eba622d4830886ec598e50cad90. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:11:16.212161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:11:16.215025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:11:16.231966 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74e34c40-f7a3-4501-b631-8cbab83dd0bc tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action" status: 202 len: 0 microversion: 2.1 time: 0.115594 Oct 28 10:11:16.233511 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2336/4656] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:11:16 2022] POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:11:16.242414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:16.244396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:16.251551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.252219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.253103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.254446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.255131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.255652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.291841 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5a50660-545f-4ef8-a42f-d7888585c594 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.386498 Oct 28 10:11:16.293171 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2321/4657] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:11:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:11:16.312631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfe82e04-d1e0-46f1-87aa-727c892b3e24 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:16.313736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfe82e04-d1e0-46f1-87aa-727c892b3e24 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:16.403361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cfe82e04-d1e0-46f1-87aa-727c892b3e24 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:16.411520 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfe82e04-d1e0-46f1-87aa-727c892b3e24 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1245 microversion: 2.1 time: 0.107108 Oct 28 10:11:16.428023 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2322/4658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:16 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:16.476454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:16.477927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:16.497675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.498213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:16.500200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.500664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.504372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.504980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.505674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.511484 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-773ef42e-e6dc-4646-b590-32f027ac4e0c tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1498 microversion: 2.1 time: 0.273949 Oct 28 10:11:16.512532 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2337/4659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:16 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1498 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:16.615353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:16.616034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:16.631348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.631686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.632814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.634170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.636177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.638860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.644065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:16.754280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:16.767987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:16.770062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:16.771561 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a605ceb-f766-4783-809e-d5e0d6f04507 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.160284 Oct 28 10:11:16.793472 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2338/4660] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:16 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:16.829170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:16.829961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:16.841620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.845034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.845700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:16.846635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:16.847763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:16.848362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:17.109634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:17.118528 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-79fcb88f-6e6d-4db8-97c4-701113fe1a9a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.293369 Oct 28 10:11:17.135827 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2339/4661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:16 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:17.205586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:17.223134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:17.225890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:17.228255 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3da71458-44b7-48a5-94b2-38060cfa18ce tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.758697 Oct 28 10:11:17.253084 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2323/4662] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:16 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:17.436068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:17.436680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:17.444454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:17.444971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:17.446115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:17.446743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:17.447775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:17.447775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:17.470155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:17.531127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:17.538878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:17.540137 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b4ededb-fb8d-4373-a47a-59a3b3d75eb6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1249 microversion: 2.1 time: 0.108921 Oct 28 10:11:17.540315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:17.543060 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2340/4663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:17 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1249 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:17.553342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:17.557270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:17.560564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:17.561851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:17.563559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:17.567123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:17.799611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:17.800475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:17.820392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:17.821040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:17.821784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:17.822659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:17.823369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:17.824129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:17.915400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:17.932825 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-71fbf4c2-11cd-4780-bc77-b837eef5efaa tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1498 microversion: 2.1 time: 0.399394 Oct 28 10:11:17.934520 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2324/4664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:17 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1498 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:18.006616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:18.021068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:18.022791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:18.024033 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d7e02a2f-3f32-4330-9e7c-458a9cc63002 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.229368 Oct 28 10:11:18.024626 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2341/4665] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:17 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:18.143221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:18.144137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:18.155542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.158425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.159071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.160001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.163554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.164334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.261429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:18.262058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:18.283113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.284155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.285235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.286161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.287106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.287726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.558102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:18.591401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74e274db-701a-448f-9aed-a046577050fe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.449182 Oct 28 10:11:18.592566 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2325/4666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:18 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:18.618887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:18.620342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:18.633032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.633953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.635268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.636614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.637469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.638100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.789919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:18.799482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44e62e17-386f-41b5-9c5a-26a83e839c96 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1315 microversion: 2.1 time: 0.205697 Oct 28 10:11:18.800086 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2326/4667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:18 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:18.962582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:18.963585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:18.973992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.974848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.975783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.977517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:18.979014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:18.979991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:18.996145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.006000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.007435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.014494 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b853bd8c-1c4d-476a-bfe7-02ef007f3948 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.757585 Oct 28 10:11:19.018793 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2342/4668] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:18 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:19.051305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:19.052032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:19.058349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:19.059208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:19.059722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:19.060522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:19.061095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:19.061618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:19.185723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.193860 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ab9918ec-4b8b-4654-a98b-320a4e1ea23d tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1498 microversion: 2.1 time: 0.239019 Oct 28 10:11:19.194976 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2327/4669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:18 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1498 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:19.216182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.233384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.235705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.238352 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49724bd7-ced8-4348-9e3d-143d7fb7da20 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.190995 Oct 28 10:11:19.239639 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2343/4670] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:19 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:19.615173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:19.615796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:19.628662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:19.629759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:19.630550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:19.634299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:19.635200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:19.637798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:19.828446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:19.829109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:19.834130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.845701 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-efe41750-589e-4554-a5db-7a44fcede768 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.234274 Oct 28 10:11:19.846003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:19.846509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:19.847547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2328/4671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:19 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:19.847990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:19.849149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:19.849627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:19.850065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:19.937527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:19.948423 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9fe7b4c-038a-4f31-9016-7d68878254db tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1303 microversion: 2.1 time: 0.124210 Oct 28 10:11:19.953293 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2344/4672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:19 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:20.047928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:20.048552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:20.055300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.055818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.056314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.058149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.059265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.059719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.217906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:20.219396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:20.228209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.229194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.229877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.230970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.231962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.232607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.350151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:20.364958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:20.366923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:20.369174 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-884469eb-2e5c-4563-bc55-662269e850a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.326095 Oct 28 10:11:20.370376 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2329/4673] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:20 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:20.375817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:20.376859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:20.385654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.386516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.388018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.389162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.390488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.391466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.472871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:20.488017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:20.489714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:20.491117 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02504b6c-ecd3-42a9-8fa0-d2c0dfa5dd11 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.119570 Oct 28 10:11:20.493457 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2330/4674] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:20 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:20.582540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:20.590868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0abef6b1-1c79-43cb-a1b8-8298a8ac9b5f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1501 microversion: 2.1 time: 0.377519 Oct 28 10:11:20.591149 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2345/4675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:20 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1501 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:20.618193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:20.618735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:20.628452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.633891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.634768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.635934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.637055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.639032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.695025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lazy-loading 'flavor' on Instance uuid 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:11:20.811893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f45b14a-e03b-4b68-b361-bd25dc326369 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action" status: 202 len: 0 microversion: 2.1 time: 0.198354 Oct 28 10:11:20.812533 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2331/4676] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:11:20 2022] POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:11:20.820636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:20.822162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:20.824991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:20.842427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.847833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.848266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.851188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.852250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.852702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.872571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:20.873247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:20.889324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.890687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.891135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:20.891863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:20.892320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:20.892751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:21.280813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:21.287305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:21.290344 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e9ac5a1c-a5bf-4d32-b56c-9beb1f3f8050 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.423486 Oct 28 10:11:21.290959 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2332/4677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:20 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:21.300748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:21.301980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:21.309044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:21.309777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:21.310372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:21.311236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:21.311845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:21.312429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:21.701681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:21.729390 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5647287-a7af-4f08-b09e-c228912e2709 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1509 microversion: 2.1 time: 0.912569 Oct 28 10:11:21.730353 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2346/4678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:20 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1509 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:21.738231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:21.738859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:21.766565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:21.767075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:21.767520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:21.768246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:21.768709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:21.769169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:21.836849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:21.846119 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6cd88d0-606d-4adf-84f1-51d41477788c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.549842 Oct 28 10:11:21.862739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2333/4679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:21 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:21.872770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:21.873666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:21.879797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:21.880495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:21.881136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:21.882164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:21.882621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:21.883762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:22.101412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:22.115767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:22.118485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:22.126322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7edd218-3ba1-43a0-bbf8-5ca80a36684b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.391884 Oct 28 10:11:22.127251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2347/4680] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:21 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:22.155831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:22.170705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:22.173981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:22.175628 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba817841-22df-4b90-a1ae-fdff4c4eeb75 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.311836 Oct 28 10:11:22.176459 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2334/4681] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:21 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:22.313909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:22.314696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:22.337730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:22.340489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:22.340988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:22.341723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:22.352656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:22.353168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:22.598047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:22.622063 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9ea6273-0768-4195-b8b7-624ca74a4e6d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.308588 Oct 28 10:11:22.625732 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2348/4682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:22 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:22.758351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:22.758975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:22.772993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:22.774362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:22.775166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:22.777400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:22.778049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:22.779360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:22.823144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-baea798f-c3a4-4721-8f43-434286413ddf req-b298ef69-cbb7-4529-8a7e-70d98e6819cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e2f782-cfed-423e-baf1-b589c3fd36ce", "tag": "78ecab50-5a8f-4c72-bc70-c4276070211b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:22.844698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-baea798f-c3a4-4721-8f43-434286413ddf req-b298ef69-cbb7-4529-8a7e-70d98e6819cc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:22.845393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-baea798f-c3a4-4721-8f43-434286413ddf req-b298ef69-cbb7-4529-8a7e-70d98e6819cc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:22.845838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-baea798f-c3a4-4721-8f43-434286413ddf req-b298ef69-cbb7-4529-8a7e-70d98e6819cc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:22.877982 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-baea798f-c3a4-4721-8f43-434286413ddf req-b298ef69-cbb7-4529-8a7e-70d98e6819cc service nova] Creating event network-changed:78ecab50-5a8f-4c72-bc70-c4276070211b for instance 28e2f782-cfed-423e-baf1-b589c3fd36ce on n-h1-zed-1 Oct 28 10:11:22.890325 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-baea798f-c3a4-4721-8f43-434286413ddf req-b298ef69-cbb7-4529-8a7e-70d98e6819cc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.359834 Oct 28 10:11:22.894235 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2335/4683] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:11:22.906446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:22.909648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:22.925367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:22.925926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:22.926453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:22.927225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:22.929502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:22.931083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.013969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.023168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6a6d6ea7-bc4d-4cb0-ac66-12795f6e58d6 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1492 microversion: 2.1 time: 0.270241 Oct 28 10:11:23.025261 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2349/4684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:22 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1492 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:23.053999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:23.054712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:23.064735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.066415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.067053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.067788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.071308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.071832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.211599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-54834fce-9333-431b-9666-e1bbe6d6a16a tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action" status: 202 len: 0 microversion: 2.1 time: 0.161937 Oct 28 10:11:23.212553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2350/4685] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:11:23 2022] POST /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:11:23.252446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:23.254702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:23.256340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.269187 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-700c9fca-2e1b-40ed-ae17-86989dea2bdf tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.373393 Oct 28 10:11:23.272440 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2336/4686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:22 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:23.276109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.278860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.280479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.282831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.283735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.284884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.288829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:23.290072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:23.315365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.315867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.321050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.321914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.323105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.323715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.560939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.578985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.586185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.587674 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-686e2a37-3553-49bd-87f9-11146140f2d6 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.307261 Oct 28 10:11:23.601290 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2337/4687] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:23 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:23.606354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:23.611156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:23.629356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.630021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.630628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.631485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.632096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.632737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.717235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.730922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.732390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:23.733642 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-be1f5d62-7a51-4064-ab37-146455391952 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.519711 Oct 28 10:11:23.741265 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2351/4688] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:23 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:23.746313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ed6fc748-79a3-4118-bc4b-173aa76c566a req-2c778b38-09c8-48aa-97e9-3fda76a28e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336847cd-072d-42f3-a542-6a73704691fe", "name": "network-vif-plugged", "status": "completed", "tag": "f06df1b9-ba73-4597-acde-8f79a062e40c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:23.768895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ed6fc748-79a3-4118-bc4b-173aa76c566a req-2c778b38-09c8-48aa-97e9-3fda76a28e07 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.769548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ed6fc748-79a3-4118-bc4b-173aa76c566a req-2c778b38-09c8-48aa-97e9-3fda76a28e07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.769819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ed6fc748-79a3-4118-bc4b-173aa76c566a req-2c778b38-09c8-48aa-97e9-3fda76a28e07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.797302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ed6fc748-79a3-4118-bc4b-173aa76c566a req-2c778b38-09c8-48aa-97e9-3fda76a28e07 service nova] Creating event network-vif-plugged:f06df1b9-ba73-4597-acde-8f79a062e40c for instance 336847cd-072d-42f3-a542-6a73704691fe on n-h2-zed-1 Oct 28 10:11:23.806742 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ed6fc748-79a3-4118-bc4b-173aa76c566a req-2c778b38-09c8-48aa-97e9-3fda76a28e07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064150 Oct 28 10:11:23.811988 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2352/4689] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:23.822007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:23.822802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:23.829754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.830416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.831047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:23.831918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:23.832536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:23.833165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:24.150444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:24.166093 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d16caf4-b5ea-4e8b-b4a9-7ee6cdc36744 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1498 microversion: 2.1 time: 0.560565 Oct 28 10:11:24.171289 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2338/4690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:23 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1498 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:24.258703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:24.268599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4692eab2-14d3-4299-a276-58e40462339d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.455147 Oct 28 10:11:24.269412 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2353/4691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:23 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:24.301980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:24.302849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:24.315598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:24.319746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:24.321511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:24.322386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:24.323840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:24.324678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:24.325502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:24.532394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:24.544928 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00a8cc52-4f43-4d05-8122-ae855ba7c5d5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.244720 Oct 28 10:11:24.545979 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2339/4692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:24 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:24.619898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:24.620719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:24.636662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:24.637174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:24.638239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:24.639448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:24.640562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:24.641633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:24.767312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:24.768436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:24.784053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:24.788940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:24.790686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:24.793187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:24.797553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:24.798921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:24.904466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:24.915071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:24.921961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:24.923532 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5d7704e-2924-457e-b9a4-15de89c9229e tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.312486 Oct 28 10:11:24.926461 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2354/4693] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:24 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:25.175383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:25.194318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:25.195122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:25.198030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:25.200817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:25.203663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.208800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.209506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:25.213657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.214517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.215193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:25.218088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7fd757e2-2884-4c86-86fc-38ff2b0eabc9 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.455727 Oct 28 10:11:25.218703 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2340/4694] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:24 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:25.293725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:25.294639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:25.307022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.307531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.309512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:25.310900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.310900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.311126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:25.550392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:25.567440 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3747503-1bc6-4942-ab8f-5802c73a3179 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1293 microversion: 2.1 time: 0.272330 Oct 28 10:11:25.568371 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2341/4695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:25 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:25.585717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:25.586650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:25.604090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.604610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.605097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:25.605826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.610373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.610946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:25.778002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:25.793289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c56dfb0-c880-4b6f-a30a-19576b355812 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1498 microversion: 2.1 time: 0.600994 Oct 28 10:11:25.813881 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2355/4696] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:25 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1498 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:25.905866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:25.919659 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a4cc2fb-000a-4557-a0a6-ad4048e7a448 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.349614 Oct 28 10:11:25.921185 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2342/4697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:25 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:25.956624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:25.957295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:25.969499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.970241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.970836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:25.975383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:25.976124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:25.977407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:26.196548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:26.200689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:26.214473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:26.220341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:26.221977 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2adbe5c-9da1-4961-85c0-e016f0a60aa0 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.269656 Oct 28 10:11:26.225923 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2356/4698] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:25 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:26.257228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:26.258111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:26.260944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:26.274303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:26.276239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:26.277835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:26.278758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:26.282156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:26.282808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:26.408636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:26.604611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:26.605466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:26.627889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:26.628569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:26.629627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:26.632442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:26.636527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:26.637463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:26.678111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:26.690977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:26.707586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:26.709029 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-142a9a92-cc1f-4c9c-beb9-ad522cdb327d tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.456920 Oct 28 10:11:26.713250 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2343/4699] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:26 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:26.825373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:26.826132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:26.840029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:26.843118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:26.843660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:26.844483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:26.845044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:26.849628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.035521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:27.049218 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e051ccb4-7110-45fa-b6f4-58640cd2be85 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1474 microversion: 2.1 time: 0.458940 Oct 28 10:11:27.049823 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2357/4700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:26 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1474 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:27.058062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:27.059119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:27.077780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.078282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.078734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.079454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.079916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.080351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.138939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:27.151674 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b614c72-ded1-4893-a30a-948651d8ea90 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1498 microversion: 2.1 time: 0.329101 Oct 28 10:11:27.152950 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2344/4701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:26 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1498 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:27.255646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-47497937", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:27.343292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:11:27.382471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:27.392216 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-814b096f-2dcf-4f0e-9fa2-952db64267d4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.341245 Oct 28 10:11:27.393368 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2358/4702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:27 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:27.398799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:27.399613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:27.419284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.420058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.420664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.421717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.424118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.424744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.623642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:27.641998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:27.646916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:27.652896 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-371211d9-8d07-4041-bd93-49367a629af1 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.254072 Oct 28 10:11:27.679157 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2359/4703] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:27 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:27.743131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:27.744103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:27.762621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.766567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.767172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.769698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.770223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.770669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.925962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:11:27.926479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:11:27.927052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:11:27.927547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:11:27.928040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:11:27.939044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.939545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.939992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.940731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:27.941226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:27.941665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:27.961522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:11:27.967495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:11:27.981029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:11:27.983408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4ca4b9c3-73d6-4be3-9231-86f3f27e9864] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:11:28.039337 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea367a97-422d-4d1e-aea5-5bd0515b0f01 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792646 Oct 28 10:11:28.040013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2345/4704] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:11:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:11:28.052113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15db335e-3d59-4098-a414-72cecd8d2ff3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:28.052964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15db335e-3d59-4098-a414-72cecd8d2ff3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4ca4b9c3-73d6-4be3-9231-86f3f27e9864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:28.076444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15db335e-3d59-4098-a414-72cecd8d2ff3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4ca4b9c3-73d6-4be3-9231-86f3f27e9864] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:11:28.211359 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15db335e-3d59-4098-a414-72cecd8d2ff3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864" status: 204 len: 0 microversion: 2.1 time: 0.163564 Oct 28 10:11:28.215255 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2346/4705] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:11:28 2022] DELETE /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:11:28.223971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:28.227887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:28.243524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:28.245195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:28.245653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:28.249367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:28.249877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:28.250324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:28.634031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:28.658351 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eab61ed9-e627-4d0d-bb44-6e0ed2b51d2f tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1501 microversion: 2.1 time: 0.441771 Oct 28 10:11:28.682544 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2347/4706] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:28 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1501 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:28.702429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-13c51387-edb3-4066-851d-06620bca6c44 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:28.704583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-13c51387-edb3-4066-851d-06620bca6c44 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4ca4b9c3-73d6-4be3-9231-86f3f27e9864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:28.731799 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-13c51387-edb3-4066-851d-06620bca6c44 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-13c51387-edb3-4066-851d-06620bca6c44 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864 HTTP/1.1 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4ca4b9c3-73d6-4be3-9231-86f3f27e9864'} Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:28.734554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:28.739429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:11:28.739429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:11:28.739429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:11:28.739429 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:28.746543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-13c51387-edb3-4066-851d-06620bca6c44 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:11:28.747849 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-13c51387-edb3-4066-851d-06620bca6c44 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864" status: 404 len: 111 microversion: 2.1 time: 0.063996 Oct 28 10:11:28.752595 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2348/4707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:28 2022] GET /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:11:28.773178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:28.774370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:28.779177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:28.790764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:28.799942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:28.801438 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1e95c92c-3ec1-477c-845f-1a4955c0a7a2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 1.066195 Oct 28 10:11:28.802636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:28.805637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:28.806218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:28.807745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:28.808396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:28.809409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:28.817799 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2360/4708] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:27 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:28.832619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:28.833167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:28.851235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:28.851735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:28.852174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:28.852888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:28.853373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:28.853802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:29.114556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:29.126880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81bb6294-e549-4c04-86dd-3370bd5ec8ad tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.371110 Oct 28 10:11:29.127899 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2349/4709] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:28 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:29.133321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:29.134615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:29.142593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:29.143409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:29.144240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:29.145421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:29.146069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:29.148451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:29.188881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:11:29.273857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:29.283679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:29.291065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:29.294500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1fef8c20-38e5-48c6-9e1c-41d8782a2f59 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.475525 Oct 28 10:11:29.320054 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2361/4710] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:28 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:29.344218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1608557285", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "99600157-ce93-4ec4-a82a-4a75b2abd468"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:29.403407 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45779ecd-2fe8-4ae1-9d9f-70892e416671 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 204 len: 0 microversion: 2.1 time: 0.273973 Oct 28 10:11:29.403998 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2350/4711] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:11:29 2022] DELETE /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:11:29.418183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:29.419200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:29.431715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:29.434045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:29.434537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:29.435278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:29.435756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:29.436216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:29.451317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:29.452448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:11:29.868054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:29.880529 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-18bf938e-58c0-4e93-94a5-92254e72a282 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1507 microversion: 2.1 time: 0.471751 Oct 28 10:11:29.882465 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2351/4712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:29 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1507 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:29.902871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:29.903653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:29.921830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:29.925552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:29.927079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:29.928300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:29.934039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:29.934797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.419413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.430606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.432359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.433976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:11:30.434445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3130128e-6fa3-4ea3-a7ea-f78544d3acfa tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.550035 Oct 28 10:11:30.434535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:11:30.435054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:11:30.435721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:11:30.436345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:11:30.449752 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2352/4713] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:29 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:30.457042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.457807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.458446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.460056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.461710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.462287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.462918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:30.464156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:30.478837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.481236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.482448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.484469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.485605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.486454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.486961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:11:30.493795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:11:30.513031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:11:30.515490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:11:30.589160 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f64d1896-5ed8-4e6e-81c2-56488c678baa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.249460 Oct 28 10:11:30.603136 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2362/4714] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:11:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:11:30.608151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:30.609059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:30.617614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.618127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.618567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.619277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.619734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.620161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.736749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.748392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.750553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.751962 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97794be5-c51b-4570-a409-56d00654affa tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.147786 Oct 28 10:11:30.753101 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2363/4715] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:30 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:30.762860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6cad9520-3419-4e05-b49c-bec3f3e5eff6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:30.763673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6cad9520-3419-4e05-b49c-bec3f3e5eff6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:30.781215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:30.833309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.844548 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9f9e0fc5-9e62-42ef-8f13-c75acfd7087b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.392171 Oct 28 10:11:30.845181 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2353/4716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:30 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:30.861710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6cad9520-3419-4e05-b49c-bec3f3e5eff6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:30.871139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6cad9520-3419-4e05-b49c-bec3f3e5eff6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1221 microversion: 2.1 time: 0.116139 Oct 28 10:11:30.872573 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2364/4717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:30 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1221 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:30.903386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:30.905951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:30.922324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.923095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.923696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:30.924569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:30.931702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:30.932398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:31.194636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:31.203268 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd6da9a0-ba38-4634-89a0-a8a91b3df692 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1507 microversion: 2.1 time: 0.303565 Oct 28 10:11:31.209098 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2354/4718] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:30 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1507 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:31.460701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:31.461405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:31.485529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:31.487364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:31.488162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:31.489604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:31.490258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:31.490689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:31.785904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:31.786524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:31.803092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:31.804256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:31.804891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:31.805846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:31.806462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:31.807063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:31.843051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:31.856627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:31.858364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:31.865686 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b36b6dc-6f0d-44b7-aae1-c27d46385f33 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.409721 Oct 28 10:11:31.866269 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2365/4719] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:31 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:31.881033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:31.882038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:31.896669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:31.901056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:31.902241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:31.904432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:31.905884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:31.906400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:31.978422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:31.989751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:31.991979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:31.993828 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c4264b1d-d3a1-4231-9996-a79fe90c1c6d tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.211478 Oct 28 10:11:32.002169 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2355/4720] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:31 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:32.002169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:32.002169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:32.017173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:32.017903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:32.018604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:32.019478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:32.020103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:32.020699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:32.173114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:32.189274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f2db9d4-5975-4321-8969-41ad1337a79f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1273 microversion: 2.1 time: 0.192059 Oct 28 10:11:32.191083 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2356/4721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:31 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1273 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:32.233468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:32.234352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:32.243996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:32.245242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:32.245877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:32.250280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:32.250943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:32.251386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:32.468733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:32.479023 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a3fe2bb-3a05-4d1e-b3a8-c1d03c2fdd1f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.611655 Oct 28 10:11:32.481632 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2366/4722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:31 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:32.501639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:32.511616 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cda1aedc-08b1-4401-b0c5-177009661f85 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1507 microversion: 2.1 time: 0.283381 Oct 28 10:11:32.515862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2357/4723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:32 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:32.903774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:32.904637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:32.918732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:32.919614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:32.920311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:32.921411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:32.922840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:32.923501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.022632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:33.023223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:33.035287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.036265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.037379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.039669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.042959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.044334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.224017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.235530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.250028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.251386 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6f141c7b-fbef-4383-ae5d-48d21eb090cd tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.233839 Oct 28 10:11:33.270174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2358/4724] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:33 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:33.270174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:33.270174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:33.275767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.276287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.276734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.277498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.277962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.278439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.461343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.492929 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-86053cce-f996-4e5d-aee6-631664670907 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1279 microversion: 2.1 time: 0.237947 Oct 28 10:11:33.496649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2359/4725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:33 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1279 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:33.511010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.533905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-963d6f1a-aa97-4730-954b-1fff12ebe8a4 req-d72ba691-1100-497f-abeb-bc3e4b4b65ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d8acb44-2123-4b22-b57e-c3f6f3aeb48c", "name": "network-vif-deleted", "tag": "f0a5b54d-d218-4043-9120-d3849ec0d14e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:33.542414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.547188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.552767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-164c2776-494a-4d75-9645-216a8a1e1c96 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.660362 Oct 28 10:11:33.560599 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2367/4726] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:32 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:33.573145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:33.577415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:33.589878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-963d6f1a-aa97-4730-954b-1fff12ebe8a4 req-d72ba691-1100-497f-abeb-bc3e4b4b65ed service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.590381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-963d6f1a-aa97-4730-954b-1fff12ebe8a4 req-d72ba691-1100-497f-abeb-bc3e4b4b65ed service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.591003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-963d6f1a-aa97-4730-954b-1fff12ebe8a4 req-d72ba691-1100-497f-abeb-bc3e4b4b65ed service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.598623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.599442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.604533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.604836 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-963d6f1a-aa97-4730-954b-1fff12ebe8a4 req-d72ba691-1100-497f-abeb-bc3e4b4b65ed service nova] Creating event network-vif-deleted:f0a5b54d-d218-4043-9120-d3849ec0d14e for instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c on n-h2-zed-1 Oct 28 10:11:33.610612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.611095 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-963d6f1a-aa97-4730-954b-1fff12ebe8a4 req-d72ba691-1100-497f-abeb-bc3e4b4b65ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099373 Oct 28 10:11:33.611340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.612360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.612586 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2360/4727] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:33.619312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:33.620719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:33.633544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.634058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.634560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.635365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.635981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.636515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.689097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:33.698855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:33.699414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:33.700046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lazy-loading 'fault' on Instance uuid 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:11:33.787844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26ff90455642401986673d1abae1bf16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd304d4926d34ba085d1a1f1bd0b7fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.800325 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25cf014a-c9a4-4a23-be85-fcb0da13bacb tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 200 len: 1304 microversion: 2.1 time: 0.185182 Oct 28 10:11:33.800961 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2361/4728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:33 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 1304 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:33.918794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:33.928086 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-883e301f-93aa-40c8-88d3-5b92f7400abb tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.366137 Oct 28 10:11:33.933849 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2368/4729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:33 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:34.279944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:34.280767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:34.298635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.300978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.302231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:34.304588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.305759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.308480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:34.467555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:34.488038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:34.494874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '45369fea2a654d1d88145db9677a53fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7db61a6ccbee4a298909d79faabc004d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:34.496334 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b41d818-6ef8-4a6d-b0c5-666a58f319e5 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 200 len: 1605 microversion: 2.32 time: 0.221340 Oct 28 10:11:34.496949 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2362/4730] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:34 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:34.523822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:34.524604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:34.541268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.543958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.545098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:34.547512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.550421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.551098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:34.599566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:34.600848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:34.629553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.631336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.634336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:34.635755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.636248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.636696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:34.947672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:34.957806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7410cd0f-7415-4046-aab5-494285482b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1321 microversion: 2.1 time: 0.438496 Oct 28 10:11:34.963696 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2369/4731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:34 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:34.974247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:34.975211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] [instance: 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:34.984342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.984953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.985454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:34.986242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:34.986802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:34.987331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:35.013588 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] HTTP exception thrown: Instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c could not be found. Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Request method failure captured: Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c HTTP/1.1 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6qnZVHHShnZrCnAZw3HVNUNc5q147cBIRZ1f8WdZbQjKc1jRy2gV-VTQ0yV6Cn5QKgSdk-ZJxB9aGmWF1-u-MdgbuXQsUNWBis6OTcAmWBsnlJFpgKzGcfbH2UuirDD-LP7s-9VQVRs6Yg4-1hSztu4mliLKxjgm-h9N7-CucS5fEc Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: bd304d4926d34ba085d1a1f1bd0b7fdd Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestServerAdvancedOps-2116826947 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd304d4926d34ba085d1a1f1bd0b7fdd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/bd304d4926d34ba085d1a1f1bd0b7fdd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_bd304d4926d34ba085d1a1f1bd0b7fdd", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/bd304d4926d34ba085d1a1f1bd0b7fdd"}]}] Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestServerAdvancedOps-2116826947 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: bd304d4926d34ba085d1a1f1bd0b7fdd Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestServerAdvancedOps-2116826947 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestServerAdvancedOps-2116826947-project Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 26ff90455642401986673d1abae1bf16 Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestServerAdvancedOps-2116826947-project Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c could not be found. Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '7d8acb44-2123-4b22-b57e-c3f6f3aeb48c'} Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c could not be found. Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c could not be found. Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:35.015271 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.019898 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:35.019898 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:35.019898 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:35.019898 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:11:35.019898 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:11:35.019898 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c could not be found. Oct 28 10:11:35.019898 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.022130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] Returning 404 to user: Instance 7d8acb44-2123-4b22-b57e-c3f6f3aeb48c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:11:35.023463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5af382c2-0976-47c4-b9b6-5cf20820b628 tempest-TestServerAdvancedOps-2116826947 tempest-TestServerAdvancedOps-2116826947-project] 10.222.0.16 "GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c" status: 404 len: 111 microversion: 2.1 time: 0.057621 Oct 28 10:11:35.024029 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2370/4732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:34 2022] GET /compute/v2.1/servers/7d8acb44-2123-4b22-b57e-c3f6f3aeb48c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:11:35.037173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0bc09918-82c4-44f9-87b1-d9380e7ca738 req-aa3b4201-ad01-414c-b440-4add9a2c1b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "4077fb51-e3aa-4216-aa06-7e391c67c8a3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:35.056401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0bc09918-82c4-44f9-87b1-d9380e7ca738 req-aa3b4201-ad01-414c-b440-4add9a2c1b92 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:35.063750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0bc09918-82c4-44f9-87b1-d9380e7ca738 req-aa3b4201-ad01-414c-b440-4add9a2c1b92 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:35.064466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0bc09918-82c4-44f9-87b1-d9380e7ca738 req-aa3b4201-ad01-414c-b440-4add9a2c1b92 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:35.091475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0bc09918-82c4-44f9-87b1-d9380e7ca738 req-aa3b4201-ad01-414c-b440-4add9a2c1b92 service nova] Creating event network-vif-plugged:4077fb51-e3aa-4216-aa06-7e391c67c8a3 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:35.106693 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0bc09918-82c4-44f9-87b1-d9380e7ca738 req-aa3b4201-ad01-414c-b440-4add9a2c1b92 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081182 Oct 28 10:11:35.107671 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2371/4733] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:35.112922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:35.121333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:35.139051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:35.139563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:35.140015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:35.140739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:35.141234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:35.141673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:35.269164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:35.282647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:35.285048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:35.291272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d43d73c-b3a9-43b5-8a97-f55448e8b309 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.701899 Oct 28 10:11:35.292498 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2363/4734] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:34 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:35.504877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:35.526707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:35.527322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:35.533363 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d24bbb3f-6290-4b18-a670-9f03678bf6ff tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.422881 Oct 28 10:11:35.534486 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2372/4735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:35 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:35.552927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:35.559607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:35.560079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:35.560838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:35.564012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:35.564646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:35.600661 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] HTTP exception thrown: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Request method failure captured: Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 HTTP/1.1 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lD0sovQQ08LpfK-zZuahcjhZMh4-Bioz-vxne9lkO2VthBod9PW5rWK-h9ra3coxoOT25PKxMnWU8AI1fRz6WyZ7cgpE2KjEaO09OCbSQ_NAykObi9uWd4_Z4SUfO_pOpiHSRqM5UfzYTTp8oON9VrP7llBQ2F6dbUj82C61_p014 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7db61a6ccbee4a298909d79faabc004d Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7db61a6ccbee4a298909d79faabc004d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7db61a6ccbee4a298909d79faabc004d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7db61a6ccbee4a298909d79faabc004d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7db61a6ccbee4a298909d79faabc004d"}]}] Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7db61a6ccbee4a298909d79faabc004d Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TaggedBootDevicesTest-1173750426-project Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 45369fea2a654d1d88145db9677a53fb Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TaggedBootDevicesTest-1173750426-project Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '466e1816-46a1-4a12-b363-9e02d94fa7c0'} Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.602679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:35.606692 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:35.609881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Returning 404 to user: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:11:35.611065 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8dc61ee4-b443-4074-9634-73802ad1f4d9 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 404 len: 111 microversion: 2.32 time: 0.088209 Oct 28 10:11:35.613265 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2364/4736] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:35 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 28 10:11:35.630319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34ba1f4f-6755-4e1e-a6aa-06dbc26ceb88 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '.version_select at 0x7fca322f7af0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:35.651543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c26b3965-c48d-43c2-8267-614b2622a5b8 req-7301d715-e440-4533-83f9-7cd7c20e76f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c864388-245e-4266-9a38-f797263121fa", "tag": "c80a40b3-2eed-4960-bc10-a90548949dc2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:35.682680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c26b3965-c48d-43c2-8267-614b2622a5b8 req-7301d715-e440-4533-83f9-7cd7c20e76f9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:35.682812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c26b3965-c48d-43c2-8267-614b2622a5b8 req-7301d715-e440-4533-83f9-7cd7c20e76f9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:35.687296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c26b3965-c48d-43c2-8267-614b2622a5b8 req-7301d715-e440-4533-83f9-7cd7c20e76f9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:35.706445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c26b3965-c48d-43c2-8267-614b2622a5b8 req-7301d715-e440-4533-83f9-7cd7c20e76f9 service nova] Creating event network-changed:c80a40b3-2eed-4960-bc10-a90548949dc2 for instance 4c864388-245e-4266-9a38-f797263121fa on n-h1-zed-1 Oct 28 10:11:35.718780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c26b3965-c48d-43c2-8267-614b2622a5b8 req-7301d715-e440-4533-83f9-7cd7c20e76f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075948 Oct 28 10:11:35.720568 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2365/4737] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:11:35.737487 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34ba1f4f-6755-4e1e-a6aa-06dbc26ceb88 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350235924" status: 204 len: 0 microversion: 2.32 time: 0.117731 Oct 28 10:11:35.738322 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2373/4738] 10.222.0.16 () {60 vars in 1262 bytes} [Fri Oct 28 10:11:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350235924 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:11:35.988183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:35.988888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:36.000568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:36.001098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:36.001543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:36.002264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:36.002725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:36.003156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:36.323699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:36.324517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:36.344650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:36.346002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:36.348142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:36.352197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:36.354678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:36.357695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:36.562597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:36.577603 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96e8e230-0989-4776-8ed1-b19d49e06442 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1321 microversion: 2.1 time: 0.593790 Oct 28 10:11:36.578202 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2366/4739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:35 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:36.592402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:36.593400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:36.608553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:36.609701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:36.610548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:36.611525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:36.613460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:36.614139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:36.974154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:36.988110 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1418cab-fafd-41a4-a0d8-45784fc27263 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.406042 Oct 28 10:11:36.989090 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2367/4740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:36 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:37.041527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:37.067603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:37.071410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:37.073319 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-428334f2-b988-4def-b2eb-224da3478bde tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.754324 Oct 28 10:11:37.074995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2374/4741] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:36 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:11:37.129327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "b922098b-e4fa-4e1d-8a01-0c34d14ff2fa"}, {"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "215c1213-38f4-44cc-a7d1-25422a75052c"}, {"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "e44943a6-b60e-4807-827d-3c63f8934012"}, {"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "de2afbc8-eb77-48b4-a449-9c49dee3933e"}, {"server_uuid": "28e2f782-cfed-423e-baf1-b589c3fd36ce", "name": "network-vif-plugged", "status": "completed", "tag": "78ecab50-5a8f-4c72-bc70-c4276070211b"}, {"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "dfd265f1-657c-455b-be7a-5d2815a9c1a9"}, {"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-plugged", "status": "completed", "tag": "6b84c793-0c92-4ac1-beea-4590074f979a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:37.141400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:37.143244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:37.143870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:37.161358 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Creating event network-vif-plugged:b922098b-e4fa-4e1d-8a01-0c34d14ff2fa for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:37.162225 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Creating event network-vif-plugged:215c1213-38f4-44cc-a7d1-25422a75052c for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:37.162992 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Creating event network-vif-plugged:e44943a6-b60e-4807-827d-3c63f8934012 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:37.164406 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Creating event network-vif-plugged:de2afbc8-eb77-48b4-a449-9c49dee3933e for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:37.165257 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Creating event network-vif-plugged:78ecab50-5a8f-4c72-bc70-c4276070211b for instance 28e2f782-cfed-423e-baf1-b589c3fd36ce on n-h1-zed-1 Oct 28 10:11:37.165906 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Creating event network-vif-plugged:dfd265f1-657c-455b-be7a-5d2815a9c1a9 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:37.166926 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] Creating event network-vif-plugged:6b84c793-0c92-4ac1-beea-4590074f979a for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:37.178489 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-96ef484a-93ca-4444-b180-9dab062df32a req-4c380423-114d-43c4-a748-582d74b8cbc9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1209 microversion: 2.1 time: 0.054760 Oct 28 10:11:37.179794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2368/4742] 10.222.0.16 () {64 vars in 1318 bytes} [Fri Oct 28 10:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 1209 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:37.600578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:37.601981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:37.608380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:37.608880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:37.609535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:37.610462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:37.610918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:37.611514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:38.012649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:38.013995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:38.018961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:38.031016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:38.031435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:38.032246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:38.033658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:38.034227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:38.034712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:38.143911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:38.337473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:38.337985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:38.362665 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b251388e-c29c-47d7-a053-899c6c0549a4 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1370 microversion: 2.1 time: 0.354422 Oct 28 10:11:38.365470 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-746e8cca-7d84-4881-9b95-3757186a5ece tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1321 microversion: 2.1 time: 0.769549 Oct 28 10:11:38.366065 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2375/4743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:37 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:38.372609 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2369/4744] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:38 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1370 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:38.390289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:38.391708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:38.401971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:38.403519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:38.404186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:38.405148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:38.405929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:38.406778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:38.834064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:38.845520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:38.847122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:38.848294 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76be1706-bc33-4c4e-9d8d-cfbed3588181 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.474274 Oct 28 10:11:38.848865 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2376/4745] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:38 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:39.390300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:39.391009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:39.400546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:39.401483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:39.406517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.416703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.417336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.417557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.418244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:39.419443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:39.419587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.420589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.421414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.422730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:39.424364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.433458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:39.486357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:39.512343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:39.785062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:39.798551 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-007a8e12-e935-44d6-a6fe-3ea6083eda59 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1563 microversion: 2.1 time: 0.403051 Oct 28 10:11:39.799757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2377/4746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:39 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1563 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:39.816950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:39.823997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:39.824878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:39.841121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.842400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b69a3fdc-b7ad-4327-8cc2-63dc425de2e6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1321 microversion: 2.1 time: 0.454970 Oct 28 10:11:39.843063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.846782 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2370/4747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:39 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1321 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:39.847113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:39.848516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.849140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.849686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:39.875092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:39.875825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:39.879156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:39.889630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.890447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.891177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:39.892064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:39.892685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:39.893337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:40.093639 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-98893fa8-2ff5-4350-8427-79c194bd3f18 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.274029 Oct 28 10:11:40.094860 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2378/4748] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:11:39 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-interface => generated 284 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:11:40.336181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:40.351051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:40.359126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:40.360299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6fd1d78-3606-4c50-ada5-110c8e52ba1a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1874 microversion: 2.42 time: 0.489791 Oct 28 10:11:40.361282 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2371/4749] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:39 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1874 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:40.870137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:40.873087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:11:40.879613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:40.880251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:40.900672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:40.902761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:40.903264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:40.906394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:40.908135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:40.909726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:41.392361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:41.393873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:41.409569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:41.410427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:41.411076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:41.414943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:41.415675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:41.416476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:41.816078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:41.824593 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ac5a0c8-1f0c-4f44-8683-a8bd4804b52c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1321 microversion: 2.1 time: 0.956210 Oct 28 10:11:41.825531 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2379/4750] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:40 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1321 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:41.878630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:41.894105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:41.896635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:41.900612 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c2d34b13-c745-42e0-b873-2a70241cc516 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2832 microversion: 2.42 time: 0.513878 Oct 28 10:11:41.913310 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2372/4751] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:41 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2832 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:41.931706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:41.933080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:41.946580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:41.947433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:41.948124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:41.949141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:41.949889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:41.950545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:42.258756 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-077b47ae-90f2-4228-9214-b9f99bb4c0cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.327749 Oct 28 10:11:42.267256 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2380/4752] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 10:11:41 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c/os-interface => generated 1832 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:11:42.752372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ff537d9a-9525-4944-aea7-b28b22642831 req-e36744c4-27ca-4242-bb95-af2864930578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c864388-245e-4266-9a38-f797263121fa", "name": "network-vif-plugged", "status": "completed", "tag": "c80a40b3-2eed-4960-bc10-a90548949dc2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:42.774574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ff537d9a-9525-4944-aea7-b28b22642831 req-e36744c4-27ca-4242-bb95-af2864930578 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:42.774574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ff537d9a-9525-4944-aea7-b28b22642831 req-e36744c4-27ca-4242-bb95-af2864930578 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:42.775235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ff537d9a-9525-4944-aea7-b28b22642831 req-e36744c4-27ca-4242-bb95-af2864930578 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:42.806056 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ff537d9a-9525-4944-aea7-b28b22642831 req-e36744c4-27ca-4242-bb95-af2864930578 service nova] Creating event network-vif-plugged:c80a40b3-2eed-4960-bc10-a90548949dc2 for instance 4c864388-245e-4266-9a38-f797263121fa on n-h1-zed-1 Oct 28 10:11:42.815384 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ff537d9a-9525-4944-aea7-b28b22642831 req-e36744c4-27ca-4242-bb95-af2864930578 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066870 Oct 28 10:11:42.822480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2373/4753] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:42.847810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:42.848557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:42.862793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:42.863457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:42.864141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:42.865205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:42.865910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:42.867192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:43.523196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:43.534292 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-195da162-3724-4f1a-8e06-d0c82e7e07cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1321 microversion: 2.1 time: 0.689986 Oct 28 10:11:43.535061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2381/4754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:42 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1321 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:43.704571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:43.705623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:43.713801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:43.714561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:43.715012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:43.715735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:43.716196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:43.716630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:43.732162 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] HTTP exception thrown: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Request method failure captured: Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 HTTP/1.1 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6lD0sovQQ08LpfK-zZuahcjhZMh4-Bioz-vxne9lkO2VthBod9PW5rWK-h9ra3coxoOT25PKxMnWU8AI1fRz6WyZ7cgpE2KjEaO09OCbSQ_NAykObi9uWd4_Z4SUfO_pOpiHSRqM5UfzYTTp8oON9VrP7llBQ2F6dbUj82C61_p014 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7db61a6ccbee4a298909d79faabc004d Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7db61a6ccbee4a298909d79faabc004d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7db61a6ccbee4a298909d79faabc004d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7db61a6ccbee4a298909d79faabc004d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7db61a6ccbee4a298909d79faabc004d"}]}] Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7db61a6ccbee4a298909d79faabc004d Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TaggedBootDevicesTest-1173750426-project Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 45369fea2a654d1d88145db9677a53fb Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TaggedBootDevicesTest-1173750426-project Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '466e1816-46a1-4a12-b363-9e02d94fa7c0'} Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:11:43.733908 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Returning 404 to user: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23b52deb-5f7f-4d81-b658-db75953b107b tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "DELETE /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 404 len: 111 microversion: 2.32 time: 0.037414 Oct 28 10:11:43.739664 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2374/4755] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:11:43 2022] DELETE /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:11:43.746994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:43.747639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] [instance: 466e1816-46a1-4a12-b363-9e02d94fa7c0] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:43.754888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:43.755381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:43.755830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:43.756550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:43.759736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:43.760594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:43.779379 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] HTTP exception thrown: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Request method failure captured: Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 HTTP/1.1 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6lD0sovQQ08LpfK-zZuahcjhZMh4-Bioz-vxne9lkO2VthBod9PW5rWK-h9ra3coxoOT25PKxMnWU8AI1fRz6WyZ7cgpE2KjEaO09OCbSQ_NAykObi9uWd4_Z4SUfO_pOpiHSRqM5UfzYTTp8oON9VrP7llBQ2F6dbUj82C61_p014 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.32 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7db61a6ccbee4a298909d79faabc004d Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7db61a6ccbee4a298909d79faabc004d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7db61a6ccbee4a298909d79faabc004d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7db61a6ccbee4a298909d79faabc004d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7db61a6ccbee4a298909d79faabc004d"}]}] Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7db61a6ccbee4a298909d79faabc004d Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1173750426 Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TaggedBootDevicesTest-1173750426-project Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 45369fea2a654d1d88145db9677a53fb Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TaggedBootDevicesTest-1173750426-project Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '466e1816-46a1-4a12-b363-9e02d94fa7c0'} Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.781432 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] Returning 404 to user: Instance 466e1816-46a1-4a12-b363-9e02d94fa7c0 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f950b462-fff7-4c1a-b987-83362f3f8cb7 tempest-TaggedBootDevicesTest-1173750426 tempest-TaggedBootDevicesTest-1173750426-project] 10.222.0.16 "GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0" status: 404 len: 111 microversion: 2.32 time: 0.042804 Oct 28 10:11:43.787027 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2382/4756] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:11:43 2022] GET /compute/v2.1/servers/466e1816-46a1-4a12-b363-9e02d94fa7c0 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:11:44.571663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:44.574452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:44.620446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:44.629230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:44.629946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:44.630886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:44.633961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:44.634629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:44.875644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c22a45e1-d175-4d77-b25a-5cb5841166f0 req-8549ccba-51af-4749-8f87-ccb7f9e964c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e2f782-cfed-423e-baf1-b589c3fd36ce", "tag": "78ecab50-5a8f-4c72-bc70-c4276070211b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:44.902151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c22a45e1-d175-4d77-b25a-5cb5841166f0 req-8549ccba-51af-4749-8f87-ccb7f9e964c3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:44.903633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c22a45e1-d175-4d77-b25a-5cb5841166f0 req-8549ccba-51af-4749-8f87-ccb7f9e964c3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:44.904310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c22a45e1-d175-4d77-b25a-5cb5841166f0 req-8549ccba-51af-4749-8f87-ccb7f9e964c3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:44.937285 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c22a45e1-d175-4d77-b25a-5cb5841166f0 req-8549ccba-51af-4749-8f87-ccb7f9e964c3 service nova] Creating event network-changed:78ecab50-5a8f-4c72-bc70-c4276070211b for instance 28e2f782-cfed-423e-baf1-b589c3fd36ce on n-h1-zed-1 Oct 28 10:11:44.948192 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c22a45e1-d175-4d77-b25a-5cb5841166f0 req-8549ccba-51af-4749-8f87-ccb7f9e964c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076702 Oct 28 10:11:44.953886 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2383/4757] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:45.001882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:45.023971 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-77da6cdc-5f87-41d0-9d44-db2479d9df5b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1321 microversion: 2.1 time: 0.466558 Oct 28 10:11:45.027202 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2375/4758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:44 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:46.059763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:46.061078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:46.074581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:46.075856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:46.076399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:46.078206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:46.078915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:46.079558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:46.476422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:46.485675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12ea203c-2e34-414c-ad6e-e2ee9cdd1cdb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1501 microversion: 2.1 time: 0.433713 Oct 28 10:11:46.490423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2384/4759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:46 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1501 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:11:46.530985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:46.533365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:46.548240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:46.548746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:46.550924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:46.551666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:46.552135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:46.552573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:46.849118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:46.859686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6445c429-bfe3-4083-8638-46f5f54d89e4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1501 microversion: 2.1 time: 0.344465 Oct 28 10:11:46.860557 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2376/4760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:46 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1501 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:46.885230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:46.885642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:46.892980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:46.893736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:46.894411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:46.895290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:46.895910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:46.896503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:46.937147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:11:47.090771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-80f7ee16-0b6d-45cc-a3ee-e96508b61285 req-c0fc780f-bc0b-4a18-85b7-5dabb4963d62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "tag": "de2afbc8-eb77-48b4-a449-9c49dee3933e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:47.094243 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-213acce5-17f4-46c1-b474-c7e0e8c62f5c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 204 len: 0 microversion: 2.1 time: 0.210111 Oct 28 10:11:47.096126 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2385/4761] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:11:46 2022] DELETE /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:11:47.110502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80f7ee16-0b6d-45cc-a3ee-e96508b61285 req-c0fc780f-bc0b-4a18-85b7-5dabb4963d62 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:47.112220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80f7ee16-0b6d-45cc-a3ee-e96508b61285 req-c0fc780f-bc0b-4a18-85b7-5dabb4963d62 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:47.113524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-80f7ee16-0b6d-45cc-a3ee-e96508b61285 req-c0fc780f-bc0b-4a18-85b7-5dabb4963d62 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:47.116672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:47.117535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:47.124137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:47.124871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:47.125831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:47.126730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:47.127354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:47.127946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:47.144148 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-80f7ee16-0b6d-45cc-a3ee-e96508b61285 req-c0fc780f-bc0b-4a18-85b7-5dabb4963d62 service nova] Creating event network-changed:de2afbc8-eb77-48b4-a449-9c49dee3933e for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:11:47.156487 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-80f7ee16-0b6d-45cc-a3ee-e96508b61285 req-c0fc780f-bc0b-4a18-85b7-5dabb4963d62 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071382 Oct 28 10:11:47.159077 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2377/4762] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:47.775264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:47.787621 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b16186a5-abb3-4de0-9362-391a3c899e05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1507 microversion: 2.1 time: 0.685877 Oct 28 10:11:47.788411 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2386/4763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:47 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1507 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:48.814778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:48.816530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:48.834033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:48.836053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:48.840267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:48.843038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:48.843528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:48.843974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:49.337895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:49.350194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-460dbedd-43b3-4124-b39e-01bb4dea1de4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1507 microversion: 2.1 time: 0.541821 Oct 28 10:11:49.351492 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2378/4764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:48 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1507 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:50.375045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:50.375722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:50.384817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:50.385343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:50.385787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:50.393227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:50.394106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:50.395456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:50.420834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e5762452-f6c5-40fc-8264-292faa052c60 req-8756fa20-1e3c-4fd1-9bae-4fc1d043706c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c864388-245e-4266-9a38-f797263121fa", "name": "network-vif-deleted", "tag": "c80a40b3-2eed-4960-bc10-a90548949dc2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:50.449295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5762452-f6c5-40fc-8264-292faa052c60 req-8756fa20-1e3c-4fd1-9bae-4fc1d043706c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:50.451256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5762452-f6c5-40fc-8264-292faa052c60 req-8756fa20-1e3c-4fd1-9bae-4fc1d043706c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:50.452847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5762452-f6c5-40fc-8264-292faa052c60 req-8756fa20-1e3c-4fd1-9bae-4fc1d043706c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:50.480864 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e5762452-f6c5-40fc-8264-292faa052c60 req-8756fa20-1e3c-4fd1-9bae-4fc1d043706c service nova] Creating event network-vif-deleted:c80a40b3-2eed-4960-bc10-a90548949dc2 for instance 4c864388-245e-4266-9a38-f797263121fa on n-h1-zed-1 Oct 28 10:11:50.488018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e5762452-f6c5-40fc-8264-292faa052c60 req-8756fa20-1e3c-4fd1-9bae-4fc1d043706c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071417 Oct 28 10:11:50.495782 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2379/4765] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:50.542085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:50.552024 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28156e2f-85f3-4a88-8ab5-43e8237b3af0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 200 len: 1465 microversion: 2.1 time: 0.180739 Oct 28 10:11:50.555821 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2387/4766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:50 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 1465 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:51.585126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:51.588019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:51.617038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:51.620614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:51.622249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:51.628153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:51.633001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:51.635096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:51.694946 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa HTTP/1.1 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4c864388-245e-4266-9a38-f797263121fa'} Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:51.699948 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:11:51.705267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:11:51.705267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:11:51.705267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:11:51.705267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:11:51.705267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:11:51.705267 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:11:51.706839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:11:51.709071 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4bd96825-d7f2-4be5-a0c2-4ff8279caeed tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 404 len: 111 microversion: 2.1 time: 0.132024 Oct 28 10:11:51.719018 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2380/4767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:51 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:11:51.724274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2702a0c1-f794-4842-a376-82790a88b62c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: .version_select at 0x7fca327a8d30>, body: {"keypair": {"name": "tempest-key-1037044625", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5w84J+eUlN0NaBQosPaRWiS4WNy7E+s1iWAY9/TKcGJ1+7jQ0bgw+hd3poxufsuXkG8+TpMUe/W9HfTU5tWuBtowcWrTV8ZyuImTSC4ZCCQSwIVW1+ULY6unmt3lXCbQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:51.762199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2702a0c1-f794-4842-a376-82790a88b62c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:11:51.776864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2702a0c1-f794-4842-a376-82790a88b62c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:11:51.853489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2702a0c1-f794-4842-a376-82790a88b62c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.132413 Oct 28 10:11:51.860030 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2388/4768] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:11:51 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:51.870775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1a79600-b44b-4649-9214-3679362e751a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '.version_select at 0x7fca324aa430>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:51.877995 n-d-zed-1 devstack@n-api.service[128747]: WARNING oslo_db.sqlalchemy.utils [None req-e1a79600-b44b-4649-9214-3679362e751a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 28 10:11:51.898504 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1a79600-b44b-4649-9214-3679362e751a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.027006 Oct 28 10:11:51.899155 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2381/4769] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:11:51 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:52.106258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1004505941", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-key-1037044625", "networks": [{"uuid": "99600157-ce93-4ec4-a82a-4a75b2abd468"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:52.213425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:11:52.760559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:11:52.763136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:11:52.764939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:11:52.766216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:11:52.767116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:11:52.780221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:52.781173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:52.781987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:52.783027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:52.783953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:52.785418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:52.822841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:11:52.830635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:11:52.844997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:11:52.848985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:11:52.905822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b13d858f-6a12-42d9-96ef-7350cbbd6aa6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804778 Oct 28 10:11:52.907258 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2389/4770] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:11:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:11:52.920002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c982ce5b-937d-4ed9-9f38-864589ddb246 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:52.921490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c982ce5b-937d-4ed9-9f38-864589ddb246 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:53.280514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c982ce5b-937d-4ed9-9f38-864589ddb246 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:53.296129 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c982ce5b-937d-4ed9-9f38-864589ddb246 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1229 microversion: 2.1 time: 0.380997 Oct 28 10:11:53.297538 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2382/4771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:52 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1229 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:54.322846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:54.323465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:54.329700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:54.330195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:54.330848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:54.331722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:54.332178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:54.332611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:54.442379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:54.453434 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8cae3d57-3c35-4e92-935d-7523ae178bcf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1289 microversion: 2.1 time: 0.136146 Oct 28 10:11:54.454026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2390/4772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:54 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1289 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:55.481000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:55.481622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:55.494358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:55.494860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:55.495311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:55.496034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:55.496494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:55.496970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:56.175902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:56.205731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d38fb2ed-518d-4d71-b70b-af4c58c72dbb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1329 microversion: 2.1 time: 0.727256 Oct 28 10:11:56.209588 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2383/4773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:55 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1329 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:56.579193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b52317e5-fcea-47e0-9bfd-e764c07bafb5 req-ba89ae75-aced-47b4-bfd1-c294d136a5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e843bdc-cb7b-4735-8f6d-84ac0924be1a", "tag": "b6fecd92-5639-404c-8aa5-a25be0375c8d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:11:56.605220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b52317e5-fcea-47e0-9bfd-e764c07bafb5 req-ba89ae75-aced-47b4-bfd1-c294d136a5a5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:56.605710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b52317e5-fcea-47e0-9bfd-e764c07bafb5 req-ba89ae75-aced-47b4-bfd1-c294d136a5a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:56.606146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b52317e5-fcea-47e0-9bfd-e764c07bafb5 req-ba89ae75-aced-47b4-bfd1-c294d136a5a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:56.628515 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b52317e5-fcea-47e0-9bfd-e764c07bafb5 req-ba89ae75-aced-47b4-bfd1-c294d136a5a5 service nova] Creating event network-changed:b6fecd92-5639-404c-8aa5-a25be0375c8d for instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a on n-h2-zed-1 Oct 28 10:11:56.645289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b52317e5-fcea-47e0-9bfd-e764c07bafb5 req-ba89ae75-aced-47b4-bfd1-c294d136a5a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069602 Oct 28 10:11:56.645914 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2391/4774] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:11:57.233352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:57.234669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:57.242755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:57.243463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:57.250468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:57.251714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:57.253235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:57.253933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:57.570798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:57.581980 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75e708c6-584f-41c2-8bcd-680263e518ad tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1329 microversion: 2.1 time: 0.352846 Oct 28 10:11:57.583573 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2384/4775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:57 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1329 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:11:58.615284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:11:58.619732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:11:58.635028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:58.635917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:58.636567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:58.637555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:11:58.639912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:11:58.640828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:11:58.978218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:11:58.988502 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-348f1613-e771-4763-bc05-e9c92ea08cd6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1329 microversion: 2.1 time: 0.383161 Oct 28 10:11:58.989507 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2392/4776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:11:58 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1329 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:00.016451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:00.017078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:00.027422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:00.029438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:00.030450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:00.031642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:00.032556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:00.033485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:00.282744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:00.290476 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ebac631f-50ea-4572-904a-040937b5c4cb tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1329 microversion: 2.1 time: 0.278613 Oct 28 10:12:00.291076 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2385/4777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:00 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1329 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:01.314342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:01.315916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:01.324061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:01.326179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:01.326967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:01.327848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:01.328807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:01.330243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:01.330896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:02.041870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:02.062449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d4db08a5-7bff-4585-97c5-8e87ccdb41d9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1329 microversion: 2.1 time: 0.752053 Oct 28 10:12:02.073564 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2393/4778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:01 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1329 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:03.092195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:03.092973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:03.101223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:03.101862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:03.102504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:03.103223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:03.103761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:03.104232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:03.292213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:03.430926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:03.440837 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2e191cdf-5b56-4f21-8366-a2a82a9efdaa tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1329 microversion: 2.1 time: 0.356079 Oct 28 10:12:03.441912 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2386/4779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:03 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1329 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:03.670945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5a6bc35e-6aaf-4bba-aaf7-0350aa8fcada req-643d0035-2d9d-4db4-96b5-a53205d1b075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e843bdc-cb7b-4735-8f6d-84ac0924be1a", "name": "network-vif-plugged", "status": "completed", "tag": "b6fecd92-5639-404c-8aa5-a25be0375c8d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:03.682546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:03.686142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:03.696553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5a6bc35e-6aaf-4bba-aaf7-0350aa8fcada req-643d0035-2d9d-4db4-96b5-a53205d1b075 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:03.697457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5a6bc35e-6aaf-4bba-aaf7-0350aa8fcada req-643d0035-2d9d-4db4-96b5-a53205d1b075 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:03.698152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5a6bc35e-6aaf-4bba-aaf7-0350aa8fcada req-643d0035-2d9d-4db4-96b5-a53205d1b075 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:03.714903 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5a6bc35e-6aaf-4bba-aaf7-0350aa8fcada req-643d0035-2d9d-4db4-96b5-a53205d1b075 service nova] Creating event network-vif-plugged:b6fecd92-5639-404c-8aa5-a25be0375c8d for instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a on n-h2-zed-1 Oct 28 10:12:03.720793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5a6bc35e-6aaf-4bba-aaf7-0350aa8fcada req-643d0035-2d9d-4db4-96b5-a53205d1b075 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055574 Oct 28 10:12:03.722812 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2394/4780] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:04.472697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:04.473431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:04.482188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:04.482780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:04.483394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:04.484237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:04.484783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:04.485892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:05.135511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:05.145632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e047e8e5-2275-409d-bab4-68d167ba02c5 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1329 microversion: 2.1 time: 0.681325 Oct 28 10:12:05.146226 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2387/4781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:04 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1329 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:05.455217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:05.462119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:05.463224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Searching by: {'deleted': False, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31'} {{(pid=128748) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:12:05.470270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:05.471283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:05.471987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:05.473036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:05.473828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:05.474562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:05.503487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.multi_cell_list [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128748) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:12:05.535426 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-220ed97d-3415-4b2c-9a39-2f9559859cbc tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.084881 Oct 28 10:12:05.536120 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2395/4782] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 10:12:05 2022] GET /compute/v2.1/servers => generated 333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:12:05.550712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:05.556056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:05.556956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Searching by: {'deleted': False, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 10:12:05.563823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:05.564315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:05.564752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:05.565707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:05.566469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:05.566899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:05.610218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 10:12:05.658499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:05.665545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:05.666288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:05.666734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:05.888453 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca778990-8d58-4a02-ab69-93648c87f408 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.341517 Oct 28 10:12:05.900504 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2388/4783] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:12:05 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:05.919645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb40db32-01a5-43fc-bde0-a27b788cce9c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:05.931529 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bb40db32-01a5-43fc-bde0-a27b788cce9c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015458 Oct 28 10:12:05.932576 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2396/4784] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:12:05 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:06.176575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:06.177344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:06.184706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.185431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.185940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.186886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.187413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.188093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.359186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:06.359974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:06.373341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.373996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.374474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.375445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.375905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.376449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.443930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:06.455392 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f84111f-207e-4055-b402-f8481994bee9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1510 microversion: 2.1 time: 0.284002 Oct 28 10:12:06.477045 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2389/4785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:06 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1510 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:06.490285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:06.491565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:06.501990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.502944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.503591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.504986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.505704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.509724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.760961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:12:06.778537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:06.858628 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71fe7e2f-95c2-41e1-9bde-0d01eeaf888a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 204 len: 0 microversion: 2.1 time: 0.505259 Oct 28 10:12:06.859180 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2397/4786] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:12:06 2022] DELETE /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:12:06.870835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:06.871608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:06.878519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.879320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.879762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.880518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:06.881050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:06.881496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:06.995069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:07.003989 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d4244d4-d3e9-4180-b051-9795af822b37 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1510 microversion: 2.1 time: 0.524834 Oct 28 10:12:07.004716 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2390/4787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:06 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1510 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:07.031732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:07.032381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:07.039429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:07.040077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:07.040857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:07.041767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:07.042480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:07.043012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:07.065520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:07.076044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:12:07.172700 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5a8264b7-5fc6-4e3a-8f89-ea831c2d00be tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 204 len: 0 microversion: 2.1 time: 0.147537 Oct 28 10:12:07.178394 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2391/4788] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:12:07 2022] DELETE /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:12:07.186581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:07.187348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:07.198876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:07.199555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:07.200109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:07.200589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:07.200984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:07.201524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:07.202042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:07.213643 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-68b59627-f2e9-4d44-979c-537fcad4a9e5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1699 microversion: 2.1 time: 0.349617 Oct 28 10:12:07.214606 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2398/4789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:06 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1699 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:07.573538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:07.585893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dae49ab2-bf68-4ff2-88ce-f8da92e3cb69 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1516 microversion: 2.1 time: 0.405435 Oct 28 10:12:07.586878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2392/4790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:07 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1516 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:08.244492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:08.253799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:08.265667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:08.269203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:08.270485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:08.271470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:08.272220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:08.273559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:08.616231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:08.617442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:08.624737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:08.625576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:08.625974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:08.626714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:08.627124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:08.627547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:08.668573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:08.678457 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-05c97885-c6c1-457c-9210-b0ea1406d5f7 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1699 microversion: 2.1 time: 0.441267 Oct 28 10:12:08.678994 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2399/4791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:08 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1699 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:08.928878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:08.939608 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9f349e29-318b-49f3-9882-9a9e71737dab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1516 microversion: 2.1 time: 0.331622 Oct 28 10:12:08.940803 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2393/4792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:08 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:09.709895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:09.714040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:09.723510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:09.727258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:09.727714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:09.728621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:09.729133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:09.729558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:09.964632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:09.965293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:09.974347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:09.986993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:09.987500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:09.988118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:09.989028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:09.989641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:09.993487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:10.204689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:10.218529 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2f611de8-1a01-4792-85df-aff10df4e3d1 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1699 microversion: 2.1 time: 0.517431 Oct 28 10:12:10.219118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2400/4793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:09 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1699 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:10.309175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:10.317274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c60d7703-ca3f-4f1b-a987-4a00b22a7735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1516 microversion: 2.1 time: 0.357445 Oct 28 10:12:10.317871 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2394/4794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:09 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1516 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:11.246251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:11.247600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:11.270837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:11.272230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:11.272852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:11.273894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:11.274542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:11.275139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:11.443585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-141b4287-b209-4e1b-9909-22e5f0b97c63 req-b062a554-6bfc-4593-b764-f22bdeb7a8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e843bdc-cb7b-4735-8f6d-84ac0924be1a", "name": "network-vif-deleted", "tag": "b6fecd92-5639-404c-8aa5-a25be0375c8d"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:11.458199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-141b4287-b209-4e1b-9909-22e5f0b97c63 req-b062a554-6bfc-4593-b764-f22bdeb7a8b2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:11.459560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-141b4287-b209-4e1b-9909-22e5f0b97c63 req-b062a554-6bfc-4593-b764-f22bdeb7a8b2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:11.460504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-141b4287-b209-4e1b-9909-22e5f0b97c63 req-b062a554-6bfc-4593-b764-f22bdeb7a8b2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:11.474738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-141b4287-b209-4e1b-9909-22e5f0b97c63 req-b062a554-6bfc-4593-b764-f22bdeb7a8b2 service nova] Creating event network-vif-deleted:b6fecd92-5639-404c-8aa5-a25be0375c8d for instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a on n-h2-zed-1 Oct 28 10:12:11.481249 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-141b4287-b209-4e1b-9909-22e5f0b97c63 req-b062a554-6bfc-4593-b764-f22bdeb7a8b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.305098 Oct 28 10:12:11.482223 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2401/4795] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:11.489671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:11.491597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:11.499746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:11.500515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:11.501464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:11.502416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:11.503044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:11.503684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:11.542526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:11.543182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:11.543628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:11.544083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lazy-loading 'fault' on Instance uuid 0e843bdc-cb7b-4735-8f6d-84ac0924be1a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:12:11.649347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:11.660243 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b989ede-375c-457f-8a77-b1afb3f4998b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 200 len: 1319 microversion: 2.1 time: 0.176012 Oct 28 10:12:11.661615 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2402/4796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:11 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:11.764955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:11.777118 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-add5dbe3-7fda-465c-b6a1-12679392151a tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1699 microversion: 2.1 time: 0.533514 Oct 28 10:12:11.780035 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2395/4797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:11 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1699 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:12.299050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-cda6dcb9-637b-4bfd-8ffb-74d4bdbdf136 req-ed8b5349-46ea-4d7d-b1fc-ebf7af950330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7125d713-46a2-4e28-b8c2-1292c02ed056", "name": "network-vif-deleted", "tag": "479e4855-3935-4ebe-86b4-036fcd3b204a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:12.328209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-cda6dcb9-637b-4bfd-8ffb-74d4bdbdf136 req-ed8b5349-46ea-4d7d-b1fc-ebf7af950330 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:12.337579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-cda6dcb9-637b-4bfd-8ffb-74d4bdbdf136 req-ed8b5349-46ea-4d7d-b1fc-ebf7af950330 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:12.340639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-cda6dcb9-637b-4bfd-8ffb-74d4bdbdf136 req-ed8b5349-46ea-4d7d-b1fc-ebf7af950330 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:12.373735 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-cda6dcb9-637b-4bfd-8ffb-74d4bdbdf136 req-ed8b5349-46ea-4d7d-b1fc-ebf7af950330 service nova] Creating event network-vif-deleted:479e4855-3935-4ebe-86b4-036fcd3b204a for instance 7125d713-46a2-4e28-b8c2-1292c02ed056 on n-h2-zed-1 Oct 28 10:12:12.382455 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-cda6dcb9-637b-4bfd-8ffb-74d4bdbdf136 req-ed8b5349-46ea-4d7d-b1fc-ebf7af950330 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091886 Oct 28 10:12:12.383919 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2403/4798] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:12.690593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:12.692143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:12.703441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:12.704715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:12.707238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:12.707976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:12.709362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:12.710009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:12.725807 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a HTTP/1.1 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0e843bdc-cb7b-4735-8f6d-84ac0924be1a'} Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:12.727963 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:12.732261 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:12.732261 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:12.732261 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:12:12.732261 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:12:12.732261 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:12:12.732261 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:12.733926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:12:12.735034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-636976a0-f85c-47a3-bd69-93eb1d685330 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 404 len: 111 microversion: 2.1 time: 0.051039 Oct 28 10:12:12.736179 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2396/4799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:12 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:12:12.745047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-48ba7e36-4dd1-45e2-92ab-5ad87893e733 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '.version_select at 0x7fca321ff3a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:12.780089 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-48ba7e36-4dd1-45e2-92ab-5ad87893e733 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-key-1037044625" status: 202 len: 0 microversion: 2.1 time: 0.039283 Oct 28 10:12:12.781326 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2404/4800] 10.222.0.16 () {58 vars in 1209 bytes} [Fri Oct 28 10:12:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1037044625 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:12:12.807041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:12.807935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:12.822425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:12.824628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:12.825599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:12.827661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:12.829157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:12.830446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:12.922823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-216546996", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "99600157-ce93-4ec4-a82a-4a75b2abd468"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:12.929114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:12.930933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:12.931395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:12.937181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lazy-loading 'fault' on Instance uuid 7125d713-46a2-4e28-b8c2-1292c02ed056 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:12:12.998818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:12:13.170220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '606397ab27814a67887f1b47f8602adf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332f1ee007fd480f9a7c2e23c309ec31', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:13.216048 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a56d751-f806-4023-b5d1-122b23823ec5 tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 200 len: 1359 microversion: 2.1 time: 0.413146 Oct 28 10:12:13.217177 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2397/4801] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:12 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 1359 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:13.785715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:12:13.787674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:12:13.788353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:12:13.788833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:12:13.789348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:12:13.805924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:13.806703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:13.807339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:13.808536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:13.809497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:13.810122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:13.837094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:12:13.842932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:12:13.862327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:12:13.864857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:12:13.926384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b7bb2d7-b4e8-47ae-96c9-476291b7aaf0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.008464 Oct 28 10:12:13.929028 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2405/4802] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:12:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1012 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:12:13.949788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-47746563-1b89-49f6-ad3c-0d75f0315f78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:13.949788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-47746563-1b89-49f6-ad3c-0d75f0315f78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:14.246038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:14.246653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] [instance: 7125d713-46a2-4e28-b8c2-1292c02ed056] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:14.258181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:14.258667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:14.262652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:14.264586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:14.266230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:14.268110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:14.334152 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] HTTP exception thrown: Instance 7125d713-46a2-4e28-b8c2-1292c02ed056 could not be found. Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Request method failure captured: Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 HTTP/1.1 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6qHDT4Y6jzkU8dhdma8qi0Vwln6Cr6nTwZyTOhhIXHhnou-w_uWHn4sMIaEI_w87OPWgkF9lItXYR5jYJFEoMvnx_1KYuV1KHFmKaiTgBQA8CxptRrYdvUQG6g2y0kpS-k811SD9o87Zv-5lMM_fKQDziy7wjNjTl4V4n8TWdgXJmo Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 332f1ee007fd480f9a7c2e23c309ec31 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-1415435512 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/332f1ee007fd480f9a7c2e23c309ec31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/332f1ee007fd480f9a7c2e23c309ec31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_332f1ee007fd480f9a7c2e23c309ec31", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/332f1ee007fd480f9a7c2e23c309ec31"}]}] Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-1415435512 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 332f1ee007fd480f9a7c2e23c309ec31 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-1415435512 Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-1415435512-project Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 606397ab27814a67887f1b47f8602adf Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-1415435512-project Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 7125d713-46a2-4e28-b8c2-1292c02ed056 could not be found. Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '7125d713-46a2-4e28-b8c2-1292c02ed056'} Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7125d713-46a2-4e28-b8c2-1292c02ed056 could not be found. Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7125d713-46a2-4e28-b8c2-1292c02ed056 could not be found. Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:14.340772 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:14.345329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:14.345329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:14.345329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:14.345329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:12:14.345329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:12:14.345329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7125d713-46a2-4e28-b8c2-1292c02ed056 could not be found. Oct 28 10:12:14.345329 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:14.348159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Returning 404 to user: Instance 7125d713-46a2-4e28-b8c2-1292c02ed056 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:12:14.349419 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c8f377ee-d52d-4868-a131-190d09b59c2c tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056" status: 404 len: 111 microversion: 2.1 time: 0.107590 Oct 28 10:12:14.379028 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2406/4803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:14 2022] GET /compute/v2.1/servers/7125d713-46a2-4e28-b8c2-1292c02ed056 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:12:14.393926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c1c30cb0-dd14-43a9-a687-efed6c5e3bff tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] Calling method '.version_select at 0x7fca322ad550>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:14.422728 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c1c30cb0-dd14-43a9-a687-efed6c5e3bff tempest-ServersTestJSON-1415435512 tempest-ServersTestJSON-1415435512-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563450963" status: 202 len: 0 microversion: 2.1 time: 0.036051 Oct 28 10:12:14.424469 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2407/4804] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1563450963 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:12:14.570348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-47746563-1b89-49f6-ad3c-0d75f0315f78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:14.586487 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-47746563-1b89-49f6-ad3c-0d75f0315f78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1208 microversion: 2.1 time: 0.646775 Oct 28 10:12:14.587890 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2398/4805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:13 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1208 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:15.613881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:15.615877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:15.626447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:15.627039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:15.627792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:15.629709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:15.630367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:15.631992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:15.837925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:15.861333 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f26737fa-5d2f-4996-86c5-746b95c5195e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1268 microversion: 2.1 time: 0.250998 Oct 28 10:12:15.864245 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2408/4806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:15 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1268 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:16.895706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:16.898524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:16.904603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:16.919302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:16.920344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:16.921491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:16.923287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:16.924095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:16.924847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:17.105949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:17.118655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63c4a447-e6ba-4743-906e-cb4f0df76af9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1266 microversion: 2.1 time: 0.229333 Oct 28 10:12:17.128169 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2399/4807] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:16 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:17.276776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39c12315-3e9c-4856-97b9-28134af06961"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:17.279987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:17.305754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:17.307895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:17.311234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:17.316265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:17.319242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:17.321484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:17.953168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c551ab0-3eb0-4031-801a-1c48e608b9b1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684091 Oct 28 10:12:17.958659 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2409/4808] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:12:17 2022] POST /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:18.148432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:18.150413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:18.160118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:18.161185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:18.162802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:18.163840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:18.165217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:18.166073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:18.772772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:18.782131 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a156678-9b91-4d83-837f-17d6ea363819 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.639408 Oct 28 10:12:18.782923 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2400/4809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:18 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:19.813442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:19.814900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:19.832174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:19.832995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:19.833637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:19.834545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:19.841165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:19.841952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:20.492216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:20.501322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52b88933-cc2a-4a8a-bc0c-a3c4a8913905 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.692932 Oct 28 10:12:20.507268 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2410/4810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:19 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:21.040039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1c284de1-30de-4050-8579-b31d650b01b8 req-851c1edb-4b1c-4406-a1f6-d75e8d56f4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d73d68fc-c148-4d42-813c-7f1b632ef898", "tag": "22044da1-15aa-42ca-8691-db3535cd2880"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:21.071843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1c284de1-30de-4050-8579-b31d650b01b8 req-851c1edb-4b1c-4406-a1f6-d75e8d56f4dc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:21.072945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1c284de1-30de-4050-8579-b31d650b01b8 req-851c1edb-4b1c-4406-a1f6-d75e8d56f4dc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:21.074067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1c284de1-30de-4050-8579-b31d650b01b8 req-851c1edb-4b1c-4406-a1f6-d75e8d56f4dc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:21.100460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1c284de1-30de-4050-8579-b31d650b01b8 req-851c1edb-4b1c-4406-a1f6-d75e8d56f4dc service nova] Creating event network-changed:22044da1-15aa-42ca-8691-db3535cd2880 for instance d73d68fc-c148-4d42-813c-7f1b632ef898 on n-h2-zed-1 Oct 28 10:12:21.114632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1c284de1-30de-4050-8579-b31d650b01b8 req-851c1edb-4b1c-4406-a1f6-d75e8d56f4dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078745 Oct 28 10:12:21.119086 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2401/4811] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:21.532606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:21.534409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:21.548002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:21.549935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:21.552875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:21.554233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:21.555005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:21.557733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:22.083879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:22.095339 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d5cfb2e-66f2-4d47-a697-bd1c2611252f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.568045 Oct 28 10:12:22.099348 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2411/4812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:21 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:23.128394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:23.135762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:23.154837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:23.158929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:23.159569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:23.161115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:23.163585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:23.166146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:24.157417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:24.174154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c3fc0de-eac3-4117-9691-03049a8ed200 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 1.051892 Oct 28 10:12:24.181096 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2402/4813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:23 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:25.199616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:25.200484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:25.207076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:25.207793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:25.217311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:25.217864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:25.218323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:25.219070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:25.226371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:25.227082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:25.728136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:25.742536 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d63212e9-a44d-4f6c-8f53-bd5e24c74751 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.546830 Oct 28 10:12:25.753374 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2412/4814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:25 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:26.099959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:26.310410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1741788829", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "1a23a693-d638-4a8e-84c5-0f4d07475308"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:26.424888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] validate_networks() for [('1a23a693-d638-4a8e-84c5-0f4d07475308', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:12:26.770289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:26.771035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:26.784162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:26.784896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:26.785788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:26.789262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:26.789975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:26.790710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:27.254912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:27.272250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70222f3d-71d4-4f48-b6e5-8880cee12ea6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.505683 Oct 28 10:12:27.288176 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2413/4815] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:26 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:27.857647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:12:27.858279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:12:27.859654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:12:27.860817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:12:27.861540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:12:27.879437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:27.881447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:27.882927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:27.884784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:27.886090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:27.887616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:27.965669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Getting quotas for project e0e72e7f3f304aa7b72036f1ab6ab000. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:12:27.983681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Getting quotas for user bafdc127af914320a17d15b77fb4ce5f and project e0e72e7f3f304aa7b72036f1ab6ab000. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:12:28.031990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:12:28.039527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:12:28.187443 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-28d63c1d-d8f7-4f48-bc92-b073001a949a tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.106164 Oct 28 10:12:28.191059 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2403/4816] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:12:28.201874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-385a402a-5077-4a47-aaae-2b674abc405e tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:28.203181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-385a402a-5077-4a47-aaae-2b674abc405e tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:28.297414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:28.298227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:28.317661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:28.320988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:28.322989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:28.323897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:28.324965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:28.325458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:28.335029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-385a402a-5077-4a47-aaae-2b674abc405e tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:28.349921 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-385a402a-5077-4a47-aaae-2b674abc405e tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1225 microversion: 2.1 time: 0.151757 Oct 28 10:12:28.354319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2414/4817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:28 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1225 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:29.030411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:29.045310 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-42c62f66-d142-4205-83cf-c9d9576443fc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.753322 Oct 28 10:12:29.058747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2404/4818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:28 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:29.383832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:29.386210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:29.406790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:29.411892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:29.412380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:29.413176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:29.413649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:29.414081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:29.528603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:29.540372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97a9afa6-ad9a-45a5-9f0a-de768fa0f012 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1221 microversion: 2.1 time: 0.162893 Oct 28 10:12:29.541331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2415/4819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:29 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1221 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:29.950094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-14a121b0-e782-4500-9f2e-548e222cf3bd req-36400eba-12ad-425e-9fbc-bc697203e659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73d68fc-c148-4d42-813c-7f1b632ef898", "name": "network-vif-plugged", "status": "completed", "tag": "22044da1-15aa-42ca-8691-db3535cd2880"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:29.971336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-14a121b0-e782-4500-9f2e-548e222cf3bd req-36400eba-12ad-425e-9fbc-bc697203e659 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:29.973206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-14a121b0-e782-4500-9f2e-548e222cf3bd req-36400eba-12ad-425e-9fbc-bc697203e659 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:29.976659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-14a121b0-e782-4500-9f2e-548e222cf3bd req-36400eba-12ad-425e-9fbc-bc697203e659 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:30.041876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-14a121b0-e782-4500-9f2e-548e222cf3bd req-36400eba-12ad-425e-9fbc-bc697203e659 service nova] Creating event network-vif-plugged:22044da1-15aa-42ca-8691-db3535cd2880 for instance d73d68fc-c148-4d42-813c-7f1b632ef898 on n-h2-zed-1 Oct 28 10:12:30.053757 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-14a121b0-e782-4500-9f2e-548e222cf3bd req-36400eba-12ad-425e-9fbc-bc697203e659 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105742 Oct 28 10:12:30.057351 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2405/4820] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:30.073311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:30.073936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:30.083895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:30.085679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:30.086090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:30.088000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:30.089392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:30.104789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:30.570821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:30.571891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:30.594097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:30.595515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:30.597792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:30.601125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:30.606824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:30.607907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:30.847153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:30.859520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:30.862317 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-421e032e-146f-4946-bd00-24fa099907d4 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.791276 Oct 28 10:12:30.868832 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2416/4821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:30 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:30.873995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:30.874901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:30.882025 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2e169961-202e-4c9d-b5e0-e0235db52bb6 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1295 microversion: 2.1 time: 0.318052 Oct 28 10:12:30.884450 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2406/4822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:30 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1295 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:30.895041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:30.895589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:30.908570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:30.909825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:30.910487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:30.912281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:30.953446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:31.454671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:31.468690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:31.473432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:31.478099 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-884a5513-bb79-4f96-9fa6-55227206718a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2951 microversion: 2.42 time: 0.606620 Oct 28 10:12:31.480029 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2417/4823] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:12:30 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2951 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:12:31.514717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:31.515895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:31.525828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:31.527049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:31.527811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:31.529020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:31.529533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:31.530309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:31.689287 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31abfb2b-094f-474d-b8e7-dbb83ae6d3dd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c/os-interface" status: 200 len: 1832 microversion: 2.42 time: 0.178791 Oct 28 10:12:31.690340 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2407/4824] 10.222.0.16 () {60 vars in 1316 bytes} [Fri Oct 28 10:12:31 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c/os-interface => generated 1832 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:12:31.891095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:31.891699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:31.893653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:31.898674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:31.899376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:31.899813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:31.900699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:31.901580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:31.901680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:31.911820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:31.912637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:31.928115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:31.928829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:31.929485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:31.930415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:31.931070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:31.931695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:32.049151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:32.059575 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d640d79f-6b83-4ca7-b681-ce8e9b6170e5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1283 microversion: 2.1 time: 0.151526 Oct 28 10:12:32.061979 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2408/4825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:31 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:32.367767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:32.383288 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4edc6255-2788-4ad8-9244-c06e008ef5dc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1308 microversion: 2.1 time: 0.496760 Oct 28 10:12:32.383903 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2418/4826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:31 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1308 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:33.082954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:33.084146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:33.093956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:33.094462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:33.094906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:33.095618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:33.096142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:33.111858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:33.422160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:33.423391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:33.435670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:33.441299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:33.448705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:33.449806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:33.452863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:33.453559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:33.537321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:33.548508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e9a2e85f-b402-43df-a798-64a07a5e007f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1325 microversion: 2.1 time: 0.469422 Oct 28 10:12:33.579608 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2409/4827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:33 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1325 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:33.787318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:33.790614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:33.806530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:33.809465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:33.810396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:33.811353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:33.812000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:33.812625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:33.817769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:33.843952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'flavor' on Instance uuid 28e2f782-cfed-423e-baf1-b589c3fd36ce {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:12:34.066736 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ae37f30c-7143-4ee1-b462-6a20afdfa747 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/action" status: 200 len: 32 microversion: 2.1 time: 0.287034 Oct 28 10:12:34.068529 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2410/4828] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:12:33 2022] POST /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/action => generated 32 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 28 10:12:34.080800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:34.082166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:34.094334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:34.095749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:34.096424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:34.104651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:34.105433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:34.106236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:34.425191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:34.440306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c79c355c-95cc-41b8-8161-b4c9d9f394df tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.365473 Oct 28 10:12:34.441627 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2411/4829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:34 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:34.533350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:34.586857 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca8ca928-c52f-45b6-92f2-06d7125b3217 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1489 microversion: 2.1 time: 1.168795 Oct 28 10:12:34.589739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2419/4830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:33 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1489 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:34.596895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:34.597800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:34.636780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:34.637465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:34.644437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:34.646609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:34.647888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:34.648344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:34.806523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-216546996", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "99600157-ce93-4ec4-a82a-4a75b2abd468"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:34.884189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:12:35.113071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:35.131545 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6cde679c-eb3e-4484-b908-d4f0f67c3ad0 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1325 microversion: 2.1 time: 0.546133 Oct 28 10:12:35.132422 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2412/4831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:34 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1325 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:35.200658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1d9d5898-e4e4-4f29-81ff-98f7612648cd req-bda5fd5b-5e91-4528-abbc-9ba939e9c69d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed47fc02-a3e0-490d-9d63-0a7da85399f5", "tag": "ae1492ab-b7e8-4522-aea9-b44666508aab"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:35.216864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d9d5898-e4e4-4f29-81ff-98f7612648cd req-bda5fd5b-5e91-4528-abbc-9ba939e9c69d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:35.217380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d9d5898-e4e4-4f29-81ff-98f7612648cd req-bda5fd5b-5e91-4528-abbc-9ba939e9c69d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:35.217813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1d9d5898-e4e4-4f29-81ff-98f7612648cd req-bda5fd5b-5e91-4528-abbc-9ba939e9c69d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:35.236329 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1d9d5898-e4e4-4f29-81ff-98f7612648cd req-bda5fd5b-5e91-4528-abbc-9ba939e9c69d service nova] Creating event network-changed:ae1492ab-b7e8-4522-aea9-b44666508aab for instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 on n-h1-zed-1 Oct 28 10:12:35.246679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1d9d5898-e4e4-4f29-81ff-98f7612648cd req-bda5fd5b-5e91-4528-abbc-9ba939e9c69d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049809 Oct 28 10:12:35.249637 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2413/4832] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:35.466200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:35.467285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:35.477846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:35.483241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:35.484065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:35.485117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:35.486915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:35.489351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:36.097131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:36.118919 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b1b31d8-44b9-4c39-a76b-71d35c9034c8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.656821 Oct 28 10:12:36.138778 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2414/4833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:35 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:36.155934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:36.157012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:36.171936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:36.179289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:36.179289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:36.179729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:36.180428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:36.181440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:36.459940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:12:36.459940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:12:36.459940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:12:36.459940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:12:36.459940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:12:36.482423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:36.483063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:36.484568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:36.488269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:36.488929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:36.492357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:36.554794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:12:36.562911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:12:36.579305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:36.581833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:12:36.588472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:12:36.590619 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fd6b8db-b648-44dc-9fb5-da0fdd036d59 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1325 microversion: 2.1 time: 0.438639 Oct 28 10:12:36.604606 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2415/4834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:36 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:36.671414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-947bf915-e7c3-4c88-8973-cf46c1d8a735 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.867251 Oct 28 10:12:36.672427 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2420/4835] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:12:36.685330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c63243bb-494a-4454-aa39-4b98e10820dd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:36.686203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c63243bb-494a-4454-aa39-4b98e10820dd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:36.836684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c63243bb-494a-4454-aa39-4b98e10820dd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:36.845941 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c63243bb-494a-4454-aa39-4b98e10820dd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1208 microversion: 2.1 time: 0.165044 Oct 28 10:12:36.846522 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2416/4836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:36 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1208 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:37.147070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:37.148207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:37.163316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:37.165335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:37.166915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:37.169359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:37.170098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:37.174013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:37.446306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:37.480168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5fb8e975-7aa0-4d42-aa13-6d9ff7198a1d tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.336969 Oct 28 10:12:37.502607 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2421/4837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:37 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:37.620767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:37.622253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:37.635535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:37.636443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:37.637395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:37.638678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:37.639398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:37.640127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:37.841398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:37.852840 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee958d82-eb3c-426e-a791-bfc66eb1122d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1325 microversion: 2.1 time: 0.238210 Oct 28 10:12:37.856294 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2417/4838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:37 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:37.879666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:37.881173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:37.893965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:37.894808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:37.896391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:37.899424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:37.900140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:37.902645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:38.142075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:38.151225 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-891de27b-130a-43d8-a3d5-3cf3a9f0d47d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1260 microversion: 2.1 time: 0.276026 Oct 28 10:12:38.155090 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2422/4839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:37 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:38.508651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:38.509386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:38.517968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:38.524870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:38.526175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:38.534609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:38.539300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:38.540045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:38.541696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:38.882793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:38.883433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:38.909621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:38.910158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:38.910614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:38.911411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:38.916742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:38.917280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:38.985070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:39.014740 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b4c45a7-5333-4555-8ee4-24c2ae733667 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.510026 Oct 28 10:12:39.018138 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2418/4840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:38 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:39.185819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:39.186872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:39.195744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:39.196687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:39.197596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:39.199024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:39.199743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:39.200407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:39.357953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:39.369600 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c9b021ae-3fb9-49ce-9d66-82e72956a38e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1266 microversion: 2.1 time: 0.189183 Oct 28 10:12:39.370499 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2419/4841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:39 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:39.766674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:39.775202 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d2f78b7-fca9-4a97-83db-7ba03873f451 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1325 microversion: 2.1 time: 0.898411 Oct 28 10:12:39.775798 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2423/4842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:38 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1325 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:40.044223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:40.045536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:40.052465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:40.057742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:40.058760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:40.059778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:40.060705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:40.061442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:40.062137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:40.294353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:40.316213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-16c3a93e-298f-43c9-b6ae-83af3aef3279 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.277884 Oct 28 10:12:40.318195 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2420/4843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:40 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:40.394560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:40.395190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:40.403645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:40.404148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:40.404590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:40.405522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:40.405981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:40.406834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:40.569173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:40.583924 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b875ab50-ddbd-4d65-b293-9743e4c30607 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1266 microversion: 2.1 time: 0.193166 Oct 28 10:12:40.586720 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2424/4844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:40 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:40.804085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:40.804776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:40.815250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:40.815757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:40.816211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:40.820239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:40.821715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:40.822176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:41.170889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:41.183030 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6e6b60d3-2c84-48f6-a522-f46a33525a14 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1325 microversion: 2.1 time: 0.385624 Oct 28 10:12:41.183886 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2421/4845] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:40 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1325 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:41.187380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fe474ff8-f36f-4508-b0ba-780a94fdd8be req-1de0136d-ed8b-4264-8059-e5f28d6b7257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed47fc02-a3e0-490d-9d63-0a7da85399f5", "name": "network-vif-plugged", "status": "completed", "tag": "ae1492ab-b7e8-4522-aea9-b44666508aab"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:41.208150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fe474ff8-f36f-4508-b0ba-780a94fdd8be req-1de0136d-ed8b-4264-8059-e5f28d6b7257 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:41.208591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fe474ff8-f36f-4508-b0ba-780a94fdd8be req-1de0136d-ed8b-4264-8059-e5f28d6b7257 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:41.213386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fe474ff8-f36f-4508-b0ba-780a94fdd8be req-1de0136d-ed8b-4264-8059-e5f28d6b7257 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:41.230392 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fe474ff8-f36f-4508-b0ba-780a94fdd8be req-1de0136d-ed8b-4264-8059-e5f28d6b7257 service nova] Creating event network-vif-plugged:ae1492ab-b7e8-4522-aea9-b44666508aab for instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 on n-h1-zed-1 Oct 28 10:12:41.244377 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fe474ff8-f36f-4508-b0ba-780a94fdd8be req-1de0136d-ed8b-4264-8059-e5f28d6b7257 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061689 Oct 28 10:12:41.245462 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2425/4846] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:12:41.344155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:41.345713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:41.355967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:41.356773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:41.358232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:41.369363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:41.369474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:41.369942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:41.593960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:41.613112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:41.614785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:41.621433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c27e4883-d182-48ce-96ec-a180da96e7fa tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.281961 Oct 28 10:12:41.627963 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2422/4847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:41 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:41.660354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:41.661911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:41.662964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:41.663881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:41.664620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:41.665242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:41.945352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:41.964289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5714509f-70ce-4f64-bdc7-b4636fc7f5f6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.355349 Oct 28 10:12:41.967390 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2426/4848] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:41 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:42.209611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:42.211014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:42.223732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:42.224475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:42.225324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:42.226237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:42.229829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:42.230500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:42.512034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:42.524115 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65bd0e48-2edb-46e4-9554-da4797d70085 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1325 microversion: 2.1 time: 0.319781 Oct 28 10:12:42.527897 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2423/4849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:42 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:42.551721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6bf5a751-64e5-4b87-8d89-0b077b9b80f6 req-d61624d8-a188-4158-83d8-6dbfd2ac063c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81", "tag": "77fe0365-95a7-49ee-abc0-9111138baf94"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:42.562464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6bf5a751-64e5-4b87-8d89-0b077b9b80f6 req-d61624d8-a188-4158-83d8-6dbfd2ac063c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:42.563373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6bf5a751-64e5-4b87-8d89-0b077b9b80f6 req-d61624d8-a188-4158-83d8-6dbfd2ac063c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:42.564011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6bf5a751-64e5-4b87-8d89-0b077b9b80f6 req-d61624d8-a188-4158-83d8-6dbfd2ac063c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:42.604499 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6bf5a751-64e5-4b87-8d89-0b077b9b80f6 req-d61624d8-a188-4158-83d8-6dbfd2ac063c service nova] Creating event network-changed:77fe0365-95a7-49ee-abc0-9111138baf94 for instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 on n-h2-zed-1 Oct 28 10:12:42.611496 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6bf5a751-64e5-4b87-8d89-0b077b9b80f6 req-d61624d8-a188-4158-83d8-6dbfd2ac063c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067561 Oct 28 10:12:42.612379 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2424/4850] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:42.625522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1200996207", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7c622546-6f98-4076-8fbe-73602c743764"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:42.651681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:42.652622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:42.670940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:42.671363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:42.678847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:42.679706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:42.680579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:42.681223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:42.743651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] validate_networks() for [('7c622546-6f98-4076-8fbe-73602c743764', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:12:42.956644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:42.973243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a223ee28-b502-4326-8d8e-8d5c50aa9f06 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.325706 Oct 28 10:12:42.978121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2425/4851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:42 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:42.994784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:42.995326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:43.004318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.005002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.005451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.006157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.006619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.007121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.194790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:43.212196 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-094079ac-5921-4def-b85f-690cc9497ab9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.220933 Oct 28 10:12:43.214029 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2426/4852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:42 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:43.519008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:12:43.519974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:12:43.520973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:12:43.521627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:12:43.522260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:12:43.533736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.534539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.535217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.536721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.537456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.538270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.550614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:43.551236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:43.562349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.562851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.567971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.570248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Getting quotas for project 93a2ed40295f44e2930a150edcbc798d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:12:43.571665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.572662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.572778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.579090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:43.605396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Getting quotas for user 906ed53d9d734a028b438ab998fdaaad and project 93a2ed40295f44e2930a150edcbc798d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:12:43.620035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:12:43.622643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:12:43.710521 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1efbbd58-a641-400d-a264-1e2a57394ae6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.355525 Oct 28 10:12:43.717556 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2427/4853] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:12:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1363 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:12:43.725630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4f04c43f-41dd-43f6-896d-65e049b16e29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:43.726255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4f04c43f-41dd-43f6-896d-65e049b16e29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:43.810540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:43.823444 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df20cd6e-e8f2-48a3-ae14-0492acf66a12 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1522 microversion: 2.1 time: 0.276913 Oct 28 10:12:43.824611 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2427/4854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:43 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:43.856285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:43.857172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:43.872342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.874392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.875297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.877805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4f04c43f-41dd-43f6-896d-65e049b16e29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:43.878308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:43.878967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:43.881343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:43.888336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4f04c43f-41dd-43f6-896d-65e049b16e29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1218 microversion: 2.1 time: 0.164874 Oct 28 10:12:43.888983 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2428/4855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:43 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1218 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:43.978516 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] HTTP exception thrown: Action 999 not found Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Request method failure captured: Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5/os-instance-actions/999 HTTP/1.1 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sJsLQxUCZJDoGiDx_ALtEXFTCNS1uIaztazjuR6hAxbQNdb-TuNCzxBlqeK3ZqfxqcznOn0YGP6Z2sIlQevSjL4ywVVxC9tRIyqxRXGqLf8vW9PlOY6JvLLPbPkwhyVVSpuxwy_fOxNT5razs2ctk8-rXVLhaDNnNobUvpr9XfSGg Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: e0e72e7f3f304aa7b72036f1ab6ab000 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0e72e7f3f304aa7b72036f1ab6ab000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0e72e7f3f304aa7b72036f1ab6ab000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0e72e7f3f304aa7b72036f1ab6ab000", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0e72e7f3f304aa7b72036f1ab6ab000"}]}] Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: e0e72e7f3f304aa7b72036f1ab6ab000 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-InstanceActionsNegativeTestJSON-98572039-project Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: bafdc127af914320a17d15b77fb4ce5f Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-98572039-project Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: exception: Action 999 not found Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': 'ed47fc02-a3e0-490d-9d63-0a7da85399f5', 'id': '999'} Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 28 10:12:43.985275 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:43.991840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Returning 404 to user: Action 999 not found {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:12:43.994779 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7bc071e0-7977-470d-bf58-e1beabfb1ad5 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.142008 Oct 28 10:12:43.997060 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2428/4856] 10.222.0.16 () {58 vars in 1308 bytes} [Fri Oct 28 10:12:43 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5/os-instance-actions/999 => generated 66 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:12:44.006457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:44.007070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:44.011084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5f68dce-b7cd-4a54-b0ef-9ccbdd7b81b3 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '.version_select at 0x7fca324745e0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:44.014747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5f68dce-b7cd-4a54-b0ef-9ccbdd7b81b3 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: 069fc34b-94d0-4c0b-a77e-9f29e5c4ac96] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:44.021392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.021902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.022352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.023079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.023538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.023970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.026010 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c5f68dce-b7cd-4a54-b0ef-9ccbdd7b81b3 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] HTTP exception thrown: Instance 069fc34b-94d0-4c0b-a77e-9f29e5c4ac96 could not be found. Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5f68dce-b7cd-4a54-b0ef-9ccbdd7b81b3 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Request method failure captured: Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/069fc34b-94d0-4c0b-a77e-9f29e5c4ac96/os-instance-actions HTTP/1.1 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sJsLQxUCZJDoGiDx_ALtEXFTCNS1uIaztazjuR6hAxbQNdb-TuNCzxBlqeK3ZqfxqcznOn0YGP6Z2sIlQevSjL4ywVVxC9tRIyqxRXGqLf8vW9PlOY6JvLLPbPkwhyVVSpuxwy_fOxNT5razs2ctk8-rXVLhaDNnNobUvpr9XfSGg Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: e0e72e7f3f304aa7b72036f1ab6ab000 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0e72e7f3f304aa7b72036f1ab6ab000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0e72e7f3f304aa7b72036f1ab6ab000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0e72e7f3f304aa7b72036f1ab6ab000", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0e72e7f3f304aa7b72036f1ab6ab000"}]}] Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: e0e72e7f3f304aa7b72036f1ab6ab000 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-InstanceActionsNegativeTestJSON-98572039-project Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: bafdc127af914320a17d15b77fb4ce5f Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-98572039-project Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 069fc34b-94d0-4c0b-a77e-9f29e5c4ac96 could not be found. Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': '069fc34b-94d0-4c0b-a77e-9f29e5c4ac96'} Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069fc34b-94d0-4c0b-a77e-9f29e5c4ac96 could not be found. Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:12:44.027833 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069fc34b-94d0-4c0b-a77e-9f29e5c4ac96 could not be found. Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069fc34b-94d0-4c0b-a77e-9f29e5c4ac96 could not be found. Oct 28 10:12:44.031788 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:12:44.034440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5f68dce-b7cd-4a54-b0ef-9ccbdd7b81b3 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Returning 404 to user: Instance 069fc34b-94d0-4c0b-a77e-9f29e5c4ac96 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:12:44.035528 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5f68dce-b7cd-4a54-b0ef-9ccbdd7b81b3 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/069fc34b-94d0-4c0b-a77e-9f29e5c4ac96/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.033520 Oct 28 10:12:44.036754 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2429/4857] 10.222.0.16 () {58 vars in 1296 bytes} [Fri Oct 28 10:12:44 2022] GET /compute/v2.1/servers/069fc34b-94d0-4c0b-a77e-9f29e5c4ac96/os-instance-actions => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:12:44.054115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:44.054810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:44.064648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.065479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.066339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.068080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.069182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.070192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.107692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:12:44.344041 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b0ae33c-47fa-4d41-ac9e-bb16a1b8a794 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 204 len: 0 microversion: 2.1 time: 0.288644 Oct 28 10:12:44.347432 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2430/4858] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:12:44 2022] DELETE /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:12:44.358601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:44.363650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:44.376628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.377727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:44.387427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.389754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-feb2a7e8-df49-4843-b61b-3b6b1771a2be tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.387622 Oct 28 10:12:44.390683 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2429/4859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:44 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:44.390802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.391465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.391956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.392397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.408194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:44.417182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:44.430028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.437695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.438370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.439398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.440075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.440736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.724108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:44.734108 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2d11f5b-52db-406c-8bd3-2bc4f4919ca1 tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1528 microversion: 2.1 time: 0.341696 Oct 28 10:12:44.739439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2430/4860] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:44 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:44.793861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:44.812134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a7b32c3-5457-41ac-a510-a9d3b937adf7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.463228 Oct 28 10:12:44.814574 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2431/4861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:44 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:44.914961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:44.917275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:44.928141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.928972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.929664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:44.930758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:44.931482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:44.933597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:45.053041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:45.064489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-731f7614-6520-467e-8340-eb13963b7ee4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1222 microversion: 2.1 time: 0.155670 Oct 28 10:12:45.066755 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2431/4862] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:44 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:45.421506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:45.422742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:45.431841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:45.432363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:45.433396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:45.434144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:45.434924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:45.436695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:45.724621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:45.736333 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e9e2374-9d51-47af-9a5a-04ac5db00257 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.321678 Oct 28 10:12:45.741414 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2432/4863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:45 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:45.764193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:45.765153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:45.776535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:45.777163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:45.778004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:45.778921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:45.779462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:45.779893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:45.839874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:45.840922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:45.849089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:45.849746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:45.850452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:45.852421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:45.853634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:45.854193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:46.142030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:46.175474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e8c3138a-c9e6-492e-80c3-0b2c6d3b823e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.342996 Oct 28 10:12:46.177229 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2433/4864] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:45 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:46.184883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:46.185928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:46.193781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:46.194323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:46.194776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:46.196409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:46.197296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:46.209678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:46.343040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:46.355953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-54b55974-c280-4e12-8c35-05522a12f767 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1270 microversion: 2.1 time: 0.177553 Oct 28 10:12:46.356878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2434/4865] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:46 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1270 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:46.623611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:46.644708 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8cb4abe-3e89-463a-bda6-ebbea34d97ca tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1528 microversion: 2.1 time: 0.883964 Oct 28 10:12:46.645819 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2432/4866] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:45 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1528 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:46.761758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:46.762368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:46.771639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:46.772232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:46.772713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:46.773525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:46.774050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:46.774476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:46.845985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:47.167247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:47.182546 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b3a2143-d243-4e43-9ac3-eb40bc32ff80 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.424740 Oct 28 10:12:47.191628 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2435/4867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:46 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:47.205713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:47.206321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:47.213894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.214732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.215540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.216493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.217178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.217818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.379573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:47.380307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:47.399822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.400759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.403961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.405058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.406010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.407834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.572163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:47.583353 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-20c81ec4-e030-4412-a0f0-9dedd20c35ac tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.381680 Oct 28 10:12:47.592972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:47.593885 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2433/4868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:47 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:47.593885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a6fd2d7f-96c7-4456-98ed-9ce3bc34264b req-3ab5f93c-0598-45f9-8aa8-9acd0496f445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed47fc02-a3e0-490d-9d63-0a7da85399f5", "name": "network-vif-deleted", "tag": "ae1492ab-b7e8-4522-aea9-b44666508aab"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:47.604352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a6fd2d7f-96c7-4456-98ed-9ce3bc34264b req-3ab5f93c-0598-45f9-8aa8-9acd0496f445 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.605068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a6fd2d7f-96c7-4456-98ed-9ce3bc34264b req-3ab5f93c-0598-45f9-8aa8-9acd0496f445 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.605610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a6fd2d7f-96c7-4456-98ed-9ce3bc34264b req-3ab5f93c-0598-45f9-8aa8-9acd0496f445 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.617718 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b7794ad9-9939-4107-bc67-125579301ac7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1276 microversion: 2.1 time: 0.242810 Oct 28 10:12:47.618326 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2436/4869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:47 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1276 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:47.619538 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a6fd2d7f-96c7-4456-98ed-9ce3bc34264b req-3ab5f93c-0598-45f9-8aa8-9acd0496f445 service nova] Creating event network-vif-deleted:ae1492ab-b7e8-4522-aea9-b44666508aab for instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 on n-h1-zed-1 Oct 28 10:12:47.625178 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a6fd2d7f-96c7-4456-98ed-9ce3bc34264b req-3ab5f93c-0598-45f9-8aa8-9acd0496f445 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039379 Oct 28 10:12:47.625887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2434/4870] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:47.671359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:47.672273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:47.687345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.688501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.690576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.692075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.692794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.693496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.730707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:47.731427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:47.732298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:47.733223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lazy-loading 'fault' on Instance uuid ed47fc02-a3e0-490d-9d63-0a7da85399f5 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:12:47.823522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bafdc127af914320a17d15b77fb4ce5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e72e7f3f304aa7b72036f1ab6ab000', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:47.833832 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62e13a1b-7bcf-4a68-9a0d-54bdca1a4f6d tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 200 len: 1315 microversion: 2.1 time: 0.168301 Oct 28 10:12:47.845602 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2437/4871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:47 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:48.209777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:48.210985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:48.224467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.225148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.225697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.226519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.227100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.227638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.405394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:48.416996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f38032b5-a765-4d3b-af03-26f5d38d9b13 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.212791 Oct 28 10:12:48.418087 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2435/4872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:48 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:48.607932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:48.609462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:48.615985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.616469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.616924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.617614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.618070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.618498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.647789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:48.648317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:48.658592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.659216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.659841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.660542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.661608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.662036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.825402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:48.833367 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c482d36e-caed-40bb-a36a-d0627863b938 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.195050 Oct 28 10:12:48.834811 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2436/4873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:48 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:48.856782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:48.857452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] [instance: ed47fc02-a3e0-490d-9d63-0a7da85399f5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:48.865118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.866210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.866210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.866723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:48.867359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:48.867957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:48.891025 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] HTTP exception thrown: Instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 could not be found. Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Request method failure captured: Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 HTTP/1.1 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6sJsLQxUCZJDoGiDx_ALtEXFTCNS1uIaztazjuR6hAxbQNdb-TuNCzxBlqeK3ZqfxqcznOn0YGP6Z2sIlQevSjL4ywVVxC9tRIyqxRXGqLf8vW9PlOY6JvLLPbPkwhyVVSpuxwy_fOxNT5razs2ctk8-rXVLhaDNnNobUvpr9XfSGg Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e0e72e7f3f304aa7b72036f1ab6ab000 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0e72e7f3f304aa7b72036f1ab6ab000"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e0e72e7f3f304aa7b72036f1ab6ab000"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e0e72e7f3f304aa7b72036f1ab6ab000", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e0e72e7f3f304aa7b72036f1ab6ab000"}]}] Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e0e72e7f3f304aa7b72036f1ab6ab000 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-98572039 Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-InstanceActionsNegativeTestJSON-98572039-project Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: bafdc127af914320a17d15b77fb4ce5f Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-98572039-project Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 could not be found. Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ed47fc02-a3e0-490d-9d63-0a7da85399f5'} Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 could not be found. Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 could not be found. Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:48.892694 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 could not be found. Oct 28 10:12:48.898288 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:12:48.899118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] Returning 404 to user: Instance ed47fc02-a3e0-490d-9d63-0a7da85399f5 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:12:48.900135 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62f3828e-1d7b-41c8-ae4c-e8c670738d2f tempest-InstanceActionsNegativeTestJSON-98572039 tempest-InstanceActionsNegativeTestJSON-98572039-project] 10.222.0.16 "GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5" status: 404 len: 111 microversion: 2.1 time: 0.047190 Oct 28 10:12:48.904189 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2437/4874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:48 2022] GET /compute/v2.1/servers/ed47fc02-a3e0-490d-9d63-0a7da85399f5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:12:49.049754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:49.064863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1729914-1857-4a8b-9c0b-c5ba6903a2c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.460994 Oct 28 10:12:49.066659 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2438/4875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:48 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:49.443439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:49.444331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:49.451570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:49.452386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:49.453098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:49.454195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:49.454904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:49.455539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:49.460831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:49.685028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:49.701633 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a277e67f-35c4-4033-957f-5a9da9323c98 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.262649 Oct 28 10:12:49.716931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2438/4876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:49 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:49.857510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:49.858515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:49.867147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:49.868667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:49.869365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:49.870307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:49.871118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:49.871780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:49.878938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-2f23b78e-b987-40a4-9eb6-6536e1e0454f req-0c2d50b7-8181-42f3-99c1-9ea9b718c7e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81", "name": "network-vif-plugged", "status": "completed", "tag": "77fe0365-95a7-49ee-abc0-9111138baf94"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:49.898975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2f23b78e-b987-40a4-9eb6-6536e1e0454f req-0c2d50b7-8181-42f3-99c1-9ea9b718c7e1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:49.901509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2f23b78e-b987-40a4-9eb6-6536e1e0454f req-0c2d50b7-8181-42f3-99c1-9ea9b718c7e1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:49.905446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2f23b78e-b987-40a4-9eb6-6536e1e0454f req-0c2d50b7-8181-42f3-99c1-9ea9b718c7e1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:49.927980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-2f23b78e-b987-40a4-9eb6-6536e1e0454f req-0c2d50b7-8181-42f3-99c1-9ea9b718c7e1 service nova] Creating event network-vif-plugged:77fe0365-95a7-49ee-abc0-9111138baf94 for instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 on n-h2-zed-1 Oct 28 10:12:49.943137 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-2f23b78e-b987-40a4-9eb6-6536e1e0454f req-0c2d50b7-8181-42f3-99c1-9ea9b718c7e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063931 Oct 28 10:12:49.943990 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2439/4877] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:12:50.092692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:50.093520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:50.113984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:50.114721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:50.115341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:50.116277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:50.116934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:50.117590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:50.163796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:50.172427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-94d78941-83a8-465e-9c7d-fb46d32d0fbd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.318628 Oct 28 10:12:50.173719 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2439/4878] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:49 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:50.370894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c7274185-ce8d-408c-9551-db859f442fd2 req-e46478f9-dbab-401e-b538-7c76ee3b14cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96aa3db3-87cc-4a3b-859d-afbe3563a681", "tag": "7739967f-73d9-40cc-af52-9f5f39ca6d9f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:50.422454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c7274185-ce8d-408c-9551-db859f442fd2 req-e46478f9-dbab-401e-b538-7c76ee3b14cf service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:50.425233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c7274185-ce8d-408c-9551-db859f442fd2 req-e46478f9-dbab-401e-b538-7c76ee3b14cf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:50.426670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c7274185-ce8d-408c-9551-db859f442fd2 req-e46478f9-dbab-401e-b538-7c76ee3b14cf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:50.502513 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c7274185-ce8d-408c-9551-db859f442fd2 req-e46478f9-dbab-401e-b538-7c76ee3b14cf service nova] Creating event network-changed:7739967f-73d9-40cc-af52-9f5f39ca6d9f for instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 on n-h2-zed-1 Oct 28 10:12:50.517566 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c7274185-ce8d-408c-9551-db859f442fd2 req-e46478f9-dbab-401e-b538-7c76ee3b14cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177924 Oct 28 10:12:50.519914 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2440/4879] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:50.651696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:50.665473 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47a2f19e-d3c7-4b12-806a-6fc253d35b51 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.577284 Oct 28 10:12:50.668690 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2440/4880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:50 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:50.734447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:50.735384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:50.772673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:50.773227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:50.784480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:50.785306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:50.786371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:50.786820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:50.957603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:50.968016 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ebbf5398-58a4-44ab-a508-2c27217213a7 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.238193 Oct 28 10:12:50.969693 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2441/4881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:50 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:51.195781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:51.196692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:51.203474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:51.204090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:51.204626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:51.205504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:51.206364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:51.207015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:51.508369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:51.516859 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb01d601-d189-4968-b463-0ff472d9772b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.324921 Oct 28 10:12:51.517887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2441/4882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:51 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:51.690745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:51.692453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:51.698669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:51.699515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:51.700139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:51.701070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:51.701698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:51.702338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:51.878078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:51.889695 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-be18c8ef-bf73-42cb-9659-b7223f261cb0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.202587 Oct 28 10:12:51.906655 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2442/4883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:51 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:51.994477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:51.995191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:52.003784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:52.004289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:52.004805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:52.005566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:52.006030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:52.006463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:52.314959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:52.327730 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1ddefa4-3fbe-4290-9a81-2cbebce2d976 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.337227 Oct 28 10:12:52.330322 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2442/4884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:51 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:52.542896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:52.543522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:52.557421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:52.557937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:52.558653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:52.559517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:52.559986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:52.560475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:52.590322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:52.868406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:52.877868 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a36c554e-31fe-4d3e-b1ee-6bf1fef953bb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.340068 Oct 28 10:12:52.894182 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2443/4885] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:52 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:52.914906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:52.915728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:52.922992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:52.923676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:52.924350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:52.925623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:52.926784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:52.927376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:53.135114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:53.147895 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-757f406b-7fe5-4d18-9afb-4c9db05f4a46 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.238039 Oct 28 10:12:53.149864 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2443/4886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:52 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:53.354196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:53.355251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:53.370251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:53.370810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:53.371277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:53.372726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:53.374248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:53.374900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:53.617999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:53.631837 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cfa04b0-dbf7-420b-81a0-f51813a23bd0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.279714 Oct 28 10:12:53.633937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2444/4887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:53 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:53.903692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:53.904410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:53.906462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:53.907373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:53.914003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:53.914678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:53.915312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:53.916172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:53.916786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:53.917395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:54.172170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:54.172797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:54.181486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:54.181983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:54.182655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:54.183623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:54.184265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:54.184705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:54.301099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:54.310744 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74443715-c331-439d-8255-78b902d05112 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.410890 Oct 28 10:12:54.311417 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2444/4888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:53 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:54.333271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:54.341265 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-73d0ba9d-afec-4ea9-9c4f-5bb96830edc9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1308 microversion: 2.1 time: 0.173497 Oct 28 10:12:54.341848 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2445/4889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:54 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1308 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:54.664729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:54.665501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:54.674330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:54.674617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:54.675062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:54.675772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:54.676837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:54.677291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:54.908260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:54.920752 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-43ee8db9-828c-42a5-974c-b71cffc81bb8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.260323 Oct 28 10:12:54.926462 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2445/4890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:54 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:55.335334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:55.336106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:55.345411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.347079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.348067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.349041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.351056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.351697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.365734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:55.367285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:55.375096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.375972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.376587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.377815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.378446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.379106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.550238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:55.560396 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-607bdb20-b827-41c8-8e73-784fea2a8fa7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1489 microversion: 2.1 time: 0.199058 Oct 28 10:12:55.561014 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2446/4891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:55 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1489 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:55.597488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:55.598201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:55.608416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.609334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.609948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.610661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.611275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.611607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.695342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:55.709871 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0538a0e7-ff87-48cb-8bb4-21186e3322cc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.378097 Oct 28 10:12:55.711280 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2446/4892] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:55 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:55.870466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:55.883402 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a025f7de-74c5-4cc6-92a4-6d2831835430 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1489 microversion: 2.1 time: 0.303457 Oct 28 10:12:55.885918 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2447/4893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:55 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1489 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:55.910670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:55.911510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:55.920842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.921709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.922409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.923308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.923970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.924818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.945956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:55.947473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:55.964318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.970245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.971602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:55.974635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:55.980563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:55.981445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:56.245513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:56.264104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a35e682f-ab72-4e36-b708-5f959483ed54 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.323863 Oct 28 10:12:56.267701 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2448/4894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:55 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:56.303023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:56.311802 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-91c065a4-c50a-42a8-be40-49e0a0767ee2 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1489 microversion: 2.1 time: 0.406841 Oct 28 10:12:56.312696 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2447/4895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:55 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1489 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:56.335871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:56.336499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:56.343627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:56.344258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:56.345006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:56.346169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:56.346795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:56.347879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:56.382309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:12:56.486921 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0450db33-9b4b-448c-9594-0f866755d0a6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 204 len: 0 microversion: 2.1 time: 0.155170 Oct 28 10:12:56.488329 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2449/4896] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:12:56 2022] DELETE /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:12:56.497544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:56.498460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:56.511753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:56.512318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:56.512962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:56.513835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:56.514470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:56.515071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:56.740796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:56.741527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:56.743690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:12:56.749856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:56.750581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:56.751219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:56.752120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:56.753242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:56.753854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:56.865776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:56.877534 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7e1736c5-0426-4145-92f9-56927c645c3e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1495 microversion: 2.1 time: 0.383237 Oct 28 10:12:56.879833 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2448/4897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:56 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1495 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:57.291941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:57.293061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:57.308423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:57.309240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:57.309846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:57.310720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:57.311351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:57.311976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:57.410928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:57.423886 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47fc87e5-e52a-492b-9b6e-2d1b330daf6f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.688295 Oct 28 10:12:57.425617 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2450/4898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:56 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:57.609956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:57.620466 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d777e0d8-0b01-43e5-902a-78c8d2d5517e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.332296 Oct 28 10:12:57.622023 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2449/4899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:57 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:57.713794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c83b19b4-3ad5-4f76-8367-123fae01a474 tempest-ComputeTenantNetworksTest-868285086 tempest-ComputeTenantNetworksTest-868285086-project] Calling method '.version_select at 0x7fca3296c670>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:57.912762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:57.913494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:57.920673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:57.922879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:57.923541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:57.924804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:57.926161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:57.926853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:58.090548 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c83b19b4-3ad5-4f76-8367-123fae01a474 tempest-ComputeTenantNetworksTest-868285086 tempest-ComputeTenantNetworksTest-868285086-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.547729 Oct 28 10:12:58.092026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2451/4900] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 10:12:57 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:58.098589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-93f9d15f-7181-4699-9775-ee76b8ba94ad req-e189af2f-55bd-4546-8564-d6d111311d02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96aa3db3-87cc-4a3b-859d-afbe3563a681", "name": "network-vif-plugged", "status": "completed", "tag": "7739967f-73d9-40cc-af52-9f5f39ca6d9f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:58.112654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-93f9d15f-7181-4699-9775-ee76b8ba94ad req-e189af2f-55bd-4546-8564-d6d111311d02 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:58.113473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-93f9d15f-7181-4699-9775-ee76b8ba94ad req-e189af2f-55bd-4546-8564-d6d111311d02 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:58.114842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-93f9d15f-7181-4699-9775-ee76b8ba94ad req-e189af2f-55bd-4546-8564-d6d111311d02 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:58.126486 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-93f9d15f-7181-4699-9775-ee76b8ba94ad req-e189af2f-55bd-4546-8564-d6d111311d02 service nova] Creating event network-vif-plugged:7739967f-73d9-40cc-af52-9f5f39ca6d9f for instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 on n-h2-zed-1 Oct 28 10:12:58.133823 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-93f9d15f-7181-4699-9775-ee76b8ba94ad req-e189af2f-55bd-4546-8564-d6d111311d02 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039254 Oct 28 10:12:58.134762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2452/4901] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:58.141181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5fb4a815-11e5-4f6f-a232-087fedc03e79 tempest-ComputeTenantNetworksTest-868285086 tempest-ComputeTenantNetworksTest-868285086-project] Calling method '.version_select at 0x7fca3227e790>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:58.181544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:58.193635 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-51517ece-0360-4e8c-b30f-17f48338b7a7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1495 microversion: 2.1 time: 0.286769 Oct 28 10:12:58.194686 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2450/4902] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:57 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1495 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:58.289622 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5fb4a815-11e5-4f6f-a232-087fedc03e79 tempest-ComputeTenantNetworksTest-868285086 tempest-ComputeTenantNetworksTest-868285086-project] 10.222.0.16 "GET /compute/v2.1/os-tenant-networks/f0b438f5-1843-4936-b702-669b55974057" status: 200 len: 139 microversion: 2.1 time: 0.153372 Oct 28 10:12:58.290879 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2453/4903] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:12:58 2022] GET /compute/v2.1/os-tenant-networks/f0b438f5-1843-4936-b702-669b55974057 => generated 139 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:58.448513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:58.449170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:58.455596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:58.456386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:58.457112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:58.458870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:58.459559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:58.460214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:58.652749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:58.655403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:58.665887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:58.667300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:58.668107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:58.669776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:58.670917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:58.671625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:58.819465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:58.829503 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bcc84411-a64b-4097-8f53-d3e1ba61dd29 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.384977 Oct 28 10:12:58.830179 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2451/4904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:58 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:58.948772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:58.962839 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0ffa446-a1f0-4162-bf06-1fd0b055b3a8 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.319093 Oct 28 10:12:58.966432 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2454/4905] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:58 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:12:59.173345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-43908d46-241e-46c8-b9ac-6460c6ba58f9 req-ba1279fc-4623-472d-900b-97fcb0b5dc30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81", "name": "network-vif-deleted", "tag": "77fe0365-95a7-49ee-abc0-9111138baf94"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:12:59.196064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-43908d46-241e-46c8-b9ac-6460c6ba58f9 req-ba1279fc-4623-472d-900b-97fcb0b5dc30 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:59.196561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-43908d46-241e-46c8-b9ac-6460c6ba58f9 req-ba1279fc-4623-472d-900b-97fcb0b5dc30 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:59.198434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-43908d46-241e-46c8-b9ac-6460c6ba58f9 req-ba1279fc-4623-472d-900b-97fcb0b5dc30 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:59.222190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:59.222819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:59.236672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:59.237114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:59.237567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:59.238283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:59.253774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:59.254521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:59.259839 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-43908d46-241e-46c8-b9ac-6460c6ba58f9 req-ba1279fc-4623-472d-900b-97fcb0b5dc30 service nova] Creating event network-vif-deleted:77fe0365-95a7-49ee-abc0-9111138baf94 for instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 on n-h2-zed-1 Oct 28 10:12:59.280344 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-43908d46-241e-46c8-b9ac-6460c6ba58f9 req-ba1279fc-4623-472d-900b-97fcb0b5dc30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111552 Oct 28 10:12:59.282047 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2452/4906] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:12:59.484070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:12:59.499533 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8c7e7175-e77d-4cae-9ba3-5a8e20456596 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 200 len: 1453 microversion: 2.1 time: 0.281052 Oct 28 10:12:59.502313 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2455/4907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:59 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 1453 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:12:59.853884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:59.855300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:12:59.870155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:59.870872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:59.871557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:59.873680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:12:59.874363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:12:59.875011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:12:59.988417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:12:59.989146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:00.000125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.000621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.001091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:00.001803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.002254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.007917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:00.077110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:00.238023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:00.248759 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d20d53ed-25d0-41de-a5f2-1495d1778472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.264962 Oct 28 10:13:00.261680 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2456/4908] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:59 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:00.409475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:00.420068 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da7423be-06aa-4fe8-be56-ec533b1f6db0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1318 microversion: 2.1 time: 0.572126 Oct 28 10:13:00.421079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2453/4909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:12:59 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1318 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:00.527359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:00.528088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:00.536875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.537387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.543092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:00.544363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.549188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.549649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:00.603794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 HTTP/1.1 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81'} Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:00.606790 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:00.611886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:00.611886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:00.611886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:00.611886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:00.611886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:13:00.611886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:00.614319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:00.615274 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49c812ba-7cd1-425b-ba45-f720d561bd65 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 404 len: 111 microversion: 2.1 time: 0.092436 Oct 28 10:13:00.616373 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2457/4910] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:00 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:13:00.624365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:00.625166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:00.636577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.637830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.638626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:00.639625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.640247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.640847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:00.671219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:13:00.814775 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a9ca41bf-b749-4384-bce2-e7db23e7a09f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 204 len: 0 microversion: 2.1 time: 0.194294 Oct 28 10:13:00.815867 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2454/4911] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:13:00 2022] DELETE /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:13:00.827307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:00.828142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:00.837443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.838251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.838836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:00.839674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:00.840307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:00.840758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:01.055718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:01.068589 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f2984f0-b848-49b2-a411-1eec3d2a06d1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1495 microversion: 2.1 time: 0.247924 Oct 28 10:13:01.069719 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2458/4912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:00 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1495 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:01.123202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc309072-e424-42fd-a134-dc8fc648aaa4 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Action: 'create', calling method: .version_select at 0x7fca32406dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1318002971"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:01.275091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:01.276649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:01.284639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:01.285424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:01.285875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:01.286591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:01.287065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:01.288063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:01.451881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:01.463092 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d3ffc9e4-3b2d-4a24-ba9d-2e08f7eb7124 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.193322 Oct 28 10:13:01.464587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2459/4913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:01 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:01.484070 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc309072-e424-42fd-a134-dc8fc648aaa4 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.590796 Oct 28 10:13:01.484254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:01.484254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:01.485656 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2455/4914] 10.222.0.16 () {60 vars in 1155 bytes} [Fri Oct 28 10:13:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 596 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 28 10:13:01.498530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ed0de15-379a-49b6-9928-07317421320b tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca3246fca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:01.499900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:01.501254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:01.502097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:01.503018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:01.504698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:01.516788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:01.570764 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ed0de15-379a-49b6-9928-07317421320b tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 200 len: 345 microversion: 2.1 time: 0.076294 Oct 28 10:13:01.571800 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2456/4915] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:13:01 2022] GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 345 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:13:01.669930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:01.679332 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52aec8e4-8d79-4bd5-ab72-efac4e29dd59 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1507 microversion: 2.1 time: 0.213534 Oct 28 10:13:01.679873 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2460/4916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:01 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:01.702689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:01.965281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:01.971641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:01.972157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:01.972608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:01.973429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:01.973898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:01.974336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.095520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:02.096877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:02.113251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.114659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.115345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.126681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.128656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.130122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.246455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:02.259792 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52e4bc81-d212-405e-8c5f-db0d315e842d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1507 microversion: 2.1 time: 0.561050 Oct 28 10:13:02.262954 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2457/4917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:01 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1507 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:02.288872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:02.291912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:02.314553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.317627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.318230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.319254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.323030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.323685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.478849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:13:02.479602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:13:02.480265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:13:02.480877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:13:02.481528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:13:02.603427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:02.608328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:02.614306 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f89d0647-0ac2-475d-91d4-f58f4ab49a38 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1495 microversion: 2.1 time: 0.523471 Oct 28 10:13:02.615641 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2461/4918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:02 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1495 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:02.620616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:02.621423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:02.622467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.625224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.625705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.627582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.629362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.630060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.630200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.630781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.631425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.631833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.632455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.633357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.713758 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-613701a8-d8db-41b6-9fbc-39eabec5aa7e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "POST /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681/action" status: 202 len: 1109 microversion: 2.1 time: 0.429332 Oct 28 10:13:02.735863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2458/4919] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:13:02 2022] POST /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681/action => generated 1109 bytes in 452 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 10:13:02.742394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0cded394-fb2a-4510-9ec0-ba25bce85f29 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca32434280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:02.861935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0cded394-fb2a-4510-9ec0-ba25bce85f29 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 200 len: 346 microversion: 2.1 time: 0.124652 Oct 28 10:13:02.862505 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2459/4920] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:13:02 2022] GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 346 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:02.867307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:02.868331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:02.881857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.882358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.882807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.883531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:02.883990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:02.887161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:02.904923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:03.165244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:03.180046 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-704187d0-c436-4806-9e0c-7cdf7c737472 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.563053 Oct 28 10:13:03.181456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2462/4921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:02 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:03.199224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7122f25c-fc25-4ccb-a7d8-3602e22d704d tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Action: 'create', calling method: .version_select at 0x7fca3296c3a0>, body: {"snapshot": {"volume_id": "0524dd2f-9901-4a6e-a894-cd0c89f4bed9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-867988419"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:03.205976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:03.219131 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c8f85236-7f70-4862-b7d3-b03fff8b55a1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.354946 Oct 28 10:13:03.221819 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2460/4922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:02 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:03.514188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-678639a6-1d23-400e-bf70-241e3d28b908 req-a1176e9f-2fbc-4946-9d0c-dc1897f31f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d73d68fc-c148-4d42-813c-7f1b632ef898", "name": "network-vif-deleted", "tag": "22044da1-15aa-42ca-8691-db3535cd2880"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:03.524001 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7122f25c-fc25-4ccb-a7d8-3602e22d704d tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.338039 Oct 28 10:13:03.524605 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2463/4923] 10.222.0.16 () {60 vars in 1162 bytes} [Fri Oct 28 10:13:03 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:03.536271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f832bb21-b61e-4c2d-8f7c-05fe9660835d tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca326faaf0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:03.542501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-678639a6-1d23-400e-bf70-241e3d28b908 req-a1176e9f-2fbc-4946-9d0c-dc1897f31f2e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:03.545689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-678639a6-1d23-400e-bf70-241e3d28b908 req-a1176e9f-2fbc-4946-9d0c-dc1897f31f2e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:03.549185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-678639a6-1d23-400e-bf70-241e3d28b908 req-a1176e9f-2fbc-4946-9d0c-dc1897f31f2e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:03.591101 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-678639a6-1d23-400e-bf70-241e3d28b908 req-a1176e9f-2fbc-4946-9d0c-dc1897f31f2e service nova] Creating event network-vif-deleted:22044da1-15aa-42ca-8691-db3535cd2880 for instance d73d68fc-c148-4d42-813c-7f1b632ef898 on n-h2-zed-1 Oct 28 10:13:03.608941 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f832bb21-b61e-4c2d-8f7c-05fe9660835d tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 200 len: 286 microversion: 2.1 time: 0.077039 Oct 28 10:13:03.609516 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2464/4924] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:13:03 2022] GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:03.611368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-678639a6-1d23-400e-bf70-241e3d28b908 req-a1176e9f-2fbc-4946-9d0c-dc1897f31f2e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100261 Oct 28 10:13:03.616923 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2461/4925] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:13:03.643574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d81cfb61-8642-4ea2-a07b-a665047fd097 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca32462d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:03.645098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:03.645856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:03.659430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:03.661855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:03.663759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:03.683879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:03.684403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:03.687288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:03.744076 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d81cfb61-8642-4ea2-a07b-a665047fd097 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.122126 Oct 28 10:13:03.745028 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2462/4926] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 10:13:03 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:03.759218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4db32c9-5707-41ae-8ee8-a69959435368 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca32474a60>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:03.822998 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4db32c9-5707-41ae-8ee8-a69959435368 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 200 len: 286 microversion: 2.1 time: 0.070558 Oct 28 10:13:03.823687 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2463/4927] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:13:03 2022] GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:13:03.884952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:03.894135 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-23f44322-2c3e-48d3-847a-88231ccbe8c0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 200 len: 1293 microversion: 2.1 time: 0.253966 Oct 28 10:13:03.919359 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2465/4928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:03 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 1293 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:04.214109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:04.215261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:04.223749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:04.226872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:04.230875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:04.235969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:04.236529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:04.237094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:04.247326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:04.248062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:04.265126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:04.266086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:04.266628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:04.269987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:04.270717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:04.271355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:04.476426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:04.493385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bbf8f1f-7164-4e40-bf08-1645e53de3c2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.289388 Oct 28 10:13:04.494585 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2464/4929] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:04 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:04.555937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:04.578985 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ac4134d5-8ab5-4b70-a14d-692add4fdc15 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.335751 Oct 28 10:13:04.605635 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2466/4930] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:04 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:04.842120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-60d35685-9220-429e-b2e8-120ac04cb7f4 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca32477430>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:04.879766 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-60d35685-9220-429e-b2e8-120ac04cb7f4 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 200 len: 286 microversion: 2.1 time: 0.046296 Oct 28 10:13:04.885543 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2465/4931] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:13:04 2022] GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:04.925141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:04.925793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:04.934934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:04.935944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:04.936560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:04.937486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:04.938132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:04.938725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:04.961798 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 HTTP/1.1 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'd73d68fc-c148-4d42-813c-7f1b632ef898'} Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:04.964332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:04.968649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:04.968649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:04.968649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:04.968649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:04.968649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:13:04.968649 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:04.970482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:04.972383 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a901633-ff36-42ea-8566-6e1a7b976c35 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 404 len: 111 microversion: 2.1 time: 0.051310 Oct 28 10:13:04.976520 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2467/4932] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:04 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:13:05.090632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-721730873", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "99600157-ce93-4ec4-a82a-4a75b2abd468"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:05.151600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:13:05.519248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:05.521478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:05.541484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:05.546826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:05.550016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:05.556554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:05.558702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:05.559344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:06.021838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:13:06.021838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:13:06.021838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:13:06.021838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:13:06.021838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:13:06.022733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:06.033516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:06.034024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:06.034474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:06.035774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:06.036436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:06.037099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:06.058569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:13:06.064776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:13:06.079219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:13:06.081916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:13:06.141959 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b464876b-eaef-4146-add8-455a31507757 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.055096 Oct 28 10:13:06.149711 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2466/4933] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:13:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:13:06.149711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:06.149711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:06.170678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:06.177532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:06.178121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:06.178973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:06.179553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:06.180109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:06.415600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:06.421598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:06.429752 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb2e97c3-7b43-42bb-9dd0-22c64401874a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.278729 Oct 28 10:13:06.432679 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2467/4934] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:06 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:06.441534 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c80c1351-7ac6-40a8-8b84-cf792126fad1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.927414 Oct 28 10:13:06.442149 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2468/4935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:05 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:06.452574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8af0b2d-86e7-4e1f-8b75-fb0f9e1820db tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca324fadc0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:06.465853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34d6c78a-df6f-4d89-aba7-49345e8f51ca tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:06.469196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34d6c78a-df6f-4d89-aba7-49345e8f51ca tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:06.517313 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8af0b2d-86e7-4e1f-8b75-fb0f9e1820db tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 200 len: 287 microversion: 2.1 time: 0.082302 Oct 28 10:13:06.518118 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2468/4936] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:13:06 2022] GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:06.538546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8db03b20-37ad-4a8c-982f-64530171accf tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca324faca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:06.615326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34d6c78a-df6f-4d89-aba7-49345e8f51ca tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:06.625800 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34d6c78a-df6f-4d89-aba7-49345e8f51ca tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1208 microversion: 2.1 time: 0.173691 Oct 28 10:13:06.627773 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2469/4937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:06 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1208 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:06.636615 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8db03b20-37ad-4a8c-982f-64530171accf tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 202 len: 0 microversion: 2.1 time: 0.110966 Oct 28 10:13:06.637563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2469/4938] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:13:06 2022] DELETE /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:13:06.649585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5544fa18-5d24-4bad-987a-550383864d29 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca321e8280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:06.712057 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5544fa18-5d24-4bad-987a-550383864d29 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 200 len: 286 microversion: 2.1 time: 0.069613 Oct 28 10:13:06.712367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2470/4939] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:13:06 2022] GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:07.456003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:07.457370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:07.466088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:07.466854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:07.467475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:07.468653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:07.469311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:07.469849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:07.470527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:07.470910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:07.485660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:07.488878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:07.489365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:07.490128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:07.490601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:07.491110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:07.702443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:07.718376 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46be2e2e-d6b8-49e7-b452-01e4f375d2f5 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1733 microversion: 2.1 time: 0.252631 Oct 28 10:13:07.719505 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2471/4940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:07 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:07.724188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:07.725018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:07.732410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:07.733144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:07.733752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:07.734616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:07.735222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:07.735805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:07.817030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:07.826898 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-98521435-0ad2-4f70-af50-aea504d52193 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1260 microversion: 2.1 time: 0.106321 Oct 28 10:13:07.827833 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2472/4941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:07 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1260 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:07.832988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b28d7122-3a40-4acd-85a1-04aac3a2705d tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca3236c9d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:07.854692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:07.867625 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a88f91de-ebb3-430b-a9ac-01319b496419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.416589 Oct 28 10:13:07.868285 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2470/4942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:07 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:07.869591 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b28d7122-3a40-4acd-85a1-04aac3a2705d tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 200 len: 286 microversion: 2.1 time: 0.040649 Oct 28 10:13:07.870319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2473/4943] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:13:07 2022] GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:08.742598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:08.743283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:08.750807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:08.755446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:08.756214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:08.756984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:08.757471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:08.757919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:08.853050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:08.853685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:08.867402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:08.867916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:08.868379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:08.869110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:08.869736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:08.870060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:08.971323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:08.979587 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-00108213-cdf9-4400-98e8-9567641d557e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1278 microversion: 2.1 time: 0.132093 Oct 28 10:13:08.980174 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2474/4944] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:08 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1278 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:08.990796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23d06f93-a5a0-46ae-a85e-406e36c6846a tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca3236ce50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:09.011018 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-23d06f93-a5a0-46ae-a85e-406e36c6846a tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] HTTP exception thrown: Snapshot c3ad308e-f3b3-42a8-94fa-e55d83dccf32 could not be found. Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23d06f93-a5a0-46ae-a85e-406e36c6846a tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Request method failure captured: Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 HTTP/1.1 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6sscljHvwHWBcgnT3WYV2k6_z_-KTf6DHThtWgYi7tCDViuM93ib_zJSmEa4TjJh9aW0WhN8fcExNFfoXxB9DZsLjcRVAed_ZiWO4s_w_C-1EKrPeD6nFBeb5gMzXogsfuOuaOfAi7IMR-K3NjUxMqmiGzcfdRWCHHWLSPUhqnJiu4 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c12546edb0a348c7921f838e9353c2cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c12546edb0a348c7921f838e9353c2cc"}]}] Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 50da5c6abdb34a278074992a8153ac98 Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: exception: Snapshot c3ad308e-f3b3-42a8-94fa-e55d83dccf32 could not be found. Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'c3ad308e-f3b3-42a8-94fa-e55d83dccf32'} Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c3ad308e-f3b3-42a8-94fa-e55d83dccf32 could not be found. (HTTP 404) (Request-ID: req-289df2c1-a7fe-47d3-9afb-cbad8d553acf) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:13:09.025918 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c3ad308e-f3b3-42a8-94fa-e55d83dccf32 could not be found. Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c3ad308e-f3b3-42a8-94fa-e55d83dccf32 could not be found. Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c3ad308e-f3b3-42a8-94fa-e55d83dccf32 could not be found. Oct 28 10:13:09.030845 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.036238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23d06f93-a5a0-46ae-a85e-406e36c6846a tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Returning 404 to user: Snapshot c3ad308e-f3b3-42a8-94fa-e55d83dccf32 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:09.039071 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-23d06f93-a5a0-46ae-a85e-406e36c6846a tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32" status: 404 len: 111 microversion: 2.1 time: 0.056200 Oct 28 10:13:09.039856 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2475/4945] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:13:08 2022] GET /compute/v2.1/os-snapshots/c3ad308e-f3b3-42a8-94fa-e55d83dccf32 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:13:09.049843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:09.050543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:09.058283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.058871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.059379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:09.060158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.060723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.061271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:09.169155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:09.178616 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-243b3aba-c830-486e-b150-b813356a518c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1713 microversion: 2.1 time: 0.440601 Oct 28 10:13:09.187743 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2471/4946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:08 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1713 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:09.193110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cffdde77-7c41-4056-aa22-67d7d37e0608 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca324e50d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:09.290093 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cffdde77-7c41-4056-aa22-67d7d37e0608 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 202 len: 0 microversion: 2.1 time: 0.100883 Oct 28 10:13:09.291251 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2472/4947] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:13:09 2022] DELETE /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:13:09.300435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df7a3054-7808-49ad-aafe-9bf9a17fb3ff tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca324fa3a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:09.345462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:09.354618 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-048b660b-8b67-46ba-8aea-9ed3dd695239 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.313525 Oct 28 10:13:09.358620 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2476/4948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:09 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:09.364618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:09.369804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:09.376352 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df7a3054-7808-49ad-aafe-9bf9a17fb3ff tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 200 len: 345 microversion: 2.1 time: 0.080724 Oct 28 10:13:09.376953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2473/4949] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:13:09 2022] GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:13:09.382738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.385546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.386174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:09.386947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.387433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.387880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:09.485666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Cannot 'detach_volume' instance 28e2f782-cfed-423e-baf1-b589c3fd36ce while it is in vm_state rescued Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments/39c12315-3e9c-4856-97b9-28134af06961 HTTP/1.1 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'detach_volume' instance 28e2f782-cfed-423e-baf1-b589c3fd36ce while it is in vm_state rescued Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '28e2f782-cfed-423e-baf1-b589c3fd36ce', 'id': '39c12315-3e9c-4856-97b9-28134af06961'} Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28e2f782-cfed-423e-baf1-b589c3fd36ce in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 28e2f782-cfed-423e-baf1-b589c3fd36ce while it is in vm_state rescued Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.488852 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:09.493983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:09.493983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:09.493983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:09.493983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:09.493983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 28e2f782-cfed-423e-baf1-b589c3fd36ce while it is in vm_state rescued Oct 28 10:13:09.493983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:09.497012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 409 to user: Cannot 'detach_volume' instance 28e2f782-cfed-423e-baf1-b589c3fd36ce while it is in vm_state rescued {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:09.498310 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7af8f1d0-c2cf-49c3-aaa6-8ecf65b77936 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments/39c12315-3e9c-4856-97b9-28134af06961" status: 409 len: 152 microversion: 2.1 time: 0.138199 Oct 28 10:13:09.499639 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2477/4950] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:13:09 2022] DELETE /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments/39c12315-3e9c-4856-97b9-28134af06961 => generated 152 bytes in 140 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:13:09.508254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:09.509472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:09.518321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.519239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.520586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:09.521546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.522186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.523410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:09.636334 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a76fe8e9-cfa5-4988-b32f-c2b46e72bacd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/action" status: 202 len: 0 microversion: 2.1 time: 0.131783 Oct 28 10:13:09.637413 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2474/4951] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:13:09 2022] POST /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:13:09.653916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:09.654635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:09.677310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.677878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.678349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:09.679885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:09.680372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:09.680814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:10.003126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:10.005098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:10.022747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:10.023540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:10.025476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:10.026403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:10.029556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:10.030193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:10.396548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:10.401551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:10.406691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a38ef226-2f64-4266-a48c-840e4f35d350 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.407715 Oct 28 10:13:10.421820 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2475/4952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:09 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:10.422148 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53381a00-33b1-42e2-a95c-78f2940b651f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1721 microversion: 2.1 time: 0.777301 Oct 28 10:13:10.422148 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2478/4953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:09 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1721 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:10.426539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:10.427283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:10.438574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36faf5c3-c1f7-4c20-8b8f-429af99538e0 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca3276f820>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:10.438758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:10.440343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:10.441106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:10.445451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:10.445935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:10.446373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:10.524471 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-36faf5c3-c1f7-4c20-8b8f-429af99538e0 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 200 len: 345 microversion: 2.1 time: 0.103216 Oct 28 10:13:10.531861 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2479/4954] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:13:10 2022] GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 345 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:10.754409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:10.762160 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-094b1862-cbbe-4a24-ad3c-e3e878cf94bd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.346183 Oct 28 10:13:10.777297 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2476/4955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:10 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:11.437145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:11.437756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:11.444945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:11.446443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:11.454962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:11.455991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:11.456575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:11.457071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:11.457239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:11.457707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:11.458292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:11.458479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:11.458943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:11.459255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:11.459427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:11.460024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:11.721928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:11.731549 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-77089f81-f648-419c-bca1-0f1d4c495f05 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.298321 Oct 28 10:13:11.732175 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2480/4956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:11 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:11.752396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3e13ea5f-4d20-49f8-9b15-1e973b393084 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca3276fca0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:11.794781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:11.806354 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c88100b0-de67-41d5-8593-229c88e8e04b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1721 microversion: 2.1 time: 0.366138 Oct 28 10:13:11.814922 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2477/4957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:11 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1721 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:11.827249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d95db295-d6d3-40c3-a459-afad1dd5234d req-d2a00bf7-5341-4359-a48b-2897de7dfdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2151c4f2-835e-4b04-8762-b8f5ef269ff5", "tag": "b96493fd-92c5-43ba-afaa-ce37c4827ca3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:11.831392 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3e13ea5f-4d20-49f8-9b15-1e973b393084 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 200 len: 345 microversion: 2.1 time: 0.097940 Oct 28 10:13:11.832014 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2481/4958] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:13:11 2022] GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 345 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:11.842905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:11.843539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:11.845179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d95db295-d6d3-40c3-a459-afad1dd5234d req-d2a00bf7-5341-4359-a48b-2897de7dfdd6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:11.846112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d95db295-d6d3-40c3-a459-afad1dd5234d req-d2a00bf7-5341-4359-a48b-2897de7dfdd6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:11.847042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d95db295-d6d3-40c3-a459-afad1dd5234d req-d2a00bf7-5341-4359-a48b-2897de7dfdd6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:11.854033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:11.855684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:11.856205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:11.857174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:11.857908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:11.858511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:11.863652 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d95db295-d6d3-40c3-a459-afad1dd5234d req-d2a00bf7-5341-4359-a48b-2897de7dfdd6 service nova] Creating event network-changed:b96493fd-92c5-43ba-afaa-ce37c4827ca3 for instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 on n-h1-zed-1 Oct 28 10:13:11.873580 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d95db295-d6d3-40c3-a459-afad1dd5234d req-d2a00bf7-5341-4359-a48b-2897de7dfdd6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057029 Oct 28 10:13:11.879511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2478/4959] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:11.889525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:12.038951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:12.047836 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca4daad4-1dfe-4710-9cd7-d4dc010a103f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.212339 Oct 28 10:13:12.049090 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2482/4960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:11 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:12.759804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:12.761080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:12.772788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:12.773333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:12.773781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:12.774495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:12.774961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:12.775398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:12.844445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:12.845824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:12.854551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:12.855532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:12.856163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:12.857082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:12.857695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:12.858284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:13.092246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:13.102392 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3089812a-bdc4-4baa-83e0-ff37f629f67b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.346683 Oct 28 10:13:13.107153 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2479/4961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:12 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:13.121237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df6224b0-e307-4f1d-8f98-ad2003041905 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca324e5ca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:13.169081 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-df6224b0-e307-4f1d-8f98-ad2003041905 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] HTTP exception thrown: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.171021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df6224b0-e307-4f1d-8f98-ad2003041905 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Request method failure captured: Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 HTTP/1.1 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sscljHvwHWBcgnT3WYV2k6_z_-KTf6DHThtWgYi7tCDViuM93ib_zJSmEa4TjJh9aW0WhN8fcExNFfoXxB9DZsLjcRVAed_ZiWO4s_w_C-1EKrPeD6nFBeb5gMzXogsfuOuaOfAi7IMR-K3NjUxMqmiGzcfdRWCHHWLSPUhqnJiu4 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c12546edb0a348c7921f838e9353c2cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c12546edb0a348c7921f838e9353c2cc"}]}] Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 50da5c6abdb34a278074992a8153ac98 Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: exception: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0524dd2f-9901-4a6e-a894-cd0c89f4bed9'} Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. (HTTP 404) (Request-ID: req-ea09893b-0edc-4834-973b-7bec1d1ac49d) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:13:13.173153 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.178554 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.190479 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3606c91d-9f52-4d56-acf4-c0993882e8e1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1727 microversion: 2.1 time: 0.349411 Oct 28 10:13:13.193120 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2483/4962] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:12 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1727 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:13.205497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:13.206586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:13.210260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df6224b0-e307-4f1d-8f98-ad2003041905 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Returning 404 to user: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:13.212856 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df6224b0-e307-4f1d-8f98-ad2003041905 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 404 len: 109 microversion: 2.1 time: 0.104203 Oct 28 10:13:13.219805 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2480/4963] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:13:13 2022] GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 109 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:13:13.222332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:13.224017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:13.224976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:13.226299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:13.227109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:13.227795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:13.231325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:13.235178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:13.257223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:13.257803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:13.258925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:13.259676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:13.260148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:13.260586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:13.416563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea982b79-073c-4233-8999-2dd2bb6b9e7b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.194877 Oct 28 10:13:13.417701 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2481/4964] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:13:13 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:13.434006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed3793d5-7156-4928-8c05-2a8abb6d2895 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca324254c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:13.486876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-ed3793d5-7156-4928-8c05-2a8abb6d2895 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] HTTP exception thrown: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed3793d5-7156-4928-8c05-2a8abb6d2895 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Request method failure captured: Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 HTTP/1.1 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sscljHvwHWBcgnT3WYV2k6_z_-KTf6DHThtWgYi7tCDViuM93ib_zJSmEa4TjJh9aW0WhN8fcExNFfoXxB9DZsLjcRVAed_ZiWO4s_w_C-1EKrPeD6nFBeb5gMzXogsfuOuaOfAi7IMR-K3NjUxMqmiGzcfdRWCHHWLSPUhqnJiu4 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c12546edb0a348c7921f838e9353c2cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c12546edb0a348c7921f838e9353c2cc"}]}] Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 50da5c6abdb34a278074992a8153ac98 Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: exception: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0524dd2f-9901-4a6e-a894-cd0c89f4bed9'} Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. (HTTP 404) (Request-ID: req-1b6a8ea6-4bfd-430e-8490-6801b2cfb63d) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:13:13.490913 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.495561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.502666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed3793d5-7156-4928-8c05-2a8abb6d2895 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Returning 404 to user: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:13.503834 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed3793d5-7156-4928-8c05-2a8abb6d2895 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 404 len: 109 microversion: 2.1 time: 0.075536 Oct 28 10:13:13.504685 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2482/4965] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:13:13 2022] DELETE /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:13:13.515748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4dc0b8ae-9236-4aea-ab63-2ff6f5acd732 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Calling method '.version_select at 0x7fca324e51f0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:13.518877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:13.538227 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dc695204-7313-4df0-b224-b0866c67a297 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.343578 Oct 28 10:13:13.538814 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2484/4966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:13 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:13.586306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4dc0b8ae-9236-4aea-ab63-2ff6f5acd732 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] HTTP exception thrown: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4dc0b8ae-9236-4aea-ab63-2ff6f5acd732 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Request method failure captured: Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 HTTP/1.1 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sscljHvwHWBcgnT3WYV2k6_z_-KTf6DHThtWgYi7tCDViuM93ib_zJSmEa4TjJh9aW0WhN8fcExNFfoXxB9DZsLjcRVAed_ZiWO4s_w_C-1EKrPeD6nFBeb5gMzXogsfuOuaOfAi7IMR-K3NjUxMqmiGzcfdRWCHHWLSPUhqnJiu4 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c12546edb0a348c7921f838e9353c2cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c12546edb0a348c7921f838e9353c2cc", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c12546edb0a348c7921f838e9353c2cc"}]}] Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: c12546edb0a348c7921f838e9353c2cc Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-600509431 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 50da5c6abdb34a278074992a8153ac98 Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesSnapshotsTestJSON-600509431-project Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: exception: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0524dd2f-9901-4a6e-a894-cd0c89f4bed9'} Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. (HTTP 404) (Request-ID: req-0c351280-94cd-4ac6-ba61-7b06b718bf7d) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:13:13.588420 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4dc0b8ae-9236-4aea-ab63-2ff6f5acd732 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] Returning 404 to user: Volume 0524dd2f-9901-4a6e-a894-cd0c89f4bed9 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4dc0b8ae-9236-4aea-ab63-2ff6f5acd732 tempest-VolumesSnapshotsTestJSON-600509431 tempest-VolumesSnapshotsTestJSON-600509431-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9" status: 404 len: 109 microversion: 2.1 time: 0.080236 Oct 28 10:13:13.592550 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2483/4967] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:13:13 2022] GET /compute/v2.1/os-volumes/0524dd2f-9901-4a6e-a894-cd0c89f4bed9 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:13:14.127719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:14.128326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:14.144468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:14.145271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:14.145866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:14.146723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:14.147328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:14.147973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:14.488777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:14.497848 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b35adf2-ac7e-43c6-b81b-da9240af1133 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.373888 Oct 28 10:13:14.499144 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2485/4968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:14 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:14.574016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:14.575460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:14.588236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:14.589172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:14.589641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:14.590393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:14.590860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:14.591299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:15.126229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7013fcb2-24b2-4bea-8593-6e6c59a1c6e0 req-523e98a4-4ae2-478a-9d37-ebb80520957a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e2f782-cfed-423e-baf1-b589c3fd36ce", "tag": "78ecab50-5a8f-4c72-bc70-c4276070211b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:15.149995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7013fcb2-24b2-4bea-8593-6e6c59a1c6e0 req-523e98a4-4ae2-478a-9d37-ebb80520957a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:15.151186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7013fcb2-24b2-4bea-8593-6e6c59a1c6e0 req-523e98a4-4ae2-478a-9d37-ebb80520957a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:15.151912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7013fcb2-24b2-4bea-8593-6e6c59a1c6e0 req-523e98a4-4ae2-478a-9d37-ebb80520957a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:15.169880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:15.176447 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7013fcb2-24b2-4bea-8593-6e6c59a1c6e0 req-523e98a4-4ae2-478a-9d37-ebb80520957a service nova] Creating event network-changed:78ecab50-5a8f-4c72-bc70-c4276070211b for instance 28e2f782-cfed-423e-baf1-b589c3fd36ce on n-h1-zed-1 Oct 28 10:13:15.181085 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d0baaf7-d6b4-440e-ace0-d338166b427c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.612834 Oct 28 10:13:15.183998 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2484/4969] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:14 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:15.184805 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7013fcb2-24b2-4bea-8593-6e6c59a1c6e0 req-523e98a4-4ae2-478a-9d37-ebb80520957a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060658 Oct 28 10:13:15.190491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2486/4970] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:15.522356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:15.522984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:15.536854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:15.537616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:15.538868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:15.540221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:15.542712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:15.544837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:15.961993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:15.975328 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8774c0b8-4ef0-4da5-9323-d2416d4de369 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.457822 Oct 28 10:13:15.975932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2485/4971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:15 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:16.213186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:16.214756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:16.231225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:16.232235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:16.232771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:16.241827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:16.242459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:16.242985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:16.435679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:16.453256 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a8464015-5b7a-4e7a-9b73-934cbdeb307b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.242961 Oct 28 10:13:16.454087 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2487/4972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:16 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:17.001887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:17.003185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:17.012200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:17.013685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:17.018579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:17.019895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:17.021378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:17.022691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:17.024923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:17.026085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:17.206237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ac6f6f67-7583-4d94-9a92-b72bb5cff5d5 req-20ee5fbb-0d47-417c-b508-9536dbfbd5b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28e2f782-cfed-423e-baf1-b589c3fd36ce", "tag": "78ecab50-5a8f-4c72-bc70-c4276070211b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:17.212991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:17.219937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ac6f6f67-7583-4d94-9a92-b72bb5cff5d5 req-20ee5fbb-0d47-417c-b508-9536dbfbd5b6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:17.220477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ac6f6f67-7583-4d94-9a92-b72bb5cff5d5 req-20ee5fbb-0d47-417c-b508-9536dbfbd5b6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:17.220940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ac6f6f67-7583-4d94-9a92-b72bb5cff5d5 req-20ee5fbb-0d47-417c-b508-9536dbfbd5b6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:17.256655 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ac6f6f67-7583-4d94-9a92-b72bb5cff5d5 req-20ee5fbb-0d47-417c-b508-9536dbfbd5b6 service nova] Creating event network-changed:78ecab50-5a8f-4c72-bc70-c4276070211b for instance 28e2f782-cfed-423e-baf1-b589c3fd36ce on n-h1-zed-1 Oct 28 10:13:17.267504 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ac6f6f67-7583-4d94-9a92-b72bb5cff5d5 req-20ee5fbb-0d47-417c-b508-9536dbfbd5b6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068856 Oct 28 10:13:17.274852 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2488/4973] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:13:17.433156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:17.442009 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3c6b6478-7cc3-49c4-901b-afdc0202de83 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.445216 Oct 28 10:13:17.465904 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2486/4974] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:16 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:17.477834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:17.478542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:17.489707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:17.490206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:17.493107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:17.493893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:17.497021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:17.497865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:17.925149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:17.940237 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-13c08af7-c456-4e92-8a85-65d1afa0d177 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.466572 Oct 28 10:13:17.944465 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2489/4975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:17 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:18.474465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:18.475622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:18.482953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:18.483644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:18.484285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:18.485040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:18.485501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:18.485928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:18.811920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:18.834192 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c30a064-47d8-4444-8d4c-44a1bd6bdb7d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.364294 Oct 28 10:13:18.837749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2487/4976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:18 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:18.862154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-223dae0f-7a80-40a6-a874-c39860a8182c req-8f18c7fd-d358-4edd-94b0-116ec579639d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2151c4f2-835e-4b04-8762-b8f5ef269ff5", "name": "network-vif-plugged", "status": "completed", "tag": "b96493fd-92c5-43ba-afaa-ce37c4827ca3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:18.877686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-223dae0f-7a80-40a6-a874-c39860a8182c req-8f18c7fd-d358-4edd-94b0-116ec579639d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:18.878615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-223dae0f-7a80-40a6-a874-c39860a8182c req-8f18c7fd-d358-4edd-94b0-116ec579639d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:18.879260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-223dae0f-7a80-40a6-a874-c39860a8182c req-8f18c7fd-d358-4edd-94b0-116ec579639d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:18.892756 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-223dae0f-7a80-40a6-a874-c39860a8182c req-8f18c7fd-d358-4edd-94b0-116ec579639d service nova] Creating event network-vif-plugged:b96493fd-92c5-43ba-afaa-ce37c4827ca3 for instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 on n-h1-zed-1 Oct 28 10:13:18.901168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-223dae0f-7a80-40a6-a874-c39860a8182c req-8f18c7fd-d358-4edd-94b0-116ec579639d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043176 Oct 28 10:13:18.903561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2490/4977] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:18.969166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:18.969789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:18.978361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:18.979227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:18.980654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:18.981438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:18.982066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:18.982534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:18.988161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:19.483071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:19.494203 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b02716b8-5b58-4832-b10f-45d05ff31604 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.529159 Oct 28 10:13:19.509842 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2488/4978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:18 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:19.862012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:19.863093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:19.870795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:19.871789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:19.872533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:19.873710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:19.874400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:19.875536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:20.134718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:20.147061 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-078ae326-8a14-4b50-be59-832ae8666e78 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1308 microversion: 2.1 time: 0.292114 Oct 28 10:13:20.153009 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2491/4979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:19 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1308 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:20.519790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:20.521065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:20.531696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:20.533164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:20.534098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:20.547942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:20.549479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:20.550179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:20.886574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:20.899262 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1f3d15c-c799-42cc-a50e-89514a1dd266 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.383358 Oct 28 10:13:20.913588 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2489/4980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:20 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:21.170993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:21.171821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:21.185247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.186102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.186760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.187706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.188391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.189112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.350632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:21.358985 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76a8d3ab-394a-445f-a215-0e927a687dcc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1488 microversion: 2.1 time: 0.192591 Oct 28 10:13:21.360185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2492/4981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:21 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1488 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:21.383838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:21.387161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:21.394755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.395524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.396430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.397753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.398415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.399107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.549182 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c11c0376-242b-4e75-a6b5-5ce4449252cf tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "PUT /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1083 microversion: 2.1 time: 0.169194 Oct 28 10:13:21.551341 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2490/4982] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:13:21 2022] PUT /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1083 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:21.572612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:21.573291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:21.581053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.581832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.582501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.585037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.585717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.586350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.786014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:21.794495 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9a3f8080-4751-4645-9c4d-0c3c9b726b31 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1509 microversion: 2.1 time: 0.226362 Oct 28 10:13:21.805289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2493/4983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:21 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:21.817749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:21.818683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:21.825113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.825797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.826544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.827446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.828147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.828654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.927543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:21.928171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:21.939929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.940324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.940766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:21.942086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:21.942545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:21.942969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:22.002407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:22.015986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95ef13d5-7567-404e-873f-a3ba2dbbc49c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1509 microversion: 2.1 time: 0.202697 Oct 28 10:13:22.018322 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2491/4984] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:21 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1509 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:22.040281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:22.041033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:22.049959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:22.051194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:22.052047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:22.052963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:22.053783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:22.055040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:22.091914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:13:22.212664 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e3dd041-2a2b-4b1c-b769-5e9cf1a052fd tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 204 len: 0 microversion: 2.1 time: 0.174551 Oct 28 10:13:22.215266 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2492/4985] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:13:22 2022] DELETE /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:13:22.227354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:22.228125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:22.234624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:22.235117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:22.235736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:22.236618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:22.237268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:22.237954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:22.296529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:22.308694 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2908c165-6cb6-49fb-a597-26f60c56aa6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.385970 Oct 28 10:13:22.310333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2494/4986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:21 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:22.418641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:22.428444 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45983e92-a42d-4c64-a5f6-fc7c33ea90f8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1515 microversion: 2.1 time: 0.208753 Oct 28 10:13:22.429065 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2493/4987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:22 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:23.336460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:23.337121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:23.350913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:23.351287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:23.352881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:23.354372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:23.354840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:23.355271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:23.454679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:23.455483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:23.481783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:23.482722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:23.485383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:23.486549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:23.487475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:23.489105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:23.598537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:23.621515 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb905aea-0b1a-4f07-ae28-eea40b706a21 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.290021 Oct 28 10:13:23.625375 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2495/4988] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:23 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:23.844938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:23.853920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c6e58023-dea9-4b16-bfb3-dda036ed232c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1515 microversion: 2.1 time: 0.404978 Oct 28 10:13:23.869634 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2494/4989] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:23 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1515 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:24.525658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-01d2e5f7-6a02-4a79-89a4-517b8b617e1b req-b4da134a-7933-46c1-99f8-fcc7c3c6cb35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2151c4f2-835e-4b04-8762-b8f5ef269ff5", "name": "network-vif-deleted", "tag": "b96493fd-92c5-43ba-afaa-ce37c4827ca3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:24.538460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-01d2e5f7-6a02-4a79-89a4-517b8b617e1b req-b4da134a-7933-46c1-99f8-fcc7c3c6cb35 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:24.539246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-01d2e5f7-6a02-4a79-89a4-517b8b617e1b req-b4da134a-7933-46c1-99f8-fcc7c3c6cb35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:24.541093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-01d2e5f7-6a02-4a79-89a4-517b8b617e1b req-b4da134a-7933-46c1-99f8-fcc7c3c6cb35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:24.557340 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-01d2e5f7-6a02-4a79-89a4-517b8b617e1b req-b4da134a-7933-46c1-99f8-fcc7c3c6cb35 service nova] Creating event network-vif-deleted:b96493fd-92c5-43ba-afaa-ce37c4827ca3 for instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 on n-h1-zed-1 Oct 28 10:13:24.564002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-01d2e5f7-6a02-4a79-89a4-517b8b617e1b req-b4da134a-7933-46c1-99f8-fcc7c3c6cb35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044195 Oct 28 10:13:24.569824 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2496/4990] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:13:24.653118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:24.653803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:24.661085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:24.661590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:24.662034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:24.662750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:24.663209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:24.663640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:24.881664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:24.883994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:24.893302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:24.894002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:24.894506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:24.895213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:24.895791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:24.896250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:24.929709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:24.930194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:24.930626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:24.931072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lazy-loading 'fault' on Instance uuid 2151c4f2-835e-4b04-8762-b8f5ef269ff5 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:13:24.975972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:24.979913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:24.984593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7689ad36-6527-4fb5-8315-9a9e46e82e28 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.336242 Oct 28 10:13:24.985383 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2495/4991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:24 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:24.988832 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1adc629-bef6-47e3-a749-2dac2da7c0cc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 200 len: 1319 microversion: 2.1 time: 0.113233 Oct 28 10:13:24.989656 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2497/4992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:24 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 1319 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:26.017433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:26.019913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:26.022857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:26.024952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:26.028845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:26.029660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:26.030265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:26.031193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:26.031801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:26.032467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:26.045028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:26.045866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:26.048005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:26.048884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:26.049383 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 HTTP/1.1 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2151c4f2-835e-4b04-8762-b8f5ef269ff5'} Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:26.051320 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:26.056501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:26.056501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:26.056501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:26.056501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:26.056501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:13:26.056501 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:13:26.059950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:26.059950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:26.060228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:26.060228 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e772e33f-bc6d-4efa-8b65-aba1e00815f7 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 404 len: 111 microversion: 2.1 time: 0.049442 Oct 28 10:13:26.060228 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2498/4993] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:26 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:13:26.253978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-945338243", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "99600157-ce93-4ec4-a82a-4a75b2abd468"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:26.297000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:26.308714 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddcde5b9-0752-43bf-a37a-67af83f2e9f9 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.302110 Oct 28 10:13:26.309688 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2496/4994] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:26 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:26.359925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] validate_networks() for [('99600157-ce93-4ec4-a82a-4a75b2abd468', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:13:27.171968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:13:27.172643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:13:27.172869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:13:27.173313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:13:27.173737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:13:27.176754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=86 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:27.188581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:27.189106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:27.189896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:27.190452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:27.191465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:27.191902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:27.216342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:13:27.222810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Getting quotas for user b28b625c3a9340c888d9fab29f82ffa3 and project 9b12cfc0bbd64e7ea4a64277b566dfd8. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:13:27.241064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:13:27.243705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:13:27.330380 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47bc3bc6-ea34-4b11-96fb-a2a106afbd88 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077078 Oct 28 10:13:27.333866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:27.335236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:27.338264 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2499/4995] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:13:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:13:27.348249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:27.351169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:27.351808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:27.352750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:27.352897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d2664311-7a97-4bc1-a200-0656df648c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:27.353546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d2664311-7a97-4bc1-a200-0656df648c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:27.354435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:27.355236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:27.509519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d2664311-7a97-4bc1-a200-0656df648c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:27.518178 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d2664311-7a97-4bc1-a200-0656df648c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1208 microversion: 2.1 time: 0.177309 Oct 28 10:13:27.534291 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2500/4996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:27 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1208 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:27.631713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:27.647649 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a576a99c-42d6-4185-996b-28892666e524 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.318220 Oct 28 10:13:27.654024 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2497/4997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:27 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:28.548106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:28.549034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:28.565292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:28.566525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:28.571482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:28.571482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:28.571482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:28.571482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:28.675507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:28.676141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:28.696510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:28.697043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:28.697489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:28.698208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:28.698660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:28.699089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:28.743089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:28.750620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e300bbe-42fa-438e-957d-e79284be050a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1260 microversion: 2.1 time: 0.207171 Oct 28 10:13:28.751192 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2501/4998] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:28 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:29.014674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:29.034460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46715eba-980c-408f-84e7-a97877d3cf46 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1514 microversion: 2.1 time: 0.363276 Oct 28 10:13:29.037291 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2498/4999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:28 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1514 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:29.775360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:29.776088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:29.786295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:29.801470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:29.802298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:29.803273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:29.803614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:29.804112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:30.000693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:30.014250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8f7f941e-e2d1-4a8a-8fc1-a844b65aca15 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1266 microversion: 2.1 time: 0.242591 Oct 28 10:13:30.016892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2502/5000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:29 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:30.061823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:30.063054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:30.076956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:30.077444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:30.077893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:30.078724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:30.079320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:30.079861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:30.406199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:30.422644 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e42821f5-6371-401d-9f2a-901d1131c766 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1520 microversion: 2.1 time: 0.360438 Oct 28 10:13:30.424575 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2499/5001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:30 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:31.039641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:31.040298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:31.054098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:31.055120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:31.055993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:31.057055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:31.058552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:31.076977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:31.448118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:31.449436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:31.458847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:31.459684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:31.460310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:31.461401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:31.462202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:31.463596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:31.935251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:31.951054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:31.955522 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8082afcd-d346-4542-8d4d-9081a6ab9d17 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1308 microversion: 2.1 time: 0.919765 Oct 28 10:13:31.971187 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2503/5002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:31 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1308 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:32.164650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:32.193148 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ea18802-1e2f-4055-8f07-6921f878f383 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1520 microversion: 2.1 time: 0.749029 Oct 28 10:13:32.195355 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2500/5003] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:31 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1520 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:32.982932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:32.983745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:33.000027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:33.001801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:33.005428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:33.006217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:33.006702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:33.007136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:33.219219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:33.219978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:33.234901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:33.236739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:33.238823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:33.239861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:33.240718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:33.244708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:33.394093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:33.404974 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da17a153-470c-4dd7-80aa-ecc083064c28 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1308 microversion: 2.1 time: 0.425966 Oct 28 10:13:33.405851 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2504/5004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:32 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1308 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:33.417235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-bcd9f1f7-8a97-4a89-b8e4-49b63b933f90 req-cdfd48b3-2606-4099-8ffe-212e65db9482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19590f1b-cdd5-424f-99b5-8c136ef7e984", "tag": "68681bb1-94da-48d2-a9de-c37a5b9ddc4c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:33.435040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bcd9f1f7-8a97-4a89-b8e4-49b63b933f90 req-cdfd48b3-2606-4099-8ffe-212e65db9482 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:33.436949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bcd9f1f7-8a97-4a89-b8e4-49b63b933f90 req-cdfd48b3-2606-4099-8ffe-212e65db9482 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:33.437648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bcd9f1f7-8a97-4a89-b8e4-49b63b933f90 req-cdfd48b3-2606-4099-8ffe-212e65db9482 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:33.451280 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-bcd9f1f7-8a97-4a89-b8e4-49b63b933f90 req-cdfd48b3-2606-4099-8ffe-212e65db9482 service nova] Creating event network-changed:68681bb1-94da-48d2-a9de-c37a5b9ddc4c for instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 on n-h1-zed-1 Oct 28 10:13:33.456927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-bcd9f1f7-8a97-4a89-b8e4-49b63b933f90 req-cdfd48b3-2606-4099-8ffe-212e65db9482 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046126 Oct 28 10:13:33.458215 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2505/5005] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:33.718481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:33.727290 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f91d981d-dd85-4ffa-8211-e424acbb234d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1520 microversion: 2.1 time: 0.513352 Oct 28 10:13:33.728393 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2501/5006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:33 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1520 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:34.432458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:34.433774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:34.444471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:34.445158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:34.445599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:34.446993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:34.447470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:34.447906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:34.687925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:34.698570 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-42a74c70-306f-4777-9c7e-74e315ddd2c9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1308 microversion: 2.1 time: 0.272960 Oct 28 10:13:34.699274 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2506/5007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:34 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1308 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:34.757104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:34.759526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:34.772146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:34.772940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:34.773864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:34.774823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:34.775721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:34.777592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:34.812822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:34.875328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f687ffa3-203f-414a-9536-fa755c7be3e3 req-5335f619-d90b-4953-85c6-838d783c3b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96aa3db3-87cc-4a3b-859d-afbe3563a681", "name": "network-vif-unplugged", "status": "completed", "tag": "7739967f-73d9-40cc-af52-9f5f39ca6d9f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:34.896965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f687ffa3-203f-414a-9536-fa755c7be3e3 req-5335f619-d90b-4953-85c6-838d783c3b45 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:34.897513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f687ffa3-203f-414a-9536-fa755c7be3e3 req-5335f619-d90b-4953-85c6-838d783c3b45 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:34.897958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f687ffa3-203f-414a-9536-fa755c7be3e3 req-5335f619-d90b-4953-85c6-838d783c3b45 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:34.938123 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f687ffa3-203f-414a-9536-fa755c7be3e3 req-5335f619-d90b-4953-85c6-838d783c3b45 service nova] Creating event network-vif-unplugged:7739967f-73d9-40cc-af52-9f5f39ca6d9f for instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 on n-h2-zed-1 Oct 28 10:13:34.962786 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f687ffa3-203f-414a-9536-fa755c7be3e3 req-5335f619-d90b-4953-85c6-838d783c3b45 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093218 Oct 28 10:13:34.963566 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2507/5008] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:34.974279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:34.983354 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc35e51e-f2c1-4925-b2d7-ad2430c90833 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1520 microversion: 2.1 time: 0.232276 Oct 28 10:13:34.984133 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2502/5009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:34 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1520 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:35.726596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:35.727398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:35.734261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:35.735053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:35.735716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:35.736535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:35.737283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:35.737914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:36.006728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:36.009086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:36.009809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:36.018196 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:13:36.018480 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:13:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 (ip 10.222.0.16) !!! Oct 28 10:13:36.022527 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-332980f8-159b-4e91-a8b7-e76055cb5208 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1308 microversion: 2.1 time: 0.301482 Oct 28 10:13:36.023682 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2508/5010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:35 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1308 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:36.050165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:36.050707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:36.051118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:36.051956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:36.052422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:36.052852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:36.324440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:36.353161 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-154c8426-6cb6-405d-89f9-68e5496fbce2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1520 microversion: 2.1 time: 0.348023 Oct 28 10:13:36.360326 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2503/5011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:36 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:37.023154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ce171116-fe7e-4352-ae04-d32d3be29fc4 req-b9e4f4c4-c9ac-40c9-979b-d38e7de75b75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96aa3db3-87cc-4a3b-859d-afbe3563a681", "name": "network-vif-plugged", "status": "completed", "tag": "7739967f-73d9-40cc-af52-9f5f39ca6d9f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:37.036594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ce171116-fe7e-4352-ae04-d32d3be29fc4 req-b9e4f4c4-c9ac-40c9-979b-d38e7de75b75 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:37.037365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ce171116-fe7e-4352-ae04-d32d3be29fc4 req-b9e4f4c4-c9ac-40c9-979b-d38e7de75b75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:37.037965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ce171116-fe7e-4352-ae04-d32d3be29fc4 req-b9e4f4c4-c9ac-40c9-979b-d38e7de75b75 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:37.047599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:37.048752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:37.050449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ce171116-fe7e-4352-ae04-d32d3be29fc4 req-b9e4f4c4-c9ac-40c9-979b-d38e7de75b75 service nova] Creating event network-vif-plugged:7739967f-73d9-40cc-af52-9f5f39ca6d9f for instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 on n-h2-zed-1 Oct 28 10:13:37.056596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:37.058913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:37.060033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:37.060652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:37.061115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ce171116-fe7e-4352-ae04-d32d3be29fc4 req-b9e4f4c4-c9ac-40c9-979b-d38e7de75b75 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041811 Oct 28 10:13:37.061622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:37.062221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:37.062561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2509/5012] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:37.062862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:37.271437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:37.283279 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c50b3031-4f5f-4a53-88bf-6aae8a4e2268 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1308 microversion: 2.1 time: 0.239511 Oct 28 10:13:37.284493 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2504/5013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:37 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1308 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:37.379747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:37.380810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:37.386111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:37.388168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:37.388743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:37.389453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:37.390848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:37.391468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:37.391903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:37.520957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:37.605849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:37.619124 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84ef6536-7d91-4f1a-bb58-7431f56940e4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1520 microversion: 2.1 time: 0.242503 Oct 28 10:13:37.634141 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2510/5014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:37 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1520 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:38.310769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:38.311392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:38.330360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:38.330898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:38.331355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:38.332114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:38.333265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:38.334157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:38.635691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:38.654162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:38.657708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:38.692955 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9e45db0f-425e-4ef3-9c9a-067b8d83b3ab tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1308 microversion: 2.1 time: 0.382941 Oct 28 10:13:38.695248 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2505/5015] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:38 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:38.711135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:38.711964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:38.712558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:38.713681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:38.714540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:38.717457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:39.032007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:39.040448 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d06d44f-1531-4df5-bc0b-ab40b6668377 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1520 microversion: 2.1 time: 0.392186 Oct 28 10:13:39.041147 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2511/5016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:38 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:39.080799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fa295180-19fd-48ad-b65b-4f3295609ee2 req-2f5b263b-7d5d-4239-93bd-05250256da53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19590f1b-cdd5-424f-99b5-8c136ef7e984", "name": "network-vif-plugged", "status": "completed", "tag": "68681bb1-94da-48d2-a9de-c37a5b9ddc4c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:39.114100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fa295180-19fd-48ad-b65b-4f3295609ee2 req-2f5b263b-7d5d-4239-93bd-05250256da53 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:39.118937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fa295180-19fd-48ad-b65b-4f3295609ee2 req-2f5b263b-7d5d-4239-93bd-05250256da53 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:39.119545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fa295180-19fd-48ad-b65b-4f3295609ee2 req-2f5b263b-7d5d-4239-93bd-05250256da53 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:39.152680 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fa295180-19fd-48ad-b65b-4f3295609ee2 req-2f5b263b-7d5d-4239-93bd-05250256da53 service nova] Creating event network-vif-plugged:68681bb1-94da-48d2-a9de-c37a5b9ddc4c for instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 on n-h1-zed-1 Oct 28 10:13:39.158767 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fa295180-19fd-48ad-b65b-4f3295609ee2 req-2f5b263b-7d5d-4239-93bd-05250256da53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081380 Oct 28 10:13:39.160096 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2506/5017] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:39.723201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:39.723897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:39.740534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:39.741151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:39.741734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:39.742491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:39.742959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:39.743397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:39.972958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:39.988920 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ee2a907-f849-4b64-95f3-1b7865cc18ff tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1308 microversion: 2.1 time: 0.272935 Oct 28 10:13:39.990810 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2512/5018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:39 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1308 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:40.066471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:40.067832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:40.087062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:40.088869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:40.090055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:40.090829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:40.091272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:40.091737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:40.361711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:40.372855 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5aa731b9-2043-4ede-a1a2-cb5e4d0f5e16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1505 microversion: 2.1 time: 0.310424 Oct 28 10:13:40.393113 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2507/5019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:40 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1505 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:40.398616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:40.399557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:40.412423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:40.413093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:40.413635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:40.414331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:40.415044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:40.415675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:40.711216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:40.721916 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1e24d94-f62a-4b45-b3e1-15603332ac48 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 200 len: 1505 microversion: 2.1 time: 0.327022 Oct 28 10:13:40.722506 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2513/5020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:40 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:40.746693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:40.747548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:40.755114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:40.755995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:40.756670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:40.758597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:40.759257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:40.759860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:40.802640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:13:40.931279 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb653adc-14a7-4411-9b7b-63e070d13fdd tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 204 len: 0 microversion: 2.1 time: 0.186965 Oct 28 10:13:40.931906 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2508/5021] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:13:40 2022] DELETE /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:13:41.014001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:41.016094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:41.027731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:41.028636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:41.029393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:41.030662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:41.031938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:41.032661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:41.147314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-720111426", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7c622546-6f98-4076-8fbe-73602c743764"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:41.232407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] validate_networks() for [('7c622546-6f98-4076-8fbe-73602c743764', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:13:41.368648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:41.378968 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-935fb7d7-04cb-4e2c-adde-bdafcc66550b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1488 microversion: 2.1 time: 0.370351 Oct 28 10:13:41.381439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2514/5022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:41 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1488 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:41.416171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1808363119"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:41.426287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:41.449450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:41.451513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:41.453717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:41.455701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:41.457002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:41.457940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:41.690810 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e540c3c-f8e3-4b9f-b39b-2025ff11c44b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "PUT /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1074 microversion: 2.1 time: 0.286408 Oct 28 10:13:41.691646 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2515/5023] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:13:41 2022] PUT /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1074 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:41.714934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:41.716130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:41.728068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:41.733797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:41.734609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:41.735593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:41.736743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:41.745747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:42.353769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:42.363078 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bc1c2459-b4ef-4947-9219-14bc0cbca38c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1500 microversion: 2.1 time: 0.651490 Oct 28 10:13:42.372744 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2516/5024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:41 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1500 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:42.415472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:42.418146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:42.433513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:42.438207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:42.438926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:42.442987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:42.444868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:42.453885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:42.972007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:42.993347 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5323c3d9-4c68-44b5-87be-1c8cf0e7ed74 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1500 microversion: 2.1 time: 0.590242 Oct 28 10:13:42.999221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2517/5025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:42 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1500 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:43.030161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a22627b4-e8cd-47d7-bd30-9a9909199709 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:43.037938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22627b4-e8cd-47d7-bd30-9a9909199709 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:43.038430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22627b4-e8cd-47d7-bd30-9a9909199709 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:43.040125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22627b4-e8cd-47d7-bd30-9a9909199709 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:43.098447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a22627b4-e8cd-47d7-bd30-9a9909199709 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Going to try to stop instance {{(pid=128748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:13:43.171325 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a22627b4-e8cd-47d7-bd30-9a9909199709 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "POST /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984/action" status: 202 len: 0 microversion: 2.1 time: 0.145991 Oct 28 10:13:43.173740 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2518/5026] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:13:43 2022] POST /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:13:43.189990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:43.191565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:43.213162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:43.214361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:43.215618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:43.217147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:43.218953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:43.219731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:43.547432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:43.556181 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-08fee8a7-a0e7-413d-a48c-3857a3be507f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.377703 Oct 28 10:13:43.556770 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2519/5027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:43 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:44.415155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:13:44.416290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:13:44.417047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:13:44.418964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:13:44.419637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:13:44.431263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:44.431980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:44.432652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:44.433928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:44.434608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:44.435396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:44.484052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Getting quotas for project 93a2ed40295f44e2930a150edcbc798d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:13:44.497663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Getting quotas for user 906ed53d9d734a028b438ab998fdaaad and project 93a2ed40295f44e2930a150edcbc798d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:13:44.526190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:13:44.528694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:13:44.580770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-79314c66-e3f7-47f5-a3c1-1333dd40214b req-4275fb1f-d124-4f34-b667-022854d6595d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96aa3db3-87cc-4a3b-859d-afbe3563a681", "name": "network-vif-deleted", "tag": "7739967f-73d9-40cc-af52-9f5f39ca6d9f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:44.609226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79314c66-e3f7-47f5-a3c1-1333dd40214b req-4275fb1f-d124-4f34-b667-022854d6595d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:44.610441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79314c66-e3f7-47f5-a3c1-1333dd40214b req-4275fb1f-d124-4f34-b667-022854d6595d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:44.610441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-79314c66-e3f7-47f5-a3c1-1333dd40214b req-4275fb1f-d124-4f34-b667-022854d6595d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:44.662838 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-79314c66-e3f7-47f5-a3c1-1333dd40214b req-4275fb1f-d124-4f34-b667-022854d6595d service nova] Creating event network-vif-deleted:7739967f-73d9-40cc-af52-9f5f39ca6d9f for instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 on n-h2-zed-1 Oct 28 10:13:44.679548 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-79314c66-e3f7-47f5-a3c1-1333dd40214b req-4275fb1f-d124-4f34-b667-022854d6595d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103583 Oct 28 10:13:44.688218 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2520/5028] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:44.697511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:44.698516 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-096e6b20-cceb-4cab-b64a-1321f2b8c068 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.557336 Oct 28 10:13:44.712125 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2509/5029] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:13:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 3572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:13:44.716012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:44.719309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19363e52-19a2-4666-ab43-066e16846178 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:44.723688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19363e52-19a2-4666-ab43-066e16846178 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:44.742840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:44.759254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:44.759723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:44.760488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:44.794638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:44.796352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:44.885282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:45.035033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19363e52-19a2-4666-ab43-066e16846178 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:45.043420 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19363e52-19a2-4666-ab43-066e16846178 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1217 microversion: 2.1 time: 0.329855 Oct 28 10:13:45.058279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2510/5030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:44 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1217 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:45.168719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:45.188424 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81cf6cb4-a1c9-4041-88f3-5abac01dd75d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.498555 Oct 28 10:13:45.189219 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2521/5031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:44 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:46.086715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:46.087531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:46.106458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.108539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.109346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:46.112064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.112787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.113267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:46.214816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:46.216402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:46.235922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.237228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.237944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:46.238907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.240080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.240815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:46.285660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:46.297516 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d193bfe7-9142-44c5-9c75-dcb2aa122ccc tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1269 microversion: 2.1 time: 0.212439 Oct 28 10:13:46.299190 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2511/5032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:46 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:46.530196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:46.530918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:46.540242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.541270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.541968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:46.543060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.543834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.544558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:46.559145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:46.574749 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-acf398e6-9d92-4d5f-a0be-318d9a678b12 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.364630 Oct 28 10:13:46.591831 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2522/5033] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:46 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:46.718977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'services' on Instance uuid 28e2f782-cfed-423e-baf1-b589c3fd36ce {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:13:46.896064 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e8c7c6ad-21ce-4110-9040-b586d53b0025 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments/39c12315-3e9c-4856-97b9-28134af06961" status: 202 len: 0 microversion: 2.1 time: 0.370032 Oct 28 10:13:46.896815 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2512/5034] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:13:46 2022] DELETE /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments/39c12315-3e9c-4856-97b9-28134af06961 => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:13:46.910417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:46.915117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:46.927857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.928785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.929628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:46.930780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:46.932460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:46.934057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:47.010856 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d8f66612-8b7b-4f80-bbda-77fd6d9fbac0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108553 Oct 28 10:13:47.021115 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2523/5035] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:13:46 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:47.326319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:47.326319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:47.351179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:47.351662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:47.353768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:47.354770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:47.357333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:47.357999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:47.609417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:47.609983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:47.623420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:47.625093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:47.628526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:47.633121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:47.633816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:47.636284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:47.856961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:47.870179 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0d78a64-d200-4a3f-b261-f14e9ec3822e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1275 microversion: 2.1 time: 0.551338 Oct 28 10:13:47.870719 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2513/5036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:47 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1275 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:48.004173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:48.028404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:48.031171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:48.037949 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa7bb318-e18e-493f-ac23-a0af78b062c1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.433257 Oct 28 10:13:48.040540 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2524/5037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:47 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:48.061718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:48.065181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:48.065898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:48.069151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:48.071316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:48.072255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:48.127123 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df1045e1-3001-4ca9-b5e5-16051399be83 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102631 Oct 28 10:13:48.128061 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2514/5038] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:13:48 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:48.895579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:48.896427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:48.911975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:48.912973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:48.914103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:48.915484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:48.916599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:48.917510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:49.065711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:49.066480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:49.083280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:49.085472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:49.087226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:49.089944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:49.091601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:49.092519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:49.125471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:49.137682 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ea1b857-1f62-4505-855c-b8bb7f5103f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.247523 Oct 28 10:13:49.142118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2525/5039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:48 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:49.148768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:49.151456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:49.166805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:49.169089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:49.173202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:49.174797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:49.177964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:49.179300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:49.254709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74d46c8d-d77a-43e8-b21b-e1f851282613 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110899 Oct 28 10:13:49.259516 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2526/5040] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:13:49 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:49.641233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:49.651150 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-965b6270-8a1a-4505-97b9-ff290fe57bbe tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.590576 Oct 28 10:13:49.651766 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2515/5041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:49 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:50.170027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:50.170658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:50.200796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:50.201540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:50.203356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:50.204430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:50.205795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:50.206926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:50.272558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:50.274843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:50.289650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:50.290197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:50.292888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:50.293708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:50.294202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:50.296229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:50.349959 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b3772b0-8735-40e0-9942-8cd1e21e5770 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081827 Oct 28 10:13:50.356150 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2516/5042] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:13:50 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:50.520599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:50.530748 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ed650fb9-bdeb-42fb-81e0-dea32e8cf7ff tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.366784 Oct 28 10:13:50.532749 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2527/5043] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:50 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:50.679947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:50.680860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:50.692693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:50.696093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:50.697695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:50.699491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:50.701374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:50.702939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:50.727427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6cafe1f2-af54-4e5e-883d-ec60337ab2cb req-a782cfce-cf30-4973-b750-0e3cf5f460a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "280448cc-7c94-4fea-a8d4-f9572147a5f7", "tag": "322cb1f5-16af-4cf4-9da0-1cefc37882fe"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:50.756136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cafe1f2-af54-4e5e-883d-ec60337ab2cb req-a782cfce-cf30-4973-b750-0e3cf5f460a8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:50.758190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cafe1f2-af54-4e5e-883d-ec60337ab2cb req-a782cfce-cf30-4973-b750-0e3cf5f460a8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:50.759192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cafe1f2-af54-4e5e-883d-ec60337ab2cb req-a782cfce-cf30-4973-b750-0e3cf5f460a8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:50.801323 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6cafe1f2-af54-4e5e-883d-ec60337ab2cb req-a782cfce-cf30-4973-b750-0e3cf5f460a8 service nova] Creating event network-changed:322cb1f5-16af-4cf4-9da0-1cefc37882fe for instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 on n-h2-zed-1 Oct 28 10:13:50.810954 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6cafe1f2-af54-4e5e-883d-ec60337ab2cb req-a782cfce-cf30-4973-b750-0e3cf5f460a8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091305 Oct 28 10:13:50.816286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2528/5044] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:51.078308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:51.095658 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d18fffa5-6f44-46d2-a408-b3540453640b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.420411 Oct 28 10:13:51.097173 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2517/5045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:50 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:51.365453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:51.368845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:51.381610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:51.382537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:51.384028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:51.385248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:51.386154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:51.388356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:51.431490 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bda9af1a-390a-47bd-a073-f0c0bb8823a2 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072122 Oct 28 10:13:51.432339 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2529/5046] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:13:51 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:51.560837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:51.562621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:51.579427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:51.579963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:51.581297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:51.582047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:51.586742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:51.587361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:51.873422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:51.887511 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b6a057b-dbdb-432b-9de9-600f1e9f1f1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.330537 Oct 28 10:13:51.889117 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2518/5047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:51 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:52.120364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:52.121380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:52.132800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:52.134310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:52.136807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:52.137756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:52.140471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:52.141156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:52.446713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:52.449862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:52.459449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:52.462537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:52.463983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:52.465564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:52.466402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:52.467625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:52.474807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:52.543806 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0204beaf-0917-42b1-87b8-303da39b43ed tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103755 Oct 28 10:13:52.545911 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2519/5048] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:13:52 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:52.731826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:52.741910 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f840f1c3-3d5d-4465-997c-614b202556bc tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.626214 Oct 28 10:13:52.742514 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2530/5049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:52 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:52.918776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:52.919828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:52.929154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:52.930311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:52.931122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:52.932639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:52.933622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:52.941911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.263905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:53.286217 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c98c9290-cabe-4f3a-a385-b9f0df0061c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.371347 Oct 28 10:13:53.287448 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2520/5050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:52 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:53.559212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:53.561529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:53.569897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.570721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.571266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.572374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.573178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.573934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.620740 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b200188-2df0-4120-b8a5-f18cf9946afd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066322 Oct 28 10:13:53.621275 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2531/5051] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:13:53 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:13:53.722741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:53.725770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:53.732687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.733364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.733922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.734753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.735328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.735872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.767054 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Cannot 'reboot' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.768615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:53.769478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action HTTP/1.1 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 28 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: {"reboot": {"type": "HARD"}} Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: exception: Cannot 'reboot' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd8d40318-f07b-4972-bd7b-2424b794d6de', 'body': {'reboot': {'type': 'HARD'}}} Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8d40318-f07b-4972-bd7b-2424b794d6de in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:13:53.770335 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.774801 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.777406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 409 to user: Cannot 'reboot' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:53.778583 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d57c2df-bbb7-4070-8a41-4720bfbfee4f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action" status: 409 len: 145 microversion: 2.1 time: 0.063580 Oct 28 10:13:53.784715 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2521/5052] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:13:53 2022] POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action => generated 145 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:13:53.787386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.787978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.788436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.789480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.789952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.790799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.793404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:53.797559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:53.806288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.807518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.808462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.809508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.810224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.810889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.839537 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Cannot 'rebuild' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action HTTP/1.1 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 65 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: exception: Cannot 'rebuild' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd8d40318-f07b-4972-bd7b-2424b794d6de', 'body': {'rebuild': {'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1'}}} Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d8d40318-f07b-4972-bd7b-2424b794d6de in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:13:53.842278 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued Oct 28 10:13:53.847036 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:13:53.849747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 409 to user: Cannot 'rebuild' instance d8d40318-f07b-4972-bd7b-2424b794d6de while it is in vm_state rescued {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:13:53.850960 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b82b92e5-44ad-4402-8129-e59e07790acd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action" status: 409 len: 146 microversion: 2.1 time: 0.064716 Oct 28 10:13:53.851739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2522/5053] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:13:53 2022] POST /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de/action => generated 146 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:13:53.860670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:53.861366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:53.869136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.869625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.870067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.870767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:53.871224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:53.871652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:53.900575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:13:53.994468 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3faf30f3-b0f1-477b-ae14-85e7309ec94c tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 204 len: 0 microversion: 2.1 time: 0.136633 Oct 28 10:13:53.996856 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2523/5054] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:13:53 2022] DELETE /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:13:54.007165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:54.008145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:54.015042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:54.015763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:54.016381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:54.017342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:54.018050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:54.018639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:54.242466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:54.250469 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-41f6cc6c-6d73-46c3-b924-53af486817f6 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1687 microversion: 2.1 time: 0.248279 Oct 28 10:13:54.265370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2524/5055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:54 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1687 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:54.307012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:54.316648 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e434f89-87a5-4fc5-9f0e-1516d6f1dde0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.554107 Oct 28 10:13:54.317548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:54.317997 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2532/5056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:53 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:54.321385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:54.330335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:54.331937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:54.332756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:54.333952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:54.335009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:54.335920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:54.474608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:54.888125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:54.903471 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5bd7998e-24f0-4329-94ff-417619eff34f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.590530 Oct 28 10:13:54.920732 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2525/5057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:54 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:13:55.244038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-291085121", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "3a479701-439c-4633-98cc-5fc4f68ba1d0"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:55.274325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:55.274951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:55.285578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:55.309080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:55.309660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:55.310122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:55.313120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:55.313607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:55.314051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:55.335983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] validate_networks() for [('3a479701-439c-4633-98cc-5fc4f68ba1d0', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:13:55.495235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:55.507425 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40a04b80-c737-4d4c-ba42-e3db53be1c68 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1687 microversion: 2.1 time: 0.237560 Oct 28 10:13:55.508036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2526/5058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:55 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1687 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:55.513081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:55.513710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:55.523244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:55.523974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:55.524580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:55.525735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:55.526199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:55.526795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:55.685762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:55.695552 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c19fa26a-7f22-4093-b679-d0ea99d2cc48 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.186199 Oct 28 10:13:55.696511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2527/5059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:55 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:55.928159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:55.928794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:55.936145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:55.936649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:55.937163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:55.937894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:55.938385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:55.938979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:56.100378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:56.108795 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10c49b5d-a2cf-47f4-87dd-b73fb00dc670 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.186014 Oct 28 10:13:56.109409 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2528/5060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:55 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:56.531289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:56.532654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:56.539151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:13:56.540096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:13:56.540767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:13:56.541563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:13:56.542153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:13:56.551835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:56.552563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:56.553294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:56.554244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:56.554877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:56.555411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:56.555638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:56.560591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:56.561152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:56.562425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:56.562958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:56.563385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:56.597242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Getting quotas for project 53ab7227ba704cbdb9ad081f5569b5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:13:56.604620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Getting quotas for user e88c699fb0cc4067970ae55a87d8eac5 and project 53ab7227ba704cbdb9ad081f5569b5f9. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:13:56.622697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:13:56.625869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:13:56.714888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d5ea4bb0-2dcf-4c43-9b6d-52915ce0003c tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.639387 Oct 28 10:13:56.715556 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2533/5061] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:13:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:13:56.728987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:56.730237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:56.738537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:56.739227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:56.739875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:56.742071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:56.742555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:56.743000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:56.867585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:56.885655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dd2b101c-508b-49de-9706-4ed758caca7e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1687 microversion: 2.1 time: 0.358187 Oct 28 10:13:56.886391 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2529/5062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:56 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1687 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:56.891326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ab652eb4-27b9-4a97-8143-e6048eb77605 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:56.896027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ab652eb4-27b9-4a97-8143-e6048eb77605 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:57.039265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ab652eb4-27b9-4a97-8143-e6048eb77605 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:57.053978 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ab652eb4-27b9-4a97-8143-e6048eb77605 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1213 microversion: 2.1 time: 0.160563 Oct 28 10:13:57.056427 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2530/5063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:56 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1213 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:57.076040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5704dcda-4e73-48b8-9a87-9e0c50fc8bea req-c4c4eb09-95f0-481d-99fa-1872cf1b9e7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280448cc-7c94-4fea-a8d4-f9572147a5f7", "name": "network-vif-plugged", "status": "completed", "tag": "322cb1f5-16af-4cf4-9da0-1cefc37882fe"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:57.103657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5704dcda-4e73-48b8-9a87-9e0c50fc8bea req-c4c4eb09-95f0-481d-99fa-1872cf1b9e7c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:57.104159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5704dcda-4e73-48b8-9a87-9e0c50fc8bea req-c4c4eb09-95f0-481d-99fa-1872cf1b9e7c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:57.104594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5704dcda-4e73-48b8-9a87-9e0c50fc8bea req-c4c4eb09-95f0-481d-99fa-1872cf1b9e7c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:57.118200 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5704dcda-4e73-48b8-9a87-9e0c50fc8bea req-c4c4eb09-95f0-481d-99fa-1872cf1b9e7c service nova] Creating event network-vif-plugged:322cb1f5-16af-4cf4-9da0-1cefc37882fe for instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 on n-h2-zed-1 Oct 28 10:13:57.128776 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5704dcda-4e73-48b8-9a87-9e0c50fc8bea req-c4c4eb09-95f0-481d-99fa-1872cf1b9e7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069606 Oct 28 10:13:57.129668 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2531/5064] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:13:57.136659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:57.138574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:57.144543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:57.148514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:57.149406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:57.150073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:57.154149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:57.155790 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb17872c-17bc-4fbc-8581-4e854fa21ae6 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.430708 Oct 28 10:13:57.158191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:57.158635 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2534/5065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:56 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:57.159126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:57.591579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:57.600692 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-467dd66b-15a5-46db-922b-56f52ba7a866 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.469397 Oct 28 10:13:57.605711 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2532/5066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:57 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:57.912818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:57.913577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:57.917905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:13:57.925777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:57.931028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:57.931595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:57.936195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:57.937093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:57.937854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:58.081298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:58.081934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:58.091686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:58.092447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:58.093107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:58.094047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:58.094671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:58.099099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:58.210555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:58.222385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a31c1eb6-1347-40ae-8ae1-69770547177f tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1209 microversion: 2.1 time: 0.147869 Oct 28 10:13:58.224982 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2533/5067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:58 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:58.231428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:58.237984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:58.253096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:58.253601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:58.254041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:58.254747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:58.256776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:58.257819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:58.703425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:58.723526 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e499ca9-7f40-4ffa-906d-222cbc3761a1 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1687 microversion: 2.1 time: 0.815634 Oct 28 10:13:58.730006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2535/5068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:57 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1687 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:58.745099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:58.746030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:58.753098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:58.753634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:58.754291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:58.755211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:58.755963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:58.756566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:58.772003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:58.784711 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9c876b56-e806-4182-a643-be0a6ec11267 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.557121 Oct 28 10:13:58.792603 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2534/5069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:58 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:59.122440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:59.137299 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-45acd736-7fa5-4c0b-80c9-b3d23f7305e8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1317 microversion: 2.1 time: 0.404458 Oct 28 10:13:59.140833 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2536/5070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:58 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:59.250321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:59.251057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:59.264330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.264966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.265535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.266344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.269679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.270181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8c57e5aa-81ac-41de-869f-760b6ae47d25 req-2381ba31-c46c-4647-b28e-65448cee25ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28e2f782-cfed-423e-baf1-b589c3fd36ce", "name": "network-vif-deleted", "tag": "78ecab50-5a8f-4c72-bc70-c4276070211b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:13:59.270582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.286724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8c57e5aa-81ac-41de-869f-760b6ae47d25 req-2381ba31-c46c-4647-b28e-65448cee25ce service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.287813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8c57e5aa-81ac-41de-869f-760b6ae47d25 req-2381ba31-c46c-4647-b28e-65448cee25ce service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.288436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8c57e5aa-81ac-41de-869f-760b6ae47d25 req-2381ba31-c46c-4647-b28e-65448cee25ce service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.309580 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8c57e5aa-81ac-41de-869f-760b6ae47d25 req-2381ba31-c46c-4647-b28e-65448cee25ce service nova] Creating event network-vif-deleted:78ecab50-5a8f-4c72-bc70-c4276070211b for instance 28e2f782-cfed-423e-baf1-b589c3fd36ce on n-h1-zed-1 Oct 28 10:13:59.315206 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8c57e5aa-81ac-41de-869f-760b6ae47d25 req-2381ba31-c46c-4647-b28e-65448cee25ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049352 Oct 28 10:13:59.320783 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2537/5071] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:13:59.454832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:13:59.480741 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-39329ef4-f077-4c8f-95a3-6e18c8fc6997 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1265 microversion: 2.1 time: 0.226636 Oct 28 10:13:59.481494 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2535/5072] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:59 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:13:59.748406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:59.749336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:59.762986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.763584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.772574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.774107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.774690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.776805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.817646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:13:59.819165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:13:59.830218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.832381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.833616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.835127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.837360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.839480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.852871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:13:59.854420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:13:59.859433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:13:59.860185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'fault' on Instance uuid 28e2f782-cfed-423e-baf1-b589c3fd36ce {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:13:59.884425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:00.021798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:00.037396 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a53ab221-d325-4210-800f-6cdf46230213 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 200 len: 1335 microversion: 2.1 time: 0.290834 Oct 28 10:14:00.052978 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2538/5073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:59 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 1335 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:00.169342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:00.169972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:00.183113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.183626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.184081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:00.184937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.185492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.185908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:00.352100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:00.372147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44b496e6-8096-4eb9-af61-920ae85dbd50 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.559341 Oct 28 10:14:00.389885 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2536/5074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:13:59 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:00.506320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:00.506949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:00.528528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.530831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.531643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:00.533225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.535771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.539358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:00.541473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:00.545038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:00.559852 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-30e1fd7a-3e47-487f-95d9-1dfa5e5d1c42 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1506 microversion: 2.1 time: 0.394494 Oct 28 10:14:00.561727 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2539/5075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:00 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1506 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:00.596634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:00.597709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:00.607253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.608037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.608722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:00.610721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.611464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.612730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:00.728378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:00.743084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5923d7fc-3d5f-4e3c-b4e3-070fd487a161 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1271 microversion: 2.1 time: 0.241069 Oct 28 10:14:00.749213 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2537/5076] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:00 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:00.931731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:00.944841 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8fbb3133-e580-4c78-a298-6dfc8dcd81c2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1506 microversion: 2.1 time: 0.362464 Oct 28 10:14:00.949461 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2540/5077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:00 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:00.970305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:00.973726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:00.988814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.989476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.990207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:00.991203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:00.992033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:00.992648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.070397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:01.071531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 28e2f782-cfed-423e-baf1-b589c3fd36ce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:01.084710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.086355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.087762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.090030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.090677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.091864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.136094 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d6e708f-a4f7-4b8f-9aa5-cb2d841954da tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "PUT /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1078 microversion: 2.1 time: 0.169755 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Instance 28e2f782-cfed-423e-baf1-b589c3fd36ce could not be found. Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce HTTP/1.1 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 28e2f782-cfed-423e-baf1-b589c3fd36ce could not be found. Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '28e2f782-cfed-423e-baf1-b589c3fd36ce'} Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28e2f782-cfed-423e-baf1-b589c3fd36ce could not be found. Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:01.151928 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28e2f782-cfed-423e-baf1-b589c3fd36ce could not be found. Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28e2f782-cfed-423e-baf1-b589c3fd36ce could not be found. Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:01.156872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 404 to user: Instance 28e2f782-cfed-423e-baf1-b589c3fd36ce could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:01.160565 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2538/5078] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:14:00 2022] PUT /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1078 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:01.161305 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7187d9a1-0e0d-41e1-85c5-9b862399d498 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce" status: 404 len: 111 microversion: 2.1 time: 0.084830 Oct 28 10:14:01.163010 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2541/5079] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:01 2022] GET /compute/v2.1/servers/28e2f782-cfed-423e-baf1-b589c3fd36ce => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:01.166758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:01.167592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:01.174354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:01.176101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.176602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e138e0c4-1ac3-4ec6-bafd-0a5af2eff87f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '.version_select at 0x7fca328989d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:01.178006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.178795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.180262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.180937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.181613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.216865 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e138e0c4-1ac3-4ec6-bafd-0a5af2eff87f tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960140666" status: 202 len: 0 microversion: 2.1 time: 0.048617 Oct 28 10:14:01.217624 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2542/5080] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:14:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1960140666 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:14:01.397913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:01.398839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:01.405579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.406437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.407037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.407920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.408578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.409204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.623908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:01.641902 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e64e96f-a3c5-486e-b015-30c460ea8eef tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1504 microversion: 2.1 time: 0.479616 Oct 28 10:14:01.642497 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2539/5081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:01 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1504 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:01.665241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:01.665623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:01.674031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.674803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.675417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:01.676565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:01.677232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:01.677832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:02.196684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:02.209118 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0dbcd448-ddf0-4015-afb5-22109ae29e2c tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.817096 Oct 28 10:14:02.212840 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2543/5082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:01 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:02.225863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:02.226755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:02.234428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:02.235322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:02.236472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:02.237338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:02.237809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:02.238238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:02.506224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:02.532240 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52125679-8114-458b-b8b5-25004585eb42 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.305616 Oct 28 10:14:02.535425 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2544/5083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:02 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:02.691379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:02.700644 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bc4f4af-2007-436f-9157-b1e2b9d5ba17 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1504 microversion: 2.1 time: 1.039446 Oct 28 10:14:02.701820 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2540/5084] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:01 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1504 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:02.735420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:02.739985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:02.750893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:02.757262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:02.758035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:02.759057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:02.760725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:02.762215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:02.899000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:14:02.899624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:14:02.900295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:14:02.900880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:14:02.901489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:14:02.996378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:03.003193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.003692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.004326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.005116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.005582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.006016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.036633 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f84fbe07-661d-4567-9aec-92385842aa3a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "POST /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7/action" status: 202 len: 1110 microversion: 2.1 time: 0.317530 Oct 28 10:14:03.045121 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2545/5085] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:14:02 2022] POST /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7/action => generated 1110 bytes in 327 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 10:14:03.058728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:03.059531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:03.075104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.075753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.076368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.077552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.078357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.079015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.235278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:03.235878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:03.243531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.245923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.247576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.248367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.249212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.249710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.451057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:03.464624 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-61ef8b0e-1ce3-4182-abaf-f72182103b58 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.233241 Oct 28 10:14:03.465804 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2546/5086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:03 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:03.558638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:03.559533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:03.571048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.576145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.576889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.577905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:03.578367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:03.578798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:03.580499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:03.601124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0d11be4-ac44-496a-981b-54f556c1ec11 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.547487 Oct 28 10:14:03.602289 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2541/5087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:03 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:03.793658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:03.805801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e6b8b42-c6d9-4e5c-96dc-893ec308552a tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.251231 Oct 28 10:14:03.806403 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2547/5088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:03 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:04.491169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:04.494632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:04.512021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:04.514691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:04.515373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:04.517152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:04.518341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:04.518946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:04.626030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:04.627273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:04.636502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:04.641660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:04.647002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:04.648100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:04.648800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:04.649588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:04.888787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:04.897811 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53b627ce-8782-4897-95ed-91f27e380838 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.276220 Oct 28 10:14:04.909437 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2548/5089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:04 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:04.921342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:04.922235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:04.928840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:04.929611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:04.930317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:04.931259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:04.931888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:04.932555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:05.107406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:05.116151 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-27b8990e-a9bd-4b5d-8b87-f721dfdb4e53 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.205230 Oct 28 10:14:05.116751 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2549/5090] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:04 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:05.458221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ead6c5ac-cd1d-4567-abce-84b34d8be6c7 req-810ead92-9996-4eb9-9188-98ba8295c81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0aa5bec-a7f6-40b3-845a-9febbe7f612c", "tag": "1052713f-9470-4143-8268-86ea14cd6b67"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:05.469533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ead6c5ac-cd1d-4567-abce-84b34d8be6c7 req-810ead92-9996-4eb9-9188-98ba8295c81f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:05.470387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ead6c5ac-cd1d-4567-abce-84b34d8be6c7 req-810ead92-9996-4eb9-9188-98ba8295c81f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:05.471154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ead6c5ac-cd1d-4567-abce-84b34d8be6c7 req-810ead92-9996-4eb9-9188-98ba8295c81f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:05.484259 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ead6c5ac-cd1d-4567-abce-84b34d8be6c7 req-810ead92-9996-4eb9-9188-98ba8295c81f service nova] Creating event network-changed:1052713f-9470-4143-8268-86ea14cd6b67 for instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c on n-h2-zed-1 Oct 28 10:14:05.484771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:05.496754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ead6c5ac-cd1d-4567-abce-84b34d8be6c7 req-810ead92-9996-4eb9-9188-98ba8295c81f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040534 Oct 28 10:14:05.497655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5cb82a53-9a69-4cd0-8f71-908297663c77 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 1.011890 Oct 28 10:14:05.498305 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2550/5091] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:14:05.498647 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2542/5092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:04 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:05.928066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:05.929537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:05.943278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:05.948039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:05.948694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:05.949656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:05.950300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:05.950738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:06.151105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:06.151737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:06.164799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:06.165341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:06.168899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:06.170131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:06.170653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:06.171115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:06.239337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:06.279338 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d473942b-c865-4f60-aa62-751286af2597 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.356801 Oct 28 10:14:06.295248 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2551/5093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:05 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:06.524792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:06.525655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:06.539161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:06.540403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:06.540863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:06.542886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:06.545215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:06.545722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:06.583584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:06.617717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:06.665095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:06.676527 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-20e90f1b-a249-4d9d-b4f8-aa901682eba2 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.535757 Oct 28 10:14:06.677414 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2543/5094] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:06 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:06.812219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:06.828370 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ceda31bb-8f59-4603-a60e-fd38595fee66 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.309383 Oct 28 10:14:06.845046 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2552/5095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:06 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:07.309444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:07.311125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:07.316701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:07.338939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:07.341162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:07.341997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:07.345044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:07.346911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:07.349556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:07.702186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:07.702748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:07.725310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:07.727193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:07.728327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:07.731833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:07.732971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:07.736739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:07.765856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:07.779499 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3b4b479-ad4f-4ee4-9dac-654bd527382f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.475321 Oct 28 10:14:07.787792 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2544/5096] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:07 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:07.854799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:07.855416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:07.865656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:07.866152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:07.881704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:07.882535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:07.882965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:07.883401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:08.095763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:08.106362 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e90e7e6-818b-4a72-a0b4-8b04a8ab4591 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1510 microversion: 2.1 time: 0.255224 Oct 28 10:14:08.106953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2545/5097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:07 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1510 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:08.126255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:08.134927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bba8bddf-d1e0-4b72-90a8-9727ba509850 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.438439 Oct 28 10:14:08.140450 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2553/5098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:07 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:08.810028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:08.811423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:08.843188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:08.843983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:08.844603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:08.846579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:08.847207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:08.848365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:09.132562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:09.134099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:09.155413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:09.158856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:09.159518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:09.160779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:09.161278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:09.161710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:09.361056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:09.373887 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ffc09b69-527a-45ba-8d02-58afd758163b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.573740 Oct 28 10:14:09.377569 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2546/5099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:08 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:09.388037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:09.390620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:09.410471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:09.411379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:09.411989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:09.413250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:09.414220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:09.416131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:09.703306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:09.717392 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-77f4381c-71ce-490b-9b2e-9992881eb750 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.338667 Oct 28 10:14:09.718278 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2547/5100] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:09 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:10.059087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:10.074929 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9bb38490-75e8-4a1b-9c08-3cd1cdce6486 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1487 microversion: 2.1 time: 0.948624 Oct 28 10:14:10.075532 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2554/5101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:09 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1487 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:10.101337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-345223751"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:10.104979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:10.112971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.113703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.114367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.115237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.115852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.116449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.229921 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55c4e1d5-e4c8-4dbb-baa8-ca55671db5d8 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "PUT /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1059 microversion: 2.1 time: 0.133950 Oct 28 10:14:10.233124 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2548/5102] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:14:10 2022] PUT /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1059 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:10.249661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:10.250934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:10.258935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.259624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.260297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.261233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.262057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.262822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.403953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:10.405157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:10.420542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.422033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.423682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.428306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.429126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.429889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.688609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:10.707482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cea1f3c9-db23-43cd-b4cb-11da5d85f697 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1486 microversion: 2.1 time: 0.455528 Oct 28 10:14:10.708837 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2555/5103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:10 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1486 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:10.737411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:10.738964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:10.753247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.754372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.755032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.755963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.756630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.757296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.810519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:10.819548 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da7621a9-515a-46b7-8347-e82b07675480 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.419611 Oct 28 10:14:10.822741 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2549/5104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:10 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:10.835612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:10.837385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:10.853441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.853943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.854390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:10.855455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:10.856093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:10.856400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.271178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:11.275127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:11.287449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c7151a7-4c07-4d55-baca-1142312e5fda tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1486 microversion: 2.1 time: 0.555263 Oct 28 10:14:11.288406 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2556/5105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:10 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1486 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:11.317751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:11.318564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:11.335212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:11.335975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:11.336724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.337694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:11.338346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:11.338941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.373194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:14:11.510654 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82a8706c-c2da-4399-a280-0d5ece22c09e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 204 len: 0 microversion: 2.1 time: 0.198675 Oct 28 10:14:11.511951 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2557/5106] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:11 2022] DELETE /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:14:11.527420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:11.529756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:11.547479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:11.548298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:11.549352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.552769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:11.553748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:11.554385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.711737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:11.729807 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2667f406-d630-4c19-8f54-3a18ef97f2f3 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.905496 Oct 28 10:14:11.732721 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2550/5107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:10 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:11.739328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-262e5f8a-dc5e-4488-b08d-6f09310863c3 req-389b9739-ce47-4230-a1f5-ea8cdea18183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0aa5bec-a7f6-40b3-845a-9febbe7f612c", "name": "network-vif-plugged", "status": "completed", "tag": "1052713f-9470-4143-8268-86ea14cd6b67"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:11.758766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-262e5f8a-dc5e-4488-b08d-6f09310863c3 req-389b9739-ce47-4230-a1f5-ea8cdea18183 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:11.760159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-262e5f8a-dc5e-4488-b08d-6f09310863c3 req-389b9739-ce47-4230-a1f5-ea8cdea18183 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:11.761459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-262e5f8a-dc5e-4488-b08d-6f09310863c3 req-389b9739-ce47-4230-a1f5-ea8cdea18183 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.795412 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-262e5f8a-dc5e-4488-b08d-6f09310863c3 req-389b9739-ce47-4230-a1f5-ea8cdea18183 service nova] Creating event network-vif-plugged:1052713f-9470-4143-8268-86ea14cd6b67 for instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c on n-h2-zed-1 Oct 28 10:14:11.802562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-262e5f8a-dc5e-4488-b08d-6f09310863c3 req-389b9739-ce47-4230-a1f5-ea8cdea18183 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067929 Oct 28 10:14:11.804082 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2551/5108] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:11.818823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:11.831851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-95b3467f-7f9f-4929-9917-a7ecc6c84606 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1492 microversion: 2.1 time: 0.312438 Oct 28 10:14:11.835108 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2558/5109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:11 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1492 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:11.854522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:11.855529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:11.875179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:11.875972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:11.878596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.879533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:11.880165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:11.882607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:11.952898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:12.085125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:12.085629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:12.094609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.095110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.095603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.096307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.096780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.097226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.157532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:14:12.261399 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffd48d88-1777-44d9-830f-58df00e347a0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 204 len: 0 microversion: 2.1 time: 0.179712 Oct 28 10:14:12.264929 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2559/5110] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:12 2022] DELETE /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:14:12.277862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:12.278642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:12.298340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.299472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.299847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.301549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.301549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.301549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.397826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:12.409666 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-654871f8-073b-4c0d-9c03-963b7c72f417 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.566287 Oct 28 10:14:12.422109 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2552/5111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:11 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:12.683679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:12.699917 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81e415a7-a7e6-417b-b1db-29144aba41ca tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1506 microversion: 2.1 time: 0.432179 Oct 28 10:14:12.700778 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2560/5112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:12 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:12.760251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:12.761664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:12.768666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.769614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.770230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.771142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.773486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.773920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.880768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:12.881685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:12.900531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.904169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.905057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.906080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:12.906716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:12.907388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:12.993397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:13.004802 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ac7f5754-b359-45e0-818f-e7b24a8458e4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1313 microversion: 2.1 time: 0.251207 Oct 28 10:14:13.021974 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2553/5113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:12 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:13.235245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:13.249204 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6116dab2-3685-49f8-8b18-f835058c7c1a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1492 microversion: 2.1 time: 0.384265 Oct 28 10:14:13.250289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2561/5114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:12 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1492 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:13.435175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:13.436605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:13.446315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:13.447261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:13.448868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:13.454617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:13.456661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:13.457415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:13.724125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:13.725426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:13.733787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:13.734724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:13.735271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:13.736740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:13.737390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:13.737929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:13.738334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:13.749456 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72753e6d-0679-4331-b207-8bee3e7d8d2c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.317828 Oct 28 10:14:13.750703 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2554/5115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:13 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:14.029302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:14.031112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:14.042743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:14.045173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:14.047117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:14.049744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:14.050332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:14.051882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:14.099581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:14.115675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edb61cbf-1fa4-4c7d-8f47-7482dc2e0576 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1506 microversion: 2.1 time: 0.395428 Oct 28 10:14:14.117546 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2562/5116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:13 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1506 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:14.272094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:14.272989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:14.279733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:14.280515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:14.280988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:14.281688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:14.282309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:14.282751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:14.531561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:14.546953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb514c6c-3a57-4418-9e94-a6702b29e466 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1497 microversion: 2.1 time: 0.522795 Oct 28 10:14:14.549965 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2555/5117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:14 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1497 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:14.587838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:14.606619 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee8d4129-8be7-4cd2-b996-1d4eb6e7e0f0 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1492 microversion: 2.1 time: 0.338289 Oct 28 10:14:14.607221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2563/5118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:14 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1492 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:14.781154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:14.782873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:14.805265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:14.811119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:14.811603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:14.814863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:14.817512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:14.818082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:15.143561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:15.144287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:15.146108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:15.157565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1f531e0d-b1c0-4f49-a490-7866ee106046 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.386581 Oct 28 10:14:15.158753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2556/5119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:14 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:15.162302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:15.165066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:15.165523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:15.167541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:15.170542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:15.171005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:15.617979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:15.631252 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf0da623-9f3c-4b59-9215-52c86c3fd35e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1506 microversion: 2.1 time: 0.495435 Oct 28 10:14:15.634916 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2564/5120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:15 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1506 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:15.638964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:15.639596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:15.649397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:15.652773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:15.654394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:15.655324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:15.659261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:15.660068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:16.182164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:16.183100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:16.216331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:16.219576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:16.221440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:16.222832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:16.223322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:16.247307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:16.294232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:16.310544 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a156ff35-5f52-4056-b08f-0ead3cbe0342 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1492 microversion: 2.1 time: 0.674796 Oct 28 10:14:16.318363 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2557/5121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:15 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1492 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:16.609361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c2d5dd4c-ae82-4c9f-9a34-ffed02a5efe3 req-800998ef-4573-4592-be69-80d5b03cb653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19590f1b-cdd5-424f-99b5-8c136ef7e984", "name": "network-vif-deleted", "tag": "68681bb1-94da-48d2-a9de-c37a5b9ddc4c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:16.627201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c2d5dd4c-ae82-4c9f-9a34-ffed02a5efe3 req-800998ef-4573-4592-be69-80d5b03cb653 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:16.627690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c2d5dd4c-ae82-4c9f-9a34-ffed02a5efe3 req-800998ef-4573-4592-be69-80d5b03cb653 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:16.634991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c2d5dd4c-ae82-4c9f-9a34-ffed02a5efe3 req-800998ef-4573-4592-be69-80d5b03cb653 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:16.666289 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c2d5dd4c-ae82-4c9f-9a34-ffed02a5efe3 req-800998ef-4573-4592-be69-80d5b03cb653 service nova] Creating event network-vif-deleted:68681bb1-94da-48d2-a9de-c37a5b9ddc4c for instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 on n-h1-zed-1 Oct 28 10:14:16.676466 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c2d5dd4c-ae82-4c9f-9a34-ffed02a5efe3 req-800998ef-4573-4592-be69-80d5b03cb653 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070895 Oct 28 10:14:16.680321 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2558/5122] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:14:16.691524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:16.692924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:16.714930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:16.715711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:16.716365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:16.717289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:16.717918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:16.718515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:16.910999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:16.933295 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e912b60-1958-4351-96c2-a745b9a9438f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.756913 Oct 28 10:14:16.946591 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2565/5123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:16 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:17.013245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:17.022901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4ee13df-cf64-4d64-b736-f7b199e5764b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1464 microversion: 2.1 time: 0.341161 Oct 28 10:14:17.024181 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2559/5124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:16 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1464 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:17.345509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:17.346777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:17.371189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:17.376212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:17.376346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:17.385840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:17.386468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:17.389312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:17.512011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:17.512508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:17.512970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:17.513432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lazy-loading 'fault' on Instance uuid 19590f1b-cdd5-424f-99b5-8c136ef7e984 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:14:17.645115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:17.659458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-133b59f7-e702-4ed4-9ef4-abb3a82b58f1 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 200 len: 1309 microversion: 2.1 time: 0.317629 Oct 28 10:14:17.660656 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2566/5125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:17 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 1309 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:17.959677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:17.963013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:17.979565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:17.980082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:17.980528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:17.986640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:17.987619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:17.989918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.049125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:18.049956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:18.063510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.064103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.064554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.067254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.069170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.070857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.220897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.227556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.238136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.238136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'fault' on Instance uuid d8d40318-f07b-4972-bd7b-2424b794d6de {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:14:18.467979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:18.477034 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4a1ed2e3-cc10-471d-b246-4d42eafdd8fe tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 200 len: 1311 microversion: 2.1 time: 0.433454 Oct 28 10:14:18.485140 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2567/5126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:18 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 1311 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:18.690141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:18.690755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:18.708952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.709816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.711164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.712717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.714021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.714463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.736888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:18.738385 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 HTTP/1.1 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '19590f1b-cdd5-424f-99b5-8c136ef7e984'} Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.740877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.747854 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.747854 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.747854 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:18.747854 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:18.747854 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.747854 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.749458 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15fc6b6b-63d2-49a3-bcb1-4582dfc6af02 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.792572 Oct 28 10:14:18.752288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:18.753492 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fef3c149-63b0-4797-9d1d-e186abc19ec9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 404 len: 111 microversion: 2.1 time: 0.068595 Oct 28 10:14:18.757442 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2568/5127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:18 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:18.764617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6cd211dd-05de-40d7-a556-b989c810bd7d req-8b0a59b5-c968-457c-9546-038110009314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8d40318-f07b-4972-bd7b-2424b794d6de", "name": "network-vif-deleted", "tag": "af6dcfb6-7754-4fff-858c-07a6a63b6732"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:18.769028 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2560/5128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:17 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:18.776660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:18.777187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:18.778212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cd211dd-05de-40d7-a556-b989c810bd7d req-8b0a59b5-c968-457c-9546-038110009314 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.778914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cd211dd-05de-40d7-a556-b989c810bd7d req-8b0a59b5-c968-457c-9546-038110009314 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.779547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6cd211dd-05de-40d7-a556-b989c810bd7d req-8b0a59b5-c968-457c-9546-038110009314 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.793437 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6cd211dd-05de-40d7-a556-b989c810bd7d req-8b0a59b5-c968-457c-9546-038110009314 service nova] Creating event network-vif-deleted:af6dcfb6-7754-4fff-858c-07a6a63b6732 for instance d8d40318-f07b-4972-bd7b-2424b794d6de on n-h1-zed-1 Oct 28 10:14:18.796057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.796627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.797097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.797805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.798264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.798762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.800621 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6cd211dd-05de-40d7-a556-b989c810bd7d req-8b0a59b5-c968-457c-9546-038110009314 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041956 Oct 28 10:14:18.802310 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2569/5129] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:18.816569 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 HTTP/1.1 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '19590f1b-cdd5-424f-99b5-8c136ef7e984'} Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:18.818293 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.822555 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.827066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:18.828006 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e28c645-49f1-44aa-9f43-50fc67986ba3 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 404 len: 111 microversion: 2.1 time: 0.056920 Oct 28 10:14:18.828600 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2561/5130] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:18 2022] DELETE /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:18.839244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:18.840324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 19590f1b-cdd5-424f-99b5-8c136ef7e984] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:18.857418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.857418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.857418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.857418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.857852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.858223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.876141 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 HTTP/1.1 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '19590f1b-cdd5-424f-99b5-8c136ef7e984'} Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.878619 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 19590f1b-cdd5-424f-99b5-8c136ef7e984 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8cb42966-f0de-4844-a39a-bfeab35d0476 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984" status: 404 len: 111 microversion: 2.1 time: 0.045939 Oct 28 10:14:18.886039 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2570/5131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:18 2022] GET /compute/v2.1/servers/19590f1b-cdd5-424f-99b5-8c136ef7e984 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:14:18.889106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:18.889608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:18.896405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.896889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.897351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.898048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.898507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.898932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.921252 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 HTTP/1.1 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '2151c4f2-835e-4b04-8762-b8f5ef269ff5'} Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:18.923154 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.928633 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.932138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:18.933363 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e430cb98-4313-4bb5-8de2-4eed89168d1b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 404 len: 111 microversion: 2.1 time: 0.048191 Oct 28 10:14:18.939985 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2562/5132] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:18 2022] DELETE /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:18.942878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:18.943681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 2151c4f2-835e-4b04-8762-b8f5ef269ff5] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:18.960458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.960981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.961428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.962135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:18.962589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:18.963015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:18.982080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 HTTP/1.1 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2151c4f2-835e-4b04-8762-b8f5ef269ff5'} Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.983633 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 2151c4f2-835e-4b04-8762-b8f5ef269ff5 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-deb39144-9a99-4c01-bd93-065415ac5b2b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5" status: 404 len: 111 microversion: 2.1 time: 0.047132 Oct 28 10:14:18.990518 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2571/5133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:18 2022] GET /compute/v2.1/servers/2151c4f2-835e-4b04-8762-b8f5ef269ff5 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:18.994275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:18.995620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.003500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.004291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.004967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.005911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.006594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.007107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.022984 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 HTTP/1.1 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81'} Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.024648 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-729e8148-ea26-4fc1-b769-dc7561c53335 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 404 len: 111 microversion: 2.1 time: 0.036412 Oct 28 10:14:19.030258 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2563/5134] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:18 2022] DELETE /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.035667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.036327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.042658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.043153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.043593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.044301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.044758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.045225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.055134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:19.067663 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 HTTP/1.1 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81'} Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.069861 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.076477 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.076477 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.076477 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.076477 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.076477 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. Oct 28 10:14:19.076477 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.078184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.079305 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75948068-12dd-46f9-b902-8ba76d98719f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81" status: 404 len: 111 microversion: 2.1 time: 0.047527 Oct 28 10:14:19.080446 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2572/5135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/cf21df68-f5ac-4ad3-a2ab-9f2d1690ef81 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.089770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.090852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.105050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.105927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.106610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.109970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.112272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.112994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.119513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.120007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.122285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:19.129818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.130352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.130783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.131498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.132143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.132803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.135390 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 HTTP/1.1 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd73d68fc-c148-4d42-813c-7f1b632ef898'} Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.137641 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca87da6d-8aa7-4bd1-8697-40ded420229f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 404 len: 111 microversion: 2.1 time: 0.055524 Oct 28 10:14:19.142972 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2564/5136] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:19 2022] DELETE /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:14:19.151918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.152849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: d73d68fc-c148-4d42-813c-7f1b632ef898] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.159879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.160824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.161736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.163506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.164201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.164857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.190332 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 HTTP/1.1 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd73d68fc-c148-4d42-813c-7f1b632ef898'} Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.192022 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.196361 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.196361 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.196361 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.196361 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.196361 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. Oct 28 10:14:19.196361 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.196765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:14:19.199198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance d73d68fc-c148-4d42-813c-7f1b632ef898 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.200361 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4738c21a-953c-4c7e-b4c7-180fc0ee2c5f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898" status: 404 len: 111 microversion: 2.1 time: 0.055708 Oct 28 10:14:19.204352 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2565/5137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/d73d68fc-c148-4d42-813c-7f1b632ef898 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.210732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.211489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.218240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.219259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.219936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.221578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.222274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.222934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.242507 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a HTTP/1.1 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0e843bdc-cb7b-4735-8f6d-84ac0924be1a'} Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.244405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.248534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.250715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.252705 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6f13fc13-fe86-4b49-8fbf-11a58f5dde5a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 404 len: 111 microversion: 2.1 time: 0.046520 Oct 28 10:14:19.254803 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2566/5138] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:19 2022] DELETE /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.263649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.265027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 0e843bdc-cb7b-4735-8f6d-84ac0924be1a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.273139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.274040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.275145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.276105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.276794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.277562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.296668 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a HTTP/1.1 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0e843bdc-cb7b-4735-8f6d-84ac0924be1a'} Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.298795 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.303146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.303146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.303146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.303146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.303146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. Oct 28 10:14:19.303146 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.305547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 0e843bdc-cb7b-4735-8f6d-84ac0924be1a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.306740 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd1d06cf-244b-456f-900c-6d6e8b70e863 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a" status: 404 len: 111 microversion: 2.1 time: 0.048696 Oct 28 10:14:19.308277 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2567/5139] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/0e843bdc-cb7b-4735-8f6d-84ac0924be1a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.316737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.317276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.325743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.326236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.326852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.327587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.328049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.328477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.346039 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa HTTP/1.1 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4c864388-245e-4266-9a38-f797263121fa'} Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.347770 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.352042 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d8a53ccc-6582-4e2d-b878-09c3b4710c75 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 404 len: 111 microversion: 2.1 time: 0.037126 Oct 28 10:14:19.353216 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2568/5140] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:19 2022] DELETE /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:14:19.365396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.366685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4c864388-245e-4266-9a38-f797263121fa] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.374768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.375066 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-32466b69-4628-4b7f-9de0-ca97002a6038 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 204 len: 0 microversion: 2.1 time: 0.259534 Oct 28 10:14:19.375665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.381007 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2573/5141] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:19 2022] DELETE /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:14:19.382003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.382984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.383687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.384281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.391544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.394041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.402080 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa HTTP/1.1 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4c864388-245e-4266-9a38-f797263121fa'} Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.404114 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.410208 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.410208 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.410208 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.410208 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.410208 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. Oct 28 10:14:19.410208 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.410953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.410953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.410953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.413569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.413569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.413907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 4c864388-245e-4266-9a38-f797263121fa could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.414057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.414221 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f053370b-817e-4386-976d-1deaadfe283a tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa" status: 404 len: 111 microversion: 2.1 time: 0.058893 Oct 28 10:14:19.418050 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2569/5142] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/4c864388-245e-4266-9a38-f797263121fa => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.428951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b61519a2-1f2c-4a2c-911c-a896b2bf0535 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.429933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b61519a2-1f2c-4a2c-911c-a896b2bf0535 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4ca4b9c3-73d6-4be3-9231-86f3f27e9864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.436625 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b61519a2-1f2c-4a2c-911c-a896b2bf0535 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b61519a2-1f2c-4a2c-911c-a896b2bf0535 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864 HTTP/1.1 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4ca4b9c3-73d6-4be3-9231-86f3f27e9864'} Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.438690 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.443403 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.443403 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.443403 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.443403 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.443403 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.443403 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.443403 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.445796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b61519a2-1f2c-4a2c-911c-a896b2bf0535 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.446952 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b61519a2-1f2c-4a2c-911c-a896b2bf0535 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864" status: 404 len: 111 microversion: 2.1 time: 0.022058 Oct 28 10:14:19.451006 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2570/5143] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:19 2022] DELETE /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.457135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d98a000-f236-40c5-8615-1aad6b3913da tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.458139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d98a000-f236-40c5-8615-1aad6b3913da tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 4ca4b9c3-73d6-4be3-9231-86f3f27e9864] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.465648 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-7d98a000-f236-40c5-8615-1aad6b3913da tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d98a000-f236-40c5-8615-1aad6b3913da tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864 HTTP/1.1 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4ca4b9c3-73d6-4be3-9231-86f3f27e9864'} Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.467607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.472226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.472226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.472226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. Oct 28 10:14:19.472226 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.473944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d98a000-f236-40c5-8615-1aad6b3913da tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 4ca4b9c3-73d6-4be3-9231-86f3f27e9864 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.475157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d98a000-f236-40c5-8615-1aad6b3913da tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864" status: 404 len: 111 microversion: 2.1 time: 0.022793 Oct 28 10:14:19.475955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2571/5144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/4ca4b9c3-73d6-4be3-9231-86f3f27e9864 => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.484207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.484933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.491733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.492387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.493104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.493915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.494641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.495168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.527661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:14:19.651020 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b793e9d-369c-4486-a318-5ef361627b1f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "DELETE /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 204 len: 0 microversion: 2.1 time: 0.170257 Oct 28 10:14:19.661444 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2572/5145] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:19 2022] DELETE /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:14:19.669796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.670499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: d8d40318-f07b-4972-bd7b-2424b794d6de] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.679805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.680322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.680763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.682020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.682485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.683182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.703206 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Instance d8d40318-f07b-4972-bd7b-2424b794d6de could not be found. Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de HTTP/1.1 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance d8d40318-f07b-4972-bd7b-2424b794d6de could not be found. Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd8d40318-f07b-4972-bd7b-2424b794d6de'} Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8d40318-f07b-4972-bd7b-2424b794d6de could not be found. Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8d40318-f07b-4972-bd7b-2424b794d6de could not be found. Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.706033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8d40318-f07b-4972-bd7b-2424b794d6de could not be found. Oct 28 10:14:19.710995 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:19.713233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 404 to user: Instance d8d40318-f07b-4972-bd7b-2424b794d6de could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:19.714326 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a3ed22e-2fc4-44f0-9974-99cc859ae5b0 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de" status: 404 len: 111 microversion: 2.1 time: 0.051659 Oct 28 10:14:19.715086 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2573/5146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/d8d40318-f07b-4972-bd7b-2424b794d6de => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:19.725955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.726683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.734073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.734570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.735009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.735948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.736308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.737018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.748462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:19.761995 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b67067c-f89e-4e2c-ae23-402b717d4f99 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1503 microversion: 2.1 time: 0.379403 Oct 28 10:14:19.763202 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2574/5147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1503 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:19.770561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.775871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.797236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.798523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.799248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.800179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.800825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.801558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.835419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:14:19.968391 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e6797fc-7480-4162-a7e8-482e1e3d0521 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 204 len: 0 microversion: 2.1 time: 0.203479 Oct 28 10:14:19.969797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2575/5148] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:19 2022] DELETE /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:14:19.980182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:19.982362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:19.991267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.992550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.993348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:19.995028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:19.995765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:19.996535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:20.053158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:20.064209 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b75e8db6-24d2-4a14-83d0-81745b2eadd9 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1480 microversion: 2.1 time: 0.347845 Oct 28 10:14:20.078162 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2574/5149] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1480 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:20.092442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:20.096396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:20.105628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:20.106619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:20.107290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:20.108668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:20.109762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:20.110405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:20.336808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:20.348409 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f6d2427-c6ea-47b6-ad74-4005d3c58634 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.375323 Oct 28 10:14:20.349022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2576/5150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:19 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:20.545148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:20.554986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e3ff29b-d625-4b11-9df7-02ed2292dc46 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.475430 Oct 28 10:14:20.559104 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2575/5151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:20 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:20.795302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:20.796476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:20.817112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:20.817696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:20.818402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:20.819765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:20.820292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:20.820710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:21.096055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:21.098465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:21.105070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:21.118545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:21.119177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:21.119866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:21.120039 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-396efbf0-3f7b-4238-9c65-9b6ae33669d4 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1503 microversion: 2.1 time: 0.326639 Oct 28 10:14:21.121068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:21.121214 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2577/5152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:20 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1503 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:21.121933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:21.122626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:21.378216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:21.379297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:21.394815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:21.395542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:21.396300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:21.397250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:21.397892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:21.398498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:21.445756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:21.452167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:21.460359 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eeb4296c-9acf-4274-99b7-8f0f7ed5759d tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1480 microversion: 2.1 time: 0.368805 Oct 28 10:14:21.461391 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2576/5153] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:21 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1480 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:21.588415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:21.592224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:21.606017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:21.606868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:21.607445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:21.608422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:21.609023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:21.609461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:21.672196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:21.682436 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-db4e9b4c-59f7-434a-87d6-54b6dd9d674c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.309504 Oct 28 10:14:21.697885 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2578/5154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:21 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:21.853296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:21.864295 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc38ea01-de5f-4ac5-bcba-4abacb057a2b tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.284461 Oct 28 10:14:21.866278 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2577/5155] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:21 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:22.146140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:22.149446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:22.163428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:22.164271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:22.165545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:22.166512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:22.168257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:22.168768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:22.365739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:22.375841 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa84e5c1-c0f7-4a00-b378-f4bdf07e639d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1503 microversion: 2.1 time: 0.233525 Oct 28 10:14:22.380294 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2579/5156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:22 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1503 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:22.484493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:22.485170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:22.492420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:22.493317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:22.493959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:22.494660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:22.495374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:22.495700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:22.707501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:22.708158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:22.714470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:22.714967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:22.715408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:22.716335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:22.717011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:22.717455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:22.744944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:22.754447 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-238cd9b0-4625-4d97-92d1-a5e6ce7f167e tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1480 microversion: 2.1 time: 0.274511 Oct 28 10:14:22.755171 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2578/5157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:22 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1480 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:23.023798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:23.035075 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2002b0d1-7b9e-420b-8242-445a633a2c6d tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.331473 Oct 28 10:14:23.035985 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2580/5158] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:22 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:23.105143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:23.105775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:23.113166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:23.114382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:23.114850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:23.115580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:23.116050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:23.116484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:23.311170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:23.326084 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fcd1c7dd-5576-4b23-8de2-954104948c9e tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.442078 Oct 28 10:14:23.327196 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2579/5159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:22 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:23.403534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:23.404218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:23.414273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:23.414774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:23.415234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:23.415933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:23.416389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:23.416897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:23.730650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:23.740158 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-122e25b3-e991-4775-8d21-3e0c8436c2e7 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1503 microversion: 2.1 time: 0.341819 Oct 28 10:14:23.742422 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2581/5160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:23 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1503 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:23.778450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:23.779012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:23.790102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:23.790602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:23.795176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:23.796016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:23.796508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:23.796978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:24.046763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:24.055012 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-614da4b0-5a30-4c8a-afd7-116ecf46590b tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1480 microversion: 2.1 time: 0.280396 Oct 28 10:14:24.076661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:24.077397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:24.081150 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2580/5161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:23 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1480 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:24.086548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:24.087299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:24.088167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:24.089155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:24.090898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:24.091511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:24.300319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:24.336767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1a7f07ba-1b07-4b66-9a5b-7a1de3fdd127 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.266500 Oct 28 10:14:24.350446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:24.350941 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2582/5162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:24 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:24.351082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:24.361449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:24.362182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:24.362798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:24.363743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:24.364440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:24.365093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:24.690589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:24.698823 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-497693f0-1556-46a0-9bba-753266845155 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.352802 Oct 28 10:14:24.699807 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2581/5163] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:24 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:24.764366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:24.765972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:24.777236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:24.780850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:24.781596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:24.783039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:24.785606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:24.786538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:25.085180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:25.086993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:25.097671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:25.098176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:25.100008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:25.103362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:25.103846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:25.104299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:25.107527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:25.132941 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9c5afa2-d02e-4ec5-8164-34c932c7f4bb tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1503 microversion: 2.1 time: 0.371890 Oct 28 10:14:25.137661 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2583/5164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:24 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1503 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:25.363312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:25.364177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:25.371187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:25.371841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:25.372384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:25.373257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:25.373821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:25.374353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:25.410390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:25.419550 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1446f4a1-58d9-4076-a601-eb18c46eb08f tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1480 microversion: 2.1 time: 0.340122 Oct 28 10:14:25.422386 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2582/5165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:25 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1480 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:25.722475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:25.723482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:25.729991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:25.730736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:25.731440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:25.732423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:25.733151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:25.733838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:25.742870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:25.750798 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d24d1af5-afb2-43e4-8f14-ad671ab55635 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.391721 Oct 28 10:14:25.765315 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2584/5166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:25 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:26.163727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:26.164474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:26.180398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:26.181242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:26.181873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:26.183039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:26.186524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:26.187292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:26.538266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:26.547517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-facbfeeb-ad03-4acc-a459-8e85858c4f88 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1522 microversion: 2.1 time: 0.828936 Oct 28 10:14:26.549619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2583/5167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:25 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1522 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:26.555394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:26.556740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:26.563564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:26.564803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:26.565414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:26.566393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:26.566852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:26.567281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:26.570637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:26.580886 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1f304df3-1792-4bdb-a40d-ca1ff0caf58d tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1503 microversion: 2.1 time: 0.420857 Oct 28 10:14:26.582199 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2585/5168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:26 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1503 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:26.775826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:26.776437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:26.805329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:26.809229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:26.809827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:26.812676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:26.814578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:26.815928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:26.852223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:26.948758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b28b625c3a9340c888d9fab29f82ffa3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b12cfc0bbd64e7ea4a64277b566dfd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:26.962080 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-34e06756-c578-4120-b772-1d2787ddb670 tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 200 len: 1480 microversion: 2.1 time: 0.410963 Oct 28 10:14:26.977629 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2584/5169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:26 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 1480 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:26.978548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-19cb1cc1-76f6-4ad7-a99b-3f3bb947b1a3 req-ab99aff6-4936-4ebd-8b30-805f2a069510 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "336847cd-072d-42f3-a542-6a73704691fe", "name": "network-vif-deleted", "tag": "f06df1b9-ba73-4597-acde-8f79a062e40c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:26.989336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-19cb1cc1-76f6-4ad7-a99b-3f3bb947b1a3 req-ab99aff6-4936-4ebd-8b30-805f2a069510 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:26.989899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-19cb1cc1-76f6-4ad7-a99b-3f3bb947b1a3 req-ab99aff6-4936-4ebd-8b30-805f2a069510 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:26.990348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-19cb1cc1-76f6-4ad7-a99b-3f3bb947b1a3 req-ab99aff6-4936-4ebd-8b30-805f2a069510 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:27.008363 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-19cb1cc1-76f6-4ad7-a99b-3f3bb947b1a3 req-ab99aff6-4936-4ebd-8b30-805f2a069510 service nova] Creating event network-vif-deleted:f06df1b9-ba73-4597-acde-8f79a062e40c for instance 336847cd-072d-42f3-a542-6a73704691fe on n-h2-zed-1 Oct 28 10:14:27.013687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-19cb1cc1-76f6-4ad7-a99b-3f3bb947b1a3 req-ab99aff6-4936-4ebd-8b30-805f2a069510 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041292 Oct 28 10:14:27.014331 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2585/5170] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:27.112950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:27.123333 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5f9812d-8d05-412c-89c2-720710e806d1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.351532 Oct 28 10:14:27.125279 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2586/5171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:26 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:27.421368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ef8f8b8f-c531-4c3c-8fa2-fbc1e7d90849 req-fdfbb8b7-bdb5-46dc-b7aa-506b139d2b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0aa5bec-a7f6-40b3-845a-9febbe7f612c", "name": "network-vif-deleted", "tag": "1052713f-9470-4143-8268-86ea14cd6b67"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:27.427384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:27.444605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ef8f8b8f-c531-4c3c-8fa2-fbc1e7d90849 req-fdfbb8b7-bdb5-46dc-b7aa-506b139d2b35 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:27.447130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ef8f8b8f-c531-4c3c-8fa2-fbc1e7d90849 req-fdfbb8b7-bdb5-46dc-b7aa-506b139d2b35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:27.447656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ef8f8b8f-c531-4c3c-8fa2-fbc1e7d90849 req-fdfbb8b7-bdb5-46dc-b7aa-506b139d2b35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:27.478577 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ef8f8b8f-c531-4c3c-8fa2-fbc1e7d90849 req-fdfbb8b7-bdb5-46dc-b7aa-506b139d2b35 service nova] Creating event network-vif-deleted:1052713f-9470-4143-8268-86ea14cd6b67 for instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c on n-h2-zed-1 Oct 28 10:14:27.493277 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ef8f8b8f-c531-4c3c-8fa2-fbc1e7d90849 req-fdfbb8b7-bdb5-46dc-b7aa-506b139d2b35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078642 Oct 28 10:14:27.494486 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2586/5172] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:27.573496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:27.574625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:27.581914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:27.582662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:27.584041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:27.585004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:27.585643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:27.587771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:27.610242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:27.611408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:27.625916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:27.628713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:27.629537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:27.633297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:27.633941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:27.634717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:27.709321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:27.719795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b425e793-9baa-4bc2-ac94-da7ee781cffd tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1480 microversion: 2.1 time: 0.149030 Oct 28 10:14:27.722878 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2587/5173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:27 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1480 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:27.738819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e88c699fb0cc4067970ae55a87d8eac5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53ab7227ba704cbdb9ad081f5569b5f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:27.745831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4048338d-1d82-4e8f-b749-61d595edc801 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 200 len: 1298 microversion: 2.1 time: 0.141622 Oct 28 10:14:27.746922 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2587/5174] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:27 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:27.990597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:27.991229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] [instance: 336847cd-072d-42f3-a542-6a73704691fe] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:27.997721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:27.998211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:27.998835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:27.999912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.000377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.000811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.015508 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] HTTP exception thrown: Instance 336847cd-072d-42f3-a542-6a73704691fe could not be found. Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Request method failure captured: Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe HTTP/1.1 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6q4BeM1MeStpvWRY5YctUqa5Jwqk7AiPleZ4y-QCaaUhV_FHd0MnRm1MIEiXYOZUphc5_z2S6MjtdNukgH7AwOgk2QsGvgAUEd10yS12e0dSMQTRs9AavGncIpbQ8ruEz87bMy5nRrZNh57VWqawYegTJWpV1rL5HQIzgp_N32tdCE Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9b12cfc0bbd64e7ea4a64277b566dfd8", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9b12cfc0bbd64e7ea4a64277b566dfd8"}]}] Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersTestJSON-85415667 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 9b12cfc0bbd64e7ea4a64277b566dfd8 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersTestJSON-85415667 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersTestJSON-85415667-project Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b28b625c3a9340c888d9fab29f82ffa3 Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersTestJSON-85415667-project Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 336847cd-072d-42f3-a542-6a73704691fe could not be found. Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '336847cd-072d-42f3-a542-6a73704691fe'} Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 336847cd-072d-42f3-a542-6a73704691fe could not be found. Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 336847cd-072d-42f3-a542-6a73704691fe could not be found. Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.017334 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:28.024680 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:28.024680 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:28.024680 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:28.024680 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:28.024680 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 336847cd-072d-42f3-a542-6a73704691fe could not be found. Oct 28 10:14:28.024680 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.026629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] Returning 404 to user: Instance 336847cd-072d-42f3-a542-6a73704691fe could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:28.027515 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15037789-33dd-4d84-85df-ffd18beaa7df tempest-ServersTestJSON-85415667 tempest-ServersTestJSON-85415667-project] 10.222.0.16 "GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe" status: 404 len: 111 microversion: 2.1 time: 0.043491 Oct 28 10:14:28.028100 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2588/5175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:27 2022] GET /compute/v2.1/servers/336847cd-072d-42f3-a542-6a73704691fe => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:28.153194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:28.154254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:28.164451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.165593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.166227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.167705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.168488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.169601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.472516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:28.484145 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23812684-7d22-4bc3-8a0e-a5da3cdf0aa0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.336390 Oct 28 10:14:28.486413 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2588/5176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:28 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:28.747653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:28.748267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:28.760264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.761075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.762897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.763851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.765584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.766487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.773407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:28.774691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] [instance: a0aa5bec-a7f6-40b3-845a-9febbe7f612c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:28.792096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.792884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.793356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.794125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.794602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.795093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.827950 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] HTTP exception thrown: Instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c could not be found. Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Request method failure captured: Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c HTTP/1.1 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6tgpCEbw99PWc6hgn3FyR3htdSrfOixWAe5qWf7BG4QnUGpBbqenQw937LpxThKrhaG6DvfqS3lgau41uzf_renB-CiwkH8ouFFfA7qpYCjMWXdI5vAnXRAxUX1zFAX27ufwOtF8pseLcX3-gCzbBIlZBCyPByvmMqy01E41KPJWUQ Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 53ab7227ba704cbdb9ad081f5569b5f9 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesActionsTest-415042199 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53ab7227ba704cbdb9ad081f5569b5f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/53ab7227ba704cbdb9ad081f5569b5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_53ab7227ba704cbdb9ad081f5569b5f9", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/53ab7227ba704cbdb9ad081f5569b5f9"}]}] Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesActionsTest-415042199 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 53ab7227ba704cbdb9ad081f5569b5f9 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesActionsTest-415042199 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesActionsTest-415042199-project Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: e88c699fb0cc4067970ae55a87d8eac5 Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesActionsTest-415042199-project Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c could not be found. Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a0aa5bec-a7f6-40b3-845a-9febbe7f612c'} Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c could not be found. Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c could not be found. Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:28.831534 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.836578 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:28.836578 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:28.836578 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:28.836578 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:28.836578 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:28.836578 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c could not be found. Oct 28 10:14:28.836578 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:14:28.839272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] Returning 404 to user: Instance a0aa5bec-a7f6-40b3-845a-9febbe7f612c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:28.841716 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5027119-0068-4ca4-82c2-9b052c7d1800 tempest-VolumesActionsTest-415042199 tempest-VolumesActionsTest-415042199-project] 10.222.0.16 "GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c" status: 404 len: 111 microversion: 2.1 time: 0.072200 Oct 28 10:14:28.846655 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2589/5177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:28 2022] GET /compute/v2.1/servers/a0aa5bec-a7f6-40b3-845a-9febbe7f612c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:14:28.854057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:28.854541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:28.855562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:28.856186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lazy-loading 'fault' on Instance uuid 1830271f-4c7c-4e75-9170-db188cfc0b75 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:14:28.953060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4dc1824197d40e58d0dfdc8f55ab72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80974eba622d4830886ec598e50cad90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:28.968625 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4810b81e-7703-4c96-9074-095fb8bf3761 tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 200 len: 1312 microversion: 2.1 time: 0.224395 Oct 28 10:14:28.973137 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2589/5178] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:28 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:29.509655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:29.510197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:29.524696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:29.525177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:29.525618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:29.526408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:29.526794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:29.532647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ca85dd48-531c-4515-b53c-397ef0f9bf9a req-e04953f3-1608-4977-9f17-9ca668c61947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1830271f-4c7c-4e75-9170-db188cfc0b75", "name": "network-vif-deleted", "tag": "de443f28-add0-435c-a727-abade52c6278"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:29.537441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:29.555144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ca85dd48-531c-4515-b53c-397ef0f9bf9a req-e04953f3-1608-4977-9f17-9ca668c61947 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:29.555641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ca85dd48-531c-4515-b53c-397ef0f9bf9a req-e04953f3-1608-4977-9f17-9ca668c61947 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:29.556076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ca85dd48-531c-4515-b53c-397ef0f9bf9a req-e04953f3-1608-4977-9f17-9ca668c61947 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:29.603126 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ca85dd48-531c-4515-b53c-397ef0f9bf9a req-e04953f3-1608-4977-9f17-9ca668c61947 service nova] Creating event network-vif-deleted:de443f28-add0-435c-a727-abade52c6278 for instance 1830271f-4c7c-4e75-9170-db188cfc0b75 on n-h2-zed-1 Oct 28 10:14:29.617189 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ca85dd48-531c-4515-b53c-397ef0f9bf9a req-e04953f3-1608-4977-9f17-9ca668c61947 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088327 Oct 28 10:14:29.618459 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2590/5179] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:29.880611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:29.891062 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f01e8f03-85ab-4f42-9d98-b8b597fe8f66 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.385394 Oct 28 10:14:29.905785 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2590/5180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:29 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:29.995907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:29.996611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] [instance: 1830271f-4c7c-4e75-9170-db188cfc0b75] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:30.006887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:30.013727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:30.014432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:30.015354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:30.015981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:30.016585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:30.046386 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] HTTP exception thrown: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 could not be found. Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Request method failure captured: Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 HTTP/1.1 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6pRH2Mi1L51E6jYuLTUQ5AcgD80BHq4TmVTDodyna4QiogYW8h-FSoEtpRRFHrU1CsH4SfIlB4WMh0cAkB8Mw7Ut_Lkv3rCFCakDYvyLPY5RDObD-LPrUMr7CLhGHOnDEn-xssTHqgpv6XfIK95f8rhD2uPMqkqSs7ilqo2G-w0CJM Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/80974eba622d4830886ec598e50cad90"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_80974eba622d4830886ec598e50cad90", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/80974eba622d4830886ec598e50cad90"}]}] Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 80974eba622d4830886ec598e50cad90 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-685700080 Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f4dc1824197d40e58d0dfdc8f55ab72d Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerRescueNegativeTestJSON-685700080-project Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 could not be found. Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1830271f-4c7c-4e75-9170-db188cfc0b75'} Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 could not be found. Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 could not be found. Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:30.048086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 could not be found. Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:14:30.052481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] Returning 404 to user: Instance 1830271f-4c7c-4e75-9170-db188cfc0b75 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:14:30.062499 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-836d0a75-f04b-46da-9b28-8a976b63a9ac tempest-ServerRescueNegativeTestJSON-685700080 tempest-ServerRescueNegativeTestJSON-685700080-project] 10.222.0.16 "GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75" status: 404 len: 111 microversion: 2.1 time: 0.071024 Oct 28 10:14:30.063139 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2591/5181] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:29 2022] GET /compute/v2.1/servers/1830271f-4c7c-4e75-9170-db188cfc0b75 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:14:30.926642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:30.928786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:30.944090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:30.944924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:30.946001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:30.949528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:30.950223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:30.950828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:31.240073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:31.247792 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9027504b-f3e1-40d0-8606-c9db5ca24740 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1515 microversion: 2.1 time: 0.334088 Oct 28 10:14:31.248377 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2591/5182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:30 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1515 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:32.275302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:32.275915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:32.292364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:32.292872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:32.295372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:32.297390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:32.298812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:32.300426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:32.836513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:32.847044 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e94f1792-9122-407d-8629-1d98a1bc2bb0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1521 microversion: 2.1 time: 0.576065 Oct 28 10:14:32.861963 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2592/5183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:32 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1521 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:33.872734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:33.873388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:33.887678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:33.888183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:33.888634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:33.889391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:33.889850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:33.890284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:34.538501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:34.549889 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-924b4ea1-31cb-4483-8bff-8bc6032256ec tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1521 microversion: 2.1 time: 0.678847 Oct 28 10:14:34.553110 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2592/5184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:33 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1521 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:35.575187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:35.575825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:35.593027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:35.593804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:35.593965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:35.599998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:35.600496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:35.600983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:36.491394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:36.491903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:36.502807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:36.514289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:36.515027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:36.515911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:36.516494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:36.517640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:36.581859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:36.609729 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec81330f-abd6-49b6-80b0-96d036dcf727 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1521 microversion: 2.1 time: 1.038633 Oct 28 10:14:36.616999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2593/5185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:35 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1521 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:36.640770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:14:36.720578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:36.816063 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ac61e7a-bab3-49fa-b467-619fc22aa97c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 204 len: 0 microversion: 2.42 time: 0.695559 Oct 28 10:14:36.820007 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2593/5186] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:14:36 2022] DELETE /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 10:14:36.830276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:36.830907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:36.844443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:36.845239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:36.845524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:36.851897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:36.852393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:36.852853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:37.638278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:37.639002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:37.653193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:37.653448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:37.653896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:37.668315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:37.668823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:37.669325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:37.719357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:37.737104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:37.739084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:37.745272 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b3ac071-5c80-4b89-90dd-b2db95508d5f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2957 microversion: 2.42 time: 0.923188 Oct 28 10:14:37.753899 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2594/5187] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:36 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2957 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:38.206450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:38.222101 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8d1d8bfe-eb6c-48b2-a8bc-719ba043a6f0 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1521 microversion: 2.1 time: 0.588527 Oct 28 10:14:38.222712 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2594/5188] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:37 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1521 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:38.774574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:38.775324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:38.790893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:38.791518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:38.792074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:38.793204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:38.793804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:38.794369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:39.232191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:39.254915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:39.256196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:39.256851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:39.266033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:39.267826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0bb57f73-9c7d-4d37-a4ff-6a8222906db7 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2957 microversion: 2.42 time: 0.497738 Oct 28 10:14:39.269824 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2595/5189] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:38 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2957 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:39.296312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:39.297060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:39.300680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:39.309870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:39.310657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:39.311285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:39.731271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:39.758824 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c59b09a8-f54b-4ab3-a410-df899d91c419 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1521 microversion: 2.1 time: 0.509632 Oct 28 10:14:39.762640 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2595/5190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:39 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1521 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:40.301479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:40.302292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:40.319124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:40.319789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:40.320261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:40.321088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:40.321805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:40.322413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:40.452701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-70d4bb92-6b67-4cfa-b20a-8936452b7104 req-a41a581b-9743-4ada-9da4-8862a32517b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280448cc-7c94-4fea-a8d4-f9572147a5f7", "name": "network-vif-plugged", "status": "completed", "tag": "322cb1f5-16af-4cf4-9da0-1cefc37882fe"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:40.474233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-70d4bb92-6b67-4cfa-b20a-8936452b7104 req-a41a581b-9743-4ada-9da4-8862a32517b7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:40.477360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-70d4bb92-6b67-4cfa-b20a-8936452b7104 req-a41a581b-9743-4ada-9da4-8862a32517b7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:40.477910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-70d4bb92-6b67-4cfa-b20a-8936452b7104 req-a41a581b-9743-4ada-9da4-8862a32517b7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:40.517160 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-70d4bb92-6b67-4cfa-b20a-8936452b7104 req-a41a581b-9743-4ada-9da4-8862a32517b7 service nova] Creating event network-vif-plugged:322cb1f5-16af-4cf4-9da0-1cefc37882fe for instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 on n-h2-zed-1 Oct 28 10:14:40.535177 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-70d4bb92-6b67-4cfa-b20a-8936452b7104 req-a41a581b-9743-4ada-9da4-8862a32517b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087360 Oct 28 10:14:40.536016 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2596/5191] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:14:40.788188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:40.789195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:40.799528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:40.809737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:40.810467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:40.811420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:40.812063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:40.812691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:41.348562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:41.362502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc3204c1-b353-4bba-8f85-eb2c6f01d96e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1521 microversion: 2.1 time: 0.579094 Oct 28 10:14:41.389325 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2597/5192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:40 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1521 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:41.793513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:41.838413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:41.848158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:41.850423 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a103b3a-9a84-406e-81e4-0982990677db tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2957 microversion: 2.42 time: 1.552394 Oct 28 10:14:41.877869 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2596/5193] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:40 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2957 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:42.396519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:42.397188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:42.437447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:42.437969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:42.439043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:42.440118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:42.440550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:42.452241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:42.884716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:42.885497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:42.922060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:42.922986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:42.925738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:42.926663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:42.927244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:42.927788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:43.250550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:43.259915 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-666a025b-b8bd-42e1-9b43-0ab5de786f2b tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1521 microversion: 2.1 time: 0.868432 Oct 28 10:14:43.274583 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2598/5194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:42 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1521 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:43.612641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:43.635726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:43.638662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:43.640144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56d93f1f-7fcf-433e-9e41-42f62990279c tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2915 microversion: 2.42 time: 0.760202 Oct 28 10:14:43.640866 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2597/5195] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:42 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2915 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:14:43.835781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-76b76e58-33ad-4be7-a772-864348de79c3 req-9c691f65-e7c6-4f2b-a9b4-0265b957b6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-unplugged", "status": "completed", "tag": "de2afbc8-eb77-48b4-a449-9c49dee3933e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:43.850931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-76b76e58-33ad-4be7-a772-864348de79c3 req-9c691f65-e7c6-4f2b-a9b4-0265b957b6f3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:43.851700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-76b76e58-33ad-4be7-a772-864348de79c3 req-9c691f65-e7c6-4f2b-a9b4-0265b957b6f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:43.852132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-76b76e58-33ad-4be7-a772-864348de79c3 req-9c691f65-e7c6-4f2b-a9b4-0265b957b6f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:43.880505 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-76b76e58-33ad-4be7-a772-864348de79c3 req-9c691f65-e7c6-4f2b-a9b4-0265b957b6f3 service nova] Creating event network-vif-unplugged:de2afbc8-eb77-48b4-a449-9c49dee3933e for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:43.905866 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-76b76e58-33ad-4be7-a772-864348de79c3 req-9c691f65-e7c6-4f2b-a9b4-0265b957b6f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.077356 Oct 28 10:14:43.907830 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2599/5196] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:44.304802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:44.307112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:44.320244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:44.320829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:44.321353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:44.322124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:44.322646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:44.323134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:44.658855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-056e0c88-7162-42c2-8a26-2f3671e223ca req-c72c2388-d60d-4d59-b103-d8b934600972 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-deleted", "tag": "4077fb51-e3aa-4216-aa06-7e391c67c8a3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:44.682068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-056e0c88-7162-42c2-8a26-2f3671e223ca req-c72c2388-d60d-4d59-b103-d8b934600972 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:44.684201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-056e0c88-7162-42c2-8a26-2f3671e223ca req-c72c2388-d60d-4d59-b103-d8b934600972 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:44.685432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-056e0c88-7162-42c2-8a26-2f3671e223ca req-c72c2388-d60d-4d59-b103-d8b934600972 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:44.716075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-056e0c88-7162-42c2-8a26-2f3671e223ca req-c72c2388-d60d-4d59-b103-d8b934600972 service nova] Creating event network-vif-deleted:4077fb51-e3aa-4216-aa06-7e391c67c8a3 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:44.754671 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-056e0c88-7162-42c2-8a26-2f3671e223ca req-c72c2388-d60d-4d59-b103-d8b934600972 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101287 Oct 28 10:14:44.755187 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2600/5197] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:44.774954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:44.775679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:44.825216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:44.827012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:44.827330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:44.828011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:44.828477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:44.838822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:45.188031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:45.202371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f82bf08-e3fd-44ab-8cff-5efc756fe3a8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1506 microversion: 2.1 time: 0.908144 Oct 28 10:14:45.206073 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2598/5198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:44 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1506 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:45.231612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:45.232694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:45.243957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:45.244864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:45.246749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:45.249788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:45.269580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:45.270366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:45.541188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:45.556477 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-33ff9f72-c37e-4d53-91ba-e8295da197fb tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 200 len: 1506 microversion: 2.1 time: 0.331698 Oct 28 10:14:45.575123 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2599/5199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:45 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 1506 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:45.599242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:45.601606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:45.609349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:45.610796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:45.612464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:45.613839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:45.614551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:45.615523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:45.685508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:14:45.893777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dfbe5d2c-ded6-49cd-b459-2d9f034fa450 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 204 len: 0 microversion: 2.1 time: 0.304899 Oct 28 10:14:45.900554 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2600/5200] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:14:45 2022] DELETE /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:14:46.100951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1458858065", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7c622546-6f98-4076-8fbe-73602c743764"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:46.199893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:46.226124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:46.231775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:46.237943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7629efc-195a-4629-97b5-08589780f2de tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2755 microversion: 2.42 time: 1.474958 Oct 28 10:14:46.238405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] validate_networks() for [('7c622546-6f98-4076-8fbe-73602c743764', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:14:46.242529 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2601/5201] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:44 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2755 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:46.301954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ecf8816d-a381-4d2b-9e0e-84f7ab6dd868 req-a51025ec-471a-452b-8e03-1215b99b87fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-unplugged", "status": "completed", "tag": "215c1213-38f4-44cc-a7d1-25422a75052c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:46.319719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ecf8816d-a381-4d2b-9e0e-84f7ab6dd868 req-a51025ec-471a-452b-8e03-1215b99b87fa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:46.320222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ecf8816d-a381-4d2b-9e0e-84f7ab6dd868 req-a51025ec-471a-452b-8e03-1215b99b87fa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:46.320663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ecf8816d-a381-4d2b-9e0e-84f7ab6dd868 req-a51025ec-471a-452b-8e03-1215b99b87fa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:46.352005 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ecf8816d-a381-4d2b-9e0e-84f7ab6dd868 req-a51025ec-471a-452b-8e03-1215b99b87fa service nova] Creating event network-vif-unplugged:215c1213-38f4-44cc-a7d1-25422a75052c for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:46.362684 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ecf8816d-a381-4d2b-9e0e-84f7ab6dd868 req-a51025ec-471a-452b-8e03-1215b99b87fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064455 Oct 28 10:14:46.367738 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2602/5202] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:14:46.975851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-081b43ad-ef10-47c1-9097-adc7781759ec req-743b3ec1-c2c2-40ff-b96b-0576ff21aca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-deleted", "tag": "dfd265f1-657c-455b-be7a-5d2815a9c1a9"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:47.002768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-081b43ad-ef10-47c1-9097-adc7781759ec req-743b3ec1-c2c2-40ff-b96b-0576ff21aca7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:47.003569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-081b43ad-ef10-47c1-9097-adc7781759ec req-743b3ec1-c2c2-40ff-b96b-0576ff21aca7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:47.004169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-081b43ad-ef10-47c1-9097-adc7781759ec req-743b3ec1-c2c2-40ff-b96b-0576ff21aca7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:47.022678 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-081b43ad-ef10-47c1-9097-adc7781759ec req-743b3ec1-c2c2-40ff-b96b-0576ff21aca7 service nova] Creating event network-vif-deleted:dfd265f1-657c-455b-be7a-5d2815a9c1a9 for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:47.031009 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-081b43ad-ef10-47c1-9097-adc7781759ec req-743b3ec1-c2c2-40ff-b96b-0576ff21aca7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071815 Oct 28 10:14:47.033030 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2603/5203] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:47.272718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:47.275721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:47.286348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:47.290491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:47.291141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:47.292771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:47.294366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:47.295805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:47.604626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:14:47.605812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:14:47.606460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:14:47.607048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:14:47.607999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:14:47.629769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:47.632243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:47.632887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:47.634621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:47.637515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:47.637961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:47.685880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Getting quotas for project 93a2ed40295f44e2930a150edcbc798d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:14:47.700366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Getting quotas for user 906ed53d9d734a028b438ab998fdaaad and project 93a2ed40295f44e2930a150edcbc798d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:14:47.730372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:14:47.733929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:14:47.800934 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b23bfe0-bf47-441b-9989-8d2d57486600 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.719064 Oct 28 10:14:47.802882 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2601/5204] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:14:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:14:47.815947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-11c63cf4-2d7c-4b2b-9040-75e72b0e0165 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:47.816808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-11c63cf4-2d7c-4b2b-9040-75e72b0e0165 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:47.950374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-11c63cf4-2d7c-4b2b-9040-75e72b0e0165 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:47.962283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-11c63cf4-2d7c-4b2b-9040-75e72b0e0165 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1218 microversion: 2.1 time: 0.152394 Oct 28 10:14:47.963526 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2602/5205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:47 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1218 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:48.355874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:48.381172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:48.386873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:48.388725 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a443463e-ea1a-466a-bfa7-4c8800a8569b tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2549 microversion: 2.42 time: 1.121107 Oct 28 10:14:48.390578 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2604/5206] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:47 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2549 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:48.430645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7be146ea-86de-4a68-94d5-30e87fe0277a req-e1e2d9bd-461f-4eae-a650-b950df360e0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-unplugged", "status": "completed", "tag": "6b84c793-0c92-4ac1-beea-4590074f979a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:48.451796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7be146ea-86de-4a68-94d5-30e87fe0277a req-e1e2d9bd-461f-4eae-a650-b950df360e0a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:48.457607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7be146ea-86de-4a68-94d5-30e87fe0277a req-e1e2d9bd-461f-4eae-a650-b950df360e0a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:48.458746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7be146ea-86de-4a68-94d5-30e87fe0277a req-e1e2d9bd-461f-4eae-a650-b950df360e0a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:48.488141 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7be146ea-86de-4a68-94d5-30e87fe0277a req-e1e2d9bd-461f-4eae-a650-b950df360e0a service nova] Creating event network-vif-unplugged:6b84c793-0c92-4ac1-beea-4590074f979a for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:48.512534 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7be146ea-86de-4a68-94d5-30e87fe0277a req-e1e2d9bd-461f-4eae-a650-b950df360e0a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086659 Oct 28 10:14:48.513236 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2603/5207] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:48.988994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:48.989611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:48.998291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:48.998785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:48.999223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:48.999928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:49.000377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:49.010866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:49.145394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c37527f4-153d-42f0-9a97-632628387961 req-e3ab82dc-f400-4f32-a4f0-9f35906e65f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-deleted", "tag": "215c1213-38f4-44cc-a7d1-25422a75052c"}, {"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-deleted", "tag": "6b84c793-0c92-4ac1-beea-4590074f979a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:49.163603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c37527f4-153d-42f0-9a97-632628387961 req-e3ab82dc-f400-4f32-a4f0-9f35906e65f7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:49.164700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c37527f4-153d-42f0-9a97-632628387961 req-e3ab82dc-f400-4f32-a4f0-9f35906e65f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:49.167616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c37527f4-153d-42f0-9a97-632628387961 req-e3ab82dc-f400-4f32-a4f0-9f35906e65f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:49.196381 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c37527f4-153d-42f0-9a97-632628387961 req-e3ab82dc-f400-4f32-a4f0-9f35906e65f7 service nova] Creating event network-vif-deleted:215c1213-38f4-44cc-a7d1-25422a75052c for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:49.204337 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c37527f4-153d-42f0-9a97-632628387961 req-e3ab82dc-f400-4f32-a4f0-9f35906e65f7 service nova] Creating event network-vif-deleted:6b84c793-0c92-4ac1-beea-4590074f979a for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:49.213738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c37527f4-153d-42f0-9a97-632628387961 req-e3ab82dc-f400-4f32-a4f0-9f35906e65f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.072777 Oct 28 10:14:49.215086 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2604/5208] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:14:49.423138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:49.423847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:49.442218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:49.453713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:49.458400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:49.458865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:49.459715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:49.460177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:49.465640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:50.041979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:50.047078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:50.068864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:50.078410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:50.081373 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b04a89a-0b56-4030-8081-c4d36e68df55 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2231 microversion: 2.42 time: 0.663395 Oct 28 10:14:50.097728 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2605/5209] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:49 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2231 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:50.302302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:50.312188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-53f99a62-4926-44d5-a022-c4d8ac07853c tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1214 microversion: 2.1 time: 1.327479 Oct 28 10:14:50.316202 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2605/5210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:48 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1214 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:50.868002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-be321162-7bfb-4b27-86bf-bd5e11039dc3 req-150bacb5-2f48-422d-8337-a261e51b625f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "280448cc-7c94-4fea-a8d4-f9572147a5f7", "name": "network-vif-deleted", "tag": "322cb1f5-16af-4cf4-9da0-1cefc37882fe"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:50.904851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-be321162-7bfb-4b27-86bf-bd5e11039dc3 req-150bacb5-2f48-422d-8337-a261e51b625f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:50.905398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-be321162-7bfb-4b27-86bf-bd5e11039dc3 req-150bacb5-2f48-422d-8337-a261e51b625f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:50.905837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-be321162-7bfb-4b27-86bf-bd5e11039dc3 req-150bacb5-2f48-422d-8337-a261e51b625f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:50.948077 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-be321162-7bfb-4b27-86bf-bd5e11039dc3 req-150bacb5-2f48-422d-8337-a261e51b625f service nova] Creating event network-vif-deleted:322cb1f5-16af-4cf4-9da0-1cefc37882fe for instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 on n-h2-zed-1 Oct 28 10:14:50.967090 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-be321162-7bfb-4b27-86bf-bd5e11039dc3 req-150bacb5-2f48-422d-8337-a261e51b625f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104744 Oct 28 10:14:50.969447 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2606/5211] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:51.113872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:51.114493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:51.133995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:51.134520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:51.134973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:51.135712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:51.136190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:51.140196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:51.325826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:51.340965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:51.341990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:51.345440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:51.347941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:51.349788 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8435d065-ec72-4521-931d-2f7b0810a4f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2164 microversion: 2.42 time: 0.240846 Oct 28 10:14:51.350906 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2606/5212] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:51 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2164 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:51.372052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:51.372846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:51.373534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:51.374450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:51.375085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:51.376258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:51.540279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:51.572236 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-11446388-5a90-4654-bf3e-79b986daa62f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1276 microversion: 2.1 time: 0.232533 Oct 28 10:14:51.585290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2607/5213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:51 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1276 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:52.378992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:52.379729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:52.392648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:52.399781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:52.400259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:52.402917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:52.403847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:52.404818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:52.599656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:52.600493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:52.603945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:52.613607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:52.614595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:52.622421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:52.623301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:52.624288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:52.625052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:52.626273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:52.627307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:52.629849 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6161b8e6-eeb2-4047-b61b-75192b314a57 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 2164 microversion: 2.42 time: 0.255819 Oct 28 10:14:52.648934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2607/5214] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:52 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 2164 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:52.809665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:52.825697 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c24fee49-19b4-4867-8b96-c590664b1637 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1276 microversion: 2.1 time: 0.228868 Oct 28 10:14:52.827419 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2608/5215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:52 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1276 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:53.289740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-9fa0d2e0-d0d3-4be4-9e4a-f64932fd9b2b req-21ced579-4743-4c8d-853e-ec39ba5fbad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf383abe-8c04-42b0-a65c-a8ba1612ef5c", "name": "network-vif-deleted", "tag": "de2afbc8-eb77-48b4-a449-9c49dee3933e"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:53.344864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9fa0d2e0-d0d3-4be4-9e4a-f64932fd9b2b req-21ced579-4743-4c8d-853e-ec39ba5fbad4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:53.354192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9fa0d2e0-d0d3-4be4-9e4a-f64932fd9b2b req-21ced579-4743-4c8d-853e-ec39ba5fbad4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:53.354864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9fa0d2e0-d0d3-4be4-9e4a-f64932fd9b2b req-21ced579-4743-4c8d-853e-ec39ba5fbad4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:53.389394 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-9fa0d2e0-d0d3-4be4-9e4a-f64932fd9b2b req-21ced579-4743-4c8d-853e-ec39ba5fbad4 service nova] Creating event network-vif-deleted:de2afbc8-eb77-48b4-a449-9c49dee3933e for instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c on n-h1-zed-1 Oct 28 10:14:53.402522 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-9fa0d2e0-d0d3-4be4-9e4a-f64932fd9b2b req-21ced579-4743-4c8d-853e-ec39ba5fbad4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137103 Oct 28 10:14:53.404172 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2608/5216] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:14:53.660514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:53.661661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:53.676089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:53.679986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:53.680580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:53.682950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:53.685267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:53.687641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:53.851009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:53.851884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:53.870716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:53.873457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:53.874793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:53.877996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:53.879713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:53.881844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:54.070965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:54.093097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:54.094892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:54.101537 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70202ac1-d243-4e5a-9aa1-609fdad3d6cd tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.445673 Oct 28 10:14:54.102940 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2609/5217] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:53 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:54.750127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:54.761943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-911b6c9d-6e20-4e8e-ab3a-fdfc169bf5e1 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 0.916288 Oct 28 10:14:54.770019 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2609/5218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:53 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:55.133326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:55.134714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:55.147746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:55.148636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:55.149350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:55.150320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:55.155866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:55.157368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:55.795900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:55.795900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:55.812895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:55.817358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:55.819998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:55.821098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:55.828676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:55.829423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:55.907178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:55.929282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:55.933784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:55.948780 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b50558b0-49b1-4696-a500-b0edd3918625 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.816090 Oct 28 10:14:55.958564 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2610/5219] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:55 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:56.985682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:56.986442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:57.000311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:57.000821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:57.001331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:57.008520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:57.009660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:57.010902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:57.177830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:57.195286 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75719a7c-2c02-434c-8b25-1bc52c3b6cb2 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 1.403860 Oct 28 10:14:57.196598 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2610/5220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:55 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:14:57.655773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:57.956813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:58.157919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:58.175686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:58.181232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:58.191127 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-537fd66f-e2f5-4ffd-8c60-ae0877a26b4e tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 1.211087 Oct 28 10:14:58.194413 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2611/5221] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:56 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:14:58.226781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:58.229460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:58.244783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:14:58.259418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:58.260463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:58.261507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:58.262758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:58.263780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:58.264587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:59.229303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:14:59.229826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:14:59.251874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:59.252880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:59.256601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:59.270677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:59.271493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:59.273196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:59.335367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:59.358921 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b48cb5b9-34c0-4a31-947b-d33bbe0bd8f8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 1.142219 Oct 28 10:14:59.363318 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2611/5222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:14:58 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:14:59.452408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-39377d68-b37b-4ea6-9d18-540aca8fa2a1 req-064d0c7f-29d8-4634-92eb-1d6b888cb733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81020421-afaa-4e8c-9d6b-bf9cfd6ee618", "tag": "656e3f46-a3e9-47c1-bf49-c3261664fdae"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:14:59.468000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-39377d68-b37b-4ea6-9d18-540aca8fa2a1 req-064d0c7f-29d8-4634-92eb-1d6b888cb733 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:14:59.474510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-39377d68-b37b-4ea6-9d18-540aca8fa2a1 req-064d0c7f-29d8-4634-92eb-1d6b888cb733 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:14:59.475429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-39377d68-b37b-4ea6-9d18-540aca8fa2a1 req-064d0c7f-29d8-4634-92eb-1d6b888cb733 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:14:59.500373 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-39377d68-b37b-4ea6-9d18-540aca8fa2a1 req-064d0c7f-29d8-4634-92eb-1d6b888cb733 service nova] Creating event network-changed:656e3f46-a3e9-47c1-bf49-c3261664fdae for instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 on n-h2-zed-1 Oct 28 10:14:59.513255 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-39377d68-b37b-4ea6-9d18-540aca8fa2a1 req-064d0c7f-29d8-4634-92eb-1d6b888cb733 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065011 Oct 28 10:14:59.516765 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2612/5223] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:14:59.526726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:59.547030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:59.550330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:14:59.554119 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16a02f64-dfa0-4e0e-a8a9-e0c1b4354afb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.328787 Oct 28 10:14:59.556673 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2612/5224] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:14:59 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:15:00.393765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:00.394798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:00.409390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:00.411362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:00.414124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:00.415015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:00.416809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:00.419465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:00.587248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:00.587898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:00.602328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:00.609371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:00.610801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:00.613338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:00.613790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:00.614234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:00.758725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:00.783182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:00.790825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:00.795036 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1d7cc82-6fe9-4fb9-8028-7217a41e7c68 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.210589 Oct 28 10:15:00.798301 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2613/5225] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:00 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:15:01.830788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67d73efd-c11b-4d38-bd31-74986434b6ff tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: .version_select at 0x7fca329ca3a0>, body: {"keypair": {"name": "tempest-keypair-401478165", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHSbY5P2HoYXCEFp9U/w5IZPmHq16k6i0awT9OwfdKTBlaHiA88Eos4GOai+0cqkQ+W/ku/P+VJ3PfuXIJ4LqOCRwblgT78+wDRtPOLo3pBFD8vY5gPvP14tzooEEKow9Q=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:01.879196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-67d73efd-c11b-4d38-bd31-74986434b6ff tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:15:01.921055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-67d73efd-c11b-4d38-bd31-74986434b6ff tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:15:01.959417 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67d73efd-c11b-4d38-bd31-74986434b6ff tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.400838 Oct 28 10:15:01.961135 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2614/5226] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:15:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:15:01.972377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:01.975912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:01.988151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:01.989603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:01.990069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:01.992004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:01.992501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:01.995358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:02.163867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:02.181464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1403c6c-69db-43b5-a1d8-11803652dd86 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 1.801034 Oct 28 10:15:02.184282 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2613/5227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:00 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:02.250705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:02.277441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:02.283567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:02.288647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1164f554-b8b6-4d28-a711-edc1db81d3fb tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.324061 Oct 28 10:15:02.289357 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2615/5228] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:01 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:03.228251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:03.230397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:03.242987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:03.243697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:03.244336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:03.246809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:03.251762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:03.254236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:03.478648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1313919216", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:03.581097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] validate_networks() for [('b3be9e65-0595-44fd-a9d6-be9889a3e39c', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:15:04.174685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:15:04.175371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:15:04.176159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:15:04.176976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:15:04.177649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:15:04.189434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:04.194357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:04.195127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:04.196194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:04.197851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:04.198518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:04.281673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Getting quotas for project 513259eefe5a40a3aa16b9c611d655b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:15:04.300131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Getting quotas for user 2c1df28a9d734105b8c99def44cbebbb and project 513259eefe5a40a3aa16b9c611d655b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:15:04.355722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:15:04.367795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:15:04.520008 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d6a78d9-c284-4948-aae5-e02be8146732 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.227674 Oct 28 10:15:04.525535 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2616/5229] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:15:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:15:04.535850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:04.537043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:04.552811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:04.568690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:04.572823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:04.573622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:04.579704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:04.582616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:04.591116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:04.621703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad58d0a3-eff2-4e8c-b576-43a5aa7f6a32 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 1.402701 Oct 28 10:15:04.622517 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2614/5230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:03 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:04.637083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a2214d8-2aa6-4dc6-9cb0-ee5fda3b0204 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:04.639609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a2214d8-2aa6-4dc6-9cb0-ee5fda3b0204 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:04.833174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:04.860860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:04.868462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:04.874381 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-df5a7e0a-10bf-4348-abae-9a507851440f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.345193 Oct 28 10:15:04.880983 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2617/5231] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:04 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:05.025686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a2214d8-2aa6-4dc6-9cb0-ee5fda3b0204 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:05.037944 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a2214d8-2aa6-4dc6-9cb0-ee5fda3b0204 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1217 microversion: 2.1 time: 0.412034 Oct 28 10:15:05.039944 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2615/5232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:04 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1217 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:05.649180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:05.649814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:05.660615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:05.670477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:05.671304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:05.672475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:05.673184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:05.673809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:05.906784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:05.907400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:05.920428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:05.920959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:05.921413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:05.931211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:05.932095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:05.932628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:05.938235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:06.125796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:06.138270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:06.150679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:06.152285 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b8c1e6b-6f0a-40ac-8bb8-1c39f0bfa0a0 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.249494 Oct 28 10:15:06.153416 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2616/5233] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:05 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:06.171362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:06.173006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:06.204300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:06.205695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:06.206347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:06.207243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:06.207877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:06.208479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:06.715655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:06.724115 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-755597f6-798c-4cba-87ac-5318efb97f68 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1269 microversion: 2.1 time: 0.569449 Oct 28 10:15:06.731987 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2617/5234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:06 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1269 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:07.184048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:07.184735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:07.198991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:07.213902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:07.214700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:07.215642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:07.221692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:07.226840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:07.262640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:07.271530 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee5eaf4b-df9b-4366-84c1-fc8187c0b76e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 1.627295 Oct 28 10:15:07.272129 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2618/5235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:05 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:07.747868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:07.748828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:07.761522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:07.765215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:07.766024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:07.768383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:07.771746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:07.772499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:07.865699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:07.877268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:07.878730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:07.879959 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8efab3a6-03c6-45c6-a97a-6afd097f8da2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.700173 Oct 28 10:15:07.897800 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2618/5236] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:07 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:15:08.300792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:08.301562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:08.316627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:08.319159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:08.319995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:08.323140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:08.323869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:08.324606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:08.424728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:08.433303 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94c3d69b-299a-44e1-ad52-e28a703545a5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1275 microversion: 2.1 time: 0.689111 Oct 28 10:15:08.444432 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2619/5237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:07 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1275 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:08.852756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1032605946", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21470466-36a9-45e2-955b-c7288f1075a0"}], "security_groups": [{"name": "tempest-securitygroup--609364060"}], "key_name": "tempest-keypair-401478165", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:09.232310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] validate_networks() for [('21470466-36a9-45e2-955b-c7288f1075a0', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:15:10.141058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:10.155194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-630a9d76-480b-4c6c-bb0d-777f0d6a4b1a tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 1.858520 Oct 28 10:15:10.158252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2619/5238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:08 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:10.170899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:10.172356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:10.181769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:10.182530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:10.183487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:10.186419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:10.188988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:10.202204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:10.465769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:15:10.466253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:15:10.466658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:15:10.467072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:15:10.467486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:15:10.503050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:10.504065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:10.504681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:10.505670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:10.508142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:10.508777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:10.591097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:15:10.603459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:15:10.668704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:15:10.671516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:15:10.819332 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70599327-7e0f-4b69-814c-c8719f11adfa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.970917 Oct 28 10:15:10.829922 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2620/5239] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:15:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 1982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:15:10.835109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:10.835942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:10.854163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:10.854942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:10.855553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:10.856471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:10.857131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:10.857733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:11.034838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:11.054151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:11.056687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:11.058409 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-301d6b1c-d6a7-40ea-a970-fff65f44ea0a tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.898873 Oct 28 10:15:11.066621 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2620/5240] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:10 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:11.080618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-315d3d54-0907-475f-ad30-53168ac46ef2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:11.081553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-315d3d54-0907-475f-ad30-53168ac46ef2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:11.257135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-315d3d54-0907-475f-ad30-53168ac46ef2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:11.270104 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-315d3d54-0907-475f-ad30-53168ac46ef2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1241 microversion: 2.1 time: 0.196074 Oct 28 10:15:11.274053 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2621/5241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:11 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1241 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:11.285635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:11.286480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:11.305853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:11.308182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:11.310669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:11.313455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:11.316551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:11.317599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:11.556418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:11.565832 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6e4de47f-4e3f-4bad-a00c-86836a13dd29 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.734546 Oct 28 10:15:11.577272 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2621/5242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:10 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:12.096897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:12.097545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:12.123656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:12.124156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:12.124603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:12.135119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:12.135824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:12.136294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:12.231904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:12.242736 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-05a833f5-17b4-4243-8439-4b25f170a80f tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 0.967405 Oct 28 10:15:12.248320 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2622/5243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:11 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:12.284275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:12.296806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:12.300896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:12.302212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:12.303171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:12.306725 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6ea9d6d7-ddd4-4a38-92bb-9a8b60d833c2 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.215299 Oct 28 10:15:12.309925 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2622/5244] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:12 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:15:12.313678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:12.324466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:12.333022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:12.334234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:12.340498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:12.344999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:12.601008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:12.601637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:12.616763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:12.617217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:12.630877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:12.633392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:12.634554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:12.635453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:12.804171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:12.830233 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d48dcd28-f823-48ac-a575-0ce9f6d79b20 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1237 microversion: 2.1 time: 0.533499 Oct 28 10:15:12.831670 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2623/5245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:12 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1237 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:13.272093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:13.272985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:13.283853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:13.285627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:13.287494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:13.288863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:13.290283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:13.291031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:13.390782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:13.408166 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9772cef3-0f43-49eb-87a9-415992ef3eba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.804575 Oct 28 10:15:13.408869 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2623/5246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:12 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:13.425485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:13.431577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:13.451712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:13.452285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:13.452733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:13.458040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:13.460952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:13.462364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:13.612690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:13.627336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:13.628783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:13.634272 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffa792ba-88d9-4fe9-a40b-a1ce1a56a0b6 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.219893 Oct 28 10:15:13.634871 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2624/5247] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:13 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:13.645616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-3bcb6c9d-c502-40d0-afed-9f5bc4168b0d req-9f030c1e-8bc6-415f-83b9-b82aba7350b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81020421-afaa-4e8c-9d6b-bf9cfd6ee618", "name": "network-vif-plugged", "status": "completed", "tag": "656e3f46-a3e9-47c1-bf49-c3261664fdae"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:13.673763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3bcb6c9d-c502-40d0-afed-9f5bc4168b0d req-9f030c1e-8bc6-415f-83b9-b82aba7350b1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:13.674362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3bcb6c9d-c502-40d0-afed-9f5bc4168b0d req-9f030c1e-8bc6-415f-83b9-b82aba7350b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:13.674822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3bcb6c9d-c502-40d0-afed-9f5bc4168b0d req-9f030c1e-8bc6-415f-83b9-b82aba7350b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:13.714298 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-3bcb6c9d-c502-40d0-afed-9f5bc4168b0d req-9f030c1e-8bc6-415f-83b9-b82aba7350b1 service nova] Creating event network-vif-plugged:656e3f46-a3e9-47c1-bf49-c3261664fdae for instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 on n-h2-zed-1 Oct 28 10:15:13.720212 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-3bcb6c9d-c502-40d0-afed-9f5bc4168b0d req-9f030c1e-8bc6-415f-83b9-b82aba7350b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081964 Oct 28 10:15:13.721098 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2625/5248] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:13.858487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:13.859231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:13.875116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:13.875618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:13.876137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:13.885827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:13.886341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:13.886948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:13.892380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:14.111456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:14.128190 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96193315-5675-451a-8d37-011ee777b3de tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1299 microversion: 2.1 time: 0.274076 Oct 28 10:15:14.141099 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2626/5249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:13 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1299 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:14.148193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-809e2679-1d00-438e-8ce2-ec872f99e568 req-8706c677-2a08-4a3c-b9dd-a5afdd566224 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbb2c02-f4e1-4ce9-85dc-6030582e257e", "tag": "74651f42-f412-4bde-9914-23e1b529beb7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:14.168471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-809e2679-1d00-438e-8ce2-ec872f99e568 req-8706c677-2a08-4a3c-b9dd-a5afdd566224 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:14.169424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-809e2679-1d00-438e-8ce2-ec872f99e568 req-8706c677-2a08-4a3c-b9dd-a5afdd566224 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:14.170251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-809e2679-1d00-438e-8ce2-ec872f99e568 req-8706c677-2a08-4a3c-b9dd-a5afdd566224 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:14.188987 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-809e2679-1d00-438e-8ce2-ec872f99e568 req-8706c677-2a08-4a3c-b9dd-a5afdd566224 service nova] Creating event network-changed:74651f42-f412-4bde-9914-23e1b529beb7 for instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e on n-h1-zed-1 Oct 28 10:15:14.209806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-809e2679-1d00-438e-8ce2-ec872f99e568 req-8706c677-2a08-4a3c-b9dd-a5afdd566224 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050660 Oct 28 10:15:14.211019 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2627/5250] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:14.435635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:14.437032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:14.458075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:14.459698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:14.461795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:14.464482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:14.465376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:14.466074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:14.468330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:14.475195 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7df59a61-54a4-4eda-a238-975cbba8a227 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 1.206971 Oct 28 10:15:14.481462 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2624/5251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:13 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:14.668581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:14.670811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:14.680010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:14.681118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:14.681823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:14.683188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:14.683900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:14.684606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:14.771970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:14.782767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b48cc25a-b58f-46ef-97df-6ac3392908d0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.350942 Oct 28 10:15:14.783440 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2628/5252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:14.849674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:14.872936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:14.881872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:14.883352 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2bc18be9-4d2f-4e06-90ba-3bf02df303cf tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.219586 Oct 28 10:15:14.883957 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2625/5253] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:14 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:15:15.154641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:15.155437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:15.167719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:15.171247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:15.178994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:15.180673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:15.181296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:15.181842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:15.361260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:15.376985 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a46dd2af-0bc0-46e7-8f46-3750fc625f5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1299 microversion: 2.1 time: 0.225663 Oct 28 10:15:15.377905 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2629/5254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:15 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:15.512802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:15.513828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:15.536176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:15.538862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:15.541682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:15.542545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:15.543094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:15.543603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:15.810225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:15.811419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:15.818797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:15.830418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:15.831465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:15.833187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:15.833914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:15.834567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:16.223291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:16.253670 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d6fb93c-72cb-4b7d-800d-1c214f9a3baa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.426117 Oct 28 10:15:16.268929 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2630/5255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:15 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:16.295788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:16.302865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:16.336411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:16.336980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:16.337438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:16.344070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:16.344581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:16.345067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:16.474584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:16.488544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:16.495909 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aceacc58-4534-48cb-b43f-128515586e04 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1318 microversion: 2.1 time: 0.989276 Oct 28 10:15:16.499751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:16.503798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:16.506048 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2626/5256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:15 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1318 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:16.513659 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09c6fb95-5021-4142-bbc7-591e039e2f87 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.245564 Oct 28 10:15:16.514537 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2631/5257] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:16 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:16.522927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:16.524166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:16.538917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:16.539680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:16.540326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:16.541281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:16.541919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:16.542530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:16.745079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:16.788175 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-859b512a-99ad-4d8e-ba7e-65e29ced21f1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1299 microversion: 2.1 time: 0.271472 Oct 28 10:15:16.791542 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2627/5258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:16 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1299 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:17.284663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:17.285517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:17.302141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:17.303025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:17.303797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:17.304730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:17.305389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:17.306561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:17.523131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:17.525545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:17.559849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:17.571503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:17.572400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:17.575540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:17.577919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:17.580083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:17.886604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:17.895914 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-993fef3b-ec0a-47e7-9683-0424740b28d1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.615605 Oct 28 10:15:17.898762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2632/5259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:17 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:17.903794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:17.916583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:17.933858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:17.936078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:17.936778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:17.938918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:17.943116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:17.944779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:18.063985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:18.076836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:18.085036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:18.086121 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf87b6b0-55cc-4f1a-abe0-44674da66968 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1507 microversion: 2.1 time: 0.567833 Oct 28 10:15:18.086332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:18.088650 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2628/5260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:17 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1507 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:18.098631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:18.101018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:18.115126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:18.116462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:18.118721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:18.120302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-002e70e2-fec7-4060-a28a-b4b8689d1974 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.220132 Oct 28 10:15:18.120772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:18.121422 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2633/5261] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:17 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:18.122290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:18.123547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:18.159266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:18.160137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:18.171454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:18.172260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:18.172871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:18.180555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:18.181318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:18.181990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:18.560679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:18.584673 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-38293632-140f-447a-be8d-f2b6efbad815 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 0.493213 Oct 28 10:15:18.585743 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2629/5262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:18 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:18.930100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:18.930635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:19.003303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.004986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.010801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.019482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.021936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.026495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.059388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:19.079442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e5a2cb3-03a9-4eb8-b53a-3114bb60f109 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1507 microversion: 2.1 time: 0.943267 Oct 28 10:15:19.085967 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2634/5263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:18 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1507 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:19.109959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:19.122575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:19.154157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:19.156293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.161317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.161810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.169809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.175792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.176275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.414990 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2066e638-06fb-4b51-a717-5dfe63da2cda tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "PUT /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1079 microversion: 2.1 time: 0.308812 Oct 28 10:15:19.435528 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2635/5264] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:15:19 2022] PUT /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1079 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:19.447977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:19.449099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:19.462954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.463826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.464869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.469701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.470602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.471626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.619433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:19.640210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:19.652581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:19.656733 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a496e1e-14cc-4f33-a259-9292bd0e71f1 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.218929 Oct 28 10:15:19.657420 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2636/5265] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:19 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:19.675206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:19.676273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:19.689739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.692754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.693091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.694950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.695507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:19.697371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:19.939274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:19.952246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a795732b-483a-4f93-a4eb-2b6d55d5945d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 1.036335 Oct 28 10:15:19.956043 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2630/5266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:18 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:19.968210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7f5f2836-9cdf-4e13-9c5e-bd34925a67a0 req-e1d81bd2-c0c4-4d72-88f5-a39dd755a16d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9399955c-6dee-411c-8c04-34ff847396e3", "tag": "cfb3fbd5-4b70-4323-b6c1-9950692f3ef8"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:19.995094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f5f2836-9cdf-4e13-9c5e-bd34925a67a0 req-e1d81bd2-c0c4-4d72-88f5-a39dd755a16d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:19.997670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f5f2836-9cdf-4e13-9c5e-bd34925a67a0 req-e1d81bd2-c0c4-4d72-88f5-a39dd755a16d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.001179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f5f2836-9cdf-4e13-9c5e-bd34925a67a0 req-e1d81bd2-c0c4-4d72-88f5-a39dd755a16d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.023377 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7f5f2836-9cdf-4e13-9c5e-bd34925a67a0 req-e1d81bd2-c0c4-4d72-88f5-a39dd755a16d service nova] Creating event network-changed:cfb3fbd5-4b70-4323-b6c1-9950692f3ef8 for instance 9399955c-6dee-411c-8c04-34ff847396e3 on n-h2-zed-1 Oct 28 10:15:20.036422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7f5f2836-9cdf-4e13-9c5e-bd34925a67a0 req-e1d81bd2-c0c4-4d72-88f5-a39dd755a16d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077905 Oct 28 10:15:20.038571 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2631/5267] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:20.058236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:20.063017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:20.077126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:20.077749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.079962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.082684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:20.083421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.084099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.332167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:20.347179 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d391a9cb-9c7a-46c5-8d42-2b1c093ba596 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1505 microversion: 2.1 time: 0.686403 Oct 28 10:15:20.347804 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2637/5268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:19 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1505 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:20.379322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:20.379946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:20.393439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:20.393850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.394454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.396746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:20.397576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.398143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.541455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:20.554282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:20.554994 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d516e9c-b78f-424b-b13e-c8e08897320a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 0.508267 Oct 28 10:15:20.557197 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2632/5269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:20 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:20.650299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:20.687944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:20.689535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:20.711547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:20.714283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.715229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.716231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:20.716990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.718955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.882477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:20.900637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:20.906399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:20.913184 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea232dc9-4c95-4610-b73d-dfd9c20aced8 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1604 microversion: 2.42 time: 0.225096 Oct 28 10:15:20.914404 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2633/5270] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:20 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1604 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:20.982972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:20.983852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:20.995869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:20.996522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:20.997148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:20.997986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.001882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.002473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.061384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:21.088490 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7280b4b-ef59-4e03-b451-56cc8eed2a16 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1505 microversion: 2.1 time: 0.701692 Oct 28 10:15:21.088945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:21.089073 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2638/5271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:20 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1505 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:21.101266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:21.109645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:21.146205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.146841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.147160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.150745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.156794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.159816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.267533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:21.331900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:21.346823 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe975cef-11d0-4d2d-bfcc-968ee3b0db18 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.367572 Oct 28 10:15:21.348346 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-016fad71-7fb8-4ce7-ade4-6b490c18592e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "PUT /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1081 microversion: 2.1 time: 0.251969 Oct 28 10:15:21.362516 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2634/5272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:20 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:21.363942 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2639/5273] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:15:21 2022] PUT /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1081 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:21.389880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:21.390863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:21.406957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.407674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.408381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.409118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.409757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.410442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.582760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:21.586769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:21.587415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:21.597408 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9df491f7-a28d-4968-9dc9-d3744f1b7233 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1507 microversion: 2.1 time: 0.224939 Oct 28 10:15:21.597408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2635/5274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:21 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1507 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:21.606610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.607319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.608680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.610554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.612560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.613336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.625123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:21.626252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:21.639927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.640862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.642788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.643801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.649801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.651751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.867620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:21.877660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c82c3e5-096c-4ed2-8e71-c8dcefaca859 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1507 microversion: 2.1 time: 0.259011 Oct 28 10:15:21.878546 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2636/5275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:21 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1507 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:21.901806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:21.902654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:21.910276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.911063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.913584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.914933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:21.915642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:21.916311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:21.968070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:15:22.088936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee90c2f5-1f54-44ae-967a-36cbb43d2586 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 204 len: 0 microversion: 2.1 time: 0.189941 Oct 28 10:15:22.097163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2637/5276] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:15:21 2022] DELETE /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:15:22.133684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:22.134443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:22.158458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.159039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.159507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.160271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.160795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.161211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.236320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.237065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.237923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.238812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lazy-loading 'fault' on Instance uuid bf383abe-8c04-42b0-a65c-a8ba1612ef5c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:15:22.296714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:22.316093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:22.318623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a40eaa5eefa439bb590a7511814f61c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adb7eccfe81e41db93216cb0441db339', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:22.320566 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7eaeb719-8016-48bd-bc32-6a3ed139aa26 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 200 len: 1609 microversion: 2.42 time: 0.226815 Oct 28 10:15:22.331397 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2638/5277] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:22 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 1609 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:15:22.331397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:22.331397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:22.335559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.336200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.336504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.343846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.343846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.343846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.376052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:15:22.467621 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.compute.api [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Instance is already in deleting state, ignoring this request Oct 28 10:15:22.468689 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0afc2c37-3a84-411b-9b23-0da51b8f76f6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 204 len: 0 microversion: 2.1 time: 0.146409 Oct 28 10:15:22.469678 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2639/5278] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:15:22 2022] DELETE /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:15:22.478870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:22.479664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:22.487724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.488399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.489249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.490069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.490741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.491276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.652206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:22.686389 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0172ceed-e60e-4381-889f-158ea2b59991 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 1.110489 Oct 28 10:15:22.720931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2640/5279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:21 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:22.720931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:22.720931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:22.721531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.721993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.722527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.723725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:22.726299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:22.726299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:22.766127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:22.782034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc1ed1c6-0fb0-4003-a3ea-78066e562434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.307641 Oct 28 10:15:22.785011 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2640/5280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:22 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:23.142476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:23.156136 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-395c58b7-19ba-47a5-9c2a-4e553918b064 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1513 microversion: 2.1 time: 0.446302 Oct 28 10:15:23.156737 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2641/5281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:22 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1513 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:23.352125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:23.352856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:23.369897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:23.370652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:23.371701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:23.372821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:23.374158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:23.375708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:23.399042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-3d941631-a904-43d1-ba18-3a9c759d52ed req-b206f129-ca9e-4f4d-9039-56b4f4a663ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbb2c02-f4e1-4ce9-85dc-6030582e257e", "name": "network-vif-plugged", "status": "completed", "tag": "74651f42-f412-4bde-9914-23e1b529beb7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:23.417895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3d941631-a904-43d1-ba18-3a9c759d52ed req-b206f129-ca9e-4f4d-9039-56b4f4a663ce service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:23.418459 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] HTTP exception thrown: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:23.419449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3d941631-a904-43d1-ba18-3a9c759d52ed req-b206f129-ca9e-4f4d-9039-56b4f4a663ce service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:23.420073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3d941631-a904-43d1-ba18-3a9c759d52ed req-b206f129-ca9e-4f4d-9039-56b4f4a663ce service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Request method failure captured: Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c HTTP/1.1 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6o6hBjbRbQHQqPoNMTYjkwaCcbK_CpMalR5PUV6c6Abw77GUrxPJi-ocIzX0iSrHIaqpy5BwgonIzq6a32vGzxpL8llc2wJc_lbCYdUn6mjk7Sgjt7nV_QEd9SibuN3vCY6Xgbii2wmMAy9H6oDv9Erso5-GbF253bHrsikmbuNF1M Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: adb7eccfe81e41db93216cb0441db339 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adb7eccfe81e41db93216cb0441db339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adb7eccfe81e41db93216cb0441db339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adb7eccfe81e41db93216cb0441db339", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adb7eccfe81e41db93216cb0441db339"}]}] Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: adb7eccfe81e41db93216cb0441db339 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TaggedBootDevicesTest_v242-1494965708-project Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 0a40eaa5eefa439bb590a7511814f61c Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1494965708-project Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'bf383abe-8c04-42b0-a65c-a8ba1612ef5c'} Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:23.420804 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Returning 404 to user: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:23.427589 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-93081588-c719-4649-9071-d1c99f047398 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 404 len: 111 microversion: 2.42 time: 0.076478 Oct 28 10:15:23.432563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2641/5282] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:23 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:15:23.441458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:23.449942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-13fd4723-b905-48f4-9b1d-1e88dd5ef89f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '.version_select at 0x7fca3ba23d30>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:23.451887 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-3d941631-a904-43d1-ba18-3a9c759d52ed req-b206f129-ca9e-4f4d-9039-56b4f4a663ce service nova] Creating event network-vif-plugged:74651f42-f412-4bde-9914-23e1b529beb7 for instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e on n-h1-zed-1 Oct 28 10:15:23.462077 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-3d941631-a904-43d1-ba18-3a9c759d52ed req-b206f129-ca9e-4f4d-9039-56b4f4a663ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068857 Oct 28 10:15:23.463053 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2642/5283] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:23.502454 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-13fd4723-b905-48f4-9b1d-1e88dd5ef89f tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-209114133" status: 204 len: 0 microversion: 2.42 time: 0.067458 Oct 28 10:15:23.503041 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2642/5284] 10.222.0.16 () {60 vars in 1259 bytes} [Fri Oct 28 10:15:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-209114133 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 28 10:15:23.734581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:23.736223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:23.747769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:23.748741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:23.750723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:23.751690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:23.752342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:23.753161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:23.812628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:23.813943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:23.828521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:23.829463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:23.830140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:23.831090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:23.833680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:23.834488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:24.335353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:24.352096 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29b6b9a8-0f36-41d8-a5f4-6d538a273364 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.544103 Oct 28 10:15:24.356390 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2643/5285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:23 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:24.371202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:24.378858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:24.399277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:24.400184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:24.401686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:24.405249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:24.407173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:24.408483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:24.798096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:24.811765 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a6180a0f-50dd-4044-af4e-3f0ab04c2230 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1513 microversion: 2.1 time: 0.453324 Oct 28 10:15:24.814812 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2644/5286] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:24 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1513 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:25.200850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:25.213041 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a16dc7c-202b-49b4-a469-07a68743eb7c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 1.480004 Oct 28 10:15:25.214061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2643/5287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:23 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:25.379467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:25.380197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:25.393694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:25.395135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:25.395879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:25.397944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:25.399706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:25.400331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:25.853077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:25.854057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:25.879060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:25.880597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:25.881284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:25.882803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:25.883504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:25.884109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:26.162464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:26.174149 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d588f50c-5409-4d1d-aa83-8b1be383073a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1317 microversion: 2.1 time: 0.799186 Oct 28 10:15:26.174750 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2645/5288] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:25 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1317 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:26.242163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:26.243209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:26.256052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:26.257415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:26.259150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:26.261612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:26.262096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:26.263905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:26.298501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:26.314397 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17941b5d-9516-4f11-85a0-23c35228dec7 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1513 microversion: 2.1 time: 0.472400 Oct 28 10:15:26.315052 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2644/5289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:25 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1513 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:26.728474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:26.742513 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37b077b0-8606-4f8f-ae73-cbab1fd268c7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 0.504439 Oct 28 10:15:26.746112 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2646/5290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:26 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:27.201351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:27.201962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:27.215284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:27.216329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:27.216329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:27.224078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:27.224602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:27.225297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:27.340992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:27.341980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:27.350088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:27.357275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:27.358876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:27.359890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:27.360832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:27.362336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:27.458695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:27.482660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '906ed53d9d734a028b438ab998fdaaad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a2ed40295f44e2930a150edcbc798d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:27.489264 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bcf26aa0-b758-4f09-b3a7-690a3613ba38 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.290442 Oct 28 10:15:27.490135 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2645/5291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:27 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:27.503920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23a1f01a-2fcf-4cf4-bc7b-810f80601899 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 200 len: 1471 microversion: 2.1 time: 0.167872 Oct 28 10:15:27.505365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7c17c148-c1d6-415e-8de5-7c8c75ccc3ae req-c457fbaf-2800-4040-9f3d-c631cc1897a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81020421-afaa-4e8c-9d6b-bf9cfd6ee618", "name": "network-vif-deleted", "tag": "656e3f46-a3e9-47c1-bf49-c3261664fdae"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:27.506112 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2647/5292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:27 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:27.541448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c17c148-c1d6-415e-8de5-7c8c75ccc3ae req-c457fbaf-2800-4040-9f3d-c631cc1897a3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:27.546113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c17c148-c1d6-415e-8de5-7c8c75ccc3ae req-c457fbaf-2800-4040-9f3d-c631cc1897a3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:27.546746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c17c148-c1d6-415e-8de5-7c8c75ccc3ae req-c457fbaf-2800-4040-9f3d-c631cc1897a3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:27.564179 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7c17c148-c1d6-415e-8de5-7c8c75ccc3ae req-c457fbaf-2800-4040-9f3d-c631cc1897a3 service nova] Creating event network-vif-deleted:656e3f46-a3e9-47c1-bf49-c3261664fdae for instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 on n-h2-zed-1 Oct 28 10:15:27.576031 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7c17c148-c1d6-415e-8de5-7c8c75ccc3ae req-c457fbaf-2800-4040-9f3d-c631cc1897a3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083300 Oct 28 10:15:27.576853 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2646/5293] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:27.724632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2025496149", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:27.774614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:27.775330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:27.787275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:27.787770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:27.788212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:27.790919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:27.796137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:27.799134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:27.826059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] validate_networks() for [('b3be9e65-0595-44fd-a9d6-be9889a3e39c', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:15:28.166721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:28.246087 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-021e0046-ad04-4dec-8a7d-a61fc343667e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 0.474230 Oct 28 10:15:28.251231 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2647/5294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:27 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:28.318156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-450458933", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7982538e-1355-490d-b839-dee12d07fb8f"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:28.398643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] validate_networks() for [('7982538e-1355-490d-b839-dee12d07fb8f', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:15:28.829872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:15:28.830940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:15:28.831684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:15:28.832344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:15:28.833415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:15:28.835923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:28.851364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:28.851860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:28.852566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:28.853688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:28.854393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:28.855121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:28.881363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Getting quotas for project 513259eefe5a40a3aa16b9c611d655b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:15:28.888512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Getting quotas for user 2c1df28a9d734105b8c99def44cbebbb and project 513259eefe5a40a3aa16b9c611d655b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:15:28.910883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:15:28.913716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:15:28.974985 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d31ba97-455d-41a0-a4c3-202b1967664b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.257267 Oct 28 10:15:28.976370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2648/5295] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:15:28.982051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:28.983501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 81020421-afaa-4e8c-9d6b-bf9cfd6ee618] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:28.991204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:28.992205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:28.993207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:28.994153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:28.994824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:28.995433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.032413 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] HTTP exception thrown: Instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 could not be found. Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Request method failure captured: Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 HTTP/1.1 Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sZeSASqIaQxlUBgviXbpAkb2wjGKG9NzzKtj0mCrBmoLZdUQ-TItsI2KSagmhSOAjSpfLUR-jDjFT6KmuMhi6UAZtBYyxdwBVHYX_GBjS3UXef5Cbl7Mihk2hULpIuWHYo--XDHsi705KI1FjlEBdgWcgjr-b0BAdvUlw_AIax9jo Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93a2ed40295f44e2930a150edcbc798d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93a2ed40295f44e2930a150edcbc798d"}]}] Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 906ed53d9d734a028b438ab998fdaaad Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 could not be found. Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '81020421-afaa-4e8c-9d6b-bf9cfd6ee618'} Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 could not be found. Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 could not be found. Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:29.035161 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.040819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:29.040819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:29.040819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:29.040819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:29.040819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:29.040819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 could not be found. Oct 28 10:15:29.040819 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.043134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Returning 404 to user: Instance 81020421-afaa-4e8c-9d6b-bf9cfd6ee618 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:29.044744 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b96d8b5-60c8-4f28-978c-ad2bdfebb6a6 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618" status: 404 len: 111 microversion: 2.1 time: 0.066948 Oct 28 10:15:29.045950 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2649/5296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:28 2022] GET /compute/v2.1/servers/81020421-afaa-4e8c-9d6b-bf9cfd6ee618 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:15:29.052590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f51abcf7-09db-4867-9a0d-1a4e0c645419 req-12d60278-a84b-494c-b02c-8a31d144d49d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9399955c-6dee-411c-8c04-34ff847396e3", "name": "network-vif-plugged", "status": "completed", "tag": "cfb3fbd5-4b70-4323-b6c1-9950692f3ef8"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:29.065915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f51abcf7-09db-4867-9a0d-1a4e0c645419 req-12d60278-a84b-494c-b02c-8a31d144d49d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:29.066733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f51abcf7-09db-4867-9a0d-1a4e0c645419 req-12d60278-a84b-494c-b02c-8a31d144d49d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:29.067359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f51abcf7-09db-4867-9a0d-1a4e0c645419 req-12d60278-a84b-494c-b02c-8a31d144d49d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.086113 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f51abcf7-09db-4867-9a0d-1a4e0c645419 req-12d60278-a84b-494c-b02c-8a31d144d49d service nova] Creating event network-vif-plugged:cfb3fbd5-4b70-4323-b6c1-9950692f3ef8 for instance 9399955c-6dee-411c-8c04-34ff847396e3 on n-h2-zed-1 Oct 28 10:15:29.091876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f51abcf7-09db-4867-9a0d-1a4e0c645419 req-12d60278-a84b-494c-b02c-8a31d144d49d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044335 Oct 28 10:15:29.093432 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2650/5297] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:29.099763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fea5f0ee-e2c3-4b54-989f-4b6105ad599b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:29.101573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fea5f0ee-e2c3-4b54-989f-4b6105ad599b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:29.708663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:15:29.709877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:15:29.710469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:15:29.711108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:15:29.711791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:15:29.733623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:29.735008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:29.735691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.736658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:29.737405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:29.738086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.772213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Getting quotas for project 72af6d56f0b5448fb4b98075f4d6be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:15:29.779464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fea5f0ee-e2c3-4b54-989f-4b6105ad599b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:29.780071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Getting quotas for user a0c3eaac6b4f4b2685de2d234573e33a and project 72af6d56f0b5448fb4b98075f4d6be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:15:29.793336 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fea5f0ee-e2c3-4b54-989f-4b6105ad599b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1217 microversion: 2.1 time: 0.693990 Oct 28 10:15:29.804948 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2651/5298] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:29 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1217 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:29.811206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:29.811206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:29.814110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:15:29.816763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:15:29.851285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:29.856640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:29.863462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.864456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:29.868643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:29.882129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.883312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c71ab86e-ef65-4bcf-925b-24dfc38b7f20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.568816 Oct 28 10:15:29.890464 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2648/5299] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:15:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:15:29.898116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:29.899255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:29.908219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:29.909227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:29.909999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.911021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:29.911846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:29.912670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:29.942207 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] HTTP exception thrown: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Request method failure captured: Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 HTTP/1.1 Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sZeSASqIaQxlUBgviXbpAkb2wjGKG9NzzKtj0mCrBmoLZdUQ-TItsI2KSagmhSOAjSpfLUR-jDjFT6KmuMhi6UAZtBYyxdwBVHYX_GBjS3UXef5Cbl7Mihk2hULpIuWHYo--XDHsi705KI1FjlEBdgWcgjr-b0BAdvUlw_AIax9jo Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93a2ed40295f44e2930a150edcbc798d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93a2ed40295f44e2930a150edcbc798d"}]}] Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 906ed53d9d734a028b438ab998fdaaad Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '280448cc-7c94-4fea-a8d4-f9572147a5f7'} Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:29.945315 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:29.950552 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:29.952318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Returning 404 to user: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:29.953518 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d01fd461-aad2-47a6-acee-99ebcef44a3e tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 404 len: 111 microversion: 2.1 time: 0.157964 Oct 28 10:15:29.954669 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2652/5300] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:15:29 2022] DELETE /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:15:29.972873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd0ec7bf-14ca-4181-bb4b-51c6fe22a0f5 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:29.973669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd0ec7bf-14ca-4181-bb4b-51c6fe22a0f5 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:30.174988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd0ec7bf-14ca-4181-bb4b-51c6fe22a0f5 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:30.183898 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd0ec7bf-14ca-4181-bb4b-51c6fe22a0f5 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1213 microversion: 2.1 time: 0.225681 Oct 28 10:15:30.199925 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2653/5301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:29 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:30.199925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:30.199925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 280448cc-7c94-4fea-a8d4-f9572147a5f7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:30.201253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.201692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.209776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.211587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.212988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.213688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.223305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:30.256997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] HTTP exception thrown: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Request method failure captured: Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 HTTP/1.1 Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sZeSASqIaQxlUBgviXbpAkb2wjGKG9NzzKtj0mCrBmoLZdUQ-TItsI2KSagmhSOAjSpfLUR-jDjFT6KmuMhi6UAZtBYyxdwBVHYX_GBjS3UXef5Cbl7Mihk2hULpIuWHYo--XDHsi705KI1FjlEBdgWcgjr-b0BAdvUlw_AIax9jo Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93a2ed40295f44e2930a150edcbc798d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93a2ed40295f44e2930a150edcbc798d"}]}] Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 906ed53d9d734a028b438ab998fdaaad Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '280448cc-7c94-4fea-a8d4-f9572147a5f7'} Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:30.261858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.267257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.267257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:30.267257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:30.267257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:30.267257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:30.267257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. Oct 28 10:15:30.267257 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.269391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Returning 404 to user: Instance 280448cc-7c94-4fea-a8d4-f9572147a5f7 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:30.274032 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b88636e8-ae34-445d-8726-468bb4390347 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7" status: 404 len: 111 microversion: 2.1 time: 0.085301 Oct 28 10:15:30.275744 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2654/5302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:30 2022] GET /compute/v2.1/servers/280448cc-7c94-4fea-a8d4-f9572147a5f7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:15:30.295224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:30.300409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:30.317704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.318605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.325309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.328275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.329051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.331754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.378028 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] HTTP exception thrown: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Request method failure captured: Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 HTTP/1.1 Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sZeSASqIaQxlUBgviXbpAkb2wjGKG9NzzKtj0mCrBmoLZdUQ-TItsI2KSagmhSOAjSpfLUR-jDjFT6KmuMhi6UAZtBYyxdwBVHYX_GBjS3UXef5Cbl7Mihk2hULpIuWHYo--XDHsi705KI1FjlEBdgWcgjr-b0BAdvUlw_AIax9jo Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93a2ed40295f44e2930a150edcbc798d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93a2ed40295f44e2930a150edcbc798d"}]}] Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 906ed53d9d734a028b438ab998fdaaad Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '96aa3db3-87cc-4a3b-859d-afbe3563a681'} Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:30.385125 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.391090 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.394913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Returning 404 to user: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:30.398102 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7e20a2c8-8a7c-4e88-a267-03ef31a2b8c4 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "DELETE /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 404 len: 111 microversion: 2.1 time: 0.112299 Oct 28 10:15:30.401309 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2655/5303] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:15:30 2022] DELETE /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:15:30.428384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:30.429389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] [instance: 96aa3db3-87cc-4a3b-859d-afbe3563a681] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:30.442005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.442835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.443394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.445504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.447199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.447815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.463557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:30.469310 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] HTTP exception thrown: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Request method failure captured: Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 HTTP/1.1 Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6sZeSASqIaQxlUBgviXbpAkb2wjGKG9NzzKtj0mCrBmoLZdUQ-TItsI2KSagmhSOAjSpfLUR-jDjFT6KmuMhi6UAZtBYyxdwBVHYX_GBjS3UXef5Cbl7Mihk2hULpIuWHYo--XDHsi705KI1FjlEBdgWcgjr-b0BAdvUlw_AIax9jo Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/93a2ed40295f44e2930a150edcbc798d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_93a2ed40295f44e2930a150edcbc798d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/93a2ed40295f44e2930a150edcbc798d"}]}] Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 93a2ed40295f44e2930a150edcbc798d Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-839135686 Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 906ed53d9d734a028b438ab998fdaaad Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiskConfigTestJSON-839135686-project Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '96aa3db3-87cc-4a3b-859d-afbe3563a681'} Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:30.471475 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:30.476897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] Returning 404 to user: Instance 96aa3db3-87cc-4a3b-859d-afbe3563a681 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:30.478817 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7fe887b-285f-4e9d-8b6e-f913100231d8 tempest-ServerDiskConfigTestJSON-839135686 tempest-ServerDiskConfigTestJSON-839135686-project] 10.222.0.16 "GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681" status: 404 len: 111 microversion: 2.1 time: 0.074830 Oct 28 10:15:30.484202 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2656/5304] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:30 2022] GET /compute/v2.1/servers/96aa3db3-87cc-4a3b-859d-afbe3563a681 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:15:30.504612 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-481d97b2-e74d-4c7e-822b-c7b6e2e2a495 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 0.603079 Oct 28 10:15:30.520938 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2649/5305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:29 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:30.820659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:30.824438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:30.838683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.841981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.843018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.844171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:30.846047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:30.846808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:30.965321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:30.974573 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b27e576a-4c1f-40d5-b49f-5fb258737b33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1269 microversion: 2.1 time: 0.159301 Oct 28 10:15:30.975987 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2657/5306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:30 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:31.206346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:31.207060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:31.220866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:31.223356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:31.224560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:31.225391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:31.226048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:31.226647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:31.531055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:31.536206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:31.554645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:31.558018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:31.561010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:31.567110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:31.568245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:31.569010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:31.955746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:31.976056 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b84304a-5f69-4362-b8c9-5a1f94d96183 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1209 microversion: 2.1 time: 0.773729 Oct 28 10:15:31.989795 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2650/5307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:31 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1209 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:32.006488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:32.008511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:32.026379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:32.028516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:32.031624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:32.032655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:32.038384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:32.039198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:32.198383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:32.265405 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b94e8b0-76cd-4f48-a002-73c8d8714ccf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1287 microversion: 2.1 time: 0.261235 Oct 28 10:15:32.266901 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2651/5308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:31 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1287 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:32.673634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:32.686139 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-609a64e8-8af5-4bbd-8c6c-e616bec8ddc5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1366 microversion: 2.1 time: 1.161713 Oct 28 10:15:32.688206 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2658/5309] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:31 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1366 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:33.019359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:33.020225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:33.027636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:33.036367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:33.037488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:33.038490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:33.039143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:33.039785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:33.268774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:33.291178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:33.291826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:33.300799 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b06881fa-672c-4a7a-8f7d-fcdaded2d5a4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1271 microversion: 2.1 time: 0.297295 Oct 28 10:15:33.304232 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2652/5310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:33 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1271 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:33.310066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:33.310896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:33.311551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:33.313063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:33.313715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:33.314317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:33.710114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:33.711002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:33.725632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:33.726405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:33.729832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:33.732703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:33.733414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:33.736541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:34.161680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:34.178900 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ea1fcc4-e4a5-444b-8f05-7bbf4e383881 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1275 microversion: 2.1 time: 0.890002 Oct 28 10:15:34.180919 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2659/5311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:33 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1275 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:34.294495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:34.314243 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f08f14df-c160-4cb3-bb4f-e4fabff37f84 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1557 microversion: 2.1 time: 0.607743 Oct 28 10:15:34.327937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2653/5312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:33 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1557 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:34.341739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:34.342251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:34.342826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:34.344222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:34.357328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:34.358372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:34.359638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:34.360634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:34.362040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:34.362292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:34.363162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:34.364447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:34.365179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:34.368825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:34.370453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:34.371817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:34.727028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:34.740329 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aa8466d3-d86c-4b4e-99cd-c20643fc55e9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1271 microversion: 2.1 time: 0.399642 Oct 28 10:15:34.741290 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2660/5313] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:34 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1271 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:34.867395 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-818af341-aa58-4063-946a-95d43e30b71a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.530354 Oct 28 10:15:34.877540 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2654/5314] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:15:34 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-interface => generated 285 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:35.206120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:35.207353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:35.218908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:35.220068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:35.222133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:35.224228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:35.224982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:35.225772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:35.770723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:35.772200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:35.780633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:35.785209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:35.786178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:35.787176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:35.787893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:35.790229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:36.045301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:36.074378 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14195c9c-ed98-46c7-bad2-9d3089b68dbe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.872737 Oct 28 10:15:36.078842 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2661/5315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:35 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:36.137574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:36.151932 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7801cc0-0c5c-481b-8369-50a367034c58 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1271 microversion: 2.1 time: 0.391799 Oct 28 10:15:36.155739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2655/5316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:35 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1271 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:37.104091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:37.104835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:37.112255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:37.121650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:37.122273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:37.123166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:37.123760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:37.125000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:37.179940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:37.180745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:37.202779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:37.205508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:37.207275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:37.208940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:37.211388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:37.215752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:38.566460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:38.583918 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d8ba1f4-590e-46fc-9278-859d754af36f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 1.483849 Oct 28 10:15:38.585460 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2662/5317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:37 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:38.598832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:38.600596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:38.622564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:38.624138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:38.625371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:38.628833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:38.629617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:38.630330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:38.656719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:38.667590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e00b075-977a-4f3d-85ad-f79375ddce15 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 1.492963 Oct 28 10:15:38.673631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] HTTP exception thrown: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.674226 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2656/5318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:37 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Request method failure captured: Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c HTTP/1.1 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6o6hBjbRbQHQqPoNMTYjkwaCcbK_CpMalR5PUV6c6Abw77GUrxPJi-ocIzX0iSrHIaqpy5BwgonIzq6a32vGzxpL8llc2wJc_lbCYdUn6mjk7Sgjt7nV_QEd9SibuN3vCY6Xgbii2wmMAy9H6oDv9Erso5-GbF253bHrsikmbuNF1M Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: adb7eccfe81e41db93216cb0441db339 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adb7eccfe81e41db93216cb0441db339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adb7eccfe81e41db93216cb0441db339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adb7eccfe81e41db93216cb0441db339", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adb7eccfe81e41db93216cb0441db339"}]}] Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: adb7eccfe81e41db93216cb0441db339 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TaggedBootDevicesTest_v242-1494965708-project Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 0a40eaa5eefa439bb590a7511814f61c Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1494965708-project Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'bf383abe-8c04-42b0-a65c-a8ba1612ef5c'} Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:38.676152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.682266 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.686248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Returning 404 to user: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:38.687968 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48dbda50-04b6-4f0f-8dee-900bea581434 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 404 len: 111 microversion: 2.42 time: 0.101170 Oct 28 10:15:38.698809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:38.699859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] [instance: bf383abe-8c04-42b0-a65c-a8ba1612ef5c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:38.702041 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2663/5319] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:15:38 2022] DELETE /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:15:38.707915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:38.708770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:38.709528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:38.710484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:38.711216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:38.711886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:38.740692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] HTTP exception thrown: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Request method failure captured: Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c HTTP/1.1 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6o6hBjbRbQHQqPoNMTYjkwaCcbK_CpMalR5PUV6c6Abw77GUrxPJi-ocIzX0iSrHIaqpy5BwgonIzq6a32vGzxpL8llc2wJc_lbCYdUn6mjk7Sgjt7nV_QEd9SibuN3vCY6Xgbii2wmMAy9H6oDv9Erso5-GbF253bHrsikmbuNF1M Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Openstack-Nova-Api-Version: 2.42 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: adb7eccfe81e41db93216cb0441db339 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adb7eccfe81e41db93216cb0441db339"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/adb7eccfe81e41db93216cb0441db339"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_adb7eccfe81e41db93216cb0441db339", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/adb7eccfe81e41db93216cb0441db339"}]}] Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: adb7eccfe81e41db93216cb0441db339 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1494965708 Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TaggedBootDevicesTest_v242-1494965708-project Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 0a40eaa5eefa439bb590a7511814f61c Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1494965708-project Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'bf383abe-8c04-42b0-a65c-a8ba1612ef5c'} Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.746411 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:15:38.751930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] Returning 404 to user: Instance bf383abe-8c04-42b0-a65c-a8ba1612ef5c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:15:38.753543 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aecdd2ee-f584-454c-91fd-6e18e7a0a878 tempest-TaggedBootDevicesTest_v242-1494965708 tempest-TaggedBootDevicesTest_v242-1494965708-project] 10.222.0.16 "GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c" status: 404 len: 111 microversion: 2.42 time: 0.059944 Oct 28 10:15:38.761402 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2657/5320] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:15:38 2022] GET /compute/v2.1/servers/bf383abe-8c04-42b0-a65c-a8ba1612ef5c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:15:39.400616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b3025e59-a6c4-42d4-90f5-9b0b568e69c5 req-21436d36-ad47-4be0-9eab-4db8eb5a5e06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21e7e1cc-120d-4870-8b90-49c4d60ea6fb", "tag": "1d449854-9a05-41f1-8ce9-e53ea36c2d72"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:39.406427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:39.434301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b3025e59-a6c4-42d4-90f5-9b0b568e69c5 req-21436d36-ad47-4be0-9eab-4db8eb5a5e06 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:39.435121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b3025e59-a6c4-42d4-90f5-9b0b568e69c5 req-21436d36-ad47-4be0-9eab-4db8eb5a5e06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:39.435870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b3025e59-a6c4-42d4-90f5-9b0b568e69c5 req-21436d36-ad47-4be0-9eab-4db8eb5a5e06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:39.470896 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b3025e59-a6c4-42d4-90f5-9b0b568e69c5 req-21436d36-ad47-4be0-9eab-4db8eb5a5e06 service nova] Creating event network-changed:1d449854-9a05-41f1-8ce9-e53ea36c2d72 for instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb on n-h2-zed-1 Oct 28 10:15:39.481511 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b3025e59-a6c4-42d4-90f5-9b0b568e69c5 req-21436d36-ad47-4be0-9eab-4db8eb5a5e06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082763 Oct 28 10:15:39.482576 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2664/5321] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:39.612240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:39.612863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:39.624996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:39.625500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:39.625947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:39.626658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:39.636370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:39.637116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:39.698032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:39.703407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:39.722354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:39.722860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:39.730418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:39.731167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:39.740789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:39.741404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:39.744833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:39.791399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:40.183722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=10 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:40.204703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:40.221511 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8755b329-abe4-4d9b-8495-15de1846c4b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.611830 Oct 28 10:15:40.241026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2658/5322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:39 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:40.252570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-59df9127-d81d-4809-9edf-8c840ba26350 req-4833c51f-4e73-4680-809d-b64c28cfbb5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9399955c-6dee-411c-8c04-34ff847396e3", "tag": "cfb3fbd5-4b70-4323-b6c1-9950692f3ef8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:40.271952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59df9127-d81d-4809-9edf-8c840ba26350 req-4833c51f-4e73-4680-809d-b64c28cfbb5c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:40.272856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59df9127-d81d-4809-9edf-8c840ba26350 req-4833c51f-4e73-4680-809d-b64c28cfbb5c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:40.273563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59df9127-d81d-4809-9edf-8c840ba26350 req-4833c51f-4e73-4680-809d-b64c28cfbb5c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:40.296745 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-59df9127-d81d-4809-9edf-8c840ba26350 req-4833c51f-4e73-4680-809d-b64c28cfbb5c service nova] Creating event network-changed:cfb3fbd5-4b70-4323-b6c1-9950692f3ef8 for instance 9399955c-6dee-411c-8c04-34ff847396e3 on n-h2-zed-1 Oct 28 10:15:40.308104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-59df9127-d81d-4809-9edf-8c840ba26350 req-4833c51f-4e73-4680-809d-b64c28cfbb5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064951 Oct 28 10:15:40.311107 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2659/5323] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:40.614401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:40.625052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00552dab-8af3-4e08-9966-ecc9c98426bd tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 0.931085 Oct 28 10:15:40.625668 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2665/5324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:39 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:41.252810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:41.253565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:41.273144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:41.280811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:41.281575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:41.282407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:41.282839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:41.283479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:41.648234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:41.649771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:41.663830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:41.664534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:41.665349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:41.666468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:41.668118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:41.669318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:41.938450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:41.946902 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8143dfec-e6bc-4993-a217-8aba15e4c4e6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.698880 Oct 28 10:15:41.970462 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2660/5325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:41 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:42.353591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-36a3281d-1bff-43b8-a3da-8590b323067e req-89b9e16e-7381-4cff-b459-a77da90ccfbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb83073d-314c-4896-bd95-3a0dc788c426", "tag": "f6e0e11a-b6ec-4ccd-9902-b47e390e93f9"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:42.388205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-36a3281d-1bff-43b8-a3da-8590b323067e req-89b9e16e-7381-4cff-b459-a77da90ccfbd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:42.389076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-36a3281d-1bff-43b8-a3da-8590b323067e req-89b9e16e-7381-4cff-b459-a77da90ccfbd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:42.392657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-36a3281d-1bff-43b8-a3da-8590b323067e req-89b9e16e-7381-4cff-b459-a77da90ccfbd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:42.422547 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-36a3281d-1bff-43b8-a3da-8590b323067e req-89b9e16e-7381-4cff-b459-a77da90ccfbd service nova] Creating event network-changed:f6e0e11a-b6ec-4ccd-9902-b47e390e93f9 for instance eb83073d-314c-4896-bd95-3a0dc788c426 on n-h2-zed-1 Oct 28 10:15:42.436248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-36a3281d-1bff-43b8-a3da-8590b323067e req-89b9e16e-7381-4cff-b459-a77da90ccfbd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087236 Oct 28 10:15:42.455533 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2661/5326] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:15:42.689226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:42.701978 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99195f20-1d84-4125-bd40-669ae6bca5a9 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 1.057787 Oct 28 10:15:42.705985 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2666/5327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:41 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:42.973806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:42.974583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:42.996303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:42.998087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:43.000332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:43.001380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:43.004005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:43.005617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:43.733174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:43.735766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:43.758754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:43.760113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:43.760814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:43.762055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:43.765989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:43.770731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:43.895931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:43.910469 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-45bd1262-2a16-46c5-9604-cf289278f9ae tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.941397 Oct 28 10:15:43.911354 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2662/5328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:42 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:44.744861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:44.763336 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-042cef9d-22e9-4b1f-90f0-9144564b2cf4 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 1.037283 Oct 28 10:15:44.767853 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2667/5329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:43 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:44.939462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:44.940173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:44.959155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:44.963308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:44.968125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:44.968933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:44.969427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:44.969867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:45.037605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:45.496251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:45.506952 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e81644a9-ee73-4afc-a337-1ba6672f3235 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.572043 Oct 28 10:15:45.510764 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2663/5330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:44 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:45.794620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:45.800924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:45.818057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:45.820948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:45.826794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:45.828830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:45.831114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:45.833775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:46.392981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:46.407335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5efea3fe-4f5f-4a4c-92cc-b3dcc223bcfa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 0.619349 Oct 28 10:15:46.411125 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2668/5331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:45 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:46.536952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:46.537992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:46.551366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:46.552011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:46.552528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:46.553355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:46.556180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:46.556711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:47.433312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:47.434720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:47.448473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:47.449641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:47.450141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:47.451023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:47.451667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:47.452810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:47.542560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:47.555350 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-55142805-1b5e-4f02-92a1-37fd4a70ec39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 1.022612 Oct 28 10:15:47.577872 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2664/5332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:46 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:48.420041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:48.437722 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1fa510b3-4878-4233-a69f-82fdeba18611 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 1.008612 Oct 28 10:15:48.439184 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2669/5333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:47 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:48.583831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:48.584478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:48.608404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:48.609964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:48.612240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:48.613992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:48.617592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:48.619418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:49.195801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:49.208041 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-95b4746b-1609-4a43-8c4c-a9bd9e66c544 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.628522 Oct 28 10:15:49.228338 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2665/5334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:48 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:49.465219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:49.465850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:49.482078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:49.483011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:49.484213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:49.485327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:49.485975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:49.486604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:50.234825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:50.237584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:50.241888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:50.265331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:50.266085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:50.266720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:50.267716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:50.268346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:50.268977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:50.494687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:50.506607 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c456a4d0-163d-439d-8006-33e67ef85799 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 1.045413 Oct 28 10:15:50.525073 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2670/5335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:49 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:50.625107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:50.638345 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd5250c1-c9b1-40cf-94c3-3ca941a6bcaf tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.408133 Oct 28 10:15:50.639881 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2666/5336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:50 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:51.546345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:51.547081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:51.573901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:51.577144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:51.577637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:51.578386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:51.578860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:51.579300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:51.605660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9158aace-2aeb-44cc-884d-0a475285fc23 req-c617413a-e204-4ccf-adcc-74a018f9573e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb83073d-314c-4896-bd95-3a0dc788c426", "name": "network-vif-plugged", "status": "completed", "tag": "f6e0e11a-b6ec-4ccd-9902-b47e390e93f9"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:51.629974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9158aace-2aeb-44cc-884d-0a475285fc23 req-c617413a-e204-4ccf-adcc-74a018f9573e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:51.631337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9158aace-2aeb-44cc-884d-0a475285fc23 req-c617413a-e204-4ccf-adcc-74a018f9573e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:51.633740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9158aace-2aeb-44cc-884d-0a475285fc23 req-c617413a-e204-4ccf-adcc-74a018f9573e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:51.670189 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9158aace-2aeb-44cc-884d-0a475285fc23 req-c617413a-e204-4ccf-adcc-74a018f9573e service nova] Creating event network-vif-plugged:f6e0e11a-b6ec-4ccd-9902-b47e390e93f9 for instance eb83073d-314c-4896-bd95-3a0dc788c426 on n-h2-zed-1 Oct 28 10:15:51.682568 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9158aace-2aeb-44cc-884d-0a475285fc23 req-c617413a-e204-4ccf-adcc-74a018f9573e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080155 Oct 28 10:15:51.685612 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2667/5337] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:15:51.702910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:51.704060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:51.714527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:51.715358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:51.716182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:51.718189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:51.718892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:51.719532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:52.174681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:52.187657 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8f66970a-9b73-44ad-8b07-35166d0d90ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.485903 Oct 28 10:15:52.190232 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2668/5338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:51 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:52.322534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:52.338512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b28744a-72f6-4050-96c0-9dc0e597b947 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 0.802212 Oct 28 10:15:52.339589 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2671/5339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:51 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:53.217230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:53.222857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:53.238786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:53.243944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:53.244436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:53.245237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:53.245705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:53.246141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:53.362964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:53.363503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:53.378532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:53.379071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:53.379539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:53.380262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:53.380952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:53.381567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:53.681319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:53.690246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc512625-4fd9-4cce-8af0-1dcc9cb098fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1313 microversion: 2.1 time: 0.332321 Oct 28 10:15:53.695224 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2672/5340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:53 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:53.775706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8ec9e473-9199-4320-a16b-7ae9e499051f req-6646d597-e619-49ea-95f8-e135f8843dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e7e1cc-120d-4870-8b90-49c4d60ea6fb", "name": "network-vif-plugged", "status": "completed", "tag": "1d449854-9a05-41f1-8ce9-e53ea36c2d72"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:15:53.794429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:53.801630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8ec9e473-9199-4320-a16b-7ae9e499051f req-6646d597-e619-49ea-95f8-e135f8843dd9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:53.802219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8ec9e473-9199-4320-a16b-7ae9e499051f req-6646d597-e619-49ea-95f8-e135f8843dd9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:53.802613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8ec9e473-9199-4320-a16b-7ae9e499051f req-6646d597-e619-49ea-95f8-e135f8843dd9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:53.813601 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-372e1bea-71e5-4c22-b8de-cd6071cb6a03 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.605968 Oct 28 10:15:53.824997 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2669/5341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:53 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:53.836344 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8ec9e473-9199-4320-a16b-7ae9e499051f req-6646d597-e619-49ea-95f8-e135f8843dd9 service nova] Creating event network-vif-plugged:1d449854-9a05-41f1-8ce9-e53ea36c2d72 for instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb on n-h2-zed-1 Oct 28 10:15:53.846793 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8ec9e473-9199-4320-a16b-7ae9e499051f req-6646d597-e619-49ea-95f8-e135f8843dd9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077043 Oct 28 10:15:53.849219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2673/5342] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:15:54.722078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:54.728099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:54.735809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:54.737009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:54.737922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:54.738975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:54.739682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:54.740431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:54.843297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:54.843919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:54.864876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:54.865725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:54.866563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:54.871217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:54.871977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:54.872601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:55.156593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:55.163002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:55.165492 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40c63ff4-ac9c-4754-879a-8eac4c6df3bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1317 microversion: 2.1 time: 0.327496 Oct 28 10:15:55.166093 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2674/5343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:54 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:56.193483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:56.194772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:56.199171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:56.216583 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ae7a8ae-2ffd-49f3-bc0d-2e9aef10d017 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1498 microversion: 2.1 time: 1.498207 Oct 28 10:15:56.219278 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2670/5344] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:54 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1498 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:56.230131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:56.231440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:56.232791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:56.234509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:56.252880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:56.253422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.047430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:57.048620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:57.064693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.067174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.067898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.068782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.070938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.071669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.176676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:15:57.337913 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a3efe247-149c-4850-b322-99227e2010b3 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 204 len: 0 microversion: 2.1 time: 0.294716 Oct 28 10:15:57.340692 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2671/5345] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:15:57 2022] DELETE /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:15:57.351094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:57.353076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:57.366152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.367112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.368029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.369073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.369929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.370712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.610674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:57.628485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad53cd3c-5303-479e-beea-37ee88993b48 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1506 microversion: 2.1 time: 1.438799 Oct 28 10:15:57.630980 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2675/5346] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:56 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1506 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:15:57.658476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:57.658476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:57.678710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.681688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.683279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.686077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.689064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.690336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.752249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:15:57.859839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:57.875011 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6333c44-2927-44cc-a719-bd286002ec47 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1504 microversion: 2.1 time: 0.529629 Oct 28 10:15:57.879718 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2672/5347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:57 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1504 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:57.953105 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-688348c7-610d-4282-b916-b43cfcb6d331 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 204 len: 0 microversion: 2.1 time: 0.297236 Oct 28 10:15:57.956267 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2676/5348] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:15:57 2022] DELETE /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:15:57.965008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:57.965630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:57.980553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.981113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.981559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:57.982260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:57.986892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:57.988878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:58.668616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:58.699184 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ea6771f-2ff4-4c80-94f8-0e287d6936b8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1512 microversion: 2.1 time: 0.738716 Oct 28 10:15:58.699931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2673/5349] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:57 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1512 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:58.904803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:58.906704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:58.910757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:15:58.934001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:58.934801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:58.935468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:58.938028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:58.947239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:58.948301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:59.261294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:15:59.273761 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-804c2c3a-f51f-4620-8635-568c435a6461 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1504 microversion: 2.1 time: 0.374391 Oct 28 10:15:59.274371 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2677/5350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:58 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1504 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:15:59.724736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:15:59.729103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:15:59.748735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:59.749841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:59.752549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:15:59.753532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:15:59.756984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:15:59.757935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:00.299673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:00.300299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:00.316049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:00.316553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:00.317024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:00.317749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:00.318218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:00.323043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:00.472526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:00.483000 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f12612b9-e74e-45fe-9e3f-5d57cfc81f76 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1512 microversion: 2.1 time: 0.761997 Oct 28 10:16:00.483805 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2674/5351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:15:59 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1512 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:00.732215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:00.744807 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb8d764b-8190-41e6-8700-6eed0a4b1e9c tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1504 microversion: 2.1 time: 0.448951 Oct 28 10:16:00.745445 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2678/5352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:00 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1504 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:01.256773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ba404245-8530-4672-8981-530416ec0bfa req-8d444d81-716f-4e87-a3e6-59d85ace0ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb83073d-314c-4896-bd95-3a0dc788c426", "name": "network-vif-deleted", "tag": "f6e0e11a-b6ec-4ccd-9902-b47e390e93f9"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:01.300396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ba404245-8530-4672-8981-530416ec0bfa req-8d444d81-716f-4e87-a3e6-59d85ace0ce2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:01.304337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ba404245-8530-4672-8981-530416ec0bfa req-8d444d81-716f-4e87-a3e6-59d85ace0ce2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:01.310604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ba404245-8530-4672-8981-530416ec0bfa req-8d444d81-716f-4e87-a3e6-59d85ace0ce2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:01.339334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ba404245-8530-4672-8981-530416ec0bfa req-8d444d81-716f-4e87-a3e6-59d85ace0ce2 service nova] Creating event network-vif-deleted:f6e0e11a-b6ec-4ccd-9902-b47e390e93f9 for instance eb83073d-314c-4896-bd95-3a0dc788c426 on n-h2-zed-1 Oct 28 10:16:01.365801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ba404245-8530-4672-8981-530416ec0bfa req-8d444d81-716f-4e87-a3e6-59d85ace0ce2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112661 Oct 28 10:16:01.368840 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2675/5353] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:16:01.511806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:01.512604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:01.555560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:01.556783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:01.557454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:01.558738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:01.559633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:01.561688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:01.770867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:01.771394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:01.793624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:01.794666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:01.796143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:01.810041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:01.812798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:01.815312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:01.882399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:01.883325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:01.883975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:01.884644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lazy-loading 'fault' on Instance uuid eb83073d-314c-4896-bd95-3a0dc788c426 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:16:01.998668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:02.009259 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ee4d9a7-dafc-485f-bc1e-eb797aa6eb60 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 200 len: 1303 microversion: 2.1 time: 0.241505 Oct 28 10:16:02.021047 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2676/5354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:01 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 1303 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:02.061636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:02.072755 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bdaf1799-2bcd-4012-8fe6-d7e75e82e28a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1512 microversion: 2.1 time: 0.568451 Oct 28 10:16:02.076345 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2679/5355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:01 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1512 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:02.610917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-57427af1-b93b-4a22-a5b2-09ab42a84bb7 req-399a7a82-3568-424c-8512-796cb973b33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21e7e1cc-120d-4870-8b90-49c4d60ea6fb", "name": "network-vif-deleted", "tag": "1d449854-9a05-41f1-8ce9-e53ea36c2d72"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:02.638907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-57427af1-b93b-4a22-a5b2-09ab42a84bb7 req-399a7a82-3568-424c-8512-796cb973b33b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:02.640301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-57427af1-b93b-4a22-a5b2-09ab42a84bb7 req-399a7a82-3568-424c-8512-796cb973b33b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:02.641006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-57427af1-b93b-4a22-a5b2-09ab42a84bb7 req-399a7a82-3568-424c-8512-796cb973b33b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:02.656248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-57427af1-b93b-4a22-a5b2-09ab42a84bb7 req-399a7a82-3568-424c-8512-796cb973b33b service nova] Creating event network-vif-deleted:1d449854-9a05-41f1-8ce9-e53ea36c2d72 for instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb on n-h2-zed-1 Oct 28 10:16:02.678043 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-57427af1-b93b-4a22-a5b2-09ab42a84bb7 req-399a7a82-3568-424c-8512-796cb973b33b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070706 Oct 28 10:16:02.680695 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2677/5356] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:03.046243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:03.046877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: eb83073d-314c-4896-bd95-3a0dc788c426] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:03.056002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:03.056816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:03.058638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:03.059570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:03.062189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:03.062857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:03.104331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:03.105229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:03.113640 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] HTTP exception thrown: Instance eb83073d-314c-4896-bd95-3a0dc788c426 could not be found. Oct 28 10:16:03.122123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:03.122626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Request method failure captured: Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 HTTP/1.1 Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6u8wpPBSZ2ehy4xFfwF62yLkRWasDU4KFJEpFgjg9d7osCtiJO7KWjBSXFfOthapA15IGCaUtOMzRCpmQ2wtPt6LRDYD4C4bMv7og2PiZUoDCas9xwGhpp0x_pfhaVCwUKQO5fb-mbfHGXOHdwtU4hqDD0DGpIOWAbo_acklRB6XLo Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 72af6d56f0b5448fb4b98075f4d6be0b Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesActionsTest-641606942 Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/72af6d56f0b5448fb4b98075f4d6be0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/72af6d56f0b5448fb4b98075f4d6be0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_72af6d56f0b5448fb4b98075f4d6be0b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/72af6d56f0b5448fb4b98075f4d6be0b"}]}] Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesActionsTest-641606942 Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 72af6d56f0b5448fb4b98075f4d6be0b Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesActionsTest-641606942 Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesActionsTest-641606942-project Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a0c3eaac6b4f4b2685de2d234573e33a Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesActionsTest-641606942-project Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance eb83073d-314c-4896-bd95-3a0dc788c426 could not be found. Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'eb83073d-314c-4896-bd95-3a0dc788c426'} Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb83073d-314c-4896-bd95-3a0dc788c426 could not be found. Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb83073d-314c-4896-bd95-3a0dc788c426 could not be found. Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:03.125550 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb83073d-314c-4896-bd95-3a0dc788c426 could not be found. Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Returning 404 to user: Instance eb83073d-314c-4896-bd95-3a0dc788c426 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:03.130568 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d311b341-8a02-407b-b517-29b3752ba9fa tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426" status: 404 len: 111 microversion: 2.1 time: 0.091424 Oct 28 10:16:03.145988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:03.148535 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2680/5357] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:03 2022] GET /compute/v2.1/servers/eb83073d-314c-4896-bd95-3a0dc788c426 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:03.149975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:03.150508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:03.153891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:03.277816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:03.278354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:03.281660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:03.282276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lazy-loading 'fault' on Instance uuid 21e7e1cc-120d-4870-8b90-49c4d60ea6fb {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:16:03.344939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1690867278", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "7982538e-1355-490d-b839-dee12d07fb8f"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:03.432251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] validate_networks() for [('7982538e-1355-490d-b839-dee12d07fb8f', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:16:03.597891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:03.611504 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2175e239-1ddc-4b11-945b-9568ebfca678 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 200 len: 1307 microversion: 2.1 time: 0.511214 Oct 28 10:16:03.629325 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2678/5358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:03 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 1307 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:04.442841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:16:04.443394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:16:04.443989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:16:04.444511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:16:04.445257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:16:04.464983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:04.468596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:04.469359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:04.470452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:04.472686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:04.473399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:04.517395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Getting quotas for project 72af6d56f0b5448fb4b98075f4d6be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:16:04.529223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Getting quotas for user a0c3eaac6b4f4b2685de2d234573e33a and project 72af6d56f0b5448fb4b98075f4d6be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:16:04.561318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:16:04.564664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:16:04.624319 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf6cb83e-624f-41b9-be82-1534099f5f65 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.283754 Oct 28 10:16:04.631577 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2681/5359] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:16:04.634732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:04.635529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:04.637827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-39b273c1-c81b-4638-86e1-c7e5a4d48d23 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:04.638690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-39b273c1-c81b-4638-86e1-c7e5a4d48d23 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:04.659641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:04.663005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:04.663555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:04.664380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:04.666909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:04.667675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:04.699157 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb HTTP/1.1 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '21e7e1cc-120d-4870-8b90-49c4d60ea6fb'} Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:04.700459 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:04.706582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:04.706582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:04.706582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:04.706582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:04.706582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:04.706582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:04.706582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:04.716011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:04.718207 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4aba2911-00a5-4538-b551-b7e9ae0b0f63 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 404 len: 111 microversion: 2.1 time: 0.086762 Oct 28 10:16:04.723489 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2679/5360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:04 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:16:04.730784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:04.738947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:04.751035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:04.752116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:04.752760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:04.753702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:04.754344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:04.754952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:04.766062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:04.880294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-39b273c1-c81b-4638-86e1-c7e5a4d48d23 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:04.890795 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-39b273c1-c81b-4638-86e1-c7e5a4d48d23 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1214 microversion: 2.1 time: 0.257588 Oct 28 10:16:04.895322 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2682/5361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:04 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1214 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:05.412364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:05.431110 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b397a424-6cb7-495d-825c-337d53d3235f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.706193 Oct 28 10:16:05.431717 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2680/5362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:04 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:05.692862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff0bfde6-4ddb-4439-a9b0-b2bcc65195ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff0bfde6-4ddb-4439-a9b0-b2bcc65195ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 163 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": 12345, "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 12345 Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:05.697590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff0bfde6-4ddb-4439-a9b0-b2bcc65195ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:05.704298 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff0bfde6-4ddb-4439-a9b0-b2bcc65195ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.017571 Oct 28 10:16:05.709629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:05.710289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:05.723320 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2683/5363] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:05 2022] POST /compute/v2.1/servers => generated 127 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:05.730195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:05.730720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:05.733669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:05.734656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:05.739912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:05.740479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:05.971117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bdee8914-e37f-4053-a417-96bd2c58b1b4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'create', calling method: .version_select at 0x7fca33209a60>, body: {"keypair": {"name": "tempest-keypair-208482007", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnmn95HYwKpTbvIUd3rJzj2DHkRKbb48oAyDkSj7ykq/4bCciC0nbGpWYa3GY05+ITaqrB2xDpszo8CtuAiqSvmB124Mw4GpAOiyJPEhrmd1Pv26ysTLImkwWbQxVxFlw=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:06.017997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bdee8914-e37f-4053-a417-96bd2c58b1b4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for project 647a75e417314ddbb20364530ad36c54. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:16:06.036451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bdee8914-e37f-4053-a417-96bd2c58b1b4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for user 1b327af221c94695bc5b82fa49e3c448 and project 647a75e417314ddbb20364530ad36c54. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:16:06.093478 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bdee8914-e37f-4053-a417-96bd2c58b1b4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.342596 Oct 28 10:16:06.094332 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2684/5364] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:16:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:16:06.099211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:06.100125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:06.116595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:06.120187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:06.121198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:06.122540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:06.126505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:06.127273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:06.335867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:06.345595 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1f037c5c-187f-4097-ae10-8fd8ca073d61 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1266 microversion: 2.1 time: 0.249672 Oct 28 10:16:06.347830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:06.360121 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba8a7bfc-4063-467c-9301-afa178a85e1a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.651929 Oct 28 10:16:06.360988 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2681/5365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:05 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:06.367275 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2685/5366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:06 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:06.387759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:06.389673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:06.408213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:06.411902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:06.413014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:06.413951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:06.415515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:06.416169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:06.901603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:06.927327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-64065562-a170-4df7-9b38-664f68034f13 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.543499 Oct 28 10:16:06.932588 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2682/5367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:06 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:07.378313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:07.379066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:07.392630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:07.393512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:07.394267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:07.395167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:07.395944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:07.396552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:07.884400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:07.892738 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b0d6979-35fd-4444-a4f8-437359725fba tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1272 microversion: 2.1 time: 0.523160 Oct 28 10:16:07.916673 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2686/5368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:07 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1272 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:08.918342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:08.919582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:08.935400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:08.936551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:08.943212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:08.944350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:08.945086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:08.945749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:09.631253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:09.643007 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34c8c826-73a0-494a-8c5b-4de50e5a1c98 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.729047 Oct 28 10:16:09.659417 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2683/5369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:08 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:10.017135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f939a52b-9f88-44b1-b231-61266e01eedd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2037132387", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c94d5f67-a6cd-458e-9698-c86dd6cb8334", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:10.133335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f939a52b-9f88-44b1-b231-61266e01eedd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Block Device c94d5f67-a6cd-458e-9698-c86dd6cb8334 is not bootable. Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f939a52b-9f88-44b1-b231-61266e01eedd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 358 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2037132387", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "c94d5f67-a6cd-458e-9698-c86dd6cb8334", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: exception: Block Device c94d5f67-a6cd-458e-9698-c86dd6cb8334 is not bootable. Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2037132387', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'c94d5f67-a6cd-458e-9698-c86dd6cb8334'}], 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device c94d5f67-a6cd-458e-9698-c86dd6cb8334 is not bootable. Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:10.145510 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device c94d5f67-a6cd-458e-9698-c86dd6cb8334 is not bootable. Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device c94d5f67-a6cd-458e-9698-c86dd6cb8334 is not bootable. Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f939a52b-9f88-44b1-b231-61266e01eedd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Block Device c94d5f67-a6cd-458e-9698-c86dd6cb8334 is not bootable. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:10.150050 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f939a52b-9f88-44b1-b231-61266e01eedd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.135703 Oct 28 10:16:10.152719 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2687/5370] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:10 2022] POST /compute/v2.1/servers => generated 110 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:10.158268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:10.159083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:10.168001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:10.168555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:10.169027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:10.169836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:10.170864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:10.171649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:10.667763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:10.668745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:10.675955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:10.676809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:10.677285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:10.678045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:10.678730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:10.679210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:10.799940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:10.810064 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f3b23667-db2d-497a-9936-97ab8c0d8a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.656016 Oct 28 10:16:10.822906 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2684/5371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:10 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:10.836172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:10.837205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:10.843922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:10.844416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:10.845145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:10.846140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:10.846835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:10.847497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:11.101471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:11.122765 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1aa37210-54a9-4f11-a930-70ed8cba1c37 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.459365 Oct 28 10:16:11.123931 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2688/5372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:10 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:11.269777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:11.279218 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca0c1ca1-6f8f-4c3d-a091-cb1136f9bd3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.448702 Oct 28 10:16:11.280354 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2685/5373] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:10 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:12.149913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:12.150659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:12.175710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:12.177538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:12.178228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:12.179827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:12.181636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:12.182308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:12.243804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1601800306", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "211d510d-dd8f-46be-8306-141acae1af62"}], "security_groups": [{"name": "tempest-securitygroup--507864725"}], "key_name": "tempest-keypair-208482007", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:12.616395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] validate_networks() for [('211d510d-dd8f-46be-8306-141acae1af62', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:16:12.643921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:12.666302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-16e2e454-8e22-4e5b-9730-83d11183c26f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.520716 Oct 28 10:16:12.684414 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2689/5374] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:12 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:12.720127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0ca70e47-818f-4f4a-a7d0-2c322c03daed req-300e27f2-6637-429b-af3e-5f7b765986f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d40455eb-aedf-43f1-93e1-8ad20989f995", "tag": "971a3b7a-0a73-47c9-939e-1ed2f28f134a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:12.801682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0ca70e47-818f-4f4a-a7d0-2c322c03daed req-300e27f2-6637-429b-af3e-5f7b765986f5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:12.805094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0ca70e47-818f-4f4a-a7d0-2c322c03daed req-300e27f2-6637-429b-af3e-5f7b765986f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:12.805738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0ca70e47-818f-4f4a-a7d0-2c322c03daed req-300e27f2-6637-429b-af3e-5f7b765986f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:12.845098 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0ca70e47-818f-4f4a-a7d0-2c322c03daed req-300e27f2-6637-429b-af3e-5f7b765986f5 service nova] Creating event network-changed:971a3b7a-0a73-47c9-939e-1ed2f28f134a for instance d40455eb-aedf-43f1-93e1-8ad20989f995 on n-h2-zed-1 Oct 28 10:16:12.856410 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0ca70e47-818f-4f4a-a7d0-2c322c03daed req-300e27f2-6637-429b-af3e-5f7b765986f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187290 Oct 28 10:16:12.861558 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2690/5375] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:13.696588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:13.698290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:13.709257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:13.710117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:13.710998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:13.711953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:13.713622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:13.714299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:13.991290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:14.000056 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e3ed5a6-03f6-4ca0-bf58-e005d7aee779 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.311967 Oct 28 10:16:14.001442 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2691/5376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:13 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:14.006868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63faeece-b4ec-419d-857c-7dd465990bc3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225568598", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "destination_type": "local"}, {"source_type": "volume", "uuid": "dd99bb12-de5a-4cbf-8cae-3681a6964b84", "destination_type": "invalid"}], "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63faeece-b4ec-419d-857c-7dd465990bc3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 494 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-225568598", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "destination_type": "local"}, {"source_type": "volume", "uuid": "dd99bb12-de5a-4cbf-8cae-3681a6964b84", "destination_type": "invalid"}], "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-225568598', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'dd99bb12-de5a-4cbf-8cae-3681a6964b84', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'invalid' Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:14.012561 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 28 10:16:14.017667 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.021092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63faeece-b4ec-419d-857c-7dd465990bc3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:14.022135 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63faeece-b4ec-419d-857c-7dd465990bc3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019412 Oct 28 10:16:14.023191 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2692/5377] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:14 2022] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:14.032605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:14.033351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:14.046049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.046722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.047315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.048097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.048966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.049574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.208956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:14.220382 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-79dfab55-84b8-43fd-87bd-030a422b1c74 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.192081 Oct 28 10:16:14.221286 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2693/5378] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:14.245113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:14.246042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:14.255617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.256118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.256561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.257447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.257910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.258341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.434594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:14.443446 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca02ba38-44f2-41e8-85b0-7a90cbe609a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.202356 Oct 28 10:16:14.444124 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2694/5379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:14.541058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-43b14de5-cd65-44ff-8094-de98ad205ca3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-112082459", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:14.541460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:16:14.541885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:16:14.542436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:16:14.542748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:16:14.543155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-43b14de5-cd65-44ff-8094-de98ad205ca3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 491 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-112082459", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-112082459', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.547029 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-43b14de5-cd65-44ff-8094-de98ad205ca3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-43b14de5-cd65-44ff-8094-de98ad205ca3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.012912 Oct 28 10:16:14.553562 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2695/5380] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:14 2022] POST /compute/v2.1/servers => generated 624 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:14.569603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:14.570536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:14.571660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.572300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.572833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.574071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.576505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.577268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.580985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:14.583057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.585181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.586016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.586934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.587640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.588613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.606741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:16:14.613201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for user 1b327af221c94695bc5b82fa49e3c448 and project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:16:14.631520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:16:14.634320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:16:14.688489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d4eef2d-6ee3-4bff-a8cc-99569b2b9fc6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.449934 Oct 28 10:16:14.689989 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2686/5381] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:12 2022] POST /compute/v2.1/servers => generated 408 bytes in 2452 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:16:14.707941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-743ed9f5-b537-421e-bfbb-3e8ed1ee07f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:14.708896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-743ed9f5-b537-421e-bfbb-3e8ed1ee07f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:14.782220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:14.792676 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-104fb357-62e7-420d-aef1-8e81692e93e1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.236347 Oct 28 10:16:14.793295 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2696/5382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:14.816383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:14.817235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:14.823493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.823973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.824633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.825372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:14.825832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:14.826304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:14.835911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-743ed9f5-b537-421e-bfbb-3e8ed1ee07f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:14.847411 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-743ed9f5-b537-421e-bfbb-3e8ed1ee07f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1238 microversion: 2.1 time: 0.150707 Oct 28 10:16:14.850662 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2687/5383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:14 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1238 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:14.990498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:14.994109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:15.002525 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2eb37a62-3f9e-418d-8708-55f31c3c0efe tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.189894 Oct 28 10:16:15.003216 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2697/5384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:15.036297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:15.040502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:15.052332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:15.052760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:15.053238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:15.053951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:15.054514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:15.054988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:15.076055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-172fb32a-debb-4372-9eed-1a79a8ef1585 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-172fb32a-debb-4372-9eed-1a79a8ef1585 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 416 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:15.081750 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:15.086426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-172fb32a-debb-4372-9eed-1a79a8ef1585 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:15.088799 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-172fb32a-debb-4372-9eed-1a79a8ef1585 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.016449 Oct 28 10:16:15.092548 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2698/5385] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:15 2022] POST /compute/v2.1/servers => generated 619 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:15.118683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:15.120157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:15.146376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:15.146890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:15.147338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:15.151170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:15.159335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:15.160009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:15.733252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:15.747336 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b86b747a-97d9-4ed3-985d-5861641a8e3a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.645012 Oct 28 10:16:15.753236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2699/5386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:15 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:15.782961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:15.784404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:15.811474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:15.812015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:15.812477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:15.817519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:15.818228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:15.818701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:15.975720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:15.990593 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae470b4c-2fab-44df-8c7e-1c43834f0801 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.969832 Oct 28 10:16:15.992104 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2688/5387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:15 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:15.997986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:16.000522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:16.009692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:16.010375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:16.010985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:16.012069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:16.013822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:16.015287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:16.051113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:16.181188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:16.198083 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12eb5f1e-8c2d-4c2c-b053-462ba100693c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1290 microversion: 2.1 time: 0.204310 Oct 28 10:16:16.199916 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2689/5388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:15 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1290 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:16.207303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:16.220097 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b896dcbc-63e8-4c06-8699-a57987e8dc4b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.446649 Oct 28 10:16:16.220821 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2700/5389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:15 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:16.296738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b151763-a912-45fe-b168-fbb869a50bed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-948277888", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": -1, "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:16.312773 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-2b151763-a912-45fe-b168-fbb869a50bed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Flavor -1 could not be found. Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b151763-a912-45fe-b168-fbb869a50bed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 205 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-948277888", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": -1, "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: exception: Flavor -1 could not be found. Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-948277888', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': -1, 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:16.318759 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 28 10:16:16.323776 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:16.326100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b151763-a912-45fe-b168-fbb869a50bed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:16.327732 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b151763-a912-45fe-b168-fbb869a50bed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.035043 Oct 28 10:16:16.328511 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2690/5390] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:16 2022] POST /compute/v2.1/servers => generated 73 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:16.338152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:16.338776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:16.350982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:16.351398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:16.351842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:16.352565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:16.353049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:16.353475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:16.694506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:16.703975 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e06dacd3-235c-4440-9a67-c908b73347c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.371020 Oct 28 10:16:16.705167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2701/5391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:16 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:16.733300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:16.740077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:16.751245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:16.752679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:16.753413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:16.754396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:16.755100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:16.758658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:17.018729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:17.021848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:17.055619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:17.056156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:17.059607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:17.060416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:17.063518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:17.067166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:17.334010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:17.343301 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb947800-0321-4dc0-9c1f-2030a73048ff tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.329200 Oct 28 10:16:17.344182 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2702/5392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:17 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:17.357989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:17.359567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:17.368756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:17.370478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:17.371449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:17.372397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:17.373264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:17.373933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:17.461575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:17.471044 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-67dac2cb-a355-457a-b5ef-f350a156e46a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1296 microversion: 2.1 time: 0.125442 Oct 28 10:16:17.472116 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2703/5393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:17 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1296 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:17.498249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:17.516216 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa54aa8f-5c3c-45a1-a9b2-5f3242296a02 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.791558 Oct 28 10:16:17.524964 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2691/5394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:16 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:17.615040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-527b67e4-538a-4e54-ba60-1789be2c6567 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224111867", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-527b67e4-538a-4e54-ba60-1789be2c6567 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 173 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1224111867", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1224111867', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi -1 Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:17.619389 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-527b67e4-538a-4e54-ba60-1789be2c6567 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:17.624264 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-527b67e4-538a-4e54-ba60-1789be2c6567 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.010011 Oct 28 10:16:17.630971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:17.631361 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2704/5395] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:17 2022] POST /compute/v2.1/servers => generated 145 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:17.632070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:17.639254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:17.639907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:17.640469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:17.641401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:17.641968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:17.642627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:18.368780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:18.369362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:18.377591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:18.378090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:18.378538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:18.379262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:18.379727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:18.380164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:18.482498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:18.490967 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca868217-1632-4e48-8b88-4696a029dda7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.863736 Oct 28 10:16:18.499124 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2692/5396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:17 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:18.505727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:18.506900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:18.514162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:18.514805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:18.515327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:18.516174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:18.516757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:18.517452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:18.649161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:18.658390 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e64a5457-08d1-4338-b780-2d237bf9caee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1296 microversion: 2.1 time: 0.157469 Oct 28 10:16:18.660812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:18.670509 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2693/5397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:18 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1296 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:18.686046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:18.686981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:18.694656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:18.695528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:18.696246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:18.696960 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-817d81cd-0b5f-4a5f-b225-006fdea7a4ed tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.331743 Oct 28 10:16:18.697454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:18.698138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:18.698836 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2705/5398] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:18 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:18.699177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.058398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-acc63c1f-9606-4764-aefb-735cc1a0e380 req-0996047a-e2b2-4ad3-9924-e746daf343ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40455eb-aedf-43f1-93e1-8ad20989f995", "name": "network-vif-plugged", "status": "completed", "tag": "971a3b7a-0a73-47c9-939e-1ed2f28f134a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:19.073256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-acc63c1f-9606-4764-aefb-735cc1a0e380 req-0996047a-e2b2-4ad3-9924-e746daf343ad service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.074496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-acc63c1f-9606-4764-aefb-735cc1a0e380 req-0996047a-e2b2-4ad3-9924-e746daf343ad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.075006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-acc63c1f-9606-4764-aefb-735cc1a0e380 req-0996047a-e2b2-4ad3-9924-e746daf343ad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.096475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-acc63c1f-9606-4764-aefb-735cc1a0e380 req-0996047a-e2b2-4ad3-9924-e746daf343ad service nova] Creating event network-vif-plugged:971a3b7a-0a73-47c9-939e-1ed2f28f134a for instance d40455eb-aedf-43f1-93e1-8ad20989f995 on n-h2-zed-1 Oct 28 10:16:19.106412 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-acc63c1f-9606-4764-aefb-735cc1a0e380 req-0996047a-e2b2-4ad3-9924-e746daf343ad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200583 Oct 28 10:16:19.108217 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2706/5399] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:16:19.331438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:19.355614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92630275-1da6-4bcb-975d-07e492f86f20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.683816 Oct 28 10:16:19.356221 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2694/5400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:18 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:19.442768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57fbcbf7-a6b0-4e24-bccb-8df92498f1d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1164484887", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:19.447813 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-57fbcbf7-a6b0-4e24-bccb-8df92498f1d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57fbcbf7-a6b0-4e24-bccb-8df92498f1d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 216 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1164484887", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1164484887', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:19.449461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57fbcbf7-a6b0-4e24-bccb-8df92498f1d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:19.454903 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57fbcbf7-a6b0-4e24-bccb-8df92498f1d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.013686 Oct 28 10:16:19.470947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:19.471724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:19.476492 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2707/5401] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:19 2022] POST /compute/v2.1/servers => generated 123 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:19.478452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.479191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.479857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.480803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.481523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.482282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.685310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:19.686092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:19.699334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.700592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.705873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.706857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.707887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.708555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.833152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:19.853124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b4f0719-ae8f-4bdd-a34b-b5c1430413e0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1296 microversion: 2.1 time: 0.172242 Oct 28 10:16:19.855107 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2708/5402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:19 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1296 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:19.863961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:19.867780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:19.874474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.875622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.876295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.877364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.878694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.881779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.916318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:19.926634 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-604e29a9-9f78-48d5-b5b6-4fcf4eab620f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.460209 Oct 28 10:16:19.927958 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2695/5403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:19 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:19.950732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:19.952315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:19.959227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.959978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.960527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:19.961371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:19.961939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:19.962474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:20.118210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:20.128368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-148a90b4-13f7-415f-878c-a042af775c1a tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1314 microversion: 2.1 time: 0.271915 Oct 28 10:16:20.132108 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2709/5404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:19 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:20.279031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:20.289688 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16cdb0a1-b46e-470e-8142-9fa380c61e6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.343235 Oct 28 10:16:20.290308 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2696/5405] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:19 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:20.499304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3dab8dc9-1bb9-41ec-b9ff-f9d10c09ba5e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1177916128", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-key-1149441006", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:20.570937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-3dab8dc9-1bb9-41ec-b9ff-f9d10c09ba5e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] validate_networks() for [('b3be9e65-0595-44fd-a9d6-be9889a3e39c', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:16:20.875530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:20.876140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:20.878954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:20.889202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:20.889702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:20.890302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:20.891007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:20.891479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:20.891971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.182198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:21.198603 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-017eccca-f72d-45ef-98dd-f571c5b3d693 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.326796 Oct 28 10:16:21.203797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2697/5406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:20 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:21.210691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:21.226744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:21.242571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:21.249499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:21.250169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.250829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:21.251467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:21.252256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.411879 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-3dab8dc9-1bb9-41ec-b9ff-f9d10c09ba5e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Invalid key_name provided. Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3dab8dc9-1bb9-41ec-b9ff-f9d10c09ba5e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 247 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1177916128", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-key-1149441006", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid key_name provided. Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1177916128', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'key_name': 'tempest-key-1149441006', 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1149441006 not found for user 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:21.415040 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 28 10:16:21.420569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:21.424560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3dab8dc9-1bb9-41ec-b9ff-f9d10c09ba5e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid key_name provided. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:21.425486 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3dab8dc9-1bb9-41ec-b9ff-f9d10c09ba5e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.931295 Oct 28 10:16:21.426552 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2710/5407] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:20 2022] POST /compute/v2.1/servers => generated 70 bytes in 933 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 28 10:16:21.434568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:21.435251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:21.441862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:21.442411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:21.442847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.443752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:21.444444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:21.445071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.640247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:21.655322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-57ae9cf3-e1fe-4a44-8956-ea8ece55fe20 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1498 microversion: 2.1 time: 0.448937 Oct 28 10:16:21.657886 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2698/5408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:21 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1498 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:21.774898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:21.792204 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8fd2935d-c99b-4c9e-be0d-f238ef7888a7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.361568 Oct 28 10:16:21.798232 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2711/5409] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:21 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:21.818484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:21.819105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:21.835609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:21.836119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:21.836557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.839676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:21.840266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:21.840638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.873709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:21.883598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b72b93aa-d03e-4ab7-839e-c57c9d887f70 req-b57e4190-f9fc-4870-b1a8-867da9ad0b8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:21.903410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b72b93aa-d03e-4ab7-839e-c57c9d887f70 req-b57e4190-f9fc-4870-b1a8-867da9ad0b8e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:21.906113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b72b93aa-d03e-4ab7-839e-c57c9d887f70 req-b57e4190-f9fc-4870-b1a8-867da9ad0b8e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:21.907300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b72b93aa-d03e-4ab7-839e-c57c9d887f70 req-b57e4190-f9fc-4870-b1a8-867da9ad0b8e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:21.932792 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b72b93aa-d03e-4ab7-839e-c57c9d887f70 req-b57e4190-f9fc-4870-b1a8-867da9ad0b8e service nova] Creating event network-changed:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:16:21.951217 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b72b93aa-d03e-4ab7-839e-c57c9d887f70 req-b57e4190-f9fc-4870-b1a8-867da9ad0b8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072979 Oct 28 10:16:21.952780 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2712/5410] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:22.219362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:22.230368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:22.231052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1f8a288-5e38-4b92-af22-c8c775957e53 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.416162 Oct 28 10:16:22.231220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:22.245006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2699/5411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:21 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:22.258484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:22.258484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:22.258484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:22.259439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:22.261978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:22.262638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:22.469720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:22.470442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:22.477415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:22.477898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:22.478323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:22.483504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:22.485927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:22.486542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:22.521697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:16:22.643972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:22.659382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0965e46c-6b0c-4ca0-aeda-98aeafb6c8e8 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 204 len: 0 microversion: 2.1 time: 0.174984 Oct 28 10:16:22.660057 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2700/5412] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:16:22 2022] DELETE /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:16:22.666134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5817b319-eb59-488a-b241-508513377f94 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.439982 Oct 28 10:16:22.668432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bffd881-3f8b-4a16-9455-cb2e218100d4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1886479831", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:22.671044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2713/5413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:22 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:22.690109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:22.692644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:22.714516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:22.715082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:22.715535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:22.716255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:22.716755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:22.717213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:22.919015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:22.930185 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49348b49-da99-45a7-9de7-2a41799b882e tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1504 microversion: 2.1 time: 0.255697 Oct 28 10:16:22.931394 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2714/5414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:22 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:22.970873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.security_group_api [None req-6bffd881-3f8b-4a16-9455-cb2e218100d4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Neutron security group does_not_exist not found {{(pid=128748) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 28 10:16:22.971465 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6bffd881-3f8b-4a16-9455-cb2e218100d4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bffd881-3f8b-4a16-9455-cb2e218100d4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 258 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1886479831", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1886479831', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 28 10:16:22.984005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:22.988828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bffd881-3f8b-4a16-9455-cb2e218100d4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:22.993394 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6bffd881-3f8b-4a16-9455-cb2e218100d4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.321905 Oct 28 10:16:22.993394 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2701/5415] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:22 2022] POST /compute/v2.1/servers => generated 106 bytes in 326 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:23.001012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:23.001967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:23.008648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.009275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.009992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:23.010993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.011700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.012378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:23.236217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:23.257385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5874ad5d-65b4-4a44-8aec-bbfce02d0ee1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.259822 Oct 28 10:16:23.259699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2715/5416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:22 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:23.289344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:23.290172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:23.304645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.305438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.305882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:23.306603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.307062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.307498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:23.700412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:23.703039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:23.735896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.736424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.736877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:23.742691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.743057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.743514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:23.844560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:23.856747 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b4673ae-cbcf-4166-a9cb-b4cb08cf04bc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.568272 Oct 28 10:16:23.857734 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2702/5417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:23 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:23.882254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f82cb2ad-cbc6-4c56-ba8f-9473e72eb96f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:23.883029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f82cb2ad-cbc6-4c56-ba8f-9473e72eb96f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 11c63216-8d19-4409-9c42-fe99b68890a2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:23.894665 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f82cb2ad-cbc6-4c56-ba8f-9473e72eb96f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 11c63216-8d19-4409-9c42-fe99b68890a2 could not be found. Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f82cb2ad-cbc6-4c56-ba8f-9473e72eb96f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/11c63216-8d19-4409-9c42-fe99b68890a2 HTTP/1.1 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 11c63216-8d19-4409-9c42-fe99b68890a2 could not be found. Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '11c63216-8d19-4409-9c42-fe99b68890a2'} Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11c63216-8d19-4409-9c42-fe99b68890a2 could not be found. Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11c63216-8d19-4409-9c42-fe99b68890a2 could not be found. Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:23.900708 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11c63216-8d19-4409-9c42-fe99b68890a2 could not be found. Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f82cb2ad-cbc6-4c56-ba8f-9473e72eb96f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 11c63216-8d19-4409-9c42-fe99b68890a2 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:23.907032 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f82cb2ad-cbc6-4c56-ba8f-9473e72eb96f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/11c63216-8d19-4409-9c42-fe99b68890a2" status: 404 len: 111 microversion: 2.1 time: 0.025230 Oct 28 10:16:23.914497 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2703/5418] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:16:23 2022] DELETE /compute/v2.1/servers/11c63216-8d19-4409-9c42-fe99b68890a2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:16:23.923229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:23.923740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:23.942112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.942880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.943065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:23.944757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:23.946915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:23.959251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:24.024401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:24.032991 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4c87edf-190f-4d7c-874b-8bba1c8e78f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.338226 Oct 28 10:16:24.036189 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2716/5419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:23 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:24.041945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:24.042884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:24.052718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:24.053482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:24.054200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:24.055236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:24.056867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:24.058453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:24.236251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:24.248519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1cd112f-4880-4e92-ba48-33ee27a02e90 tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1504 microversion: 2.1 time: 0.212188 Oct 28 10:16:24.252762 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2717/5420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:24 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:24.502182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:24.519169 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c498de0e-c557-40ab-bbd2-4fadb4906660 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.602946 Oct 28 10:16:24.534992 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2704/5421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:23 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:24.553903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:24.555394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:24.563032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:24.564421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:24.565455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:24.566652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:24.567433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:24.569025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:24.883015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:24.901870 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d25a062e-cc2c-4da5-8660-66ee30c2a856 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.348756 Oct 28 10:16:24.902519 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2718/5422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:24 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:24.929373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40a744c1-33f8-4909-b234-68bdc90b9c01 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:24.930529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-40a744c1-33f8-4909-b234-68bdc90b9c01 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 10:16:24.931058 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-40a744c1-33f8-4909-b234-68bdc90b9c01 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40a744c1-33f8-4909-b234-68bdc90b9c01 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 9223372036854775808 could not be found. Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '9223372036854775808'} Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:24.932550 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:24.938639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:24.938639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:24.938639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:24.938639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 28 10:16:24.938639 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:24.938639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40a744c1-33f8-4909-b234-68bdc90b9c01 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:24.938639 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-40a744c1-33f8-4909-b234-68bdc90b9c01 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.010764 Oct 28 10:16:24.939767 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2705/5423] 10.222.0.16 () {58 vars in 1188 bytes} [Fri Oct 28 10:16:24 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:16:24.945150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:24.945775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:24.953202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:24.968279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:24.968791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:24.969263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:24.972383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:24.974651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:24.975400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.057478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:25.059083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:25.065423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:25.066886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:25.077279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.077905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.078799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.080016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.080709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.081469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.324791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:25.328804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:25.338063 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00c15c51-f75e-4158-a435-93bb5787e2c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.398691 Oct 28 10:16:25.354942 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2719/5424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:24 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:25.364977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:25.367302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:25.374315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.374812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.375487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.376600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.377091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.377825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.401709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:25.417933 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29f1f63c-d341-4932-be1f-91f8a61cde63 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.359863 Oct 28 10:16:25.446994 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2706/5425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:25 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:25.454350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:25.455006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:25.461252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.461753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.462205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.463031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.463600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.464135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.611902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0c3eaac6b4f4b2685de2d234573e33a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72af6d56f0b5448fb4b98075f4d6be0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:25.640646 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d16a57f-c3b6-45cf-97e8-5a99d5d1c73f tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 200 len: 1504 microversion: 2.1 time: 0.283303 Oct 28 10:16:25.654517 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2720/5426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:25 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 1504 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:25.870624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:25.882681 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6a9ac1a0-5f47-4129-9708-22a02c5d4b27 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.434487 Oct 28 10:16:25.887370 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2707/5427] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:25 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:25.925193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8bb8b31-32ae-4299-a7c3-7fa5bdc13ba7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:25.925984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c8bb8b31-32ae-4299-a7c3-7fa5bdc13ba7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Failed to fetch instance by id -1 {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 10:16:25.928590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c8bb8b31-32ae-4299-a7c3-7fa5bdc13ba7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance -1 could not be found. Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8bb8b31-32ae-4299-a7c3-7fa5bdc13ba7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance -1 could not be found. Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '-1'} Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:25.936075 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:25.940829 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:25.940829 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:25.940829 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 28 10:16:25.940829 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:25.946465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8bb8b31-32ae-4299-a7c3-7fa5bdc13ba7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:25.947846 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c8bb8b31-32ae-4299-a7c3-7fa5bdc13ba7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.037457 Oct 28 10:16:25.952821 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2708/5428] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:16:25 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:16:25.963723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:25.969139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:25.979853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.980355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.980792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:25.981619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:25.982010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:25.983098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.201431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:26.226914 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-891aa1d9-fc36-4421-b595-8b4df31db04c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.267986 Oct 28 10:16:26.229196 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2709/5429] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:25 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:26.262501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:26.263271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:26.295558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.297130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.300097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.302987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.303918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.306274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.373350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f636b55d-4b2d-4417-895a-636b6652df2e req-3d84f3b7-a2b9-4552-9c97-f42ed63082d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d40455eb-aedf-43f1-93e1-8ad20989f995", "name": "network-vif-deleted", "tag": "971a3b7a-0a73-47c9-939e-1ed2f28f134a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:26.386013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f636b55d-4b2d-4417-895a-636b6652df2e req-3d84f3b7-a2b9-4552-9c97-f42ed63082d1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.387293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f636b55d-4b2d-4417-895a-636b6652df2e req-3d84f3b7-a2b9-4552-9c97-f42ed63082d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.389900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f636b55d-4b2d-4417-895a-636b6652df2e req-3d84f3b7-a2b9-4552-9c97-f42ed63082d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.420027 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f636b55d-4b2d-4417-895a-636b6652df2e req-3d84f3b7-a2b9-4552-9c97-f42ed63082d1 service nova] Creating event network-vif-deleted:971a3b7a-0a73-47c9-939e-1ed2f28f134a for instance d40455eb-aedf-43f1-93e1-8ad20989f995 on n-h2-zed-1 Oct 28 10:16:26.432343 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f636b55d-4b2d-4417-895a-636b6652df2e req-3d84f3b7-a2b9-4552-9c97-f42ed63082d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602332 Oct 28 10:16:26.434298 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2721/5430] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:26.459546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:26.460321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:26.477144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.479354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.479819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.484569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.485290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.485750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.604139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:26.622587 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94a1af1a-f32e-4338-8a2b-fb3b1197fe75 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.366380 Oct 28 10:16:26.623815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2710/5431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:26 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:26.658847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4db8242-0d94-423c-b31a-2909a460f6f7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:26.660334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d4db8242-0d94-423c-b31a-2909a460f6f7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 97e608d3-949d-4094-b1b8-fc27b67c721c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:26.672385 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-d4db8242-0d94-423c-b31a-2909a460f6f7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 97e608d3-949d-4094-b1b8-fc27b67c721c could not be found. Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4db8242-0d94-423c-b31a-2909a460f6f7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/97e608d3-949d-4094-b1b8-fc27b67c721c/action HTTP/1.1 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 19 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: {"forceDelete": {}} Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 97e608d3-949d-4094-b1b8-fc27b67c721c could not be found. Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '97e608d3-949d-4094-b1b8-fc27b67c721c', 'body': {'forceDelete': {}}} Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97e608d3-949d-4094-b1b8-fc27b67c721c could not be found. Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97e608d3-949d-4094-b1b8-fc27b67c721c could not be found. Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:26.681731 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:26.687470 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:26.687470 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:26.687470 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97e608d3-949d-4094-b1b8-fc27b67c721c could not be found. Oct 28 10:16:26.687470 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.688872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4db8242-0d94-423c-b31a-2909a460f6f7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 97e608d3-949d-4094-b1b8-fc27b67c721c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:26.689925 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d4db8242-0d94-423c-b31a-2909a460f6f7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/97e608d3-949d-4094-b1b8-fc27b67c721c/action" status: 404 len: 111 microversion: 2.1 time: 0.046570 Oct 28 10:16:26.690612 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2711/5432] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:26 2022] POST /compute/v2.1/servers/97e608d3-949d-4094-b1b8-fc27b67c721c/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:16:26.695524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:26.696417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] [instance: d40455eb-aedf-43f1-93e1-8ad20989f995] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:26.717611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.718114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.718548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.719259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.719710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.720132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.751277 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] HTTP exception thrown: Instance d40455eb-aedf-43f1-93e1-8ad20989f995 could not be found. Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Request method failure captured: Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 HTTP/1.1 Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6u8wpPBSZ2ehy4xFfwF62yLkRWasDU4KFJEpFgjg9d7osCtiJO7KWjBSXFfOthapA15IGCaUtOMzRCpmQ2wtPt6LRDYD4C4bMv7og2PiZUoDCas9xwGhpp0x_pfhaVCwUKQO5fb-mbfHGXOHdwtU4hqDD0DGpIOWAbo_acklRB6XLo Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 72af6d56f0b5448fb4b98075f4d6be0b Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesActionsTest-641606942 Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/72af6d56f0b5448fb4b98075f4d6be0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/72af6d56f0b5448fb4b98075f4d6be0b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_72af6d56f0b5448fb4b98075f4d6be0b", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/72af6d56f0b5448fb4b98075f4d6be0b"}]}] Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesActionsTest-641606942 Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 72af6d56f0b5448fb4b98075f4d6be0b Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesActionsTest-641606942 Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesActionsTest-641606942-project Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a0c3eaac6b4f4b2685de2d234573e33a Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesActionsTest-641606942-project Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance d40455eb-aedf-43f1-93e1-8ad20989f995 could not be found. Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'd40455eb-aedf-43f1-93e1-8ad20989f995'} Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d40455eb-aedf-43f1-93e1-8ad20989f995 could not be found. Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d40455eb-aedf-43f1-93e1-8ad20989f995 could not be found. Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:26.752965 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d40455eb-aedf-43f1-93e1-8ad20989f995 could not be found. Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] Returning 404 to user: Instance d40455eb-aedf-43f1-93e1-8ad20989f995 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2fb6232d-b410-4f27-9e0a-4caeb06f9aae tempest-VolumesActionsTest-641606942 tempest-VolumesActionsTest-641606942-project] 10.222.0.16 "GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995" status: 404 len: 111 microversion: 2.1 time: 0.062678 Oct 28 10:16:26.758661 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2712/5433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:26 2022] GET /compute/v2.1/servers/d40455eb-aedf-43f1-93e1-8ad20989f995 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:26.759483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:26.786022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:26.796809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.797592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.798229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.799273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:26.799938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:26.801160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:26.821553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:26.839090 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f045b37b-99e6-496a-bfcb-2b6332831839 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.390215 Oct 28 10:16:26.840044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2722/5434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:26 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:27.166231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:27.177236 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c99b7ec-86fa-47e0-aed5-d984d1ff4b43 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.421127 Oct 28 10:16:27.196855 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2713/5435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:26 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:27.208146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:27.209677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:27.233565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:27.235723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:27.237591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:27.238759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:27.242032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:27.242746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:27.595397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:27.609053 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec508752-a99f-47b4-91bb-f2514cd2582d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.403039 Oct 28 10:16:27.611908 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2723/5436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:27 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:27.634148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28876fb7-fe6a-4af6-bf56-40368bde4ee4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:27.637884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-28876fb7-fe6a-4af6-bf56-40368bde4ee4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: d8fe7542-ca7c-4067-8e1a-63e0bf0522f6] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:27.644135 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-28876fb7-fe6a-4af6-bf56-40368bde4ee4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance d8fe7542-ca7c-4067-8e1a-63e0bf0522f6 could not be found. Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28876fb7-fe6a-4af6-bf56-40368bde4ee4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/d8fe7542-ca7c-4067-8e1a-63e0bf0522f6/action HTTP/1.1 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 39 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: {"os-getConsoleOutput": {"length": 10}} Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance d8fe7542-ca7c-4067-8e1a-63e0bf0522f6 could not be found. Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'd8fe7542-ca7c-4067-8e1a-63e0bf0522f6', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8fe7542-ca7c-4067-8e1a-63e0bf0522f6 could not be found. Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8fe7542-ca7c-4067-8e1a-63e0bf0522f6 could not be found. Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:27.655019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8fe7542-ca7c-4067-8e1a-63e0bf0522f6 could not be found. Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28876fb7-fe6a-4af6-bf56-40368bde4ee4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance d8fe7542-ca7c-4067-8e1a-63e0bf0522f6 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28876fb7-fe6a-4af6-bf56-40368bde4ee4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/d8fe7542-ca7c-4067-8e1a-63e0bf0522f6/action" status: 404 len: 111 microversion: 2.1 time: 0.028886 Oct 28 10:16:27.663983 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2714/5437] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:27 2022] POST /compute/v2.1/servers/d8fe7542-ca7c-4067-8e1a-63e0bf0522f6/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:27.672828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:27.673748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:27.681913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:27.682858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:27.683858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:27.685041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:27.685981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:27.687781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:27.864288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:27.865000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:27.882798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:27.883719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:27.888198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:27.899405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:27.901967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:27.903068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:27.960576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:27.974714 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c7f7ba3d-8d25-4ea3-99e0-6da51e6d6899 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.306642 Oct 28 10:16:27.988999 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2724/5438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:27 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:28.002508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:28.003448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:28.012182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:28.013222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:28.014464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:28.015435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:28.016112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:28.016771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:28.254378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:28.266055 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7c257bca-afbd-4022-8748-fb21d3376a91 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.269371 Oct 28 10:16:28.269673 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2725/5439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:27 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:28.296612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d059da58-32a1-42d0-9ab2-a981be028bf1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:28.300076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d059da58-32a1-42d0-9ab2-a981be028bf1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 30401984-3530-48d6-b7cf-219101b53da9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:28.308618 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d059da58-32a1-42d0-9ab2-a981be028bf1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 30401984-3530-48d6-b7cf-219101b53da9 could not be found. Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d059da58-32a1-42d0-9ab2-a981be028bf1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/30401984-3530-48d6-b7cf-219101b53da9 HTTP/1.1 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 30401984-3530-48d6-b7cf-219101b53da9 could not be found. Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '30401984-3530-48d6-b7cf-219101b53da9'} Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30401984-3530-48d6-b7cf-219101b53da9 could not be found. Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30401984-3530-48d6-b7cf-219101b53da9 could not be found. Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:28.317088 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:28.323765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:28.323765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:28.323765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:28.323765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30401984-3530-48d6-b7cf-219101b53da9 could not be found. Oct 28 10:16:28.323765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:28.330623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d059da58-32a1-42d0-9ab2-a981be028bf1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 30401984-3530-48d6-b7cf-219101b53da9 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:28.331866 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d059da58-32a1-42d0-9ab2-a981be028bf1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/30401984-3530-48d6-b7cf-219101b53da9" status: 404 len: 111 microversion: 2.1 time: 0.043089 Oct 28 10:16:28.333052 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2726/5440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:28 2022] GET /compute/v2.1/servers/30401984-3530-48d6-b7cf-219101b53da9 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:16:28.340866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:28.345607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:28.360758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:28.363949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:28.364659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:28.365808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:28.367970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:28.368873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:28.664934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:28.676301 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c84d648d-b641-40c3-93a8-a48c9ed999bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.337956 Oct 28 10:16:28.677866 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2727/5441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:28 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:28.705341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:28.706356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:28.719140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:28.721876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:28.722932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:28.723839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:28.725858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:28.729333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:28.898526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:28.909948 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eccabbda-3ded-4f4a-a42b-a749b63506f0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 1.049269 Oct 28 10:16:28.910848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2715/5442] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:27 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:29.458570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:29.468840 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74c04f7a-cc32-4e7e-b090-a9dfb705a62b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.768904 Oct 28 10:16:29.470070 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2728/5443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:28 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:29.758858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5933e92e-5a99-404b-9d4b-255c1a6ae31c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-20313531", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5933e92e-5a99-404b-9d4b-255c1a6ae31c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 236 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-20313531", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-20313531', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.774490 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5933e92e-5a99-404b-9d4b-255c1a6ae31c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:29.780977 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5933e92e-5a99-404b-9d4b-255c1a6ae31c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.021478 Oct 28 10:16:29.788061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:29.788792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:29.797641 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2716/5444] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:29.801592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:29.803981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:29.804550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:29.806887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:29.807767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:29.809285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:29.951409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:29.953600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:29.987139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:29.992727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:29.995340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:29.996308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:29.997338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:29.998010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:30.231949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:30.241970 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92bab6ba-2c5d-43cd-ac1a-30385f1843be tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.458599 Oct 28 10:16:30.242472 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2729/5445] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:29 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:30.269670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:30.279678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:30.290523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:30.301749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:30.305468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:30.307431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:30.310882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:30.313987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:30.522809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:30.544714 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f3d5d2f8-0b41-4226-a143-672215c93d4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.611761 Oct 28 10:16:30.553761 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2717/5446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:29 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:30.891373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:30.903377 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-501a0bce-2b68-414a-af02-10e61037da41 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.637496 Oct 28 10:16:30.926374 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2730/5447] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:30 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:31.051540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9f42be0-7950-4e11-8aef-b2cbaa91b7cc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-397092741", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9f42be0-7950-4e11-8aef-b2cbaa91b7cc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 234 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-397092741", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-397092741', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.073699 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 28 10:16:31.080346 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:31.085414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9f42be0-7950-4e11-8aef-b2cbaa91b7cc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:31.088759 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9f42be0-7950-4e11-8aef-b2cbaa91b7cc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.047563 Oct 28 10:16:31.092455 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2718/5448] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:31 2022] POST /compute/v2.1/servers => generated 133 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:31.099600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:31.100623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:31.116261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:31.123575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:31.124262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:31.126768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:31.128060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:31.130374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:31.512169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:31.525839 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c46979ad-e022-47ca-b702-5d99c09a0ea4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.428997 Oct 28 10:16:31.526725 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2731/5449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:31 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:31.557779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:31.558866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:31.590022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:31.590247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:31.590794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:31.591250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:31.593920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:31.611333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:31.611819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:31.612010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:31.613534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:31.614143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:31.614854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:31.617313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:31.617984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:31.619671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:31.940626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:31.953294 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-949eda21-7266-49ae-ad82-e10e0dbeb370 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.375581 Oct 28 10:16:31.964565 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2732/5450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:31 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:32.429900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:32.444975 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bcf5a1c8-d9bd-4519-aca5-9b4c675dc31d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.890666 Oct 28 10:16:32.446506 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2719/5451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:31 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:32.474868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-589ea0b7-a2d8-447f-a10f-87286cf191dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:32.488983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-589ea0b7-a2d8-447f-a10f-87286cf191dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 5867cf01-bfda-4c37-b973-acfd84bbf41e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:32.524183 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-589ea0b7-a2d8-447f-a10f-87286cf191dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 5867cf01-bfda-4c37-b973-acfd84bbf41e could not be found. Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-589ea0b7-a2d8-447f-a10f-87286cf191dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/5867cf01-bfda-4c37-b973-acfd84bbf41e/action HTTP/1.1 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 13 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: {"pause": {}} Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 5867cf01-bfda-4c37-b973-acfd84bbf41e could not be found. Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '5867cf01-bfda-4c37-b973-acfd84bbf41e', 'body': {'pause': {}}} Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5867cf01-bfda-4c37-b973-acfd84bbf41e could not be found. Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5867cf01-bfda-4c37-b973-acfd84bbf41e could not be found. Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:32.534223 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:32.539901 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:32.539901 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:32.539901 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5867cf01-bfda-4c37-b973-acfd84bbf41e could not be found. Oct 28 10:16:32.539901 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:32.539901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-589ea0b7-a2d8-447f-a10f-87286cf191dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 5867cf01-bfda-4c37-b973-acfd84bbf41e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:32.539901 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-589ea0b7-a2d8-447f-a10f-87286cf191dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/5867cf01-bfda-4c37-b973-acfd84bbf41e/action" status: 404 len: 111 microversion: 2.1 time: 0.065859 Oct 28 10:16:32.539901 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2733/5452] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:32 2022] POST /compute/v2.1/servers/5867cf01-bfda-4c37-b973-acfd84bbf41e/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:32.549715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:32.550599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:32.557623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:32.558389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:32.558827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:32.559554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:32.560015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:32.580186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:32.989122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:32.989727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:32.999571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:33.000080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:33.000529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:33.001279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:33.001746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:33.002179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:33.707085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:33.730869 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c10582ea-4469-4934-8e99-99fa7e2cd643 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.737462 Oct 28 10:16:33.731559 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2734/5453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:32 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:33.893260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:33.908613 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2c9fda94-73a5-4b1d-a138-d0b6c72dc596 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 1.362648 Oct 28 10:16:33.909891 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2720/5454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:32 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:33.941186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:33.941833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:33.958449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:33.958967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:33.959418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:33.968290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:33.969977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:33.972008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:34.286437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:34.299790 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0bca0f9a-e2a6-4ede-8885-ccce71213292 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.364838 Oct 28 10:16:34.313238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2735/5455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:33 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:34.338834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:34.339444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:34.354896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:34.356031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:34.356699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:34.359541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:34.360405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:34.361412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:34.587312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ec3d7dd-0e91-40ae-af7a-25bbcaaf452b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 202 len: 0 microversion: 2.1 time: 0.252687 Oct 28 10:16:34.588572 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2721/5456] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:34 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:16:34.615526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:34.616155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:34.643512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:34.649244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:34.649556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:34.650768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:34.651464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:34.652073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:34.781681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:34.783250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:34.813091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:34.813806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:34.814417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:34.818079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:34.819682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:34.821203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:34.839937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:35.369823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:35.416319 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e1de588-46e9-4230-92c1-5ee0cd0f848e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1510 microversion: 2.1 time: 0.823488 Oct 28 10:16:35.419561 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2736/5457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:34 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1510 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:35.522729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:35.539859 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a354dd52-f213-429b-ba61-34d8c352a777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.781076 Oct 28 10:16:35.542096 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2722/5458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:34 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:36.446830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:36.447474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:36.454637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:36.466036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:36.469807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:36.471066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:36.474026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:36.479813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:36.566904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:36.568560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:36.600994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:36.601860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:36.602541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:36.604135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:36.606032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:36.613357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:36.976380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:36.986352 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6d37118c-d5d0-414d-81a8-7b808e9934bb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.423600 Oct 28 10:16:36.987641 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2723/5459] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:36 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:37.337378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:37.352627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-70ec03cb-c2d0-47d9-b048-e305623a779f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1490 microversion: 2.1 time: 0.910444 Oct 28 10:16:37.356508 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2737/5460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:36 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1490 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:37.380085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:37.380985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:37.391342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:37.392584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:37.393552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:37.395804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:37.397935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:37.398638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:37.457196 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Cannot 'pause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state paused Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action HTTP/1.1 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 13 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: {"pause": {}} Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'pause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state paused Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'pause': {}}} Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e in vm_state paused. Cannot pause while the instance is in this state. Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state paused Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:37.463773 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:37.469652 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:37.469652 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:37.469652 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:37.469652 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state paused Oct 28 10:16:37.469652 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:37.474930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 409 to user: Cannot 'pause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state paused {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:37.477483 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0fec6411-6247-441d-a7ae-985d31487d21 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 409 len: 143 microversion: 2.1 time: 0.101875 Oct 28 10:16:37.478624 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2724/5461] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:37 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 143 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 28 10:16:37.488326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:37.488892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:37.511677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:37.520328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:37.523590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:37.524713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:37.530757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:37.533019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:37.689065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:37.756406 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-39b13878-218a-483e-bda8-706d72cd94d9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 202 len: 0 microversion: 2.1 time: 0.267158 Oct 28 10:16:37.757173 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2738/5462] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:37 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:16:37.766033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:37.766661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:37.778869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:37.783222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:37.783687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:37.790592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:37.791274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:37.791539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:37.999327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-66993445", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "5cbfeb20-6702-491b-bd27-b55382d17e26"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:38.203458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] validate_networks() for [('5cbfeb20-6702-491b-bd27-b55382d17e26', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:16:38.259483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:38.288952 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ff921e3-ea22-4168-8396-ad006b71d713 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1497 microversion: 2.1 time: 0.527137 Oct 28 10:16:38.293781 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2725/5463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:37 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1497 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:38.300477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:38.301130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:38.322087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:38.322593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:38.323038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:38.323751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:38.324210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:38.324641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:38.661245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:38.676638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7bc92a75-f0a5-4ad9-b82e-cd5bfe296052 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 0.376839 Oct 28 10:16:38.677639 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2726/5464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:38 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:39.315659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:39.317718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:39.325261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:39.326545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:39.327175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:39.328081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:39.328707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:39.329340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:39.438373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:16:39.439195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:16:39.439332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:16:39.439672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:16:39.440087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:16:39.458411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:39.465889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:39.469293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:39.472142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:39.472840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:39.474786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:39.576063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Getting quotas for project 3ce2931e024a42219d4ed709e828b03d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:16:39.592391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Getting quotas for user 90e6b24b39a3428882a1dee1bc3281bc and project 3ce2931e024a42219d4ed709e828b03d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:16:39.625680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:16:39.628594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:16:39.714841 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-20eeb9cd-44c9-4912-a865-3e6443acc21f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941683 Oct 28 10:16:39.715527 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2739/5465] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:16:39.724494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:39.725665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:39.734752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:39.735533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:39.736199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:39.737149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:39.737796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:39.738463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:39.859130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:39.872278 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d62c925-2ead-47cb-a6cc-9bcc9fa1965d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.560402 Oct 28 10:16:39.880691 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2727/5466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:39 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:39.896885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25e1d21e-bfdf-4338-806a-7a861aa61c82 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:39.905404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25e1d21e-bfdf-4338-806a-7a861aa61c82 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:40.072027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-25e1d21e-bfdf-4338-806a-7a861aa61c82 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:40.080666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25e1d21e-bfdf-4338-806a-7a861aa61c82 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1223 microversion: 2.1 time: 0.198536 Oct 28 10:16:40.087103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2728/5467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:39 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1223 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:40.104896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:40.107937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:40.119530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:40.120349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:40.121085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:40.122999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:40.123853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:40.124523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:40.382263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:40.398810 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2799da1b-665f-4f40-8212-ecbf04cdf42f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.310527 Oct 28 10:16:40.407979 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2729/5468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:40 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:40.413647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0484c491-49c2-4ac5-8e85-0364d7e70fc8 req-aae3bb2a-8d2e-400f-b31b-d49ff2ffdeb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "name": "network-vif-plugged", "status": "completed", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:40.436031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0484c491-49c2-4ac5-8e85-0364d7e70fc8 req-aae3bb2a-8d2e-400f-b31b-d49ff2ffdeb4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:40.436926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0484c491-49c2-4ac5-8e85-0364d7e70fc8 req-aae3bb2a-8d2e-400f-b31b-d49ff2ffdeb4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:40.437643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0484c491-49c2-4ac5-8e85-0364d7e70fc8 req-aae3bb2a-8d2e-400f-b31b-d49ff2ffdeb4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:40.454786 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0484c491-49c2-4ac5-8e85-0364d7e70fc8 req-aae3bb2a-8d2e-400f-b31b-d49ff2ffdeb4 service nova] Creating event network-vif-plugged:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:16:40.464868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0484c491-49c2-4ac5-8e85-0364d7e70fc8 req-aae3bb2a-8d2e-400f-b31b-d49ff2ffdeb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053475 Oct 28 10:16:40.481841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2730/5469] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:40.491291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:40.500539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:40.545619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:40.547350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:40.549699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:40.551631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:40.553453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:40.564873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:40.617104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb/action HTTP/1.1 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 28 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: {"reboot": {"type": "SOFT"}} Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '21e7e1cc-120d-4870-8b90-49c4d60ea6fb', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:40.622020 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:40.627438 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:40.633380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:40.636967 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7f3244c-af25-4763-8f11-c80eafe9ad4e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb/action" status: 404 len: 111 microversion: 2.1 time: 0.152050 Oct 28 10:16:40.642173 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2731/5470] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:40 2022] POST /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb/action => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:40.648151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:40.648930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:40.658436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:40.659064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:40.659610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:40.660675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:40.661416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:40.662372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:41.285438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:41.317468 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d301f9e-35f1-427f-9c6e-def398bcaee6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1363 microversion: 2.1 time: 1.596886 Oct 28 10:16:41.321590 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2740/5471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:39 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1363 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:41.366892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:41.369004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:41.400205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:41.405872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:41.417246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:41.419808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:41.449260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:41.452475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:41.516380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:41.526327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9699d2f8-f611-4362-ac4e-67ab3bee86ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.882797 Oct 28 10:16:41.539095 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2732/5472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:40 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:41.576827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:41.581161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:41.611328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:41.611839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:41.612303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:41.613048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:41.613513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:41.616236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:41.830487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:41.850601 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b182d799-f3f6-4df5-b986-4e181be9b5f6 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1227 microversion: 2.1 time: 0.527534 Oct 28 10:16:41.855513 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2741/5473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:41 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1227 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:42.335198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:42.344228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:42.344849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:42.350600 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c0e5fa6-a5ff-42ba-920f-41d76ce64aed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.786464 Oct 28 10:16:42.353394 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2733/5474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:41 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:42.379702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-760bfe33-8938-4450-ae9a-5e7d0159bb52 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:42.383023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-760bfe33-8938-4450-ae9a-5e7d0159bb52 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: e68cc729-4a32-41cf-9052-a7cdc696eb73] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:42.385835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:42.386353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:42.386807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:42.387542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:42.388053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:42.388496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:42.402568 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-760bfe33-8938-4450-ae9a-5e7d0159bb52 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance e68cc729-4a32-41cf-9052-a7cdc696eb73 could not be found. Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-760bfe33-8938-4450-ae9a-5e7d0159bb52 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/e68cc729-4a32-41cf-9052-a7cdc696eb73/action HTTP/1.1 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 28 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: {"reboot": {"type": "SOFT"}} Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e68cc729-4a32-41cf-9052-a7cdc696eb73 could not be found. Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e68cc729-4a32-41cf-9052-a7cdc696eb73', 'body': {'reboot': {'type': 'SOFT'}}} Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e68cc729-4a32-41cf-9052-a7cdc696eb73 could not be found. Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e68cc729-4a32-41cf-9052-a7cdc696eb73 could not be found. Oct 28 10:16:42.409279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e68cc729-4a32-41cf-9052-a7cdc696eb73 could not be found. Oct 28 10:16:42.415006 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:42.421013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-760bfe33-8938-4450-ae9a-5e7d0159bb52 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance e68cc729-4a32-41cf-9052-a7cdc696eb73 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:42.427259 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-760bfe33-8938-4450-ae9a-5e7d0159bb52 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/e68cc729-4a32-41cf-9052-a7cdc696eb73/action" status: 404 len: 111 microversion: 2.1 time: 0.052335 Oct 28 10:16:42.428156 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2734/5475] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:42 2022] POST /compute/v2.1/servers/e68cc729-4a32-41cf-9052-a7cdc696eb73/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:42.451951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:42.455675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:42.481332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:42.482792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:42.485282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:42.486256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:42.489205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:42.489916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:42.575699 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-227630f7-e5fe-43fd-9aa2-8490a411563f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/ips" status: 200 len: 150 microversion: 2.1 time: 0.145489 Oct 28 10:16:42.585961 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2735/5476] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:16:42 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/ips => generated 150 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:42.601730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:42.602775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:42.612789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:42.616133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:42.617093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:42.618712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:42.621596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:42.622169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:43.228084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:43.253840 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9460897d-cdb9-455d-b79b-3199fb4d07eb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.660043 Oct 28 10:16:43.257992 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2736/5477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:42 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:43.301608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:43.303590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:43.342643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:43.348358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:43.348861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:43.355526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:43.361114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:43.366491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:43.550428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:43.567631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1691a79-247a-48a7-afae-0f3930f9b0fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1549 microversion: 2.1 time: 1.227183 Oct 28 10:16:43.580058 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2742/5478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:42 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1549 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:43.586723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:43.612403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:43.672875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:43.678879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:43.681471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:43.683558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:43.691607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:43.693821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:43.826757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:43.853670 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a09db3b-2483-455a-9c35-bb031349b35f tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1283 microversion: 2.1 time: 0.582551 Oct 28 10:16:43.855215 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2737/5479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:43 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1283 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:43.861111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:43.870445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:43.891207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:43.901046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:43.903472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:43.907346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:43.909969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:43.910686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:44.400468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:44.410506 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e50985c6-e1ea-442b-b568-17a0727547ed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.829123 Oct 28 10:16:44.414305 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2743/5480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:43 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:44.437166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:44.442739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:44.464390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:44.464923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:44.465379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:44.474859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:44.475572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:44.476034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:44.505069 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb/action HTTP/1.1 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 65 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '21e7e1cc-120d-4870-8b90-49c4d60ea6fb', 'body': {'rebuild': {'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1'}}} Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 10:16:44.509718 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:16:44.516325 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:44.521171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:44.522312 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6fe2368e-56e5-4908-96a3-cf5b5596f28e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb/action" status: 404 len: 111 microversion: 2.1 time: 0.090330 Oct 28 10:16:44.526740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2744/5481] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:44 2022] POST /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:16:44.536198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:44.538975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:44.552478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:44.553840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:44.554508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:44.558224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:44.558995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:44.559684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:45.217896 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-847c1d4c-389f-4b31-8e52-d4bbafcc38bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 1.361269 Oct 28 10:16:45.226673 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2738/5482] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:16:43 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/os-interface => generated 284 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:45.233941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:45.236520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:45.253718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:45.258385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:45.268518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:45.270487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:45.272701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:45.273526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:45.478628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:45.494018 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ad7f373-bbdd-462e-bdef-a60c69687404 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1281 microversion: 2.1 time: 0.259507 Oct 28 10:16:45.505999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2739/5483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:45 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1281 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:46.127318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81664b39-807e-43c6-84a8-bf2417f6690f"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:46.129842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:46.155242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:46.158658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:46.161748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:46.164006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:46.166566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:46.169203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:46.794035 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-37a368de-3e81-4915-96f5-69dde55cf8f0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675890 Oct 28 10:16:46.795907 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2740/5484] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:16:46 2022] POST /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:16:46.820943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:46.821993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:46.840994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:46.842036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:46.842746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:46.843518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:46.844956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:46.846891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:46.847538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:46.871194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a1798e4-6572-49e1-9a2f-97b2349bdb33 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 2.336233 Oct 28 10:16:46.871944 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2745/5485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:44 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 2341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:46.906257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:46.907027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:46.924525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:46.925441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:46.926147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:46.927111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:46.927816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:46.929512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:47.492731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:47.497430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:47.502739 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8f3d9307-597e-4c12-9570-d7a2fbfd0baf tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.705284 Oct 28 10:16:47.538129 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2741/5486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:46 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:47.963255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:47.973853 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4c7dbff-b9d4-452e-9884-a18dcfcf64d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 1.074116 Oct 28 10:16:47.978405 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2746/5487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:46 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:48.009672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b18e778-ade6-4d45-85dc-6fbe9b5392bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:48.013437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b18e778-ade6-4d45-85dc-6fbe9b5392bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: b5067ca8-bc82-4af5-90e6-491e52b2805b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:48.036127 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4b18e778-ade6-4d45-85dc-6fbe9b5392bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance b5067ca8-bc82-4af5-90e6-491e52b2805b could not be found. Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b18e778-ade6-4d45-85dc-6fbe9b5392bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/b5067ca8-bc82-4af5-90e6-491e52b2805b/action HTTP/1.1 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 65 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance b5067ca8-bc82-4af5-90e6-491e52b2805b could not be found. Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'b5067ca8-bc82-4af5-90e6-491e52b2805b', 'body': {'rebuild': {'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1'}}} Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5067ca8-bc82-4af5-90e6-491e52b2805b could not be found. Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 28 10:16:48.040533 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5067ca8-bc82-4af5-90e6-491e52b2805b could not be found. Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5067ca8-bc82-4af5-90e6-491e52b2805b could not be found. Oct 28 10:16:48.046691 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:48.049505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b18e778-ade6-4d45-85dc-6fbe9b5392bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance b5067ca8-bc82-4af5-90e6-491e52b2805b could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:48.051948 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b18e778-ade6-4d45-85dc-6fbe9b5392bb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/b5067ca8-bc82-4af5-90e6-491e52b2805b/action" status: 404 len: 111 microversion: 2.1 time: 0.047058 Oct 28 10:16:48.060220 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2742/5488] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:48 2022] POST /compute/v2.1/servers/b5067ca8-bc82-4af5-90e6-491e52b2805b/action => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:48.066111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:48.066936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:48.087423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:48.087984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:48.088485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:48.095059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:48.095677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:48.096147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:48.527086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:48.528884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:48.575058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:48.576238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:48.576712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:48.593833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:48.594605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:48.595329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:48.805625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:48.817839 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4aeaadb9-5715-42de-b283-5842d58dc70f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.756748 Oct 28 10:16:48.824205 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2747/5489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:48 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:48.850190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:48.852193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:48.875063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:48.878956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:48.888683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:48.890643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:48.891648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:48.894097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:49.319086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:49.335187 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6212769b-d616-4d8d-a993-04b819bd3a0e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.813024 Oct 28 10:16:49.336447 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2743/5490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:48 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:49.505603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:49.617120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:49.684178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:49.694598 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c7aeaf2-2b52-4959-b917-23f6c837e251 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.848399 Oct 28 10:16:49.705612 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2748/5491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:48 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:49.729525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ad3ee67-17f3-421e-8c68-87e746b3ebf7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:49.730356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0ad3ee67-17f3-421e-8c68-87e746b3ebf7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: ed963578-0119-41a2-89ed-e091d4d78d25] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:49.741202 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-0ad3ee67-17f3-421e-8c68-87e746b3ebf7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance ed963578-0119-41a2-89ed-e091d4d78d25 could not be found. Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ad3ee67-17f3-421e-8c68-87e746b3ebf7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/ed963578-0119-41a2-89ed-e091d4d78d25/action HTTP/1.1 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 15 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: {"restore": {}} Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ed963578-0119-41a2-89ed-e091d4d78d25 could not be found. Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ed963578-0119-41a2-89ed-e091d4d78d25', 'body': {'restore': {}}} Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed963578-0119-41a2-89ed-e091d4d78d25 could not be found. Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed963578-0119-41a2-89ed-e091d4d78d25 could not be found. Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:49.749507 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:49.754348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:49.754348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:49.754348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed963578-0119-41a2-89ed-e091d4d78d25 could not be found. Oct 28 10:16:49.754348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:49.754348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ad3ee67-17f3-421e-8c68-87e746b3ebf7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance ed963578-0119-41a2-89ed-e091d4d78d25 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:49.754348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ad3ee67-17f3-421e-8c68-87e746b3ebf7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/ed963578-0119-41a2-89ed-e091d4d78d25/action" status: 404 len: 111 microversion: 2.1 time: 0.026443 Oct 28 10:16:49.759817 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2744/5492] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:49 2022] POST /compute/v2.1/servers/ed963578-0119-41a2-89ed-e091d4d78d25/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:49.762429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:49.763862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:49.777202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:49.786008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:49.786840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:49.790357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:49.793922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:49.795250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:50.363206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:50.366479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:50.376377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:50.378881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:50.379924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:50.380917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:50.410139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:50.412395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:50.415295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:50.430933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:50.453355 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1d9178c-24b7-4e2c-af43-460f01e96d8d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.693202 Oct 28 10:16:50.479233 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2749/5493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:49 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:50.527637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:50.529743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:50.559200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:50.561875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:50.562521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:50.564178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:50.564885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:50.567301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.221334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:51.230321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b478560-e7dd-48b5-a6eb-f2e880bb97d0 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.873428 Oct 28 10:16:51.248674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:51.257201 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2745/5494] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:50 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:51.261396 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-05b798ff-d04d-4fe3-bfb7-4366c50bbeed tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.752911 Oct 28 10:16:51.262273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2750/5495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:50 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:51.270968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c75c2500-d2d6-42a9-86e8-232dd3b45f16 req-751de3f6-0150-422b-9af6-3a79e39dc749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:51.276793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-576deb6a-e1c3-491f-9d71-17122333c07e req-93537943-b7fa-4145-b8d4-9e3c3f4ea1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357ac794-3f28-428c-8023-13e193734866", "tag": "dea50373-404f-4df6-9985-8a099b847c70"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:51.286039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c75c2500-d2d6-42a9-86e8-232dd3b45f16 req-751de3f6-0150-422b-9af6-3a79e39dc749 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.287417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c75c2500-d2d6-42a9-86e8-232dd3b45f16 req-751de3f6-0150-422b-9af6-3a79e39dc749 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.288176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c75c2500-d2d6-42a9-86e8-232dd3b45f16 req-751de3f6-0150-422b-9af6-3a79e39dc749 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.290555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:51.294671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-576deb6a-e1c3-491f-9d71-17122333c07e req-93537943-b7fa-4145-b8d4-9e3c3f4ea1f1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.295373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-576deb6a-e1c3-491f-9d71-17122333c07e req-93537943-b7fa-4145-b8d4-9e3c3f4ea1f1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.296017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-576deb6a-e1c3-491f-9d71-17122333c07e req-93537943-b7fa-4145-b8d4-9e3c3f4ea1f1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.305782 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c75c2500-d2d6-42a9-86e8-232dd3b45f16 req-751de3f6-0150-422b-9af6-3a79e39dc749 service nova] Creating event network-changed:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:16:51.310118 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-576deb6a-e1c3-491f-9d71-17122333c07e req-93537943-b7fa-4145-b8d4-9e3c3f4ea1f1 service nova] Creating event network-changed:dea50373-404f-4df6-9985-8a099b847c70 for instance 357ac794-3f28-428c-8023-13e193734866 on n-h2-zed-1 Oct 28 10:16:51.315415 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-576deb6a-e1c3-491f-9d71-17122333c07e req-93537943-b7fa-4145-b8d4-9e3c3f4ea1f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054207 Oct 28 10:16:51.316581 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2746/5496] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:51.317479 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c75c2500-d2d6-42a9-86e8-232dd3b45f16 req-751de3f6-0150-422b-9af6-3a79e39dc749 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052939 Oct 28 10:16:51.322552 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2751/5497] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:16:51.323432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:51.324260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:51.331501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.332239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.332870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.333797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.334429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.335651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.405476 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Cannot 'restore' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action HTTP/1.1 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 15 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: {"restore": {}} Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'restore' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'restore': {}}} Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e in vm_state active. Cannot restore while the instance is in this state. Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:51.424373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:51.430184 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:51.430184 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:51.430184 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:51.430184 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:51.430184 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:51.431467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 409 to user: Cannot 'restore' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:51.432591 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73b8164a-e559-41ec-a135-0a736696d16b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 409 len: 145 microversion: 2.1 time: 0.114367 Oct 28 10:16:51.434024 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2747/5498] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:51 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 145 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:16:51.444039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:51.445218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:51.452633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.453786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.454502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.455489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.456192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.456865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.798013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:51.811949 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2de45dfc-785b-4827-b927-b4affce01c9f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.371131 Oct 28 10:16:51.814118 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2752/5499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:51 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:51.838275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:51.838905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:51.850587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.855983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.863060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:51.868454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:51.874370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:51.875774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:52.258437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:52.259315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:52.276894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:52.277890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:52.278613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:52.279538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:52.280178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:52.281716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:52.476173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:52.486549 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-18cea28f-154f-4b60-85f0-3bd25bf6cd3e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.232195 Oct 28 10:16:52.489430 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2753/5500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:52 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:53.370229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:53.389456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50a159c8-c726-46fc-acb5-276473d4c6d8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 1.555105 Oct 28 10:16:53.397461 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2748/5501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:51 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:53.424403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2e66285-eb6b-4572-803a-5760aa5d8fba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:53.424949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2e66285-eb6b-4572-803a-5760aa5d8fba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: abcfcb9e-8274-44ca-a99d-4b221e920ee6] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:53.438898 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e2e66285-eb6b-4572-803a-5760aa5d8fba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance abcfcb9e-8274-44ca-a99d-4b221e920ee6 could not be found. Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2e66285-eb6b-4572-803a-5760aa5d8fba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/abcfcb9e-8274-44ca-a99d-4b221e920ee6/action HTTP/1.1 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 14 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: {"resume": {}} Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance abcfcb9e-8274-44ca-a99d-4b221e920ee6 could not be found. Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'abcfcb9e-8274-44ca-a99d-4b221e920ee6', 'body': {'resume': {}}} Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abcfcb9e-8274-44ca-a99d-4b221e920ee6 could not be found. Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abcfcb9e-8274-44ca-a99d-4b221e920ee6 could not be found. Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:53.454376 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:53.461371 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:53.461371 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:53.461371 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abcfcb9e-8274-44ca-a99d-4b221e920ee6 could not be found. Oct 28 10:16:53.461371 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:16:53.461371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2e66285-eb6b-4572-803a-5760aa5d8fba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance abcfcb9e-8274-44ca-a99d-4b221e920ee6 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:53.461371 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2e66285-eb6b-4572-803a-5760aa5d8fba tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/abcfcb9e-8274-44ca-a99d-4b221e920ee6/action" status: 404 len: 111 microversion: 2.1 time: 0.035989 Oct 28 10:16:53.462737 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2754/5502] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:53 2022] POST /compute/v2.1/servers/abcfcb9e-8274-44ca-a99d-4b221e920ee6/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:16:53.466322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:53.467203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:53.478508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:53.482184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:53.482668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:53.483419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:53.483877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:53.484299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:53.511743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:53.512375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:53.525217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:53.526038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:53.526683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:53.527608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:53.533702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:53.534493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:53.795017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:53.812822 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44963e74-5aa9-428c-8354-723b7ab6e393 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.301520 Oct 28 10:16:53.813846 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2755/5503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:53 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:53.936191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:53.955797 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b9a11a8d-57f0-41eb-ad49-b45752a2f3b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.491709 Oct 28 10:16:53.957763 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2749/5504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:53 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:16:53.982930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:53.984042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:53.991584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:53.992387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:53.993257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:53.994971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:53.995619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:53.996766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.270782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:54.309251 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2183dbca-9868-4a73-a2d4-efbad9513369 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.322239 Oct 28 10:16:54.312101 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2756/5505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:53 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:54.342269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:54.342886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:54.364439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.373849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.374578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.375169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.375648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.376089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.458650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Cannot 'resume' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action HTTP/1.1 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 14 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: {"resume": {}} Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'resume' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'resume': {}}} Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e in vm_state active. Cannot resume while the instance is in this state. Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:54.463755 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 409 to user: Cannot 'resume' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:54.469964 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17516bed-b0a8-4fe8-9d30-58567eeed8b0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 409 len: 144 microversion: 2.1 time: 0.132503 Oct 28 10:16:54.470836 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2750/5506] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:54 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 144 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:16:54.479450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:54.480170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:54.494373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.496290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.496800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.498806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.499484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.499954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.764347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:54.774041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:54.784112 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a20bd268-ef77-4ef0-b82b-239e32d814e2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.305162 Oct 28 10:16:54.786040 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2757/5507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:54 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:54.809917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:54.810984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:54.819073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.825338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.827258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.828704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.830296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.831406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.840672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:54.842246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:54.855583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.856450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.858439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:54.872530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:54.873492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:54.874382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:55.436592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:55.457721 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1aa8a39c-50c7-4520-9018-729adefbbd42 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.648971 Oct 28 10:16:55.458801 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2751/5508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:54 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:55.488268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:55.502611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5266d8f0-fe2e-4b96-9b92-ad6c4e341d1e tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.666522 Oct 28 10:16:55.503154 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2758/5509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:54 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:55.539320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bae8172e-b97d-42f9-9671-81e6ffccdb07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bae8172e-b97d-42f9-9671-81e6ffccdb07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 160 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b3be9e65-0595-44fd-a9d6-be9889a3e39c"}]}} Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'server': {'name': '', 'imageRef': 'c7ac23d6-0e32-4a44-9d15-3c8a5df377c1', 'flavorRef': '452', 'networks': [{'uuid': 'b3be9e65-0595-44fd-a9d6-be9889a3e39c'}]}}} Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '' Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:16:55.543571 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:16:55.549417 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:55.554139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bae8172e-b97d-42f9-9671-81e6ffccdb07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:55.555207 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bae8172e-b97d-42f9-9671-81e6ffccdb07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.021424 Oct 28 10:16:55.560236 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2752/5510] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:16:55 2022] POST /compute/v2.1/servers => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:16:55.572538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:55.573747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:55.584713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:16:55.592049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:55.594752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:55.595487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:55.598403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:55.599200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:55.601476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:56.051445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:56.068233 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-de3e5643-61d3-4992-9f4a-fd2f260c0df3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.501450 Oct 28 10:16:56.069506 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2759/5511] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:55 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:56.092518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:56.093538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:56.111908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:56.116269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:56.117046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:56.119695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:56.120452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:56.124299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:56.531642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:56.533155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:56.559464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:56.559974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:56.560414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:56.561527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:56.568689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:56.569178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:56.959686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:56.978911 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-565fdc7f-3942-4c82-8d69-7313d3586a2b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.890211 Oct 28 10:16:56.981844 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2753/5512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:56 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:57.011366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbaf41f9-2da3-4f22-a3da-e920f38cd32c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:57.012182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fbaf41f9-2da3-4f22-a3da-e920f38cd32c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 2b679767-0758-4595-8410-219a401b22a4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:57.026125 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-fbaf41f9-2da3-4f22-a3da-e920f38cd32c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 2b679767-0758-4595-8410-219a401b22a4 could not be found. Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbaf41f9-2da3-4f22-a3da-e920f38cd32c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/2b679767-0758-4595-8410-219a401b22a4/action HTTP/1.1 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 14 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: {"shelve": {}} Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 2b679767-0758-4595-8410-219a401b22a4 could not be found. Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2b679767-0758-4595-8410-219a401b22a4', 'body': {'shelve': {}}} Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b679767-0758-4595-8410-219a401b22a4 could not be found. Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b679767-0758-4595-8410-219a401b22a4 could not be found. Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:16:57.034294 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:16:57.039747 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:16:57.039747 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:16:57.039747 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b679767-0758-4595-8410-219a401b22a4 could not be found. Oct 28 10:16:57.039747 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:16:57.041568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbaf41f9-2da3-4f22-a3da-e920f38cd32c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 2b679767-0758-4595-8410-219a401b22a4 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:16:57.042647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fbaf41f9-2da3-4f22-a3da-e920f38cd32c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/2b679767-0758-4595-8410-219a401b22a4/action" status: 404 len: 111 microversion: 2.1 time: 0.042349 Oct 28 10:16:57.043423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2754/5513] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:56 2022] POST /compute/v2.1/servers/2b679767-0758-4595-8410-219a401b22a4/action => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:16:57.052882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:57.063903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:57.083102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:57.084090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:57.085104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:57.086148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:57.089423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:57.090171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:57.690509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:57.699982 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-39d721d3-1b3a-436c-81f3-3daa2ac5fd54 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 1.174270 Oct 28 10:16:57.719380 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2760/5514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:56 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:57.817706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:57.830555 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd344175-4e2b-4db7-a865-6bd09ccb6e46 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.781404 Oct 28 10:16:57.831757 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2755/5515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:57 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:57.865218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:57.866067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:57.889307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:57.889844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:57.890306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:57.891055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:57.900075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:57.903337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:58.394567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:58.412312 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fc019ca0-377d-4125-808e-9343c09a4380 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.556513 Oct 28 10:16:58.413197 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2761/5516] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:57 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:58.438407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:16:58.441339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:58.466767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:58.468409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:58.470618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:58.471570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:58.473035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:58.475512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:58.537822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lazy-loading 'flavor' on Instance uuid 1fbb2c02-f4e1-4ce9-85dc-6030582e257e {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:16:58.734908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:58.737687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:58.759873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:58.760377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:58.760821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:58.761605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:58.762067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:58.762498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:59.094921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:59.104351 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4de6093f-62cc-466c-bd38-3bf43c5d910c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.377454 Oct 28 10:16:59.109384 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2762/5517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:58 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:16:59.157826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbe15d3a-f404-45bf-b840-6431e17d7d81 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 202 len: 0 microversion: 2.1 time: 0.724935 Oct 28 10:16:59.158742 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2756/5518] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:16:58 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 0 bytes in 727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:16:59.172511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:16:59.177944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:16:59.195770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:59.196585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:59.197321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:59.202919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:16:59.203955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:16:59.204650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:16:59.670343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:16:59.682917 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7bbba006-9853-48a2-bc86-12c9a7a96d65 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.520182 Oct 28 10:16:59.684107 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2763/5519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:16:59 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:00.132601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:00.134015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:00.148979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:00.149766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:00.152765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:00.154399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:00.157208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:00.158040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:00.555389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:00.572150 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a1d3fffc-f60d-49e9-bbf2-6b24c3d5da8c tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.443753 Oct 28 10:17:00.572755 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2757/5520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:00 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:00.711733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:00.712362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:00.739308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:00.739826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:00.740280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:00.741040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:00.741506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:00.741935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:01.210845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:01.222103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-be367076-3b26-47f0-b314-f83d50db56af tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.514418 Oct 28 10:17:01.222703 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2764/5521] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:00 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:01.609151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:01.609792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:01.629741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:01.631141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:01.632091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:01.636476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:01.637251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:01.642611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:01.681345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-246ecc23-4354-41cc-a8a2-572385cec38e req-bec9d8e9-f031-437c-942d-aef0d04f8aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357ac794-3f28-428c-8023-13e193734866", "name": "network-vif-plugged", "status": "completed", "tag": "dea50373-404f-4df6-9985-8a099b847c70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:01.698618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-246ecc23-4354-41cc-a8a2-572385cec38e req-bec9d8e9-f031-437c-942d-aef0d04f8aad service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:01.703956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-246ecc23-4354-41cc-a8a2-572385cec38e req-bec9d8e9-f031-437c-942d-aef0d04f8aad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:01.704827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-246ecc23-4354-41cc-a8a2-572385cec38e req-bec9d8e9-f031-437c-942d-aef0d04f8aad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:01.738959 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-246ecc23-4354-41cc-a8a2-572385cec38e req-bec9d8e9-f031-437c-942d-aef0d04f8aad service nova] Creating event network-vif-plugged:dea50373-404f-4df6-9985-8a099b847c70 for instance 357ac794-3f28-428c-8023-13e193734866 on n-h2-zed-1 Oct 28 10:17:01.755100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-246ecc23-4354-41cc-a8a2-572385cec38e req-bec9d8e9-f031-437c-942d-aef0d04f8aad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076554 Oct 28 10:17:01.756811 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2765/5522] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:17:02.198317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:02.213781 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e037e6e2-02a2-427e-951b-b51304579eb9 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.610039 Oct 28 10:17:02.214423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2758/5523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:01 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:02.250883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:02.251601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:02.269642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:02.270346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:02.270806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:02.271580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:02.272053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:02.272507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:02.714859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:02.732271 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c59fa7d-ee9c-4267-bead-b12ae5714c58 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.486658 Oct 28 10:17:02.733593 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2766/5524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:02 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:03.240607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:03.242348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:03.265511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:03.266270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:03.269476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:03.274160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:03.275834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:03.278500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:03.759534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:03.760232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:03.784234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:03.784656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:03.786104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:03.790704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:03.794463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:03.797727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:03.814131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:03.830304 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9676a6ee-6659-4775-a69b-73d122cffa59 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1323 microversion: 2.1 time: 0.592644 Oct 28 10:17:03.833266 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2759/5525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:03 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1323 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:04.123685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d50f43a8-98c2-48aa-bea3-8a5b0f823fbd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: .version_select at 0x7fca327a8af0>, body: {"keypair": {"name": "tempest-keypair-1405976678", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxf9DdWXrJhci5wsKm3o0DLvhlxZmVsWT4vXQ7V4ipAQUalEavSKoJE3MBHgBzO6wufGY3bfCFo6nMiZJUgC1pWcjF4cSZQYkKJtdJ18p1Yh3CUJIWV1zwkbLc3VhI6Xg=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:04.162374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d50f43a8-98c2-48aa-bea3-8a5b0f823fbd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:17:04.171026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-d50f43a8-98c2-48aa-bea3-8a5b0f823fbd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:17:04.224109 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d50f43a8-98c2-48aa-bea3-8a5b0f823fbd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.103024 Oct 28 10:17:04.226089 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2760/5526] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:17:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:04.485067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:04.539439 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-493cd3e5-6422-48b6-a041-51a45f4b28ca tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.783943 Oct 28 10:17:04.552639 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2767/5527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:03 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:04.862054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:04.864697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:04.890316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:04.892065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:04.894177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:04.896796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:04.897602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:04.900638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.261222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:05.275607 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b31b93fe-06b5-4615-ac31-6c47f80e688b tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1520 microversion: 2.1 time: 0.420440 Oct 28 10:17:05.278969 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2761/5528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:04 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1520 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:05.303894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:05.305453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:05.317634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.318137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.318593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.319317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.319779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.325552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.377509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] HTTP exception thrown: Instance is not a member of specified network Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Request method failure captured: Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866/ips/invalid HTTP/1.1 Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6wFkAgTkkXIcnedUbs7Lh9U_AS47TWvrIEihT5p4B0730C1F5SNeokzXxh3PqwgyKISE5RrURAn36kX6-Tynb7gPqfM-YJFbIqB9FtiMSR5jrU_GvM11OXr0u3iSpMjakCvt8kZpSPQN6SJcV4MHz81gVt6fODannVObjw9kh5KXwE Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3ce2931e024a42219d4ed709e828b03d Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2931e024a42219d4ed709e828b03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2931e024a42219d4ed709e828b03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2931e024a42219d4ed709e828b03d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2931e024a42219d4ed709e828b03d"}]}] Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3ce2931e024a42219d4ed709e828b03d Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerAddressesNegativeTestJSON-1931804836-project Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 90e6b24b39a3428882a1dee1bc3281bc Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1931804836-project Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance is not a member of specified network Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': '357ac794-3f28-428c-8023-13e193734866', 'id': 'invalid'} Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 28 10:17:05.384009 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.390616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:17:05.390616 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-687c394b-7cb1-4dce-b3de-267741dc4224 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.085728 Oct 28 10:17:05.390616 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2768/5529] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:17:05 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866/ips/invalid => generated 91 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:17:05.396302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36bba94f-3cbb-4c01-bc92-d9f47b90d7c3 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:05.396815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-36bba94f-3cbb-4c01-bc92-d9f47b90d7c3 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Failed to fetch instance by id 999 {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 28 10:17:05.397343 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-36bba94f-3cbb-4c01-bc92-d9f47b90d7c3 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] HTTP exception thrown: Instance 999 could not be found. Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36bba94f-3cbb-4c01-bc92-d9f47b90d7c3 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Request method failure captured: Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6wFkAgTkkXIcnedUbs7Lh9U_AS47TWvrIEihT5p4B0730C1F5SNeokzXxh3PqwgyKISE5RrURAn36kX6-Tynb7gPqfM-YJFbIqB9FtiMSR5jrU_GvM11OXr0u3iSpMjakCvt8kZpSPQN6SJcV4MHz81gVt6fODannVObjw9kh5KXwE Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2931e024a42219d4ed709e828b03d Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2931e024a42219d4ed709e828b03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2931e024a42219d4ed709e828b03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2931e024a42219d4ed709e828b03d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2931e024a42219d4ed709e828b03d"}]}] Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2931e024a42219d4ed709e828b03d Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerAddressesNegativeTestJSON-1931804836-project Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90e6b24b39a3428882a1dee1bc3281bc Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1931804836-project Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 999 could not be found. Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '999'} Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 28 10:17:05.399109 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:05.404777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36bba94f-3cbb-4c01-bc92-d9f47b90d7c3 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:17:05.404777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-36bba94f-3cbb-4c01-bc92-d9f47b90d7c3 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.008492 Oct 28 10:17:05.405717 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2762/5530] 10.222.0.16 () {58 vars in 1149 bytes} [Fri Oct 28 10:17:05 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:17:05.410736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:05.411247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:05.418623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.425935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.426397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.427159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.427629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.428066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.527137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:17:05.576874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:05.580264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:05.600644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.608442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.613345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.614105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.614751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.615376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.761788 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f728b59e-81be-4fda-999d-1c3ac7640ee1 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "DELETE /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 204 len: 0 microversion: 2.1 time: 0.353179 Oct 28 10:17:05.770595 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2769/5531] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:17:05 2022] DELETE /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:17:05.777831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:05.778853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:05.786020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.786754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.787403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:05.788304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:05.788977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:05.789612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:06.084781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:06.089206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:06.094244 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-18d55cf4-1112-4c08-b835-d7eafd8f7c88 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.521731 Oct 28 10:17:06.114146 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2763/5532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:05 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:06.582187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:06.599273 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00e9a9b5-3197-4785-bf5e-e5b0b87f3eeb tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1526 microversion: 2.1 time: 0.826997 Oct 28 10:17:06.601851 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2770/5533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:05 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1526 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:07.123801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:07.125032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:07.158411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:07.163986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:07.165341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:07.166245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:07.166947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:07.167512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:07.511413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:07.523600 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5aaf6aa9-c58a-4327-bcf1-5e4ec8a2bfc6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.401374 Oct 28 10:17:07.525453 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2764/5534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:07 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:07.634126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:07.635365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:07.646838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:07.648126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:07.653597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:07.655604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:07.658940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:07.659591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:07.814765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1162672979", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21470466-36a9-45e2-955b-c7288f1075a0"}], "security_groups": [{"name": "tempest-securitygroup--162826891"}], "key_name": "tempest-keypair-1405976678", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:08.306827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:08.323574 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-09db378c-632f-480b-9ccd-f00c510b48c7 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1526 microversion: 2.1 time: 0.696788 Oct 28 10:17:08.324444 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2771/5535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:07 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1526 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:08.469400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] validate_networks() for [('21470466-36a9-45e2-955b-c7288f1075a0', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:17:08.547309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:08.548370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:08.559643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:08.560511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:08.562068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:08.563464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:08.565348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:08.566549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:09.145726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:09.155087 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7138450b-6d32-4b24-b9d6-721c97af3bbc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.611906 Oct 28 10:17:09.159054 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2772/5536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:08 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:09.351060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:09.351989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:09.365266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:09.366070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:09.366726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:09.367639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:09.368273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:09.371476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:10.085287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:17:10.085942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:17:10.086419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:17:10.086835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:17:10.087310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:17:10.106315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:10.107288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:10.110709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:10.111640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:10.112162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:10.113078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:10.123312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90e6b24b39a3428882a1dee1bc3281bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce2931e024a42219d4ed709e828b03d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:10.132217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:10.136244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ae7b1e0-97b8-4a9f-a64b-7571acaadf75 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 200 len: 1484 microversion: 2.1 time: 0.789077 Oct 28 10:17:10.140415 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2773/5537] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:09 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 1484 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:10.151299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-239f391a-776f-4ad0-bc06-dffc019030ae req-838a7312-9503-496e-a872-7385df7ca8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357ac794-3f28-428c-8023-13e193734866", "name": "network-vif-deleted", "tag": "dea50373-404f-4df6-9985-8a099b847c70"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:10.164044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:17:10.178082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-239f391a-776f-4ad0-bc06-dffc019030ae req-838a7312-9503-496e-a872-7385df7ca8f6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:10.180838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:17:10.181759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-239f391a-776f-4ad0-bc06-dffc019030ae req-838a7312-9503-496e-a872-7385df7ca8f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:10.182212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-239f391a-776f-4ad0-bc06-dffc019030ae req-838a7312-9503-496e-a872-7385df7ca8f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:10.213647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:17:10.218601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:17:10.225682 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-239f391a-776f-4ad0-bc06-dffc019030ae req-838a7312-9503-496e-a872-7385df7ca8f6 service nova] Creating event network-vif-deleted:dea50373-404f-4df6-9985-8a099b847c70 for instance 357ac794-3f28-428c-8023-13e193734866 on n-h2-zed-1 Oct 28 10:17:10.240138 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-239f391a-776f-4ad0-bc06-dffc019030ae req-838a7312-9503-496e-a872-7385df7ca8f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098128 Oct 28 10:17:10.246467 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2774/5538] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:10.260751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:10.264937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:10.288374 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c52e0c11-1086-47fb-81a2-4d5a02e92bc0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.477587 Oct 28 10:17:10.289199 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2765/5539] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:17:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 2480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:17:10.292080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:10.292774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:10.294144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:10.295159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:10.295796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:10.297371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:10.310931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-390febdd-ecfa-4af3-a41f-89ee0f343124 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:10.311987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-390febdd-ecfa-4af3-a41f-89ee0f343124 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:10.405607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-390febdd-ecfa-4af3-a41f-89ee0f343124 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:10.416313 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-390febdd-ecfa-4af3-a41f-89ee0f343124 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1242 microversion: 2.1 time: 0.112613 Oct 28 10:17:10.436098 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2766/5540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:10 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:10.625306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:10.635826 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c1d819ec-969c-430c-b93d-f067c9b540a3 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.385607 Oct 28 10:17:10.645542 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2775/5541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:10 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:11.169391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:11.173953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] [instance: 357ac794-3f28-428c-8023-13e193734866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:11.190047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:11.190551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:11.190989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:11.191919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:11.192564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:11.193346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:11.231746 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] HTTP exception thrown: Instance 357ac794-3f28-428c-8023-13e193734866 could not be found. Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Request method failure captured: Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 HTTP/1.1 Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6wFkAgTkkXIcnedUbs7Lh9U_AS47TWvrIEihT5p4B0730C1F5SNeokzXxh3PqwgyKISE5RrURAn36kX6-Tynb7gPqfM-YJFbIqB9FtiMSR5jrU_GvM11OXr0u3iSpMjakCvt8kZpSPQN6SJcV4MHz81gVt6fODannVObjw9kh5KXwE Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3ce2931e024a42219d4ed709e828b03d Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2931e024a42219d4ed709e828b03d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3ce2931e024a42219d4ed709e828b03d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3ce2931e024a42219d4ed709e828b03d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3ce2931e024a42219d4ed709e828b03d"}]}] Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3ce2931e024a42219d4ed709e828b03d Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1931804836 Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerAddressesNegativeTestJSON-1931804836-project Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 90e6b24b39a3428882a1dee1bc3281bc Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1931804836-project Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 357ac794-3f28-428c-8023-13e193734866 could not be found. Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '357ac794-3f28-428c-8023-13e193734866'} Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357ac794-3f28-428c-8023-13e193734866 could not be found. Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357ac794-3f28-428c-8023-13e193734866 could not be found. Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:11.238386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357ac794-3f28-428c-8023-13e193734866 could not be found. Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] Returning 404 to user: Instance 357ac794-3f28-428c-8023-13e193734866 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d1772af-d745-400b-af22-9e69960bb509 tempest-ServerAddressesNegativeTestJSON-1931804836 tempest-ServerAddressesNegativeTestJSON-1931804836-project] 10.222.0.16 "GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866" status: 404 len: 111 microversion: 2.1 time: 0.076353 Oct 28 10:17:11.245458 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2767/5542] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:11 2022] GET /compute/v2.1/servers/357ac794-3f28-428c-8023-13e193734866 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:17:11.444661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:11.446334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:11.458368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:11.460403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:11.461110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:11.464455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:11.465258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:11.473320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:11.644763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:11.657045 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-51571f26-653b-4250-96df-7e829b58db7e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1238 microversion: 2.1 time: 0.219068 Oct 28 10:17:11.661962 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2776/5543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:11 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1238 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:11.671472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:11.672369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:11.686423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:11.690214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:11.690814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:11.691553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:11.692008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:11.696394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:12.165515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:12.180343 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-be0f2f52-91c3-4e05-88f7-af86237f3142 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.512637 Oct 28 10:17:12.182503 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2768/5544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:11 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:12.688394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:12.689693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:12.698558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:12.699377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:12.700026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:12.700933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:12.703117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:12.703789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:12.855726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:12.870263 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e9cd8f14-72b9-4016-b232-3212e6fe04bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1300 microversion: 2.1 time: 0.191001 Oct 28 10:17:12.871101 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2777/5545] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:12 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:13.206957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:13.208858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:13.236584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:13.244475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:13.247757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:13.248436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:13.252030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:13.252483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:13.828644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:13.844067 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-54f4a1a0-add9-4097-8ced-e2647c579a8f tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.640912 Oct 28 10:17:13.848677 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2769/5546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:13 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:13.894483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:13.895125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:13.908595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:13.909151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:13.909576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:13.910517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:13.911171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:13.917090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:14.133981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:14.149272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95589b5e-dc84-413c-98c7-f23fd6966a06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1300 microversion: 2.1 time: 0.258650 Oct 28 10:17:14.149885 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2778/5547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:13 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1300 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:14.614891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:14.617574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:14.629985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:14.632274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:14.633769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:14.636016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:14.636894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:14.640622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:14.875190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:14.875822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:14.890135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:14.893340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:14.896516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:14.897335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:14.898000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:14.901635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:15.232083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:15.240671 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e94889d-985b-4d18-bb92-d1d01797bea4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.632195 Oct 28 10:17:15.248700 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2770/5548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:14 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:15.253831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:15.282251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:15.302310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:15.313718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:15.314519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:15.315532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:15.317849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:15.322153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:15.500611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:15.522669 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b97ddc58-08cc-4637-88a3-7ce0df2eaad8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1532 microversion: 2.1 time: 0.654768 Oct 28 10:17:15.523282 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2779/5549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1532 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:15.531878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:15.535305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:15.552784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:15.553575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:15.555340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:15.557520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:15.558436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:15.561631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:15.967551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:15.976361 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a53abad-cd6a-4869-bb4b-07072117f3f5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.450217 Oct 28 10:17:15.977294 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2780/5550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:15 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:16.001480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:16.002113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:16.017402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:16.017908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:16.018353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:16.025607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:16.026018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:16.026483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:16.283990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:16.297575 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a22bf719-f1a9-4161-a5f0-77ab138efbe7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 1.047374 Oct 28 10:17:16.298739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2771/5551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:15 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:16.499486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:16.508892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b31a5a69-8650-4573-8ab5-fc5268ace23d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.512081 Oct 28 10:17:16.509824 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2781/5552] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:15 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:16.533521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1145583294"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:16.536473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:16.553861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:16.554397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:16.554720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:16.555134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:16.555343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:16.557283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:16.557784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:16.560013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:16.571250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:16.571754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:16.572201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:16.572930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:16.576821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:16.579068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:16.970522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:16.989798 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b580414c-5da0-46b5-8a13-be8ef8804b59 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1532 microversion: 2.1 time: 0.429603 Oct 28 10:17:16.990477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2782/5553] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:16 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1532 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:17.091538 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a3ffcf22-ba5b-4497-adc1-db35687c7867 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.561745 Oct 28 10:17:17.097041 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2772/5554] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:17:16 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 10:17:17.321154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:17.321781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:17.336473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:17.337011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:17.345839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:17.348255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:17.352047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:17.352798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:17.853141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fa03404e-af62-4d1d-8368-24496c8d4de2 req-fbfc838a-bb27-4ed2-95fc-842e2c1339de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa93feb-174d-4a13-869f-ece3341a8d3c", "tag": "d375271d-e59d-4285-bfa3-8b434b9ee33f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:17.896651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fa03404e-af62-4d1d-8368-24496c8d4de2 req-fbfc838a-bb27-4ed2-95fc-842e2c1339de service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:17.897441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fa03404e-af62-4d1d-8368-24496c8d4de2 req-fbfc838a-bb27-4ed2-95fc-842e2c1339de service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:17.898078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fa03404e-af62-4d1d-8368-24496c8d4de2 req-fbfc838a-bb27-4ed2-95fc-842e2c1339de service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:17.928191 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fa03404e-af62-4d1d-8368-24496c8d4de2 req-fbfc838a-bb27-4ed2-95fc-842e2c1339de service nova] Creating event network-changed:d375271d-e59d-4285-bfa3-8b434b9ee33f for instance 5fa93feb-174d-4a13-869f-ece3341a8d3c on n-h2-zed-1 Oct 28 10:17:17.939860 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fa03404e-af62-4d1d-8368-24496c8d4de2 req-fbfc838a-bb27-4ed2-95fc-842e2c1339de service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090669 Oct 28 10:17:17.942086 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2773/5555] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:17.979596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:17.989267 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-308c50d3-da39-4349-94a5-ab5da40230c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 0.672056 Oct 28 10:17:18.016533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:18.017778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:18.022235 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2783/5556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:17 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:18.026343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:18.027151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:18.028386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:18.029381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:18.030075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:18.030737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:18.538368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:18.557904 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7664cb9a-a43d-4e53-9dbd-c286c8ed74bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.545640 Oct 28 10:17:18.565768 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2774/5557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:18 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:19.018704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:19.019324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:19.036505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:19.041129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:19.041734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:19.042485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:19.042984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:19.043468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:19.596448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:19.597900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:19.623742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:19.624598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:19.625329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:19.626557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:19.627257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:19.629312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:20.142924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:20.273712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:20.306668 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1dd3f8db-63bc-47a5-83ca-1d998f27f0de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.715025 Oct 28 10:17:20.307885 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2775/5558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:19 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:20.339232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c91a67d0-0681-4221-bb4f-d4301cda8255 req-3a091304-cd03-4049-bc38-71c9251e28ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbb2c02-f4e1-4ce9-85dc-6030582e257e", "name": "network-vif-plugged", "status": "completed", "tag": "74651f42-f412-4bde-9914-23e1b529beb7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:20.358043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c91a67d0-0681-4221-bb4f-d4301cda8255 req-3a091304-cd03-4049-bc38-71c9251e28ef service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:20.358789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c91a67d0-0681-4221-bb4f-d4301cda8255 req-3a091304-cd03-4049-bc38-71c9251e28ef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:20.359433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c91a67d0-0681-4221-bb4f-d4301cda8255 req-3a091304-cd03-4049-bc38-71c9251e28ef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:20.397653 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c91a67d0-0681-4221-bb4f-d4301cda8255 req-3a091304-cd03-4049-bc38-71c9251e28ef service nova] Creating event network-vif-plugged:74651f42-f412-4bde-9914-23e1b529beb7 for instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e on n-h1-zed-1 Oct 28 10:17:20.411487 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c91a67d0-0681-4221-bb4f-d4301cda8255 req-3a091304-cd03-4049-bc38-71c9251e28ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096365 Oct 28 10:17:20.426948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2776/5559] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:20.835781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:20.844199 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f431f314-fe1d-4767-86a6-20bd760fd5bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 1.829275 Oct 28 10:17:20.869869 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2784/5560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:19 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:21.332108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:21.333298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:21.336006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:21.343148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:21.373258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:21.391949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:21.392538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:21.393327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:21.395075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:21.395545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:21.869984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:21.871210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:21.898212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:21.898821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:21.899278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:21.907381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:21.910751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:21.911584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:22.572245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:22.587303 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-30641133-ecc9-4cb9-8a7d-da86caf48264 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 1.260196 Oct 28 10:17:22.588591 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2777/5561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:21 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:22.632757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:22.642151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d4d82321-4df4-47c2-ab67-05dc3104dc2d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 0.776411 Oct 28 10:17:22.662667 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2785/5562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:21 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:23.611970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:23.612691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:23.626155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:23.637044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:23.645477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:23.647022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:23.649735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:23.653999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:23.678889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:23.679522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:23.695841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:23.705748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:23.709323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:23.710289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:23.710963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:23.717558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:24.611746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:24.624138 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f9b66a38-34b1-4b4b-8501-0c82353aa5c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 0.949071 Oct 28 10:17:24.624738 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2786/5563] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:23 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:25.656323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:25.657666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:25.674570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:25.710265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:25.713962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:25.714737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:25.715876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:25.720128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:25.723246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:26.261580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:26.280105 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2af52322-ac5a-4195-8d29-adee0da8c17d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 0.624810 Oct 28 10:17:26.284856 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2787/5564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:25 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:26.404556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:26.424381 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-568c55d9-22fd-4171-ac57-c2ad524eae09 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 2.813958 Oct 28 10:17:26.428156 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2778/5565] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:23 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 2821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:27.008050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-9fe7012e-f51f-46db-bc2c-5f4914e8510d req-91da733e-ca27-4d68-a207-f42227bebf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "name": "network-vif-plugged", "status": "completed", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:27.047740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9fe7012e-f51f-46db-bc2c-5f4914e8510d req-91da733e-ca27-4d68-a207-f42227bebf3a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:27.048363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9fe7012e-f51f-46db-bc2c-5f4914e8510d req-91da733e-ca27-4d68-a207-f42227bebf3a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:27.049059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9fe7012e-f51f-46db-bc2c-5f4914e8510d req-91da733e-ca27-4d68-a207-f42227bebf3a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:27.100731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-9fe7012e-f51f-46db-bc2c-5f4914e8510d req-91da733e-ca27-4d68-a207-f42227bebf3a service nova] Creating event network-vif-plugged:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:17:27.157797 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-9fe7012e-f51f-46db-bc2c-5f4914e8510d req-91da733e-ca27-4d68-a207-f42227bebf3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154190 Oct 28 10:17:27.160253 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2788/5566] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:27.305204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:27.306147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:27.378454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:27.382079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:27.385468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:27.386468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:27.391494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:27.392137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:27.457950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:27.459311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:27.475233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:27.477524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:27.479407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:27.481267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:27.482202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:27.482846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:27.781472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:27.794589 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-33aba04d-199d-426f-beb7-6af2bb53a2db tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.342929 Oct 28 10:17:27.796966 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2789/5567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:27 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:28.594785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:28.647294 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b2b5240-bb27-42c6-b3ab-60f0c6a3b502 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 1.340884 Oct 28 10:17:28.666728 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2779/5568] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:27 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:28.822812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:28.824819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:28.855780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:28.865835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:28.868490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:28.869782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:28.874918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:28.880690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:29.217390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-54eb63a8-e171-451e-b292-4096f76efa90 req-fe589985-b5a0-4eb8-a791-d2f0881352b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa93feb-174d-4a13-869f-ece3341a8d3c", "name": "network-vif-plugged", "status": "completed", "tag": "d375271d-e59d-4285-bfa3-8b434b9ee33f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:29.260329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-54eb63a8-e171-451e-b292-4096f76efa90 req-fe589985-b5a0-4eb8-a791-d2f0881352b9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:29.265103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-54eb63a8-e171-451e-b292-4096f76efa90 req-fe589985-b5a0-4eb8-a791-d2f0881352b9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:29.268413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-54eb63a8-e171-451e-b292-4096f76efa90 req-fe589985-b5a0-4eb8-a791-d2f0881352b9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:29.326217 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-54eb63a8-e171-451e-b292-4096f76efa90 req-fe589985-b5a0-4eb8-a791-d2f0881352b9 service nova] Creating event network-vif-plugged:d375271d-e59d-4285-bfa3-8b434b9ee33f for instance 5fa93feb-174d-4a13-869f-ece3341a8d3c on n-h2-zed-1 Oct 28 10:17:29.332769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-54eb63a8-e171-451e-b292-4096f76efa90 req-fe589985-b5a0-4eb8-a791-d2f0881352b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119907 Oct 28 10:17:29.338188 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2780/5569] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:29.676819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:29.677990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:29.695919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:29.698044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:29.698969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:29.701616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:29.703871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:29.705967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:29.733695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:29.759817 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb19233e-1f6b-42e4-8cc8-9218f06424d5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.938032 Oct 28 10:17:29.782919 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2790/5570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:28 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:29.986344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:30.000611 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b967c7d-2ba5-420a-a6da-9356c7095088 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 0.329617 Oct 28 10:17:30.020759 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2781/5571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:29 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:30.789757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:30.791080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:30.808033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:30.809363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:30.811309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:30.813523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:30.814214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:30.817121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:31.026411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:31.027628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:31.045223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:31.046539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:31.047741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:31.051676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:31.054422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:31.056682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:31.391572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:31.406261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:31.417023 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e285499-c7f8-46ac-b84b-a0848107e920 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.630834 Oct 28 10:17:31.442663 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2791/5572] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:30 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:31.721588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:31.744936 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-77a47cd1-c41c-41e1-b079-6456c0775e67 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1367 microversion: 2.1 time: 0.721717 Oct 28 10:17:31.766752 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2782/5573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:31 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1367 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:32.449664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:32.450874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:32.470115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:32.472374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:32.473435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:32.475755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:32.483833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:32.484764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:32.777924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:32.783422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:32.805829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:32.807821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:32.809307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:32.816062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:32.818566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:32.821859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:32.868551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:32.882486 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e856aeaa-9dfc-4beb-9269-834737f97612 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.437977 Oct 28 10:17:32.883666 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2792/5574] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:32 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:32.939089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:33.801008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:33.810060 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-834c34f0-f0d1-4d99-8fc9-c074ee15ab52 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1557 microversion: 2.1 time: 1.037297 Oct 28 10:17:33.813949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2783/5575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:32 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1557 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:33.843746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:33.844267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:33.879201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:33.879724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:33.880180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:33.880930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:33.885562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:33.886015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:33.911761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:33.912390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:33.921254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:33.921758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:33.922203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:33.922927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:33.929321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:33.929844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:34.469724 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-73e4630c-9b21-4766-bfb2-dcdf64ad3487 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.630565 Oct 28 10:17:34.470760 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2793/5576] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:17:33 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c/os-interface => generated 284 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:34.833545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:34.853171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c36db37e-b680-4bb7-be89-225df107363d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.946181 Oct 28 10:17:34.860735 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2784/5577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:33 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:35.885497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:35.888244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:35.908493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:35.923501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:35.930702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:35.935223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:35.937296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:35.945717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:36.888415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:36.897365 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb8d76d7-79f6-4d47-9596-db231f9706c1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 1.016538 Oct 28 10:17:36.914261 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2794/5578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:35 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:37.932861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:37.934377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:37.949811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:37.953099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:37.953755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:37.954650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:37.955315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:37.957336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:38.658292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:38.667509 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b713554-a67d-4c82-b0fb-a9489eb7e980 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.739657 Oct 28 10:17:38.684987 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2785/5579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:37 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:39.696830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:39.697640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:39.718564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:39.722140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:39.722729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:39.723857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:39.724356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:39.724806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:40.681908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:40.703151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eed288ab-ac55-4e85-b149-52ff91aa9851 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 1.003524 Oct 28 10:17:40.709469 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2795/5580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:39 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:41.080611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b7f4df87-90c9-4bb4-93a9-9e203fe537df req-c014521d-fabb-483f-b23f-cb759060e525 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa93feb-174d-4a13-869f-ece3341a8d3c", "tag": "d375271d-e59d-4285-bfa3-8b434b9ee33f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:41.105258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b7f4df87-90c9-4bb4-93a9-9e203fe537df req-c014521d-fabb-483f-b23f-cb759060e525 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:41.107537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b7f4df87-90c9-4bb4-93a9-9e203fe537df req-c014521d-fabb-483f-b23f-cb759060e525 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:41.107988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b7f4df87-90c9-4bb4-93a9-9e203fe537df req-c014521d-fabb-483f-b23f-cb759060e525 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:41.142766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b7f4df87-90c9-4bb4-93a9-9e203fe537df req-c014521d-fabb-483f-b23f-cb759060e525 service nova] Creating event network-changed:d375271d-e59d-4285-bfa3-8b434b9ee33f for instance 5fa93feb-174d-4a13-869f-ece3341a8d3c on n-h2-zed-1 Oct 28 10:17:41.155490 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b7f4df87-90c9-4bb4-93a9-9e203fe537df req-c014521d-fabb-483f-b23f-cb759060e525 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.426933 Oct 28 10:17:41.169906 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2786/5581] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:41.736777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:41.737436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:41.744511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:41.754848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:41.755454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:41.758821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:41.761459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:41.767232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:42.519422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:42.530778 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5feb3fe1-718f-471a-8123-aabb7fc65a54 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.799114 Oct 28 10:17:42.556535 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2796/5582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:41 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:43.579297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:43.580644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:43.598709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:43.602817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:43.606845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:43.613224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:43.623169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:43.625223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:45.017055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:45.030439 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2793d0de-23c5-48e2-85c7-2010334e2d4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 1.455288 Oct 28 10:17:45.031256 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2787/5583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:43 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:46.059850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:46.059850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:46.085560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:46.086866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:46.089885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:46.094394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:46.099748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:46.109764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:46.566031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:46.577846 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-09647f51-63ca-469b-9992-92ac84994485 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1527 microversion: 2.1 time: 0.527145 Oct 28 10:17:46.578997 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2797/5584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:46 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1527 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:47.608332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:47.609720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:47.629010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:47.634261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:47.641597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:47.642682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:47.644002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:47.653932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:48.284743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:48.293327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bf6b05a8-ac65-4213-b3e4-2278e76bfc24 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1509 microversion: 2.1 time: 0.688409 Oct 28 10:17:48.293932 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2788/5585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:47 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1509 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:49.321239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:49.321953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:49.332081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:49.332571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:49.336043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:49.339294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:49.339835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:49.341187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:49.485986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1428352491", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:49.578063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] validate_networks() for [('ccbf4e9d-1f3f-4f87-a4a0-76c946e9c099', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:17:49.651119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:49.659746 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-226c824e-db1b-4cfe-99c7-74425f86a3df tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1509 microversion: 2.1 time: 0.342022 Oct 28 10:17:49.663991 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2789/5586] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:49 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1509 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:49.909057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:49.909833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:49.929632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:49.929632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:49.929632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:49.929632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:49.929632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:49.929632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:50.239849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:50.252334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f1b65fe-6c2a-4781-91cf-df0163ca2c4b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.355558 Oct 28 10:17:50.264977 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2790/5587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:49 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:50.683249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:50.684157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:50.695511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:50.697815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:50.698420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:50.701669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:50.702450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:50.703116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:51.259285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:17:51.260367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:17:51.261110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:17:51.261790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:17:51.262424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:17:51.281049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:51.282843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:51.284345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:51.285875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:51.288054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:51.288507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:51.309726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:51.319005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Getting quotas for project 946b5c4d8cbf4ab5b94f15c2704d5ce3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:17:51.322659 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4ebb41fd-f81e-4991-80fc-d151fa8b38ee tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1509 microversion: 2.1 time: 0.643360 Oct 28 10:17:51.323262 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2791/5588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:50 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1509 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:51.326249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Getting quotas for user 85f5e98a834f490fa846a847306085e4 and project 946b5c4d8cbf4ab5b94f15c2704d5ce3. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:17:51.342012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:17:51.344563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:17:51.363125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4ba4fa97-9e54-4ab7-af89-b9240fe35cbf req-d8aa2bb3-8526-48cd-8243-d4a5a6ecf977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbb2c02-f4e1-4ce9-85dc-6030582e257e", "name": "network-vif-unplugged", "status": "completed", "tag": "74651f42-f412-4bde-9914-23e1b529beb7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:51.419644 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-42642880-84b7-4af4-9b3e-34ddb2a5be75 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.158057 Oct 28 10:17:51.428434 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2798/5589] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:17:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2167 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:17:51.436248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:51.437219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:51.445510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:51.446362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:51.447065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:51.448501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:51.449439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:51.450146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:51.451225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4ba4fa97-9e54-4ab7-af89-b9240fe35cbf req-d8aa2bb3-8526-48cd-8243-d4a5a6ecf977 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:51.451722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4ba4fa97-9e54-4ab7-af89-b9240fe35cbf req-d8aa2bb3-8526-48cd-8243-d4a5a6ecf977 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:51.452159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4ba4fa97-9e54-4ab7-af89-b9240fe35cbf req-d8aa2bb3-8526-48cd-8243-d4a5a6ecf977 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:51.468809 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4ba4fa97-9e54-4ab7-af89-b9240fe35cbf req-d8aa2bb3-8526-48cd-8243-d4a5a6ecf977 service nova] Creating event network-vif-unplugged:74651f42-f412-4bde-9914-23e1b529beb7 for instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e on n-h1-zed-1 Oct 28 10:17:51.476544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4ba4fa97-9e54-4ab7-af89-b9240fe35cbf req-d8aa2bb3-8526-48cd-8243-d4a5a6ecf977 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116785 Oct 28 10:17:51.477224 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2792/5590] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:51.484524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85480660-41f4-4344-86e7-8c7e696c8bb8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:51.485723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-85480660-41f4-4344-86e7-8c7e696c8bb8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:51.576166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85480660-41f4-4344-86e7-8c7e696c8bb8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:51.586201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85480660-41f4-4344-86e7-8c7e696c8bb8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1223 microversion: 2.1 time: 0.105306 Oct 28 10:17:51.587023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2793/5591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:51 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:51.785163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:51.807883 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d28e55d1-de63-4a47-9459-73737f07c927 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.377059 Oct 28 10:17:51.809706 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2799/5592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:51 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:51.847179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2013541961"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:51.850481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:51.861099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:51.863053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:51.863771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:51.864306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:51.865140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:51.865732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:51.866380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:52.174976 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e6c8bc9c-84a0-4c1a-b040-391b11c5f375 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.332546 Oct 28 10:17:52.176125 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2794/5593] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:17:51 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 10:17:52.352127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:52.352628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:52.391768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:52.392579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:52.395064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:52.396436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:52.413719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:52.414570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:52.612346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:52.615145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:52.625185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:52.626090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:52.627137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:52.628550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:52.629300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:52.630308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:52.725866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:52.736971 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc8af881-46f7-4266-b531-3e27dd60d024 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1452 microversion: 2.1 time: 0.389589 Oct 28 10:17:52.740072 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2800/5594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:52 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1452 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:52.769311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:52.770104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:52.798181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:52.800499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:52.801552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:52.805696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:52.806423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:52.807478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:52.855627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:52.873103 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a0cefa53-ae26-46b6-a58a-80efd151ba41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1219 microversion: 2.1 time: 0.265929 Oct 28 10:17:52.874351 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2795/5595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:52 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1219 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:53.147509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:53.162087 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6eee3f0-7561-4c8a-b221-ebca07d01826 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1452 microversion: 2.1 time: 0.395992 Oct 28 10:17:53.165840 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2801/5596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:52 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1452 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:53.241084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:53.241841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:53.254046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.254547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.257402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:53.258156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.258632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.265413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:53.317910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lazy-loading 'flavor' on Instance uuid 1fbb2c02-f4e1-4ce9-85dc-6030582e257e {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:17:53.332425 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Cannot 'shelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state shelved_offloaded Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action HTTP/1.1 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 14 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: {"shelve": {}} Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'shelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state shelved_offloaded Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'shelve': {}}} Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:17:53.334590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state shelved_offloaded Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state shelved_offloaded Oct 28 10:17:53.337833 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:17:53.351039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 409 to user: Cannot 'shelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state shelved_offloaded {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:17:53.355926 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28c35b0e-c5c3-4569-bfc9-1e281696ff20 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 409 len: 155 microversion: 2.1 time: 0.131078 Oct 28 10:17:53.359503 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2796/5597] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:17:53 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 155 bytes in 136 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:17:53.367121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:53.368420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:53.378564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.380583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.381300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:53.382320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.384131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.384978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:53.467286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128747) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 10:17:53.658437 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c512bee4-4d4a-4b29-a14a-74c039455ee9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 202 len: 0 microversion: 2.1 time: 0.295066 Oct 28 10:17:53.673620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:53.674365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:53.677368 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2802/5598] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:17:53 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:17:53.691894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.692401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.692844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:53.698449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.712349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.713274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:53.902990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:53.903722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:53.916696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.918260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.918882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:53.919787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:53.929074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:53.930348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:54.125100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:54.146887 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e5c8fe8-92cc-40a5-be84-30110cc5cb6e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1283 microversion: 2.1 time: 0.247062 Oct 28 10:17:54.149961 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2803/5599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:53 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1283 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:54.388094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:54.397616 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4df59da7-b324-4bcb-9b4d-45f6f9c46b6c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1460 microversion: 2.1 time: 0.731744 Oct 28 10:17:54.402869 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2797/5600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:53 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1460 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:55.173164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:55.174494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:55.221438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:55.222155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:55.222399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:55.239471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:55.240014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:55.240481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:55.455281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:55.458756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:55.493495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:55.493995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:55.494435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:55.495158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:55.495650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:55.496075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:55.564199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:55.602534 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2020947c-9ea8-46ee-9872-62eb09a55496 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1281 microversion: 2.1 time: 0.433239 Oct 28 10:17:55.603192 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2804/5601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:55 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1281 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:55.948080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:55.966722 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4bc89339-cb51-4fc5-a14c-47d71b5ff131 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1460 microversion: 2.1 time: 0.527062 Oct 28 10:17:55.977603 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2798/5602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:55 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1460 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:56.633191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:56.637080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:56.649017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:56.653251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:56.654119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:56.654784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:56.658326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:56.662827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:56.663857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:56.691100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f930d989-44f3-4d41-9985-b3b78af0c80a req-5980c737-705b-4f77-ad00-4dcc076ba763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "name": "network-vif-plugged", "status": "completed", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:56.707224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f930d989-44f3-4d41-9985-b3b78af0c80a req-5980c737-705b-4f77-ad00-4dcc076ba763 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:56.707709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f930d989-44f3-4d41-9985-b3b78af0c80a req-5980c737-705b-4f77-ad00-4dcc076ba763 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:56.708141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f930d989-44f3-4d41-9985-b3b78af0c80a req-5980c737-705b-4f77-ad00-4dcc076ba763 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:56.739673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f930d989-44f3-4d41-9985-b3b78af0c80a req-5980c737-705b-4f77-ad00-4dcc076ba763 service nova] Creating event network-vif-plugged:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:17:56.773761 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f930d989-44f3-4d41-9985-b3b78af0c80a req-5980c737-705b-4f77-ad00-4dcc076ba763 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086943 Oct 28 10:17:56.774385 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2799/5603] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:17:56.994243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:56.997181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:57.007816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:57.009950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:57.012492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:57.014197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:57.016455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:57.018362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:57.019818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:57.021526 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3f8211b-8942-49a0-b4fe-ab919b7b52c1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.397776 Oct 28 10:17:57.022855 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2805/5604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:56 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:57.442709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:57.452762 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7c37778-20d1-47ce-a9fd-d16670c805c6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.465206 Oct 28 10:17:57.475272 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2800/5605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:56 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:58.047417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:58.048032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:58.062493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:58.063355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:58.064013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:58.074195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:58.075156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:58.075772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:58.427828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:58.478928 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e27479ab-dfe3-428e-ac2b-384327cb3aa8 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.435532 Oct 28 10:17:58.479487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:58.481388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:58.491274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:58.492078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:58.495122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:58.495477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2806/5606] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:58 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:17:58.496366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:58.497026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:58.499671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:59.082621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:17:59.103968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:17:59.113537 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34f4e384-de83-4dbf-b5c7-550485027a80 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.636944 Oct 28 10:17:59.130043 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2801/5607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:58 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:17:59.334852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-47196ea1-d712-4b01-a651-19dc9bdebdb3 req-aec556c0-b4e2-404c-a8d7-e8ab7ed302d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c08ddd-41c8-4fe3-9667-8d4961457a9d", "tag": "c3a577fc-3330-4924-9947-af7b9c29dcef"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:17:59.360600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-47196ea1-d712-4b01-a651-19dc9bdebdb3 req-aec556c0-b4e2-404c-a8d7-e8ab7ed302d1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:59.366947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-47196ea1-d712-4b01-a651-19dc9bdebdb3 req-aec556c0-b4e2-404c-a8d7-e8ab7ed302d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:59.367689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-47196ea1-d712-4b01-a651-19dc9bdebdb3 req-aec556c0-b4e2-404c-a8d7-e8ab7ed302d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:59.395776 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-47196ea1-d712-4b01-a651-19dc9bdebdb3 req-aec556c0-b4e2-404c-a8d7-e8ab7ed302d1 service nova] Creating event network-changed:c3a577fc-3330-4924-9947-af7b9c29dcef for instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d on n-h1-zed-1 Oct 28 10:17:59.403765 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-47196ea1-d712-4b01-a651-19dc9bdebdb3 req-aec556c0-b4e2-404c-a8d7-e8ab7ed302d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081837 Oct 28 10:17:59.407380 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2807/5608] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:17:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:17:59.531371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:17:59.532175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:17:59.568886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:59.569432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:59.569889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:17:59.582610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:17:59.583429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:17:59.585720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:00.151718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:00.153453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:00.168754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:00.169631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:00.170273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:00.171222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:00.172369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:00.173580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:00.429830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:00.442300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-69e772bd-01bd-4f8c-afae-b5d37b986e5f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.914572 Oct 28 10:18:00.466441 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2802/5609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:17:59 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:00.489456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:00.505892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f4b7fe3-24be-4580-9224-8e25e7279c86 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.358410 Oct 28 10:18:00.507201 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2808/5610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:00 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:01.447852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0e3fefda-a6c0-4c75-bced-ff91d5ce700a req-6c73f78b-866f-4706-b95a-b2865eec1858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbb2c02-f4e1-4ce9-85dc-6030582e257e", "tag": "74651f42-f412-4bde-9914-23e1b529beb7"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:01.469151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0e3fefda-a6c0-4c75-bced-ff91d5ce700a req-6c73f78b-866f-4706-b95a-b2865eec1858 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:01.472507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0e3fefda-a6c0-4c75-bced-ff91d5ce700a req-6c73f78b-866f-4706-b95a-b2865eec1858 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:01.482291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:01.483269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:01.487901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0e3fefda-a6c0-4c75-bced-ff91d5ce700a req-6c73f78b-866f-4706-b95a-b2865eec1858 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:01.493678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:01.498293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:01.509711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:01.523451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:01.528212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:01.537113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:01.538464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:01.539845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:01.550691 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0e3fefda-a6c0-4c75-bced-ff91d5ce700a req-6c73f78b-866f-4706-b95a-b2865eec1858 service nova] Creating event network-changed:74651f42-f412-4bde-9914-23e1b529beb7 for instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e on n-h2-zed-1 Oct 28 10:18:01.556886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:01.563060 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0e3fefda-a6c0-4c75-bced-ff91d5ce700a req-6c73f78b-866f-4706-b95a-b2865eec1858 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119609 Oct 28 10:18:01.569052 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2803/5611] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:01.579230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:01.583673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:01.600457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:01.603977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:01.610184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:01.610847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:01.611782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:01.612400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:01.613140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:01.835433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:01.850920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e170368-5565-4cfd-955f-6ff9eb1b77eb tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.375403 Oct 28 10:18:01.852318 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2809/5612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:01 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:02.160584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:02.172470 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c4192b7a-7cd6-4cd4-93bf-03abaab7ff34 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.601892 Oct 28 10:18:02.180202 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2804/5613] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:01 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:02.878914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:02.879532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:02.903348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:02.912356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:02.914992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:02.915930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:02.916579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:02.917747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:03.205640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:03.206615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:03.230691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:03.232057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:03.232581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:03.238490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:03.241170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:03.241720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:03.325336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:03.337745 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1aac0903-0883-42c7-b54a-85910c8f85a2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.463515 Oct 28 10:18:03.341217 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2810/5614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:02 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:04.368339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:04.369798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:04.393556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:04.400176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:04.403936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:04.410672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:04.413682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:04.414896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:04.508689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:04.527761 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da28a2b3-5c47-4547-8643-466ba596888b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 1.326433 Oct 28 10:18:04.528668 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2805/5615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:03 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:04.785390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:04.794381 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b68710ba-1956-4d7c-88b7-d8187c6c3b6f tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.431663 Oct 28 10:18:04.803664 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2811/5616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:04 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:05.577099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:05.581802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:05.607840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:05.607928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:05.608381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:05.609143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:05.621699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:05.622167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:05.842454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:05.844056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:05.859548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:05.865361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:05.866633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:05.874098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:05.889270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:05.907041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:06.247877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:06.265980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b8f3987-f933-4bd6-b495-e932522439b5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.713214 Oct 28 10:18:06.275262 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2806/5617] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:05 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:06.622817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:06.631383 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e33ce28d-ab3a-4643-bfff-ced70ab3cc49 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.803376 Oct 28 10:18:06.664712 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2812/5618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:05 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:07.292613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:07.297418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:07.310317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:07.311050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:07.314072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:07.315006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:07.315651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:07.316931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:07.671613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:07.672232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:07.697834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:07.700025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:07.701209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:07.702828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:07.716258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:07.726048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:07.951753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:07.987696 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd7b96f6-510f-44dd-aa54-4ea0ea92aa6b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.690028 Oct 28 10:18:08.012134 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2807/5619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:07 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:08.262153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:08.282161 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63478837-5253-42fe-8f14-0e98950391bd tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.614889 Oct 28 10:18:08.296932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2813/5620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:07 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:09.016282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:09.017150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:09.038099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:09.039997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:09.040625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:09.047740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:09.051350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:09.053326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:09.298938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:09.307942 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41d4c150-dfe2-4023-a758-e479cf92c3ec tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.299837 Oct 28 10:18:09.310473 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2808/5621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:09 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:09.327767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:09.328472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:09.363762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:09.373976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:09.380961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:09.392880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:09.393663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:09.393866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:09.927296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e1b5eb7a-6f8c-4735-936a-0a23b828ee92 req-97898cf7-aad1-44e2-a665-8e98a0c76d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c08ddd-41c8-4fe3-9667-8d4961457a9d", "name": "network-vif-plugged", "status": "completed", "tag": "c3a577fc-3330-4924-9947-af7b9c29dcef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:09.946671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e1b5eb7a-6f8c-4735-936a-0a23b828ee92 req-97898cf7-aad1-44e2-a665-8e98a0c76d3f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:09.947159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e1b5eb7a-6f8c-4735-936a-0a23b828ee92 req-97898cf7-aad1-44e2-a665-8e98a0c76d3f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:09.947619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e1b5eb7a-6f8c-4735-936a-0a23b828ee92 req-97898cf7-aad1-44e2-a665-8e98a0c76d3f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:09.976914 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e1b5eb7a-6f8c-4735-936a-0a23b828ee92 req-97898cf7-aad1-44e2-a665-8e98a0c76d3f service nova] Creating event network-vif-plugged:c3a577fc-3330-4924-9947-af7b9c29dcef for instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d on n-h1-zed-1 Oct 28 10:18:09.990312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e1b5eb7a-6f8c-4735-936a-0a23b828ee92 req-97898cf7-aad1-44e2-a665-8e98a0c76d3f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065792 Oct 28 10:18:09.997267 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2809/5622] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:18:10.324311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:10.343460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:10.346031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:10.347241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3abe398e-e777-485f-83f6-97dbe53e0e41 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 1.038396 Oct 28 10:18:10.349226 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2814/5623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:09 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:10.366640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:10.371793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:10.373570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:10.375406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:10.383810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:10.387590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:10.774654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:10.784347 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5576efd8-f464-4e54-a4d2-76cab5b8df6d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.449049 Oct 28 10:18:10.796944 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2810/5624] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:10 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:11.377766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:11.378721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:11.420247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:11.421153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:11.421942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:11.429801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:11.430563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:11.431225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:11.825236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:11.826551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:11.836698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:11.840953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:11.842044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:11.844593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:11.845366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:11.852449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:11.919863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:11.929509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c63fa322-f62c-48a5-9963-f041882c1e80 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1323 microversion: 2.1 time: 0.556958 Oct 28 10:18:11.938057 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2815/5625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:11 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1323 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:12.314059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:12.323157 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-95938bb3-e0ec-4f25-a3c1-bea78792988c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.501971 Oct 28 10:18:12.330531 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2811/5626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:11 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:12.963308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:12.964668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:12.982697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:12.990308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:12.990791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:12.991569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:12.992047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:12.992498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:13.364050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:13.365518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:13.376886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:13.398323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:13.398801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:13.399558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:13.400028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:13.400464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:13.511863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:13.521699 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a568a4b-bddf-488e-b003-9d8d6e8ade5b tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1519 microversion: 2.1 time: 0.562135 Oct 28 10:18:13.566274 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2816/5627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:12 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1519 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:13.589991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:13.597600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:13.613512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:13.616589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:13.617210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:13.618284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:13.623590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:13.624303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:13.689411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lazy-loading 'flavor' on Instance uuid c4c08ddd-41c8-4fe3-9667-8d4961457a9d {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:18:13.995936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d08b504d-acb4-4882-b0f6-9abd388c5f72 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action" status: 200 len: 32 microversion: 2.1 time: 0.427676 Oct 28 10:18:14.009616 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2817/5628] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:13 2022] POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:18:14.021946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:14.029665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:14.050814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:14.054215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:14.054912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:14.055846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:14.059371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:14.060079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:14.424135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:14.437681 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb77fe7a-d939-4d39-a8d2-7259006fcd17 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.424786 Oct 28 10:18:14.439855 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2818/5629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:14 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:15.023440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:15.037611 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eeefeb46-efca-49ee-a0c0-17a2e2142ca4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 1.677801 Oct 28 10:18:15.044225 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2812/5630] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:13 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:15.466887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:15.468185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:15.480331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:15.485624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:15.486369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:15.493973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:15.494753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:15.497083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:16.066732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:16.067361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:16.079960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:16.080726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:16.081358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:16.082270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:16.084312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:16.085412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:16.101886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:16.113218 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c5308f0e-b1fd-461e-8e9e-672a0146dc60 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.649895 Oct 28 10:18:16.123749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2819/5631] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:15 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:16.532631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:16.547890 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-126bb4f0-e21e-4c9e-92c8-9abbbed2d9cd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.484355 Oct 28 10:18:16.549890 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2813/5632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:16 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:17.149512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:17.150784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:17.170879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:17.171573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:17.172199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:17.173043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:17.173548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:17.174075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:17.571924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:17.573819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:17.596358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:17.597794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:17.598974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:17.602100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:17.602570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:17.603011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:17.722356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:17.739711 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-79401b7e-e597-4255-867c-5405dec9f44d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.594100 Oct 28 10:18:17.753699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2820/5633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:17 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:17.985122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:17.993592 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edd9eae1-47c4-4a8e-8ce7-f6ea13815ae8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.425597 Oct 28 10:18:17.996646 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2814/5634] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:17 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:18.784534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:18.785801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:18.804079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:18.805615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:18.806943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:18.809350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:18.810205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:18.811177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:19.019631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:19.021149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:19.033757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:19.044890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:19.046902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:19.048528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:19.050525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:19.052451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:19.221540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:19.231181 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12a5c6c3-1eb6-45ea-9229-0f9dafed00f3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.451173 Oct 28 10:18:19.253622 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2821/5635] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:18 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:19.545171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:19.554738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b33406f-3f05-48ea-9a83-175d6c3fc0e7 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.538858 Oct 28 10:18:19.561280 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2815/5636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:19 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:20.261704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:20.262330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:20.280212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:20.280721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:20.285331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:20.286316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:20.287640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:20.288248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:20.587871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:20.589171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:20.608312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:20.617856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:20.627379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:20.629946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:20.632027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:20.632673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:20.770948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:20.788517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-782b4f02-5a88-4e85-9ff1-b9ce13be1010 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.532741 Oct 28 10:18:20.799280 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2822/5637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:20 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:21.298777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:21.317929 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-037731a4-c9ee-446b-955a-cf09033b33a4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.734087 Oct 28 10:18:21.333734 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2816/5638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:20 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:21.827476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:21.828385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:21.849156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:21.851056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:21.852816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:21.857235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:21.858597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:21.860350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:22.237801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:22.239044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:22.272814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=46 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:22.281042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:22.283567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:22.284022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:22.284746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:22.289073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:22.293477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:22.476027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:22.488279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:22.528663 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-84c41ff9-193d-4c3d-966d-edce79d66906 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.689320 Oct 28 10:18:22.529613 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2823/5639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:21 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:22.536152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:22.536764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:22.575757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:22.576359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:22.576753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:22.577509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:22.577968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:22.578393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:22.674682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:22.692493 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34e396bb-5560-423d-9c4f-1cba2af0d6fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.456087 Oct 28 10:18:22.695180 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2817/5640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:22 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:23.102141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:23.118312 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3607b230-ee3b-4e60-8748-c60a0e2d986d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.583806 Oct 28 10:18:23.120999 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2824/5641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:22 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:23.555967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:23.557464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:23.567878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:23.580242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:23.581020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:23.582024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:23.586106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:23.587416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:23.720719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:23.722184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:23.738123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:23.741116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:23.742231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:23.747845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:23.751033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:23.757507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:24.179439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:24.198698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f85aeb10-fd45-45e7-ad81-c7596690aa20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.482063 Oct 28 10:18:24.202781 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2825/5642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:23 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:24.218046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:24.218046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:24.235926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:24.237203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:24.238003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:24.238997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:24.239615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:24.240394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:24.251581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:24.259546 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c5d9b71-a26b-46dc-be1e-dc6b692f7aaa tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.707935 Oct 28 10:18:24.261061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2818/5643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:23 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:24.274320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1605246473"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:24.276862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:24.288357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:24.288853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:24.289316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:24.290028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:24.290483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:24.290940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:24.353916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:24.642466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:24.657405 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e5bf7b1a-20bf-4b73-9a9e-390b2d2aeaac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.448339 Oct 28 10:18:24.658032 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2826/5644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:24 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:24.737412 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da6d16ba-441a-47a9-bf5b-8ba206f7e9c7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.475066 Oct 28 10:18:24.742162 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2819/5645] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:24 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 28 10:18:24.747515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:24.748124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:24.762513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:24.770765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:24.771553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:24.772507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:24.773247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:24.778193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:25.068530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:25.077536 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6be06bb7-bf6f-43eb-85ba-61dae1209ca8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.334001 Oct 28 10:18:25.082832 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2827/5646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:24 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:25.287320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:25.288227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:25.299889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:25.302876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:25.303478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:25.307814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:25.308422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:25.310727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:25.540147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-10ce1c72-b62a-406f-bd81-3f3c8c4cc89c req-26592baf-fc3d-41ac-8143-68470bae4771 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "name": "network-vif-unplugged", "status": "completed", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:25.562211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-10ce1c72-b62a-406f-bd81-3f3c8c4cc89c req-26592baf-fc3d-41ac-8143-68470bae4771 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:25.562909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-10ce1c72-b62a-406f-bd81-3f3c8c4cc89c req-26592baf-fc3d-41ac-8143-68470bae4771 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:25.563541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-10ce1c72-b62a-406f-bd81-3f3c8c4cc89c req-26592baf-fc3d-41ac-8143-68470bae4771 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:25.594690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-10ce1c72-b62a-406f-bd81-3f3c8c4cc89c req-26592baf-fc3d-41ac-8143-68470bae4771 service nova] Creating event network-vif-unplugged:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:18:25.606475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-10ce1c72-b62a-406f-bd81-3f3c8c4cc89c req-26592baf-fc3d-41ac-8143-68470bae4771 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070607 Oct 28 10:18:25.608217 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2828/5647] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:25.681896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:25.684035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:25.698944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:25.700043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:25.701159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:25.704665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:25.705412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:25.707447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:25.805926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:25.817016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c380cbf-3455-40a2-86b5-6ddd9ccb110a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.534163 Oct 28 10:18:25.828607 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2820/5648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:25 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:25.998597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:26.011388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f03aee51-036c-4f26-be79-2a896eb034a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.334400 Oct 28 10:18:26.012429 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2829/5649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:25 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:26.111672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:26.111672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:26.140513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:26.149141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:26.149885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:26.155685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:26.156557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:26.157140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:26.487876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:26.495022 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2be8655-76c8-4cab-ae4d-836ac43cbc64 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.391453 Oct 28 10:18:26.495842 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2821/5650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:26 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:26.851028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:26.851595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:26.857092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=50 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:26.858801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:26.859629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:26.860414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:26.861481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:26.862336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:26.862995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:27.038911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:27.042366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:27.076721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:27.078750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:27.079963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:27.081110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:27.081943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:27.082674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:27.198174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:27.208539 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fcde715c-7bda-477c-a7a5-97c4d1b5e182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.361335 Oct 28 10:18:27.211057 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2830/5651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:26 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:27.312605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:27.322557 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8a00518-97e4-4fec-89b0-66cffd2d86dd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.290999 Oct 28 10:18:27.323790 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2822/5652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:27 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:27.520825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:27.521555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:27.529595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:27.530443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:27.531324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:27.532474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:27.533158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:27.534178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:27.710967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:27.719476 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fc115275-b6f7-4298-8b0e-eb58d838e341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1685 microversion: 2.1 time: 0.203665 Oct 28 10:18:27.737882 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2831/5653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:27 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1685 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:28.234418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:28.235660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:28.242561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:28.243411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:28.244017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:28.248289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:28.249007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:28.249658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:28.352504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:28.354027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:28.366624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:28.367808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:28.368830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:28.370966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:28.371966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:28.372921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:28.455474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:28.465970 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a371ca33-8275-4325-81cb-dbf4da0b705a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.235408 Oct 28 10:18:28.467227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2823/5654] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:28 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:28.547071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:28.553483 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed2e1623-7dd3-4547-b1d1-d97d780c1780 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.210557 Oct 28 10:18:28.554079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2832/5655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:28 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:28.755067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:28.755692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:28.771586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:28.772273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:28.772934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:28.773768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:28.774307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:28.774767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:29.166113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:29.181469 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76ccc620-1e5e-4345-8f15-f8b342dda9fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.430374 Oct 28 10:18:29.204514 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2824/5656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:28 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:29.491868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:29.492548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:29.503401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:29.503902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:29.504867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:29.505333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:29.505795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:29.506226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:29.588116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:29.589521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:29.603613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:29.606249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:29.610223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:29.613692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:29.614981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:29.615694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:29.689513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:29.700943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f58816e5-0979-47f6-b1f3-2e606ad6872a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.213929 Oct 28 10:18:29.702552 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2833/5657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:29 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:30.021518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:30.032889 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d7f8dac4-64ab-48a3-af8c-16023a9b66fa tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.459226 Oct 28 10:18:30.043053 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2825/5658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:29 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:30.219257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:30.220011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:30.234857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:30.235392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:30.235815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:30.236535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:30.237021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:30.237457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:30.664567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:30.673564 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-11b3504c-3a20-41dc-b685-5353c2363600 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.462889 Oct 28 10:18:30.676160 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2834/5659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:30 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:30.734556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:30.736513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:30.746589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:30.747845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:30.748552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:30.750351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:30.751013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:30.751784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:31.066287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:31.067488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:31.086365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:31.087967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:31.089339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:31.090883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:31.092268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:31.095072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:31.110727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:31.119377 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af2160e5-88e0-41fb-9052-083fe4c1cedf tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.388858 Oct 28 10:18:31.124654 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2826/5660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:30 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:31.536670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:31.564106 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-806f279f-9fac-431f-bb66-2dc5d23c944a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.503921 Oct 28 10:18:31.566268 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2835/5661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:31 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:31.705579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:31.707649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:31.731522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:31.733928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:31.734751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:31.736154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:31.736841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:31.741793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:31.883924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7fdccea8-8c20-4f7b-9dc1-6e35712a0e5b req-f322a954-e81b-494f-8718-41f5f083cd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbb2c02-f4e1-4ce9-85dc-6030582e257e", "name": "network-vif-plugged", "status": "completed", "tag": "74651f42-f412-4bde-9914-23e1b529beb7"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:31.912198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7fdccea8-8c20-4f7b-9dc1-6e35712a0e5b req-f322a954-e81b-494f-8718-41f5f083cd35 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:31.912198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7fdccea8-8c20-4f7b-9dc1-6e35712a0e5b req-f322a954-e81b-494f-8718-41f5f083cd35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:31.912198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7fdccea8-8c20-4f7b-9dc1-6e35712a0e5b req-f322a954-e81b-494f-8718-41f5f083cd35 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:31.965551 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7fdccea8-8c20-4f7b-9dc1-6e35712a0e5b req-f322a954-e81b-494f-8718-41f5f083cd35 service nova] Creating event network-vif-plugged:74651f42-f412-4bde-9914-23e1b529beb7 for instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e on n-h2-zed-1 Oct 28 10:18:31.985525 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7fdccea8-8c20-4f7b-9dc1-6e35712a0e5b req-f322a954-e81b-494f-8718-41f5f083cd35 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109795 Oct 28 10:18:31.987958 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2836/5662] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:32.005282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:32.014904 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ac021be8-7557-4f17-adf6-cbd541cedf67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.319086 Oct 28 10:18:32.024087 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2827/5663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:31 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:32.147895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:32.148594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:32.163217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:32.164494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:32.166227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:32.168708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:32.170471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:32.176829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:32.588794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:32.603136 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-311d53de-61d2-4d10-aade-4e4aaa92067a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.455565 Oct 28 10:18:32.603363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:32.605027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:32.605848 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2837/5664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:32 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:32.630877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:32.632269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:32.632979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:32.634451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:32.635144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:32.635677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:33.049967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:33.051544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:33.067504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:33.068644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:33.069358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:33.071950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:33.076068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:33.076753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:33.218988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:33.239974 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-761876dd-4b03-40bc-8e3b-5da7bf7262a0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.647147 Oct 28 10:18:33.247069 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2828/5665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:32 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:33.438626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:33.465603 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a0a7ddd1-0ac4-4dfc-b86a-83f111b71dd7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.420734 Oct 28 10:18:33.468162 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2838/5666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:33 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:33.637511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:33.638283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:33.665179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:33.665683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:33.666129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:33.666897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:33.667351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:33.667832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:34.275269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:34.275952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:34.290972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:34.291538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:34.291989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:34.292720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:34.296310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:34.298275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:34.675577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:34.692953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-34bae5dc-5e9a-42e7-8759-673bf00ca707 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.422098 Oct 28 10:18:34.709097 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2839/5667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:34 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:34.718059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e8898975-9a50-495a-a5b3-11ed712c6754 req-6e220574-77ac-4d62-bcae-a1edad3c268b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "name": "network-vif-plugged", "status": "completed", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:34.763278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e8898975-9a50-495a-a5b3-11ed712c6754 req-6e220574-77ac-4d62-bcae-a1edad3c268b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:34.763782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e8898975-9a50-495a-a5b3-11ed712c6754 req-6e220574-77ac-4d62-bcae-a1edad3c268b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:34.764232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e8898975-9a50-495a-a5b3-11ed712c6754 req-6e220574-77ac-4d62-bcae-a1edad3c268b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:34.829568 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e8898975-9a50-495a-a5b3-11ed712c6754 req-6e220574-77ac-4d62-bcae-a1edad3c268b service nova] Creating event network-vif-plugged:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:18:34.846445 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e8898975-9a50-495a-a5b3-11ed712c6754 req-6e220574-77ac-4d62-bcae-a1edad3c268b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134412 Oct 28 10:18:34.850784 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2840/5668] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:34.867485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:34.869062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:34.883710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:34.884215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:34.884658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:34.891912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:34.893894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:34.895879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:35.114390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:35.127903 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0cb0112-6ca2-4f38-83b5-8fee6b9cca45 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 1.496112 Oct 28 10:18:35.148411 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2829/5669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:33 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:35.156633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:35.166314 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b1ff4b1-cf1c-436b-b109-e48c85ad9258 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.314286 Oct 28 10:18:35.167365 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2841/5670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:34 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:35.717384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:35.718041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:35.726121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:35.726632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:35.727062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:35.727773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:35.728431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:35.728817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:36.064109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:36.076408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76721e65-c238-43df-8337-c89cf2f17f39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.364050 Oct 28 10:18:36.100123 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2830/5671] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:35 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:36.175638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:36.176932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:36.196877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:36.197502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:36.206127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:36.206631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:36.207074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:36.207791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:36.208248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:36.208678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:36.211796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:36.212299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:36.212745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:36.213538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:36.214134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:36.214571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:36.298440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:36.560077 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:18:36.560314 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:18:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d (ip 10.222.0.16) !!! Oct 28 10:18:36.572435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:36.586578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f5074ec-6feb-400a-8516-2bde5dd3f085 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.411151 Oct 28 10:18:36.591218 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2842/5672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:36 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:36.782673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:36.790694 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b403123b-d221-4e25-9f01-55a7df9e8901 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.597639 Oct 28 10:18:36.801676 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2831/5673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:36 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:37.107033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:37.107444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:37.118627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:37.119236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:37.119787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:37.122294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:37.122881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:37.125482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:37.462110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:37.474952 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-abcc601d-d1aa-4268-abe0-8c0675b5e6f9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.370555 Oct 28 10:18:37.475833 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2843/5674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:37 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:37.621424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:37.622794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:37.636818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:37.645993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:37.647457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:37.648717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:37.656751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:37.657463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:37.815964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:37.816898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:37.824087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:37.837917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:37.846633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:37.847688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:37.848331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:37.851613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:38.021648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:38.038594 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-589722dc-a70d-4b93-a6c2-a94409f25e1d tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.421325 Oct 28 10:18:38.043819 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2832/5675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:37 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:38.500882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:38.502018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:38.513426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:38.518131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:38.518912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:38.522524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:38.523256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:38.523897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:38.807378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:38.815774 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8426227f-7c64-4d1c-b5c3-70e1f1390ceb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.319307 Oct 28 10:18:38.828435 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2833/5676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:38 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:38.828618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:38.828618 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6710ee12-bbf5-40e4-87cf-6c523d9ec387 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 1.015909 Oct 28 10:18:38.828618 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2844/5677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:37 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:39.072012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:39.073620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:39.081388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:39.082151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:39.082807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:39.083780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:39.084407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:39.085396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:39.424030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:39.432948 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-45833e11-0983-4bc5-b2b5-89087ab83429 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.368927 Oct 28 10:18:39.439699 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2834/5678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:39 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:39.843700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:39.844936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:39.859341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:39.868203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:39.868832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:39.874169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:39.875175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:39.875931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:39.882543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:39.883065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:39.887846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:39.888358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:39.888805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:39.889559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:39.890023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:39.898585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:39.923100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:40.215378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:40.226446 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48c736c2-0737-4f77-9e09-3151b5ca6a4a tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.386503 Oct 28 10:18:40.227411 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2845/5679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:39 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:40.382998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:40.394967 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c33240df-e100-4185-8eab-35819b8840c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.534185 Oct 28 10:18:40.405124 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2835/5680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:39 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:40.468634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:40.469675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:40.490871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:40.492998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:40.494480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:40.498424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:40.499390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:40.500056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:40.860226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:40.875009 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30485461-2620-408e-a536-fc06be3e3999 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.409468 Oct 28 10:18:40.878836 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2846/5681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:40 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:41.251003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:41.251605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:41.262302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:41.263153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:41.263967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:41.265302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:41.265974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:41.266629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:41.430457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:41.431346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:41.442447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:41.444186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:41.453630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:41.454714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:41.456169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:41.457579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:41.530409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:41.553884 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b17b12ae-3e58-4a08-8093-c9e7875b9ccc tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.306642 Oct 28 10:18:41.581829 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2836/5682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:41 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:41.883628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:41.897732 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a87d54a9-0b38-42a3-9d41-844e5d82fc4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.478120 Oct 28 10:18:41.898647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:41.899339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:41.900212 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2847/5683] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:41 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:41.912186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:41.912683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:41.913155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:41.913860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:41.914323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:41.914761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:42.181325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:42.190191 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87bc4d98-c362-40e5-8189-cacf12b80a3e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.295250 Oct 28 10:18:42.195123 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2837/5684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:41 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:42.582021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:42.582998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:42.593337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:42.596642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:42.600660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:42.601643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:42.602472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:42.603099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:42.925484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:42.926331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:42.958162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:42.962932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:42.965321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:42.967343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:42.970686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:42.971364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:42.979527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:42.997204 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c6ecf7e3-8856-4179-b908-72464f592e07 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.418253 Oct 28 10:18:42.997712 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2848/5685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:42 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:43.221105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:43.222118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:43.238792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:43.239988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:43.242781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:43.245799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:43.246648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:43.249006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:43.465187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:43.479640 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1b0c65b-36c2-4b3b-836f-5b2065bf3f2c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.558622 Oct 28 10:18:43.484263 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2838/5686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:42 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:43.667282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:43.678657 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8fb22654-c398-4980-8bc2-4e1d0a7d8a2e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.462188 Oct 28 10:18:43.681000 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2849/5687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:43 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:44.019723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:44.020332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:44.033860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:44.037554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:44.038481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:44.055491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:44.056346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:44.057133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:44.279263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:44.300969 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52b2327d-d6bc-464b-b70f-bdbfab7560c0 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.285120 Oct 28 10:18:44.309474 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2839/5688] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:44 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:44.507846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:44.508582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:44.523642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:44.527818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:44.528353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:44.531109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:44.533430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:44.533958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:44.709136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:44.709796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:44.716721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:44.725459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:44.733609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:44.734819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:44.737059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:44.737664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:44.753668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:44.788621 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72199ec1-89c9-4c50-95c2-803f683c2d1f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.284549 Oct 28 10:18:44.790770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2850/5689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:44 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:45.102789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:45.115900 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-21b2346d-5eb5-4acb-99f3-1ad297a00173 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1525 microversion: 2.1 time: 0.408304 Oct 28 10:18:45.117035 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2840/5690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:44 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1525 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:45.336993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:45.337930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:45.346273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:45.347177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:45.347804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:45.348696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:45.349500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:45.350180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:45.653035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:45.662472 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52315788-764a-4d19-a203-0e5c71035924 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.333937 Oct 28 10:18:45.673885 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2851/5691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:45 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:45.818246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:45.819006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:45.833011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:45.833879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:45.834555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:45.835500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:45.836149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:45.836790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:46.140101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:46.141474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:46.176602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:46.179897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:46.180524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:46.181759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:46.183472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:46.188149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:46.209860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:46.237278 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b1c2e39-a9a7-4a9f-958b-ec39172a3000 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.418743 Oct 28 10:18:46.249461 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2841/5692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:45 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:46.625615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:46.637768 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f86d9ad8-db0a-4967-9c9f-0640ad0c1a81 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1505 microversion: 2.1 time: 0.501822 Oct 28 10:18:46.647330 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2852/5693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:46 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1505 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:46.662522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82f2793b-1179-4884-94c1-88d749bbfad3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'create', calling method: .version_select at 0x7fca321f6670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-317508151", "description": "tempest-description-1089368825"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:46.695409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:46.696584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:46.708152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:46.708152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:46.708152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:46.709343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:46.709945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:46.710596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:47.172697 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82f2793b-1179-4884-94c1-88d749bbfad3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.514514 Oct 28 10:18:47.182622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:47.183576 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2842/5694] 10.222.0.16 () {60 vars in 1180 bytes} [Fri Oct 28 10:18:46 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:47.189898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-317508151"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:47.190994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:47.191866 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b47c14a-c714-4b53-9c76-e352eb1d27bd tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1518 microversion: 2.1 time: 0.503620 Oct 28 10:18:47.192797 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2853/5695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:46 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1518 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:47.213850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:47.219165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:47.219617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:47.220463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:47.220961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:47.221402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:47.263992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:47.264973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:47.274122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:47.274637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:47.275086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:47.275851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:47.278951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:47.280524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:47.491527 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.network.security_group_api [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Adding security group 2076757c-21b7-416b-b7a9-96c77d20f321 to port c3a577fc-3330-4924-9947-af7b9c29dcef Oct 28 10:18:47.560352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:47.573464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1d6518e-5a68-4c07-8b10-4ad720166114 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.313185 Oct 28 10:18:47.574611 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2854/5696] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:47 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:48.220996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:48.222446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:48.240490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:48.241320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:48.242213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:48.244928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:48.252462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:48.253295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:48.558089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:48.569998 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-632874e4-e843-476c-abba-c033a81440f1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.352943 Oct 28 10:18:48.571668 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2855/5697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:48 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:48.602832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:48.603542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:48.622952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:48.623883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:48.624562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:48.625536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:48.626195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:48.626817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:48.751398 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d7614c52-05ec-4787-8a03-7085e0eedd39 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action" status: 202 len: 0 microversion: 2.1 time: 1.565388 Oct 28 10:18:48.755862 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2843/5698] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:47 2022] POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action => generated 0 bytes in 1571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:18:48.765092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:48.768644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:48.790885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:48.796086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:48.802476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:48.803532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:48.809732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:48.811266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:48.982274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:48.994632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb25b9a0-31f0-4774-86cb-6d24ebcc8009 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.398747 Oct 28 10:18:48.995850 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2856/5699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:48 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:49.002182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-317508151"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:49.003032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:49.010964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:49.011730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:49.012389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:49.013406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:49.014174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:49.014791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:49.323558 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.network.security_group_api [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Removing security group 2076757c-21b7-416b-b7a9-96c77d20f321 from port c3a577fc-3330-4924-9947-af7b9c29dcef Oct 28 10:18:49.362541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:49.383769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e72cfaba-6f13-41b3-8333-9aeb4175ead6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.626493 Oct 28 10:18:49.389243 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2844/5700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:48 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:49.393517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8b586f5f-4656-4046-b436-65045a98e515 req-342b7278-f94d-4a6f-852d-d34a48e29c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c08ddd-41c8-4fe3-9667-8d4961457a9d", "tag": "c3a577fc-3330-4924-9947-af7b9c29dcef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:49.428481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8b586f5f-4656-4046-b436-65045a98e515 req-342b7278-f94d-4a6f-852d-d34a48e29c06 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:49.429274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8b586f5f-4656-4046-b436-65045a98e515 req-342b7278-f94d-4a6f-852d-d34a48e29c06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:49.429876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8b586f5f-4656-4046-b436-65045a98e515 req-342b7278-f94d-4a6f-852d-d34a48e29c06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:49.458851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8b586f5f-4656-4046-b436-65045a98e515 req-342b7278-f94d-4a6f-852d-d34a48e29c06 service nova] Creating event network-changed:c3a577fc-3330-4924-9947-af7b9c29dcef for instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d on n-h1-zed-1 Oct 28 10:18:49.470841 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8b586f5f-4656-4046-b436-65045a98e515 req-342b7278-f94d-4a6f-852d-d34a48e29c06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080645 Oct 28 10:18:49.471789 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2845/5701] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:49.478279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:49.486103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:49.504421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:49.505202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:49.505870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:49.506747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:49.508022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:49.510666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:49.874463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:49.883555 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-237ea555-15d5-44a3-9062-2d9eba7f9d16 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.409370 Oct 28 10:18:49.889695 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2846/5702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:49 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:49.917533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8088aaa2-edb1-4542-a2f4-28c6ae21b12c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:49.935475 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8088aaa2-edb1-4542-a2f4-28c6ae21b12c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 6a2961f6-a829-4da3-81aa-c56ffa0b0d8d has no mapping to a cell. Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8088aaa2-edb1-4542-a2f4-28c6ae21b12c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/6a2961f6-a829-4da3-81aa-c56ffa0b0d8d/action HTTP/1.1 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 15 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: {"os-stop": {}} Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 6a2961f6-a829-4da3-81aa-c56ffa0b0d8d has no mapping to a cell. Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '6a2961f6-a829-4da3-81aa-c56ffa0b0d8d', 'body': {'os-stop': {}}} Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 6a2961f6-a829-4da3-81aa-c56ffa0b0d8d has no mapping to a cell. Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:18:49.959542 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2961f6-a829-4da3-81aa-c56ffa0b0d8d has no mapping to a cell. Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2961f6-a829-4da3-81aa-c56ffa0b0d8d has no mapping to a cell. Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8088aaa2-edb1-4542-a2f4-28c6ae21b12c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 6a2961f6-a829-4da3-81aa-c56ffa0b0d8d has no mapping to a cell. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8088aaa2-edb1-4542-a2f4-28c6ae21b12c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/6a2961f6-a829-4da3-81aa-c56ffa0b0d8d/action" status: 404 len: 117 microversion: 2.1 time: 0.047162 Oct 28 10:18:49.968576 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2847/5703] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:49 2022] POST /compute/v2.1/servers/6a2961f6-a829-4da3-81aa-c56ffa0b0d8d/action => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:18:49.970708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:49.971330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:49.987798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:49.988302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:49.988737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:49.994768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:49.995676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:49.996352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:50.212118 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c38bd871-1d0e-44d6-a532-02473a8a233a tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action" status: 202 len: 0 microversion: 2.1 time: 1.213920 Oct 28 10:18:50.214446 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2857/5704] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:48 2022] POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action => generated 0 bytes in 1218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:18:50.220103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:50.220254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:50.234355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:50.234799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:50.235239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:50.235946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:50.236400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:50.236828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:50.691259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:50.699467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:50.703568 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2899119a-8d86-4103-bb12-bae517ba6615 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1680 microversion: 2.1 time: 0.487448 Oct 28 10:18:50.705014 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2858/5705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:50 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1680 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:50.707855 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b879a4d-810c-433d-9e42-f503736eac9e tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.741537 Oct 28 10:18:50.711394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-47afd77c-f273-4f42-ba88-4f7ecd32d5e2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'create', calling method: .version_select at 0x7fca323b88b0>, body: {"pool": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:50.712431 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2848/5706] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:49 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:50.738640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-beb2bc37-0ed2-4152-a59d-d0e40e41ce8d req-17918cf8-4670-47d0-be03-0d78c439935c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c08ddd-41c8-4fe3-9667-8d4961457a9d", "tag": "c3a577fc-3330-4924-9947-af7b9c29dcef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:50.767826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-beb2bc37-0ed2-4152-a59d-d0e40e41ce8d req-17918cf8-4670-47d0-be03-0d78c439935c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:50.768768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-beb2bc37-0ed2-4152-a59d-d0e40e41ce8d req-17918cf8-4670-47d0-be03-0d78c439935c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:50.770303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-beb2bc37-0ed2-4152-a59d-d0e40e41ce8d req-17918cf8-4670-47d0-be03-0d78c439935c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:50.805368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-beb2bc37-0ed2-4152-a59d-d0e40e41ce8d req-17918cf8-4670-47d0-be03-0d78c439935c service nova] Creating event network-changed:c3a577fc-3330-4924-9947-af7b9c29dcef for instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d on n-h1-zed-1 Oct 28 10:18:50.824564 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-beb2bc37-0ed2-4152-a59d-d0e40e41ce8d req-17918cf8-4670-47d0-be03-0d78c439935c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107270 Oct 28 10:18:50.826907 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2849/5707] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:50.840804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:50.843255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:50.865376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:50.866149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:50.866738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:50.867648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:50.868313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:50.868954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:51.423722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:51.460139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-549c547e-d92f-48bc-b397-88df25754d66 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.620980 Oct 28 10:18:51.463544 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2850/5708] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:50 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:51.476560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:51.477093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:51.489177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:51.491280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:51.493311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:51.496268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:51.497259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:51.498911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:51.556113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7602de8c-6316-4b82-af06-69f910bcb7dc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c/ips" status: 200 len: 150 microversion: 2.1 time: 0.088502 Oct 28 10:18:51.564058 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2851/5709] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:18:51 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c/ips => generated 150 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:51.568227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67a999c9-7766-4674-a22a-13c9bc6ba4ad tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:51.569923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67a999c9-7766-4674-a22a-13c9bc6ba4ad tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: bd07062b-4345-4bf8-a792-1b16fae1cf23] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-67a999c9-7766-4674-a22a-13c9bc6ba4ad tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance bd07062b-4345-4bf8-a792-1b16fae1cf23 could not be found. Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67a999c9-7766-4674-a22a-13c9bc6ba4ad tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/bd07062b-4345-4bf8-a792-1b16fae1cf23/action HTTP/1.1 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 15 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: {"suspend": {}} Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance bd07062b-4345-4bf8-a792-1b16fae1cf23 could not be found. Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'bd07062b-4345-4bf8-a792-1b16fae1cf23', 'body': {'suspend': {}}} Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd07062b-4345-4bf8-a792-1b16fae1cf23 could not be found. Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd07062b-4345-4bf8-a792-1b16fae1cf23 could not be found. Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:51.586510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd07062b-4345-4bf8-a792-1b16fae1cf23 could not be found. Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67a999c9-7766-4674-a22a-13c9bc6ba4ad tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance bd07062b-4345-4bf8-a792-1b16fae1cf23 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:18:51.591373 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67a999c9-7766-4674-a22a-13c9bc6ba4ad tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/bd07062b-4345-4bf8-a792-1b16fae1cf23/action" status: 404 len: 111 microversion: 2.1 time: 0.027572 Oct 28 10:18:51.592024 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2852/5710] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:51 2022] POST /compute/v2.1/servers/bd07062b-4345-4bf8-a792-1b16fae1cf23/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:18:51.602770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81664b39-807e-43c6-84a8-bf2417f6690f"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:51.609467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:51.636891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:51.637437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:51.637946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:51.638671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:51.640290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:51.640734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:51.878299 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Invalid volume: volume 81664b39-807e-43c6-84a8-bf2417f6690f is already attached to instances: 9399955c-6dee-411c-8c04-34ff847396e3 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c/os-volume_attachments HTTP/1.1 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 74 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: {"volumeAttachment": {"volumeId": "81664b39-807e-43c6-84a8-bf2417f6690f"}} Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid volume: volume 81664b39-807e-43c6-84a8-bf2417f6690f is already attached to instances: 9399955c-6dee-411c-8c04-34ff847396e3 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '5fa93feb-174d-4a13-869f-ece3341a8d3c', 'body': {'volumeAttachment': {'volumeId': '81664b39-807e-43c6-84a8-bf2417f6690f'}}} Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 81664b39-807e-43c6-84a8-bf2417f6690f is already attached to instances: 9399955c-6dee-411c-8c04-34ff847396e3 Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:18:51.881213 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 81664b39-807e-43c6-84a8-bf2417f6690f is already attached to instances: 9399955c-6dee-411c-8c04-34ff847396e3 Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 81664b39-807e-43c6-84a8-bf2417f6690f is already attached to instances: 9399955c-6dee-411c-8c04-34ff847396e3 Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 400 to user: Invalid volume: volume 81664b39-807e-43c6-84a8-bf2417f6690f is already attached to instances: 9399955c-6dee-411c-8c04-34ff847396e3 {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17ac0fe3-4bff-4472-96e0-d5c6051e5b89 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.290208 Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2853/5711] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:18:51 2022] POST /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c/os-volume_attachments => generated 174 bytes in 291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:18:51.888484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:51.890847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:51.896091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:51.896580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:51.897077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:51.897799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:51.898251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:51.898673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:52.604980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:52.613431 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0bcbcea-ed59-46f8-99c7-725d81019d3d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.729013 Oct 28 10:18:52.641186 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2854/5712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:51 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:52.664886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:52.667555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:52.672777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=74 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:52.693794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:52.708006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:52.708584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:52.709412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:52.709888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:52.710328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.011310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:53.028458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d225cc0f-0ec4-4992-8bb4-9f0f132695ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.385388 Oct 28 10:18:53.048601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2855/5713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:52 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:53.048601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:53.048601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:53.051840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.052514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.053420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.054360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.055036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.055681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.125260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:18:53.133854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:53.262991 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3127dcc3-54f0-42ec-bdb9-6001de008561 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 204 len: 0 microversion: 2.1 time: 0.231304 Oct 28 10:18:53.264352 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2856/5714] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:18:53 2022] DELETE /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:18:53.272555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:53.273888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:53.282174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.285347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.286800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.288206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.290099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.293183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.585777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:53.603147 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3890a887-a18d-4daa-a6c4-4baba4a89872 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.336479 Oct 28 10:18:53.604614 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2857/5715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:53 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:53.621714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:53.623262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:53.629596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.630100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.630544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.631404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.631734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.632161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.919383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:53.928862 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-104f903e-e3de-4b2f-b56a-15f504a09845 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.323053 Oct 28 10:18:53.945958 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2858/5716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:53 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:53.960438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:53.961629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:53.976520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.977087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.977610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:53.978353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:53.979553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:53.980746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:54.363618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:54.409846 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cfa9c230-ebd7-4884-8928-776516db5235 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1682 microversion: 2.1 time: 0.462632 Oct 28 10:18:54.410444 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2859/5717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:53 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1682 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:54.433659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:54.443725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:54.470042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:54.470572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:54.471027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:54.471766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:54.474274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:54.476692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:54.540714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lazy-loading 'flavor' on Instance uuid 1fbb2c02-f4e1-4ce9-85dc-6030582e257e {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:18:54.705086 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38e23960-f480-46e9-b431-bb9a234d8b56 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 202 len: 0 microversion: 2.1 time: 0.287486 Oct 28 10:18:54.710883 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2860/5718] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:54 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:18:54.730677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:54.731499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:54.749028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:54.750659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:54.751318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:54.753030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:54.754838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:54.755974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:55.164644 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-47afd77c-f273-4f42-ba88-4f7ecd32d5e2 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.457389 Oct 28 10:18:55.165816 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2859/5719] 10.222.0.16 () {60 vars in 1170 bytes} [Fri Oct 28 10:18:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:55.196501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.7.177"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:55.204753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:55.235103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:55.236233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:55.237809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:55.240699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:55.241410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:55.244384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:55.297493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:55.352850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "refresh_cache-c4c08ddd-41c8-4fe3-9667-8d4961457a9d" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:18:55.354763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquired lock "refresh_cache-c4c08ddd-41c8-4fe3-9667-8d4961457a9d" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:18:55.403719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:55.420088 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce73d499-284d-4820-9bad-c80435b24a9c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1513 microversion: 2.1 time: 0.705384 Oct 28 10:18:55.439577 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2861/5720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:54 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1513 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:55.448593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:55.449263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:55.466166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:55.466586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:55.467189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:55.472063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:55.472678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:55.474315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:55.791143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:55.800864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c8c8f90-2495-477a-9a5d-91eab521c8ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1682 microversion: 2.1 time: 0.359915 Oct 28 10:18:55.802339 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2862/5721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:55 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1682 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:55.843246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:55.844623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:55.861116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:55.861659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:55.865570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:55.866385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:55.866870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:55.867311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:56.194852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:56.210321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85c89fd2-445f-48f4-ab12-b96b3b6ec695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.372256 Oct 28 10:18:56.211050 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2863/5722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:55 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:18:56.225160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-30016a19-3ac3-4a66-a29f-4f8026188927 req-1c310046-a0c3-4376-9e92-4e8f5e345279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "name": "network-vif-unplugged", "status": "completed", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:56.246168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30016a19-3ac3-4a66-a29f-4f8026188927 req-1c310046-a0c3-4376-9e92-4e8f5e345279 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:56.246832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30016a19-3ac3-4a66-a29f-4f8026188927 req-1c310046-a0c3-4376-9e92-4e8f5e345279 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:56.247376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30016a19-3ac3-4a66-a29f-4f8026188927 req-1c310046-a0c3-4376-9e92-4e8f5e345279 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:56.269738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-30016a19-3ac3-4a66-a29f-4f8026188927 req-1c310046-a0c3-4376-9e92-4e8f5e345279 service nova] Creating event network-vif-unplugged:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:18:56.284482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-30016a19-3ac3-4a66-a29f-4f8026188927 req-1c310046-a0c3-4376-9e92-4e8f5e345279 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068433 Oct 28 10:18:56.287023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2864/5723] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:56.294630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:56.295455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:56.320989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:56.321621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:56.322208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:56.323610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:56.324192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:56.324720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:56.678024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:56.690234 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8748ae14-9039-4162-a9c2-009bdafd16c3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.401882 Oct 28 10:18:56.693172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2865/5724] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:56 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:56.698008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:56.703478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:56.709907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:56.710649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:56.711282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:56.712386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:56.713615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:56.714262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.041326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:57.071408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da52a280-19db-416e-8818-446154bb973c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1496 microversion: 2.1 time: 0.376883 Oct 28 10:18:57.076043 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2866/5725] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:56 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1496 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:57.096761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:57.097723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:57.131562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:57.131977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:57.132427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.133227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:57.133689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:57.134128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.468329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:57.482149 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-820646f0-80be-4013-9667-f20f024fbd86 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.404664 Oct 28 10:18:57.490134 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2867/5726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:57 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:57.518765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:57.522240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:57.547344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:57.549093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:57.550470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.553187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:57.555301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:57.556150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.632144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:57.635729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:57.644963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.644963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lazy-loading 'fault' on Instance uuid 5fa93feb-174d-4a13-869f-ece3341a8d3c {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:18:57.790632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:57.812948 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c4241e07-d97a-4723-9c80-7218aaf0afed tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 200 len: 1332 microversion: 2.1 time: 0.324749 Oct 28 10:18:57.832937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2868/5727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:57 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 1332 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:57.832937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:57.832937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:57.851303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:57.853007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:57.855057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.857929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:57.861576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:57.862275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:57.951609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lazy-loading 'flavor' on Instance uuid 1fbb2c02-f4e1-4ce9-85dc-6030582e257e {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:18:57.976162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Cannot 'suspend' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state suspended Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action HTTP/1.1 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 15 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: {"suspend": {}} Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'suspend' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state suspended Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'suspend': {}}} Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e in vm_state suspended. Cannot suspend while the instance is in this state. Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 28 10:18:57.979959 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state suspended Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state suspended Oct 28 10:18:57.983733 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:18:57.988397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 409 to user: Cannot 'suspend' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state suspended {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:18:57.989438 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-95e60b50-92d8-493e-9e5e-890d5e521ef1 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 409 len: 148 microversion: 2.1 time: 0.166863 Oct 28 10:18:57.990049 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2869/5728] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:57 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 148 bytes in 169 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:18:58.005492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a38c6889-4c67-4c82-915e-d1f8b7275793 req-0a9e1fe0-e105-4ccb-b1dc-27832d214b78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa93feb-174d-4a13-869f-ece3341a8d3c", "name": "network-vif-deleted", "tag": "d375271d-e59d-4285-bfa3-8b434b9ee33f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:58.018228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a38c6889-4c67-4c82-915e-d1f8b7275793 req-0a9e1fe0-e105-4ccb-b1dc-27832d214b78 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:58.019207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a38c6889-4c67-4c82-915e-d1f8b7275793 req-0a9e1fe0-e105-4ccb-b1dc-27832d214b78 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:58.020103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a38c6889-4c67-4c82-915e-d1f8b7275793 req-0a9e1fe0-e105-4ccb-b1dc-27832d214b78 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:58.053078 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a38c6889-4c67-4c82-915e-d1f8b7275793 req-0a9e1fe0-e105-4ccb-b1dc-27832d214b78 service nova] Creating event network-vif-deleted:d375271d-e59d-4285-bfa3-8b434b9ee33f for instance 5fa93feb-174d-4a13-869f-ece3341a8d3c on n-h2-zed-1 Oct 28 10:18:58.060036 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a38c6889-4c67-4c82-915e-d1f8b7275793 req-0a9e1fe0-e105-4ccb-b1dc-27832d214b78 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068701 Oct 28 10:18:58.061224 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2870/5729] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:18:58.071160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:58.081158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:58.093674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:58.094379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:58.094966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:58.095823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:58.096457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:58.097790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:58.102913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:18:58.301358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d295b20-3a33-407f-b939-065f3f01b92b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.235315 Oct 28 10:18:58.320487 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2871/5730] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:58 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:18:58.329027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:18:58.330058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:58.342875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:58.343646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:58.344294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:58.345540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:58.346206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:58.346960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:58.457667 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1931cd18-a352-4968-b58c-15ddeb13dda8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 202 len: 0 microversion: 2.1 time: 0.135060 Oct 28 10:18:58.459036 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2872/5731] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:58 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:18:58.466704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:58.467645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:58.474299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:58.475284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:58.476021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:58.477911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:58.479242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:58.479835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:59.390379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Building network info cache for instance {{(pid=128747) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:18:59.407338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:18:59.419807 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3578772-ae88-4f59-8793-709e071441cb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1669 microversion: 2.1 time: 0.959229 Oct 28 10:18:59.438827 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2873/5732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:58 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1669 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:18:59.451741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:18:59.455653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:18:59.473967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:59.476236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:59.476862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:59.481981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:18:59.488625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:18:59.492485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:18:59.979327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:00.001704 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92774d1b-808a-4dc6-9592-be307d25fae5 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1502 microversion: 2.1 time: 0.561644 Oct 28 10:19:00.018002 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2874/5733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:18:59 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1502 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:00.069095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:00.070016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:00.089463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:00.091124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:00.092597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:00.095949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:00.096609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:00.097238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:00.150007 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c HTTP/1.1 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5fa93feb-174d-4a13-869f-ece3341a8d3c'} Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:00.156999 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:00.160742 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:00.160742 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:00.160742 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:00.160742 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:00.160742 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:00.160742 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:19:00.160742 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:00.168439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:00.169720 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c235f2b2-7138-4b2d-b860-6b389c51f67f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 404 len: 111 microversion: 2.1 time: 0.137412 Oct 28 10:19:00.178343 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2875/5734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:00 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:00.192934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-33b4f3e0-9471-4968-8472-31bd2195c818 req-cffeada3-1e24-46f2-a190-471e4807f759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c08ddd-41c8-4fe3-9667-8d4961457a9d", "tag": "c3a577fc-3330-4924-9947-af7b9c29dcef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:00.210080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-33b4f3e0-9471-4968-8472-31bd2195c818 req-cffeada3-1e24-46f2-a190-471e4807f759 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:00.210572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-33b4f3e0-9471-4968-8472-31bd2195c818 req-cffeada3-1e24-46f2-a190-471e4807f759 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:00.211009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-33b4f3e0-9471-4968-8472-31bd2195c818 req-cffeada3-1e24-46f2-a190-471e4807f759 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:00.242655 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-33b4f3e0-9471-4968-8472-31bd2195c818 req-cffeada3-1e24-46f2-a190-471e4807f759 service nova] Creating event network-changed:c3a577fc-3330-4924-9947-af7b9c29dcef for instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d on n-h1-zed-1 Oct 28 10:19:00.249234 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-33b4f3e0-9471-4968-8472-31bd2195c818 req-cffeada3-1e24-46f2-a190-471e4807f759 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069356 Oct 28 10:19:00.253960 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2876/5735] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:00.262767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8a81dc2-c3ef-4b8a-92c9-47f07623595e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '.version_select at 0x7fca32168ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:00.301535 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8a81dc2-c3ef-4b8a-92c9-47f07623595e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405976678" status: 202 len: 0 microversion: 2.1 time: 0.046302 Oct 28 10:19:00.305236 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2877/5736] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:19:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405976678 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:19:00.452500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:00.457353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:00.471273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:00.471786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:00.472239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:00.479052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:00.479762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:00.481146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:00.649257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Updating instance_info_cache with network_info: [{"id": "c3a577fc-3330-4924-9947-af7b9c29dcef", "address": "fa:16:3e:95:56:b7", "network": {"id": "ccbf4e9d-1f3f-4f87-a4a0-76c946e9c099", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1824033737-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.7.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "946b5c4d8cbf4ab5b94f15c2704d5ce3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3a577fc-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128747) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:19:00.671309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Releasing lock "refresh_cache-c4c08ddd-41c8-4fe3-9667-8d4961457a9d" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:19:00.674021 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d284bde6-2bf5-480c-b396-c71e6a8333e1 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action" status: 202 len: 0 microversion: 2.1 time: 5.497259 Oct 28 10:19:00.678576 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2860/5737] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:18:55 2022] POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action => generated 0 bytes in 5502 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:19:00.699160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Action: 'action', calling method: .version_select at 0x7fca39446f70>, body: {"removeFloatingIp": {"address": "172.35.7.177"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:00.937515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:00.948139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1aca5b3d-8ac1-4260-ae3e-298f2afde843 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1669 microversion: 2.1 time: 0.499729 Oct 28 10:19:00.955354 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2878/5738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:00 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1669 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:01.032012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:01.032896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:01.042559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:01.043062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:01.043508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:01.044233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:01.044695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:01.045159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:01.432091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:01.437341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:01.439473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=60 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:01.446781 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5d685ef-49c6-485f-904b-eba19d8030a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1502 microversion: 2.1 time: 0.418593 Oct 28 10:19:01.447944 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2879/5739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:01 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1502 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:01.473555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:01.485990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:01.487250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:01.489967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:01.490504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:01.490998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:01.986521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:01.987894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:02.005269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.006383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.006837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:02.007575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.008033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.010746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:02.168731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "refresh_cache-c4c08ddd-41c8-4fe3-9667-8d4961457a9d" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 28 10:19:02.169276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquired lock "refresh_cache-c4c08ddd-41c8-4fe3-9667-8d4961457a9d" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 28 10:19:02.270491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:02.281635 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a28647cc-56f0-4b3a-af34-7e34c571fbcb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.300637 Oct 28 10:19:02.287619 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2880/5740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:01 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:02.313874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:02.319066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:02.335615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.336118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.336605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:02.337418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.337913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.338484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:02.449570 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ddc8870-29f3-4bcf-afec-971d870012c2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 200 len: 322 microversion: 2.1 time: 0.145003 Oct 28 10:19:02.450249 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2881/5741] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:02 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:19:02.460117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:02.461053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:02.480557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.481396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.481995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:02.482879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.483494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.484224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:02.844823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:02.857072 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-05a23962-7e41-407e-9dd6-989a2a499dcf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.400886 Oct 28 10:19:02.858295 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2882/5742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:02 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:02.863212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:02.863828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:02.871163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.871721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.872161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:02.872931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:02.873398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:02.873886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:03.131379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:03.140879 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4d6f099-8a6d-4e1d-9a4b-7c5281dbf84b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.281558 Oct 28 10:19:03.143022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2883/5743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:02 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:03.153679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:03.154188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:03.163990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:03.164491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:03.164953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:03.165681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:03.166184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:03.166620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:03.263648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lazy-loading 'services' on Instance uuid 9399955c-6dee-411c-8c04-34ff847396e3 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:19:03.442059 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b9ccc8f-b90c-482b-993c-68ee2ef0cb23 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments/81664b39-807e-43c6-84a8-bf2417f6690f" status: 202 len: 0 microversion: 2.1 time: 0.297437 Oct 28 10:19:03.445835 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2884/5744] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:19:03 2022] DELETE /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments/81664b39-807e-43c6-84a8-bf2417f6690f => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:19:03.452417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:03.455377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:03.469788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:03.470291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:03.470731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:03.471443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:03.471899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:03.475705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:03.552637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Building network info cache for instance {{(pid=128747) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 28 10:19:03.822144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:03.846862 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0060ee3e-7bf0-4c89-b752-e0adaee0abde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.402452 Oct 28 10:19:03.851676 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2885/5745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:03 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:03.869516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:03.873366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:03.904450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:03.906772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:03.909770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:03.910763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:03.912883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:03.915660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:04.394019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:04.409283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d4ff1717-07ba-436f-86a1-bc7911211b7d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.556372 Oct 28 10:19:04.427935 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2886/5746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:03 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:04.460596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:04.469403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:04.484542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:04.489755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:04.490223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:04.490970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:04.491434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:04.496478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:04.567317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:04.583913 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5991ee3d-3bcb-439f-8698-1d777b8b23c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152154 Oct 28 10:19:04.593860 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2887/5747] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:04 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:04.608522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-923c42ec-97ad-462d-bca1-7082c091b6c1 req-b6621af4-3453-43dc-8cbd-dd1a1d119222 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4c08ddd-41c8-4fe3-9667-8d4961457a9d", "tag": "c3a577fc-3330-4924-9947-af7b9c29dcef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:04.635596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-923c42ec-97ad-462d-bca1-7082c091b6c1 req-b6621af4-3453-43dc-8cbd-dd1a1d119222 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:04.636093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-923c42ec-97ad-462d-bca1-7082c091b6c1 req-b6621af4-3453-43dc-8cbd-dd1a1d119222 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:04.637429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-923c42ec-97ad-462d-bca1-7082c091b6c1 req-b6621af4-3453-43dc-8cbd-dd1a1d119222 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:04.640088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Updating instance_info_cache with network_info: [{"id": "c3a577fc-3330-4924-9947-af7b9c29dcef", "address": "fa:16:3e:95:56:b7", "network": {"id": "ccbf4e9d-1f3f-4f87-a4a0-76c946e9c099", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1824033737-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "946b5c4d8cbf4ab5b94f15c2704d5ce3", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc3a577fc-33", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128747) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:19:04.656854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Releasing lock "refresh_cache-c4c08ddd-41c8-4fe3-9667-8d4961457a9d" {{(pid=128747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 28 10:19:04.658502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3faa5b63-5d79-4646-9515-d3afcdd70aee tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action" status: 202 len: 0 microversion: 2.1 time: 3.965863 Oct 28 10:19:04.664469 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2861/5748] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:00 2022] POST /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d/action => generated 0 bytes in 3977 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 28 10:19:04.670739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:04.671726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:04.678671 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-923c42ec-97ad-462d-bca1-7082c091b6c1 req-b6621af4-3453-43dc-8cbd-dd1a1d119222 service nova] Creating event network-changed:c3a577fc-3330-4924-9947-af7b9c29dcef for instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d on n-h1-zed-1 Oct 28 10:19:04.681969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:04.682795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:04.683542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:04.684794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:04.685537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:04.686905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:04.691981 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-923c42ec-97ad-462d-bca1-7082c091b6c1 req-b6621af4-3453-43dc-8cbd-dd1a1d119222 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096007 Oct 28 10:19:04.693165 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2888/5749] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:04.707849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4eb27a32-8326-40d4-87bd-c797f7225434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:04.708646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4eb27a32-8326-40d4-87bd-c797f7225434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 2d868faa-0fb8-461c-882b-863cff1b59c2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:04.722313 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4eb27a32-8326-40d4-87bd-c797f7225434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 2d868faa-0fb8-461c-882b-863cff1b59c2 could not be found. Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4eb27a32-8326-40d4-87bd-c797f7225434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/2d868faa-0fb8-461c-882b-863cff1b59c2/action HTTP/1.1 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 15 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: {"unpause": {}} Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 2d868faa-0fb8-461c-882b-863cff1b59c2 could not be found. Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '2d868faa-0fb8-461c-882b-863cff1b59c2', 'body': {'unpause': {}}} Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d868faa-0fb8-461c-882b-863cff1b59c2 could not be found. Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d868faa-0fb8-461c-882b-863cff1b59c2 could not be found. Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:04.727572 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:04.733240 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:04.733240 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:04.733240 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d868faa-0fb8-461c-882b-863cff1b59c2 could not be found. Oct 28 10:19:04.733240 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:04.737786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4eb27a32-8326-40d4-87bd-c797f7225434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 2d868faa-0fb8-461c-882b-863cff1b59c2 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:04.738673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4eb27a32-8326-40d4-87bd-c797f7225434 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/2d868faa-0fb8-461c-882b-863cff1b59c2/action" status: 404 len: 111 microversion: 2.1 time: 0.044074 Oct 28 10:19:04.753403 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2889/5750] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:04 2022] POST /compute/v2.1/servers/2d868faa-0fb8-461c-882b-863cff1b59c2/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:04.767553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7617a495-18df-4471-85c8-df9d0c9ed779 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '.version_select at 0x7fca321253a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:05.051199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:05.063699 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cad11256-d0ad-4dc1-8d02-77c94b9f2c67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.397385 Oct 28 10:19:05.065600 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2862/5751] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:04 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:05.094519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:05.097048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:05.120647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:05.123637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:05.125440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:05.126383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:05.127579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:05.129362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:05.589364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:05.602608 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b8a1955-5cbc-4c67-9b90-7f964dddb1ac tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.535223 Oct 28 10:19:05.603592 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2863/5752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:05 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:05.610587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:05.611561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:05.622596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:05.623482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:05.624259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:05.642392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:05.646091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:05.649855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:06.431889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:06.442414 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c318e12c-428d-4080-b065-13d4dd555823 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.836111 Oct 28 10:19:06.444290 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2864/5753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:05 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:06.484347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:06.491776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:06.528728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:06.531045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:06.531690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:06.535468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:06.536198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:06.536962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:06.612647 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-325ba57d-b483-449c-98cb-50e9772593df tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137475 Oct 28 10:19:06.613547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2865/5754] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:06 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:06.628440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:06.630206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:06.645679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:06.649771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:06.652515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:06.656558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:06.657269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:06.657879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:07.145616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:07.155400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a4eb23f-7f4c-4e62-995d-64780e96879d tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.535830 Oct 28 10:19:07.158714 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2866/5755] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:06 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:07.169878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1800067571", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "211d510d-dd8f-46be-8306-141acae1af62"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:07.273771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] validate_networks() for [('211d510d-dd8f-46be-8306-141acae1af62', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:19:07.578562 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7617a495-18df-4471-85c8-df9d0c9ed779 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "DELETE /compute/v2.1/os-floating-ips/af231cac-de8d-4a07-92eb-db5f7ef55473" status: 202 len: 0 microversion: 2.1 time: 2.821780 Oct 28 10:19:07.580440 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2890/5756] 10.222.0.16 () {58 vars in 1263 bytes} [Fri Oct 28 10:19:04 2022] DELETE /compute/v2.1/os-floating-ips/af231cac-de8d-4a07-92eb-db5f7ef55473 => generated 0 bytes in 2826 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:19:07.599104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:07.599667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:07.617990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:07.618623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:07.619639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:07.624287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:07.624782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:07.625261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:07.678225 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Cannot 'unpause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action HTTP/1.1 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 15 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: {"unpause": {}} Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'unpause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'unpause': {}}} Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e in vm_state active. Cannot unpause while the instance is in this state. Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:07.689220 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 409 to user: Cannot 'unpause' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-336c2176-9aa2-4cfc-bbdd-d8e837a1e763 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 409 len: 145 microversion: 2.1 time: 0.102027 Oct 28 10:19:07.692860 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2891/5757] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:07 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 145 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:19:07.700700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07494f79-9f78-4bf1-b408-ceab2c2216d6 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '.version_select at 0x7fca320c6700>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:07.989221 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07494f79-9f78-4bf1-b408-ceab2c2216d6 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "DELETE /compute/v2.1/os-security-groups/2076757c-21b7-416b-b7a9-96c77d20f321" status: 202 len: 0 microversion: 2.1 time: 0.296437 Oct 28 10:19:07.990072 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2892/5758] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 10:19:07 2022] DELETE /compute/v2.1/os-security-groups/2076757c-21b7-416b-b7a9-96c77d20f321 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:19:08.000648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:08.010493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:08.034849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.035466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.035987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.038997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.039557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.040237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.056686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:19:08.057268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:19:08.057656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:19:08.058079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:19:08.058521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:19:08.083059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.083566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.084018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.090131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.090690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.091157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.119618 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34ba6892-e913-4933-8170-ca32231a2c3c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127866 Oct 28 10:19:08.128179 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2893/5759] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:07 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:08.145355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:08.146445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:08.156085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:19:08.185939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.196510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.199562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.200574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.201175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for user 1b327af221c94695bc5b82fa49e3c448 and project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:19:08.203181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.203830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.234569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:19:08.240317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:19:08.413729 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-608e384f-0454-4a27-83ad-7b421db3e447 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253697 Oct 28 10:19:08.418797 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2867/5760] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:19:08.457591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:08.459033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:08.476092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.477155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.481627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.482652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.484291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.485278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:08.491442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.495286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-015bd490-0ea4-47aa-ac14-98c7e36af5d6 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.362826 Oct 28 10:19:08.497959 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2894/5761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:08 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:08.502837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f83285cd-e02f-4a5b-8fff-ef863ecba211 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:08.503463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f83285cd-e02f-4a5b-8fff-ef863ecba211 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:08.642575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:19:08.671144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f83285cd-e02f-4a5b-8fff-ef863ecba211 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:08.679997 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f83285cd-e02f-4a5b-8fff-ef863ecba211 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1215 microversion: 2.1 time: 0.180887 Oct 28 10:19:08.698106 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2895/5762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:08 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:08.716567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:08.719114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:08.737186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.737815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.738579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.739862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.740592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.741943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.775809 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee4cb7bd-88a5-4b42-8093-5cfe4d9521dc tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 204 len: 0 microversion: 2.1 time: 0.352873 Oct 28 10:19:08.776678 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2868/5763] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:19:08 2022] DELETE /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:19:08.804601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:08.805570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:08.813147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.813733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.814246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:08.815052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:08.815591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:08.816077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.059200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:09.086395 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94cd2ac3-b96e-403e-9d97-b7a3d4e1bc99 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.384440 Oct 28 10:19:09.089158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:09.089831 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2896/5764] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:08 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:09.106143 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22386953-c643-48c1-8176-33bdcfcb0b40 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1511 microversion: 2.1 time: 0.302646 Oct 28 10:19:09.109105 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2869/5765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:08 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1511 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:09.128130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d27a7dd3-c999-4833-bbf9-4829fc0c4605 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:09.128782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d27a7dd3-c999-4833-bbf9-4829fc0c4605 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: ce070793-1465-460d-a4cc-7901a2339f59] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:09.140153 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-d27a7dd3-c999-4833-bbf9-4829fc0c4605 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance ce070793-1465-460d-a4cc-7901a2339f59 could not be found. Oct 28 10:19:09.142055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d27a7dd3-c999-4833-bbf9-4829fc0c4605 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/ce070793-1465-460d-a4cc-7901a2339f59/action HTTP/1.1 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 18 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: {"unshelve": null} Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ce070793-1465-460d-a4cc-7901a2339f59 could not be found. Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ce070793-1465-460d-a4cc-7901a2339f59', 'body': {'unshelve': None}} Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce070793-1465-460d-a4cc-7901a2339f59 could not be found. Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce070793-1465-460d-a4cc-7901a2339f59 could not be found. Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:09.143844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce070793-1465-460d-a4cc-7901a2339f59 could not be found. Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d27a7dd3-c999-4833-bbf9-4829fc0c4605 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance ce070793-1465-460d-a4cc-7901a2339f59 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:09.147777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d27a7dd3-c999-4833-bbf9-4829fc0c4605 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/ce070793-1465-460d-a4cc-7901a2339f59/action" status: 404 len: 111 microversion: 2.1 time: 0.037187 Oct 28 10:19:09.151370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:09.159703 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2897/5766] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:09 2022] POST /compute/v2.1/servers/ce070793-1465-460d-a4cc-7901a2339f59/action => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:19:09.168353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:09.169003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:09.170626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.174167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.184475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.185452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.186070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.187165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.187290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.188230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.189678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.190137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.190672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.192375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.302244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6cc39540-6ff8-487d-8765-eb837a24d50f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.165881 Oct 28 10:19:09.308252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2870/5767] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:09 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:19:09.441500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:09.454505 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d9ea46c8-7a49-4e9f-b9ac-d681bd0bfd3b tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.293619 Oct 28 10:19:09.455104 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2898/5768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:09 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:09.479669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:09.480286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:09.489965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.497468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.498549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.502092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.503900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.506680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.707844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:09.709151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:09.726181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.728012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.730626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.746674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:09.748056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:09.749928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:09.946721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:09.971619 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-456573d1-7062-4e62-845d-cde23c91362b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1211 microversion: 2.1 time: 0.269106 Oct 28 10:19:09.989121 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2899/5769] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:09 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1211 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:10.136248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:10.136873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:10.155827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:10.156335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:10.156781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:10.157530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:10.157987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:10.158415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:10.305626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:10.316631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1f06b10c-6d9b-4ebc-9791-aa17bf0f023c tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.841084 Oct 28 10:19:10.320881 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2871/5770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:09 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:10.326993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:10.330216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:10.352625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:10.353477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:10.355445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:10.356349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:10.358369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:10.360391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:10.424308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:10.433095 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a541f1b-28e4-4f15-9349-ddd15051504e tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1511 microversion: 2.1 time: 0.301795 Oct 28 10:19:10.441802 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2900/5771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:10 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:10.452623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:10.456432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:10.459157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:10.469083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:10.469799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:10.470784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:10.471803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:10.472420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:10.473884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:10.484716 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5a3272cf-fb41-4c41-805d-04b9ff64f0a6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162196 Oct 28 10:19:10.485304 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2872/5772] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:10 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:11.003633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:11.004179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:11.025472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.026164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.026631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.027393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.027862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.028342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.151131 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Cannot 'unshelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action HTTP/1.1 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 18 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: {"unshelve": null} Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: exception: Cannot 'unshelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'unshelve': None}} Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e in vm_state active. Cannot unshelve while the instance is in this state. Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 28 10:19:11.153121 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 409 to user: Cannot 'unshelve' instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e while it is in vm_state active {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1a494b51-c38b-434b-a5c6-cf1db29800e9 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action" status: 409 len: 146 microversion: 2.1 time: 0.711834 Oct 28 10:19:11.157372 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2901/5773] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:10 2022] POST /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e/action => generated 146 bytes in 713 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:19:11.165655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:11.168616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:11.183575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.184462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.184992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.185865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.186338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.186778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.301294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:11.318879 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b883798-5087-42e9-9c78-f44c18d3a12a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1273 microversion: 2.1 time: 0.319522 Oct 28 10:19:11.323574 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2873/5774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:10 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1273 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:11.476948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:11.477630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:11.491926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.492477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.493308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.495249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.501157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.501621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.567567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:11.800370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:11.822729 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e2c685c-d575-4a25-9edf-2b2d46f6ba00 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.661858 Oct 28 10:19:11.825807 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2902/5775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:11 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:11.843191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:11.845741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:11.866274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.866770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.867392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.868362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.869121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.869800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.947617 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aedb82d4-9504-4623-9c74-bb52450c2251 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116084 Oct 28 10:19:11.948568 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2903/5776] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:11 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 197 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:11.959823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:11.960989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:11.976660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.977477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.978785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:11.981539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:11.982184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:11.982810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:12.111113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:12.134023 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22296282-e56c-4cce-8dc0-b7d9cab68182 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1511 microversion: 2.1 time: 0.667468 Oct 28 10:19:12.135450 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2874/5777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:11 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1511 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:12.354058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:12.356312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:12.414520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:12.419664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:12.420740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:12.422532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:12.424752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:12.425916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:12.899519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:12.985237 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34089b29-7b80-48c0-8fdb-87fc3d2f8d51 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 1.034974 Oct 28 10:19:12.998185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2904/5778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:11 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:13.011212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:13.013855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:13.020521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:13.021247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:13.021871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:13.022747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:13.023367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:13.023957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:13.089795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-83bfebf1-d8b6-40be-a406-9ded8e31152c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090040 Oct 28 10:19:13.095053 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2905/5779] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:12 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:13.100276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82cd3723-6fa3-4159-9bbe-800e2faaf2ea tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-43813491_updated"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:13.112425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-82cd3723-6fa3-4159-9bbe-800e2faaf2ea tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: daf30890-db8e-4a50-8168-fa80204f73fa] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:13.125043 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-82cd3723-6fa3-4159-9bbe-800e2faaf2ea tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance daf30890-db8e-4a50-8168-fa80204f73fa could not be found. Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82cd3723-6fa3-4159-9bbe-800e2faaf2ea tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/servers/daf30890-db8e-4a50-8168-fa80204f73fa HTTP/1.1 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 79 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-43813491_updated"}} Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance daf30890-db8e-4a50-8168-fa80204f73fa could not be found. Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'daf30890-db8e-4a50-8168-fa80204f73fa', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-43813491_updated'}}} Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance daf30890-db8e-4a50-8168-fa80204f73fa could not be found. Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 28 10:19:13.131597 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance daf30890-db8e-4a50-8168-fa80204f73fa could not be found. Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance daf30890-db8e-4a50-8168-fa80204f73fa could not be found. Oct 28 10:19:13.136086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:13.138052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82cd3723-6fa3-4159-9bbe-800e2faaf2ea tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance daf30890-db8e-4a50-8168-fa80204f73fa could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:13.139112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82cd3723-6fa3-4159-9bbe-800e2faaf2ea tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "PUT /compute/v2.1/servers/daf30890-db8e-4a50-8168-fa80204f73fa" status: 404 len: 111 microversion: 2.1 time: 0.042817 Oct 28 10:19:13.142986 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2906/5780] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:19:13 2022] PUT /compute/v2.1/servers/daf30890-db8e-4a50-8168-fa80204f73fa => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:13.158927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:13.164364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:13.179191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:13.202605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:13.203476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:13.205134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dd9f9da3-a4f3-4e2e-951e-c3c46edbe66e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.859187 Oct 28 10:19:13.205717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:13.206583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:13.207835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:13.208242 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2875/5781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:12 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:13.211342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:13.217215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:13.219751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:13.240151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:13.244455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:13.245371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:13.249323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:13.250064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:13.250793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:13.507096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:13.516674 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4652c431-de94-4c29-9af3-41a1cfceb053 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1511 microversion: 2.1 time: 0.306443 Oct 28 10:19:13.533887 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2876/5782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:13 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1511 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:13.801050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-cc39fb9b-efc6-4cb6-98cd-74dd3d1a2c7a req-69fc7957-31df-4eb1-9f07-a4629ff270fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4c08ddd-41c8-4fe3-9667-8d4961457a9d", "name": "network-vif-deleted", "tag": "c3a577fc-3330-4924-9947-af7b9c29dcef"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:13.867830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cc39fb9b-efc6-4cb6-98cd-74dd3d1a2c7a req-69fc7957-31df-4eb1-9f07-a4629ff270fd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:13.869891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cc39fb9b-efc6-4cb6-98cd-74dd3d1a2c7a req-69fc7957-31df-4eb1-9f07-a4629ff270fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:13.872140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cc39fb9b-efc6-4cb6-98cd-74dd3d1a2c7a req-69fc7957-31df-4eb1-9f07-a4629ff270fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:13.895147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-cc39fb9b-efc6-4cb6-98cd-74dd3d1a2c7a req-69fc7957-31df-4eb1-9f07-a4629ff270fd service nova] Creating event network-vif-deleted:c3a577fc-3330-4924-9947-af7b9c29dcef for instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d on n-h1-zed-1 Oct 28 10:19:13.906244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-cc39fb9b-efc6-4cb6-98cd-74dd3d1a2c7a req-69fc7957-31df-4eb1-9f07-a4629ff270fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120800 Oct 28 10:19:13.908119 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2877/5783] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:13.995714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:14.028591 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-febc3329-fdfa-4d66-ab6c-4114c030b5a8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.880924 Oct 28 10:19:14.039688 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2907/5784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:13 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:14.060849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:14.064659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:14.086105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.086929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.088138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.092108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.093226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.094979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.105114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:14.108077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:14.121942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.123859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.124495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.126448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.128237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.128923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.172739 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8fa77522-83db-4f5d-8718-47d41dc8ab5d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073778 Oct 28 10:19:14.175349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2908/5785] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:19:14 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:19:14.234094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:14.235046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:14.245972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.247112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.247860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.249252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.250239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.251353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.379785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:14.390227 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cd3b72f-ff22-492f-92ba-76121b149733 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.338028 Oct 28 10:19:14.390847 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2878/5786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:14.422343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:14.422865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:14.435055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.435195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.435646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.436378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.436846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.437402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.522360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:19:14.559345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:14.577061 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-13807120-d411-4b69-8f0d-ca90f1ee6c1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.346360 Oct 28 10:19:14.591680 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2909/5787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:14 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:14.609724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9de040ed-fa8d-4318-bacd-66487c33eb39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9de040ed-fa8d-4318-bacd-66487c33eb39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e HTTP/1.1 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 280 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:14.625258 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9de040ed-fa8d-4318-bacd-66487c33eb39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:14.628662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9de040ed-fa8d-4318-bacd-66487c33eb39 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "PUT /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 400 len: 619 microversion: 2.1 time: 0.029820 Oct 28 10:19:14.630206 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2910/5788] 10.222.0.16 () {60 vars in 1257 bytes} [Fri Oct 28 10:19:14 2022] PUT /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:19:14.649123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:14.649286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:14.670735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.671248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.671699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.673561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.673561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.673954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.741728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.742723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.743373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.749750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lazy-loading 'fault' on Instance uuid c4c08ddd-41c8-4fe3-9667-8d4961457a9d {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:19:14.757536 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-58d9c5a6-cf80-43cd-97c7-263da0c1631f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 204 len: 0 microversion: 2.1 time: 0.339689 Oct 28 10:19:14.758491 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2879/5789] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:19:14 2022] DELETE /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:19:14.769146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:14.771962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:14.794539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.794539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.794539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.794862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.795317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.795750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.880588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85f5e98a834f490fa846a847306085e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '946b5c4d8cbf4ab5b94f15c2704d5ce3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:14.894105 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15eb6268-f53a-426e-ab32-b2dfda81c0e4 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 200 len: 1313 microversion: 2.1 time: 0.262703 Oct 28 10:19:14.896874 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2911/5790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:14 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 1313 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:14.913574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:14.916710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:14.930686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.931230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.931658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:14.932383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:14.932846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:14.933310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.019701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:15.061285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:15.063629 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee23f4f4-2f0c-4cd3-9410-aa955bf47e31 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.303823 Oct 28 10:19:15.065756 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2880/5791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:14 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:15.091589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:15.092373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:15.104643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.105272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.105913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.106722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.107191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.109286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.292612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:15.309793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b07965c-ef50-4d42-b6a7-fd26ef157878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1681 microversion: 2.1 time: 0.410539 Oct 28 10:19:15.310943 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2912/5792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:14 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:15.446011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:15.454650 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0101915e-b498-461f-ae43-3b252ba208e4 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.368093 Oct 28 10:19:15.455833 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2881/5793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:15 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:15.482980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a1175c3-9131-4aad-9c73-c24fb9cc9429 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a1175c3-9131-4aad-9c73-c24fb9cc9429 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: request: PUT /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e HTTP/1.1 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 24 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: {"server": {"name": ""}} Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e', 'body': {'server': {'name': ''}}} Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '' Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:19:15.489332 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 28 10:19:15.493130 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.500177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a1175c3-9131-4aad-9c73-c24fb9cc9429 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:15.502188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6a1175c3-9131-4aad-9c73-c24fb9cc9429 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "PUT /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 400 len: 108 microversion: 2.1 time: 0.026171 Oct 28 10:19:15.504086 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2913/5794] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:19:15 2022] PUT /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 108 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:19:15.512299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:15.512942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:15.521269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.521776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.522426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.523865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.524481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.525170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.603928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:15.604480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:15.613270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.615612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.617085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.617835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.620673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.621183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.774930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:15.786460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6216c8b0-9850-4ed6-a2ed-16f3fbbb26de tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1505 microversion: 2.1 time: 0.278394 Oct 28 10:19:15.788794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2882/5795] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:15 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:15.906997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:15.924599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:15.925713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] [instance: c4c08ddd-41c8-4fe3-9667-8d4961457a9d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:15.930956 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-44590d8c-eb43-42f7-b635-cb8b1da01f84 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.331858 Oct 28 10:19:15.937863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.938378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.938790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.939517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:15.940084 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2914/5796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:15 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:15.944775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:15.945456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:15.986811 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] HTTP exception thrown: Instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d could not be found. Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Request method failure captured: Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d HTTP/1.1 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6xN6j8H9xy3fk57GwPnNhcA3pvC-Dw-dC1lR9Qq3sIWDfomM5vcP-rUAbGhW6QsnvBUetiegTWJd64FxJCri1fAQAPQg3_zkmWm2X-dCCxKLxHBNbPjWrtldK0SZTr9FRCJAnu7VLk7kutQn7NtZiIQ7ZNRk-aTmIGVGlQhytBKtzM Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 946b5c4d8cbf4ab5b94f15c2704d5ce3 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-640291654 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b5c4d8cbf4ab5b94f15c2704d5ce3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/946b5c4d8cbf4ab5b94f15c2704d5ce3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_946b5c4d8cbf4ab5b94f15c2704d5ce3", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/946b5c4d8cbf4ab5b94f15c2704d5ce3"}]}] Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-640291654 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 946b5c4d8cbf4ab5b94f15c2704d5ce3 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-640291654 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerRescueTestJSONUnderV235-640291654-project Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 85f5e98a834f490fa846a847306085e4 Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-640291654-project Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d could not be found. Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'c4c08ddd-41c8-4fe3-9667-8d4961457a9d'} Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d could not be found. Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d could not be found. Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.988516 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d could not be found. Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] Returning 404 to user: Instance c4c08ddd-41c8-4fe3-9667-8d4961457a9d could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-089a8b57-1511-4d40-86cd-d0a539dbc6c3 tempest-ServerRescueTestJSONUnderV235-640291654 tempest-ServerRescueTestJSONUnderV235-640291654-project] 10.222.0.16 "GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d" status: 404 len: 111 microversion: 2.1 time: 0.070079 Oct 28 10:19:15.993044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2883/5797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:15 2022] GET /compute/v2.1/servers/c4c08ddd-41c8-4fe3-9667-8d4961457a9d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:19:16.063444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-3cc0bed5-c0d0-41a6-a13c-9ed6e6f606f6 req-fca6308f-9d37-4fee-83c8-bca63fbf052d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79bd6411-af08-4081-a862-c2243d0eb04c", "tag": "ef12a598-b1fe-40f1-9ea5-465d01c5f771"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:16.078024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3cc0bed5-c0d0-41a6-a13c-9ed6e6f606f6 req-fca6308f-9d37-4fee-83c8-bca63fbf052d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:16.083807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3cc0bed5-c0d0-41a6-a13c-9ed6e6f606f6 req-fca6308f-9d37-4fee-83c8-bca63fbf052d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:16.084499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3cc0bed5-c0d0-41a6-a13c-9ed6e6f606f6 req-fca6308f-9d37-4fee-83c8-bca63fbf052d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:16.111708 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-3cc0bed5-c0d0-41a6-a13c-9ed6e6f606f6 req-fca6308f-9d37-4fee-83c8-bca63fbf052d service nova] Creating event network-changed:ef12a598-b1fe-40f1-9ea5-465d01c5f771 for instance 79bd6411-af08-4081-a862-c2243d0eb04c on n-h2-zed-1 Oct 28 10:19:16.135342 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-3cc0bed5-c0d0-41a6-a13c-9ed6e6f606f6 req-fca6308f-9d37-4fee-83c8-bca63fbf052d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075713 Oct 28 10:19:16.141100 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2915/5798] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:16.334388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:16.335426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:16.350676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:16.356772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:16.357430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:16.358347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:16.358969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:16.361298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:16.847769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:16.861421 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3945ca4e-d882-4d93-ba22-9eaf36043265 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1681 microversion: 2.1 time: 0.526946 Oct 28 10:19:16.863664 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2884/5799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:16 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1681 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:16.959684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:16.960395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:16.976409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:16.976943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:16.977380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:16.978859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:16.979316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:16.985417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:17.858220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:17.870199 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3130ac8e-f9a0-4dcd-a407-9cb29a479c88 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.915379 Oct 28 10:19:17.870802 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2916/5800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:16 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:17.894442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:17.895690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:17.905849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:17.906353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:17.906799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:17.907504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:17.916065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:17.916788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:18.115091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:18.216601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:18.486961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:18.497834 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aec55412-dca7-4575-b14d-19676779902a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1681 microversion: 2.1 time: 0.606976 Oct 28 10:19:18.518373 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2885/5801] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:17 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1681 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:18.896123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:18.897655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:18.911843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:18.919570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:18.920859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:18.921921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:18.925193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:18.926103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:18.926851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:19.534939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:19.538406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:19.554637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:19.571561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:19.571561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:19.571561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:19.572384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:19.581475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:19.597402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:19.602454 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e2a964ac-b307-46ba-84c0-be906d7c3740 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.712857 Oct 28 10:19:19.604966 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2917/5802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:18 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:19.860185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:19.873033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2750cd7e-52bc-4b24-8970-f80cfeaa0faf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1614 microversion: 2.1 time: 0.350135 Oct 28 10:19:19.881781 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2886/5803] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:19 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1614 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:20.397256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-3354344b-c3aa-45dd-a518-a79aca344034 req-f1bc7b27-38b4-4430-8848-5f0ce3a103ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9399955c-6dee-411c-8c04-34ff847396e3", "name": "network-vif-deleted", "tag": "cfb3fbd5-4b70-4323-b6c1-9950692f3ef8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:20.427373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3354344b-c3aa-45dd-a518-a79aca344034 req-f1bc7b27-38b4-4430-8848-5f0ce3a103ff service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:20.427869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3354344b-c3aa-45dd-a518-a79aca344034 req-f1bc7b27-38b4-4430-8848-5f0ce3a103ff service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:20.428311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3354344b-c3aa-45dd-a518-a79aca344034 req-f1bc7b27-38b4-4430-8848-5f0ce3a103ff service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:20.467322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-3354344b-c3aa-45dd-a518-a79aca344034 req-f1bc7b27-38b4-4430-8848-5f0ce3a103ff service nova] Creating event network-vif-deleted:cfb3fbd5-4b70-4323-b6c1-9950692f3ef8 for instance 9399955c-6dee-411c-8c04-34ff847396e3 on n-h2-zed-1 Oct 28 10:19:20.472830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-3354344b-c3aa-45dd-a518-a79aca344034 req-f1bc7b27-38b4-4430-8848-5f0ce3a103ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079377 Oct 28 10:19:20.482004 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2918/5804] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:20.627784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:20.628308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:20.646618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:20.647172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:20.665007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:20.665946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:20.666440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:20.666947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:20.920385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:20.921445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:20.933847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:20.941689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:20.942393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:20.943328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:20.951309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:20.951981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:21.060934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:21.061431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:21.069218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:21.070582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lazy-loading 'fault' on Instance uuid 9399955c-6dee-411c-8c04-34ff847396e3 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:19:21.375532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:21.413579 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a17c753-8e73-4329-a118-61894a17794e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 200 len: 1331 microversion: 2.1 time: 0.482841 Oct 28 10:19:21.442130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2919/5805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:20 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 1331 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:21.613079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:21.628035 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4dd09a12-ea8d-4eca-b4ed-cd2fc7d54338 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 1.004153 Oct 28 10:19:21.636796 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2887/5806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:20 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:22.471711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:22.472688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:22.483862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:22.489311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:22.495195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:22.501231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:22.503602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:22.507381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:22.561655 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 HTTP/1.1 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '9399955c-6dee-411c-8c04-34ff847396e3'} Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:22.573687 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-057d9d7d-7df4-4edb-90a2-9edd0be1372c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 404 len: 111 microversion: 2.1 time: 0.107467 Oct 28 10:19:22.578416 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2920/5807] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:22 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:22.584769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-189d47ee-efe3-4a56-91f1-6ad4eb60a749 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '.version_select at 0x7fca323aeaf0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:22.654009 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-189d47ee-efe3-4a56-91f1-6ad4eb60a749 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-401478165" status: 202 len: 0 microversion: 2.1 time: 0.063006 Oct 28 10:19:22.662708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:22.663673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:22.674498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:22.675616 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2888/5808] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:19:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-401478165 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:19:22.677680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:22.679396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:22.682996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:22.684216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:22.685443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:24.144191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:24.167112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c4f66295-e7cd-4582-a28c-6ed28fc467aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 1.509947 Oct 28 10:19:24.168023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2921/5809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:22 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:25.194039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:25.195272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:25.221153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:25.221825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:25.222288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:25.223020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:25.223484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:25.223919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:25.772384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:25.787439 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9c621ef-1d36-4b59-b537-e8dca9ba92bc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.598485 Oct 28 10:19:25.809732 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2889/5810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:25 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:26.280406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-bd93faa0-c7dc-4e8a-9b4d-1776c5f077f6 req-fea51a72-6945-40bb-b4f4-ea7ef8043b84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bd6411-af08-4081-a862-c2243d0eb04c", "name": "network-vif-plugged", "status": "completed", "tag": "ef12a598-b1fe-40f1-9ea5-465d01c5f771"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:26.314107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bd93faa0-c7dc-4e8a-9b4d-1776c5f077f6 req-fea51a72-6945-40bb-b4f4-ea7ef8043b84 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.333068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bd93faa0-c7dc-4e8a-9b4d-1776c5f077f6 req-fea51a72-6945-40bb-b4f4-ea7ef8043b84 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.333782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bd93faa0-c7dc-4e8a-9b4d-1776c5f077f6 req-fea51a72-6945-40bb-b4f4-ea7ef8043b84 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.360766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-bd93faa0-c7dc-4e8a-9b4d-1776c5f077f6 req-fea51a72-6945-40bb-b4f4-ea7ef8043b84 service nova] Creating event network-vif-plugged:ef12a598-b1fe-40f1-9ea5-465d01c5f771 for instance 79bd6411-af08-4081-a862-c2243d0eb04c on n-h2-zed-1 Oct 28 10:19:26.388514 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-bd93faa0-c7dc-4e8a-9b4d-1776c5f077f6 req-fea51a72-6945-40bb-b4f4-ea7ef8043b84 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105222 Oct 28 10:19:26.389806 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2922/5811] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:26.486058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3090170-c16e-45a2-b596-c6189825e16f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: .version_select at 0x7fca32372e50>, body: {"keypair": {"name": "tempest-keypair-123818722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBm2eRxm4dcxdbqnnIQrHMWUDc6uqzst+Q6I3P0OrUuxoc8/v9Vo09PNZ1+u+uIS8YeztV0RI46T7SGQ3TIED2/31I/nXIawo00cAsP/PayHBB//2/Q1+ti9AuKmhwdUQ=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:26.538275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a3090170-c16e-45a2-b596-c6189825e16f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:19:26.553100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:26.554514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:26.563867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a3090170-c16e-45a2-b596-c6189825e16f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:19:26.568202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.568767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.569890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.573406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.573991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.574322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.615161 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb HTTP/1.1 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '21e7e1cc-120d-4870-8b90-49c4d60ea6fb'} Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:26.622344 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.626961 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.634564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:26.635648 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3090170-c16e-45a2-b596-c6189825e16f tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164916 Oct 28 10:19:26.642162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7fb67a13-2865-4688-86a3-314cbae030ef tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 404 len: 111 microversion: 2.1 time: 0.093424 Oct 28 10:19:26.643473 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2890/5812] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:19:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:26.649129 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2923/5813] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:19:26 2022] DELETE /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:19:26.653584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:26.654956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 21e7e1cc-120d-4870-8b90-49c4d60ea6fb] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:26.662443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.663169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.663778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.664872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.666217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.671156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.703766 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb HTTP/1.1 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '21e7e1cc-120d-4870-8b90-49c4d60ea6fb'} Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:26.705643 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.710170 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:26.710170 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:26.710170 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:26.710170 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:26.710170 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:26.710170 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. Oct 28 10:19:26.710170 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:26.711575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 21e7e1cc-120d-4870-8b90-49c4d60ea6fb could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:26.713186 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d11ad3f5-47cf-494b-abf7-b88007075ffb tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb" status: 404 len: 111 microversion: 2.1 time: 0.064641 Oct 28 10:19:26.722065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:26.722808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:26.725746 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2891/5814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:26 2022] GET /compute/v2.1/servers/21e7e1cc-120d-4870-8b90-49c4d60ea6fb => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:26.733747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.734514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.735222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.736167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.742602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.743314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.787762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:19:26.819935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:26.822969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:26.830555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:26.834322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.835211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.835882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.838060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:26.838707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:26.840083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:26.990686 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5bfdfed9-0d7b-480a-9916-6443a93d32b2 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 204 len: 0 microversion: 2.1 time: 0.272151 Oct 28 10:19:26.995478 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2924/5815] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:19:26 2022] DELETE /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:19:27.006422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:27.012512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:27.043467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:27.043977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:27.044421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:27.045174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:27.054927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:27.055402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:27.429815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:27.438616 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-38e02667-529c-40ae-bfd0-81dc44c46428 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.624681 Oct 28 10:19:27.439204 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2892/5816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:26 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:27.783682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:27.797449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92728d45-4d88-43fa-a5be-57649d3e3bd8 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.799782 Oct 28 10:19:27.812184 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2925/5817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:26 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:28.467246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:28.469656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:28.485506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:28.487160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:28.489650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:28.490865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:28.492052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:28.495985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:28.554856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:28.829751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:28.830510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:28.846119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:28.848300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:28.849591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:28.851765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:28.854772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:28.855354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:28.856337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:28.868433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e590351-57e8-413c-98d9-e341844773fb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.405802 Oct 28 10:19:28.895006 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2893/5818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:28 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:29.257756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:29.271871 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a61d52d9-f6aa-4588-b62d-99e715a7d541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.446895 Oct 28 10:19:29.272934 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2926/5819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:28 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:29.900655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:29.901979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:29.942516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:29.946025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:29.949499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:29.955225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:29.957159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:29.961180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:30.296443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:30.298345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:30.316323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:30.320839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:30.322295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:30.326617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:30.327440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:30.328469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:30.517473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:30.542762 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6550afde-dd70-4daa-b5b8-2b189f24ca11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1315 microversion: 2.1 time: 0.651526 Oct 28 10:19:30.548928 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2894/5820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:29 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:30.868846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c1df28a9d734105b8c99def44cbebbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '513259eefe5a40a3aa16b9c611d655b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:30.877407 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5cbf4c69-94e4-4448-b6cd-48dce96ee541 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 200 len: 1511 microversion: 2.1 time: 0.585304 Oct 28 10:19:30.882802 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2927/5821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:30 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 1511 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:31.036944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d3dadec6-c2ac-4699-9e7a-31a5a473d763 req-cd525e27-2349-4283-b3a5-909aedfa15bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbb2c02-f4e1-4ce9-85dc-6030582e257e", "name": "network-vif-deleted", "tag": "74651f42-f412-4bde-9914-23e1b529beb7"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:31.052616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d3dadec6-c2ac-4699-9e7a-31a5a473d763 req-cd525e27-2349-4283-b3a5-909aedfa15bb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:31.053554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d3dadec6-c2ac-4699-9e7a-31a5a473d763 req-cd525e27-2349-4283-b3a5-909aedfa15bb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:31.054180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d3dadec6-c2ac-4699-9e7a-31a5a473d763 req-cd525e27-2349-4283-b3a5-909aedfa15bb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:31.098474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d3dadec6-c2ac-4699-9e7a-31a5a473d763 req-cd525e27-2349-4283-b3a5-909aedfa15bb service nova] Creating event network-vif-deleted:74651f42-f412-4bde-9914-23e1b529beb7 for instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e on n-h2-zed-1 Oct 28 10:19:31.119427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d3dadec6-c2ac-4699-9e7a-31a5a473d763 req-cd525e27-2349-4283-b3a5-909aedfa15bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095898 Oct 28 10:19:31.122543 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2895/5822] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:31.350624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-168e5ebe-91f6-4ece-88b9-418512e58195 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Action: 'create', calling method: .version_select at 0x7fca32176dc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1449269046", "metadata": {"Type": "work"}}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-168e5ebe-91f6-4ece-88b9-418512e58195 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Request method failure captured: Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 122 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6yyDTjIgPkPczfODP9n_maWly7xDiPILJIOJ4dqEbmpoHkXCn6xInu7Nke1ZwurSL7K_OSXWiTnvLpI7L4JSGfgYGCc8ATH-yp2dyGQEAHa_RgR2TGzTL2Ij1pUaGqrFLIFqg9dTigYeBlx0HAhEWCR488OW-FDrbUaA9VDzjCK_Zg Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a1ffb082694e5c814dfbaf1f1d10c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a1ffb082694e5c814dfbaf1f1d10c4"}]}] Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: d125418511e64745a6caee0328899c64 Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1449269046", "metadata": {"Type": "work"}}} Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1449269046', 'metadata': {'Type': 'work'}}}} Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '#$%' Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:19:31.359312 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.363486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-168e5ebe-91f6-4ece-88b9-418512e58195 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:31.364234 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-168e5ebe-91f6-4ece-88b9-418512e58195 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.295629 Oct 28 10:19:31.378624 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2928/5823] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:19:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:19:31.391311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61cd9614-7cd5-49f6-b4be-5070c93c89c5 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Action: 'create', calling method: .version_select at 0x7fca3307cdc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1607390286", "metadata": {"Type": "work"}}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61cd9614-7cd5-49f6-b4be-5070c93c89c5 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Request method failure captured: Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 120 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6yyDTjIgPkPczfODP9n_maWly7xDiPILJIOJ4dqEbmpoHkXCn6xInu7Nke1ZwurSL7K_OSXWiTnvLpI7L4JSGfgYGCc8ATH-yp2dyGQEAHa_RgR2TGzTL2Ij1pUaGqrFLIFqg9dTigYeBlx0HAhEWCR488OW-FDrbUaA9VDzjCK_Zg Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a1ffb082694e5c814dfbaf1f1d10c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a1ffb082694e5c814dfbaf1f1d10c4"}]}] Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: d125418511e64745a6caee0328899c64 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1607390286", "metadata": {"Type": "work"}}} Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1607390286', 'metadata': {'Type': 'work'}}}} Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi '0' Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:19:31.399152 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 28 10:19:31.403216 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.409889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61cd9614-7cd5-49f6-b4be-5070c93c89c5 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:31.415417 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-61cd9614-7cd5-49f6-b4be-5070c93c89c5 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029547 Oct 28 10:19:31.418603 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2896/5824] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:19:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:19:31.430039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-967ac252-8740-421d-821b-daa3a9cc1569 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Action: 'create', calling method: .version_select at 0x7fca3213e5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1985978471", "metadata": {"Type": "work"}}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-967ac252-8740-421d-821b-daa3a9cc1569 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Request method failure captured: Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 119 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6yyDTjIgPkPczfODP9n_maWly7xDiPILJIOJ4dqEbmpoHkXCn6xInu7Nke1ZwurSL7K_OSXWiTnvLpI7L4JSGfgYGCc8ATH-yp2dyGQEAHa_RgR2TGzTL2Ij1pUaGqrFLIFqg9dTigYeBlx0HAhEWCR488OW-FDrbUaA9VDzjCK_Zg Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a1ffb082694e5c814dfbaf1f1d10c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a1ffb082694e5c814dfbaf1f1d10c4"}]}] Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: d125418511e64745a6caee0328899c64 Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1985978471", "metadata": {"Type": "work"}}} Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: method: Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1985978471', 'metadata': {'Type': 'work'}}}} Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '' Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:19:31.439929 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 28 10:19:31.448720 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.452557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-967ac252-8740-421d-821b-daa3a9cc1569 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:31.455043 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-967ac252-8740-421d-821b-daa3a9cc1569 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029815 Oct 28 10:19:31.457863 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2929/5825] 10.222.0.16 () {60 vars in 1156 bytes} [Fri Oct 28 10:19:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:19:31.471431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-21fd9349-be51-4c09-8460-7a045e9face7 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Calling method '.version_select at 0x7fca32603940>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:31.533198 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-21fd9349-be51-4c09-8460-7a045e9face7 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] HTTP exception thrown: Volume tempest-invalid-390670856 could not be found. Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-21fd9349-be51-4c09-8460-7a045e9face7 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Request method failure captured: Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-390670856 HTTP/1.1 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6yyDTjIgPkPczfODP9n_maWly7xDiPILJIOJ4dqEbmpoHkXCn6xInu7Nke1ZwurSL7K_OSXWiTnvLpI7L4JSGfgYGCc8ATH-yp2dyGQEAHa_RgR2TGzTL2Ij1pUaGqrFLIFqg9dTigYeBlx0HAhEWCR488OW-FDrbUaA9VDzjCK_Zg Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a1ffb082694e5c814dfbaf1f1d10c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a1ffb082694e5c814dfbaf1f1d10c4"}]}] Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: d125418511e64745a6caee0328899c64 Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: exception: Volume tempest-invalid-390670856 could not be found. Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'tempest-invalid-390670856'} Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-390670856 could not be found. (HTTP 404) (Request-ID: req-4281afc4-7926-4a6f-8ae2-f1db031fad37) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:19:31.535346 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-390670856 could not be found. Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-390670856 could not be found. Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-390670856 could not be found. Oct 28 10:19:31.542369 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:31.559254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-21fd9349-be51-4c09-8460-7a045e9face7 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Returning 404 to user: Volume tempest-invalid-390670856 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:31.560385 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-21fd9349-be51-4c09-8460-7a045e9face7 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-390670856" status: 404 len: 98 microversion: 2.1 time: 0.095236 Oct 28 10:19:31.560589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-999805976", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21470466-36a9-45e2-955b-c7288f1075a0"}], "security_groups": [{"name": "tempest-securitygroup--548519228"}], "key_name": "tempest-keypair-123818722", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:31.561998 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2897/5826] 10.222.0.16 () {58 vars in 1215 bytes} [Fri Oct 28 10:19:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-390670856 => generated 98 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:19:31.576499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:31.578858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:31.597451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:31.598440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:31.599172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:31.602153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:31.605926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:31.606714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:31.760973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] validate_networks() for [('21470466-36a9-45e2-955b-c7288f1075a0', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:19:31.857281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:31.867324 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da9bc5a2-a747-46aa-b8b1-8fdc58b4c64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1501 microversion: 2.1 time: 0.299144 Oct 28 10:19:31.881832 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2898/5827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:31 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1501 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:31.892882 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-358442e8-45ea-4dc5-b1dc-1f6b0fae5eeb tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009265 Oct 28 10:19:31.899453 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2899/5828] 10.222.0.16 () {58 vars in 1140 bytes} [Fri Oct 28 10:19:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 10:19:31.906463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83ef77a6-7254-4052-8c4e-10e3545bad89 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:31.915205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83ef77a6-7254-4052-8c4e-10e3545bad89 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:31.915932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83ef77a6-7254-4052-8c4e-10e3545bad89 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:31.916370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83ef77a6-7254-4052-8c4e-10e3545bad89 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:31.944829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83ef77a6-7254-4052-8c4e-10e3545bad89 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Going to try to stop instance {{(pid=128747) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:19:32.025318 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83ef77a6-7254-4052-8c4e-10e3545bad89 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c/action" status: 202 len: 0 microversion: 2.1 time: 0.123456 Oct 28 10:19:32.029580 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2900/5829] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:31 2022] POST /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:19:32.036144 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c2ba0e14-f719-4fa7-9ca9-de8874ccfb77 tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004288 Oct 28 10:19:32.043021 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2901/5830] 10.222.0.16 () {58 vars in 1137 bytes} [Fri Oct 28 10:19:32 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 28 10:19:32.050934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:32.052102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] [instance: 1fbb2c02-f4e1-4ce9-85dc-6030582e257e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:32.062373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:32.063992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:32.064697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:32.065793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:32.066504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:32.067217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:32.086432 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] HTTP exception thrown: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e could not be found. Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Request method failure captured: Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e HTTP/1.1 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6unFwH3B0hDp4fzmMGGCBPseAid7EU-ihOLdgIeKGIHW0OiuvH9AjmHlZekaM4Qu8cklKnFCeKsMy61wGn3HP7NLg-fSPpLyX7aUpcg_b666IHRayZtK_iZ6q-alXcQgc4j27eg-zW8BAW-4EoM3XXBg5U7CMiJrUDNxu1MTpjLTAg Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/513259eefe5a40a3aa16b9c611d655b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_513259eefe5a40a3aa16b9c611d655b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/513259eefe5a40a3aa16b9c611d655b2"}]}] Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 513259eefe5a40a3aa16b9c611d655b2 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1075811122 Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 2c1df28a9d734105b8c99def44cbebbb Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-1075811122-project Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e could not be found. Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '1fbb2c02-f4e1-4ce9-85dc-6030582e257e'} Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e could not be found. Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e could not be found. Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.088497 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.092569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.092569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:32.092569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:32.092569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:32.092569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:32.092569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e could not be found. Oct 28 10:19:32.092569 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.094634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] Returning 404 to user: Instance 1fbb2c02-f4e1-4ce9-85dc-6030582e257e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:32.095683 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-358eb564-9e8c-4377-8b3b-25fc79825f35 tempest-ServersNegativeTestJSON-1075811122 tempest-ServersNegativeTestJSON-1075811122-project] 10.222.0.16 "GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e" status: 404 len: 111 microversion: 2.1 time: 0.050170 Oct 28 10:19:32.096725 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2902/5831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:32 2022] GET /compute/v2.1/servers/1fbb2c02-f4e1-4ce9-85dc-6030582e257e => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:32.102490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:32.103523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:32.112769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:32.113653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:32.114996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:32.118065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:32.119266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:32.121300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:32.435667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:19:32.437327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:19:32.438153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:19:32.438977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:19:32.439618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:19:32.457664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:32.460059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:32.460982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:32.463890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:32.464563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:32.465937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:32.494671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:19:32.501353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:19:32.526101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:19:32.533393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:32.534167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:19:32.543400 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e52b926-4e7c-47ce-90ee-aac2a674d3b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.445058 Oct 28 10:19:32.548937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2903/5832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:32 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:32.555949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8c30810-f68e-4850-b674-3d3cd074574b tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Calling method '.version_select at 0x7fca3235aaf0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:32.628147 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [d1df3681-c805-43c0-98f8-5fe994109871] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 10:19:32.628938 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c8c30810-f68e-4850-b674-3d3cd074574b tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] HTTP exception thrown: Volume 9614f928-db0a-4f80-a8e6-22733e101e7e could not be found. Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8c30810-f68e-4850-b674-3d3cd074574b tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Request method failure captured: Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/os-volumes/9614f928-db0a-4f80-a8e6-22733e101e7e HTTP/1.1 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6yyDTjIgPkPczfODP9n_maWly7xDiPILJIOJ4dqEbmpoHkXCn6xInu7Nke1ZwurSL7K_OSXWiTnvLpI7L4JSGfgYGCc8ATH-yp2dyGQEAHa_RgR2TGzTL2Ij1pUaGqrFLIFqg9dTigYeBlx0HAhEWCR488OW-FDrbUaA9VDzjCK_Zg Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a1ffb082694e5c814dfbaf1f1d10c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a1ffb082694e5c814dfbaf1f1d10c4"}]}] Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: d125418511e64745a6caee0328899c64 Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: exception: Volume 9614f928-db0a-4f80-a8e6-22733e101e7e could not be found. Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '9614f928-db0a-4f80-a8e6-22733e101e7e'} Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9614f928-db0a-4f80-a8e6-22733e101e7e could not be found. (HTTP 404) (Request-ID: req-50e902f6-0e95-4c86-bf9e-c8322f7cc1de) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:19:32.631094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9614f928-db0a-4f80-a8e6-22733e101e7e could not be found. Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9614f928-db0a-4f80-a8e6-22733e101e7e could not be found. Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9614f928-db0a-4f80-a8e6-22733e101e7e could not be found. Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.635446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8c30810-f68e-4850-b674-3d3cd074574b tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Returning 404 to user: Volume 9614f928-db0a-4f80-a8e6-22733e101e7e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:32.639838 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c8c30810-f68e-4850-b674-3d3cd074574b tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/9614f928-db0a-4f80-a8e6-22733e101e7e" status: 404 len: 109 microversion: 2.1 time: 0.086024 Oct 28 10:19:32.639838 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2904/5833] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:19:32 2022] DELETE /compute/v2.1/os-volumes/9614f928-db0a-4f80-a8e6-22733e101e7e => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:19:32.649622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e801b8d-f21b-46cc-9a6e-3d6067c1ea5e tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Calling method '.version_select at 0x7fca3307c040>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:32.684775 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-9e801b8d-f21b-46cc-9a6e-3d6067c1ea5e tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] HTTP exception thrown: Volume 38da9c11-dfb6-419a-8b53-133f92b402a6 could not be found. Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e801b8d-f21b-46cc-9a6e-3d6067c1ea5e tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Request method failure captured: Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/os-volumes/38da9c11-dfb6-419a-8b53-133f92b402a6 HTTP/1.1 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6yyDTjIgPkPczfODP9n_maWly7xDiPILJIOJ4dqEbmpoHkXCn6xInu7Nke1ZwurSL7K_OSXWiTnvLpI7L4JSGfgYGCc8ATH-yp2dyGQEAHa_RgR2TGzTL2Ij1pUaGqrFLIFqg9dTigYeBlx0HAhEWCR488OW-FDrbUaA9VDzjCK_Zg Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/36a1ffb082694e5c814dfbaf1f1d10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_36a1ffb082694e5c814dfbaf1f1d10c4", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/36a1ffb082694e5c814dfbaf1f1d10c4"}]}] Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 36a1ffb082694e5c814dfbaf1f1d10c4 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesNegativeTest-844192831 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: d125418511e64745a6caee0328899c64 Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesNegativeTest-844192831-project Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: method: Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: exception: Volume 38da9c11-dfb6-419a-8b53-133f92b402a6 could not be found. Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '38da9c11-dfb6-419a-8b53-133f92b402a6'} Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 38da9c11-dfb6-419a-8b53-133f92b402a6 could not be found. (HTTP 404) (Request-ID: req-cb0bed63-4c5a-4658-a25d-f1375435ef84) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 28 10:19:32.687121 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 38da9c11-dfb6-419a-8b53-133f92b402a6 could not be found. Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 38da9c11-dfb6-419a-8b53-133f92b402a6 could not be found. Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 38da9c11-dfb6-419a-8b53-133f92b402a6 could not be found. Oct 28 10:19:32.690942 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:19:32.695053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9e801b8d-f21b-46cc-9a6e-3d6067c1ea5e tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] Returning 404 to user: Volume 38da9c11-dfb6-419a-8b53-133f92b402a6 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:19:32.696266 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9e801b8d-f21b-46cc-9a6e-3d6067c1ea5e tempest-VolumesNegativeTest-844192831 tempest-VolumesNegativeTest-844192831-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/38da9c11-dfb6-419a-8b53-133f92b402a6" status: 404 len: 109 microversion: 2.1 time: 0.051942 Oct 28 10:19:32.697123 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2905/5834] 10.222.0.16 () {58 vars in 1245 bytes} [Fri Oct 28 10:19:32 2022] GET /compute/v2.1/os-volumes/38da9c11-dfb6-419a-8b53-133f92b402a6 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:19:33.577105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:33.581324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:33.607699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:33.608477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:33.609136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:33.611150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:33.612886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:33.613896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:33.638556 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [d1df3681-c805-43c0-98f8-5fe994109871] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34398. Oct 28 10:19:33.642596 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7640d71-6a3d-4a97-a0f6-25c65cd23878 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.090337 Oct 28 10:19:33.643426 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2930/5835] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:19:33.655243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0d5f97e-9e08-472a-8c22-6a20035fd795 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:33.656356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0d5f97e-9e08-472a-8c22-6a20035fd795 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:33.733393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0d5f97e-9e08-472a-8c22-6a20035fd795 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:33.742069 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0d5f97e-9e08-472a-8c22-6a20035fd795 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1240 microversion: 2.1 time: 0.090638 Oct 28 10:19:33.744310 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2931/5836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:33 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1240 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:34.521420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:34.538097 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e3e0635-6b81-4b29-b0bd-e97a15ad4c8f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.967427 Oct 28 10:19:34.558958 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2906/5837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:33 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:34.768728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:34.769995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:34.808050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:34.809760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:34.813827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:34.818684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:34.823283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:34.824099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:34.983390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:34.999171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fba3cf3c-b5de-4665-8e5f-4a5559dcaaae tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1236 microversion: 2.1 time: 0.229241 Oct 28 10:19:35.020968 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2932/5838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:34 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1236 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:35.564303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:35.565400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:35.615818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:35.617231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:35.618953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:35.620117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:35.622488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:35.623251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:36.034059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:36.034681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:36.067060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:36.067844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:36.068461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:36.069366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:36.069979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:36.070566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:36.329330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:36.356043 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b085689e-c3e3-40f1-9597-7d7bd9d1cbf4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.797202 Oct 28 10:19:36.361130 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2907/5839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:35 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:36.382581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:36.393143 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d67ccaa2-1781-4cec-87aa-9657f2f781b3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1310 microversion: 2.1 time: 0.363237 Oct 28 10:19:36.394859 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2933/5840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:36 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1310 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:37.386648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:37.388072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:37.403388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:37.422946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:37.423566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:37.442172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:37.442690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:37.447789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:37.448493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:37.448616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:37.449141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:37.449594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:37.450919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:37.451401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:37.452150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:37.452710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:37.453063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:37.768082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:37.779529 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5bc7443-5d66-4569-9e13-4ca054b4ff7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1298 microversion: 2.1 time: 0.360563 Oct 28 10:19:37.780491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2934/5841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:37 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1298 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:38.167445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:38.178161 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f15549ac-fa6d-4c52-b2ce-0a1fee80c0d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.797678 Oct 28 10:19:38.183852 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2908/5842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:37 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:38.813241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:38.814158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:38.853381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:38.857539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:38.861498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:38.865611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:38.870190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:38.873834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:38.891029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:39.211177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:39.212442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:39.225460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:39.229518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:39.232309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:39.234447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:39.237031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:39.237736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:39.943806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:39.949438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:39.969590 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7178184-a8a2-45a4-8d97-d14dc2f53d39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.762875 Oct 28 10:19:39.973666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-51f26c76-fa8e-48fa-bc1f-0ab7052a4968 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1298 microversion: 2.1 time: 1.168096 Oct 28 10:19:39.974674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2909/5843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:39 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:39.989269 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2935/5844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:38 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1298 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:40.020694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1795443742", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "a7779092-7f94-4488-a8de-d63f45f86e75"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:40.115234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] validate_networks() for [('a7779092-7f94-4488-a8de-d63f45f86e75', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:19:40.998558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:40.999171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:41.010961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:41.018741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:41.023449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:41.024056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:41.026807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:41.028450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:41.031141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:41.459782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:41.472929 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7de84c75-1d6d-4369-a4fb-587a675c14d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.476874 Oct 28 10:19:41.492831 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2936/5845] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:40 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:41.502721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:41.511098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:41.518816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:41.519312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:41.522716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:41.523464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:41.524058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:41.524932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:41.898325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:19:41.899284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:19:41.899698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:19:41.900126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:19:41.900548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:19:41.916663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:41.917198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:41.917646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:41.918385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:41.927722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:41.928189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:41.962934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Getting quotas for project e901c15dac8e49e5b0e0ead18d6cd6b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:19:41.969129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Getting quotas for user 839e2104bc0d4b1fb55d69966eedd998 and project e901c15dac8e49e5b0e0ead18d6cd6b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:19:41.984531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:19:41.987150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:19:42.019067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:42.035608 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71a8c6c6-6055-41a7-88d9-1c694348fc4b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1365 microversion: 2.1 time: 0.546915 Oct 28 10:19:42.042739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2937/5846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:41 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1365 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:42.059907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-71b12c8e-c3a3-442b-8cfa-2af1df990289 req-24622df2-c100-4676-a09d-b28c17eef144 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a2778-8256-44e7-ab19-f6acf03b5819", "tag": "6ab96304-52b0-4a46-8026-91ac10820ca0"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:42.073836 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f62e1cfd-15be-4c3f-a443-c422508ca1f8 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.089629 Oct 28 10:19:42.087058 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2910/5847] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:19:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:19:42.096458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0706042-021e-4eee-b312-338cf267c1c6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:42.099157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0706042-021e-4eee-b312-338cf267c1c6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:42.122080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-71b12c8e-c3a3-442b-8cfa-2af1df990289 req-24622df2-c100-4676-a09d-b28c17eef144 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:42.123201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-71b12c8e-c3a3-442b-8cfa-2af1df990289 req-24622df2-c100-4676-a09d-b28c17eef144 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:42.125150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-71b12c8e-c3a3-442b-8cfa-2af1df990289 req-24622df2-c100-4676-a09d-b28c17eef144 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:42.160545 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-71b12c8e-c3a3-442b-8cfa-2af1df990289 req-24622df2-c100-4676-a09d-b28c17eef144 service nova] Creating event network-changed:6ab96304-52b0-4a46-8026-91ac10820ca0 for instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 on n-h1-zed-1 Oct 28 10:19:42.176284 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-71b12c8e-c3a3-442b-8cfa-2af1df990289 req-24622df2-c100-4676-a09d-b28c17eef144 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127026 Oct 28 10:19:42.177187 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2938/5848] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:42.211967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0706042-021e-4eee-b312-338cf267c1c6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:42.221088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0706042-021e-4eee-b312-338cf267c1c6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1219 microversion: 2.1 time: 0.132564 Oct 28 10:19:42.223150 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2911/5849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:42 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1219 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:42.501430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:42.502231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:42.514581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:42.519157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:42.520881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:42.523769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:42.525291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:42.528043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:42.528887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:42.981436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:42.995084 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4f303bd-647f-4e79-9508-32905a1fb21c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.493437 Oct 28 10:19:42.995986 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2939/5850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:42 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:43.069598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:43.070888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:43.106805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:43.108378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:43.110050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:43.117753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:43.118492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:43.119386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:43.251429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:43.252120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:43.263104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:43.263999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:43.265141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:43.267687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:43.268503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:43.269255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:43.338375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:43.347941 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b122d5e8-c33c-4558-ae84-fb823bdf6f96 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1365 microversion: 2.1 time: 0.282299 Oct 28 10:19:43.353471 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2912/5851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:43 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:43.455954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:43.464878 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25a2bac0-1513-4b29-abb9-bf30caeccf76 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1215 microversion: 2.1 time: 0.219384 Oct 28 10:19:43.465591 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2940/5852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:43 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:44.028694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:44.029682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:44.038713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:44.039167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:44.039610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:44.044527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:44.045219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:44.045679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:44.280693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:44.296737 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d2536c5-0560-4766-840a-856ed78d6f3c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.278984 Oct 28 10:19:44.297382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2913/5853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:44 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:44.377803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:44.378428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:44.391363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:44.397443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:44.400440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:44.401093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:44.403769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:44.404414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:44.406766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:44.487544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:44.488445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:44.496306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:44.503267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:44.503515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:44.504411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:44.504834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:44.505381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:44.713901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:44.727004 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d91333ea-17a8-43cd-b649-f878e45b4e00 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1277 microversion: 2.1 time: 0.243293 Oct 28 10:19:44.744810 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2914/5854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:44 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:44.851251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:44.875748 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d6e5eb12-ea65-48d5-9bb0-50321bf8e6cd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1365 microversion: 2.1 time: 0.489790 Oct 28 10:19:44.889784 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2941/5855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:44 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1365 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:45.323662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:45.324405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:45.337450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:45.342979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:45.344107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:45.347613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:45.348215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:45.348769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:45.645357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:45.658109 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81e09bf1-af4b-467c-92e3-b066356b5bd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.339440 Oct 28 10:19:45.659179 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2915/5856] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:45 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:45.751275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:45.752408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:45.764124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:45.764636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:45.765120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:45.765841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:45.766306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:45.766738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:45.900421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:45.901084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:45.919020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:45.919424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:45.919877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:45.920597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:45.921288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:45.922061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:46.232029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:46.242030 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52f94bcf-71cb-4539-9536-30306f8eddac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1365 microversion: 2.1 time: 0.344345 Oct 28 10:19:46.243733 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2916/5857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:45 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:46.682601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:46.684997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:46.698104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:46.701045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:46.701592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:46.706227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:46.706974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:46.709522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:46.927226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:46.966795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 1.218467 Oct 28 10:19:46.984865 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2942/5858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:45 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:47.028119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:47.039651 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6670e7d2-ad55-4eef-bb32-fc4ff37bb9d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.361275 Oct 28 10:19:47.040312 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2917/5859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:46 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:47.242303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:47.243962 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-05088b3c-b68c-4542-ae53-9e0b57c4c270 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002842 Oct 28 10:19:47.245164 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2943/5860] 10.222.0.16 () {56 vars in 886 bytes} [Fri Oct 28 10:19:47 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 28 10:19:47.268573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:47.269185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:47.281068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:47.281607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:47.282062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:47.287048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:47.287545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:47.288646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:47.304650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:47.546472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:47.557323 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9609db68-a351-433f-9e1a-d7817dfc6031 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1365 microversion: 2.1 time: 0.293376 Oct 28 10:19:47.575609 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2918/5861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:47 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1365 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:47.994058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:47.994935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:48.024930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:48.025609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:48.026063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:48.028259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:48.028744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:48.029214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:48.065401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:48.066018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:48.075550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:48.076057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:48.076502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:48.077247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:48.077712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:48.078149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:48.331545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:48.344987 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-770ea73e-c61e-44ea-856c-7a19d099eba9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 0.356156 Oct 28 10:19:48.356938 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2944/5862] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:47 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:48.356938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-73c1f350-c0ba-46de-89c5-d92b68b173b1 req-33f1da67-69e6-4c04-bc44-ef8468a52cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a2778-8256-44e7-ab19-f6acf03b5819", "name": "network-vif-plugged", "status": "completed", "tag": "6ab96304-52b0-4a46-8026-91ac10820ca0"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:48.372913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-73c1f350-c0ba-46de-89c5-d92b68b173b1 req-33f1da67-69e6-4c04-bc44-ef8468a52cad service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:48.373416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-73c1f350-c0ba-46de-89c5-d92b68b173b1 req-33f1da67-69e6-4c04-bc44-ef8468a52cad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:48.373854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-73c1f350-c0ba-46de-89c5-d92b68b173b1 req-33f1da67-69e6-4c04-bc44-ef8468a52cad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:48.394082 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-73c1f350-c0ba-46de-89c5-d92b68b173b1 req-33f1da67-69e6-4c04-bc44-ef8468a52cad service nova] Creating event network-vif-plugged:6ab96304-52b0-4a46-8026-91ac10820ca0 for instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 on n-h1-zed-1 Oct 28 10:19:48.409858 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-73c1f350-c0ba-46de-89c5-d92b68b173b1 req-33f1da67-69e6-4c04-bc44-ef8468a52cad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062522 Oct 28 10:19:48.410496 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2945/5863] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:48.494484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:48.512963 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-61fcfbe0-a05a-4d3f-8245-51e45fe41e87 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.450112 Oct 28 10:19:48.515034 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2919/5864] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:48 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:48.586594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:48.587842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:48.603699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:48.612791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:48.613572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:48.614358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:48.614822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:48.615251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:48.958986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:48.975652 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29227589-f003-4494-885a-f410f8a5c9d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1365 microversion: 2.1 time: 0.393197 Oct 28 10:19:48.976253 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2946/5865] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:48 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:49.372140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:49.372763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:49.384231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:49.384741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:49.385216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:49.385933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:49.386415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:49.386818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:49.523031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-66967789-c366-4cf6-9396-2e03997e3425 req-bef6814d-86b3-4ca6-962e-f595957baedd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ffcfe60-8da8-4af8-a192-81b087d04134", "tag": "62f0460f-920b-4f25-aa74-22315aae0fbf"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:49.541409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66967789-c366-4cf6-9396-2e03997e3425 req-bef6814d-86b3-4ca6-962e-f595957baedd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:49.541892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66967789-c366-4cf6-9396-2e03997e3425 req-bef6814d-86b3-4ca6-962e-f595957baedd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:49.542325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66967789-c366-4cf6-9396-2e03997e3425 req-bef6814d-86b3-4ca6-962e-f595957baedd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:49.623422 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-66967789-c366-4cf6-9396-2e03997e3425 req-bef6814d-86b3-4ca6-962e-f595957baedd service nova] Creating event network-changed:62f0460f-920b-4f25-aa74-22315aae0fbf for instance 0ffcfe60-8da8-4af8-a192-81b087d04134 on n-h2-zed-1 Oct 28 10:19:49.654104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-66967789-c366-4cf6-9396-2e03997e3425 req-bef6814d-86b3-4ca6-962e-f595957baedd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134634 Oct 28 10:19:49.659210 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2947/5866] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:19:49.670688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:49.671399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:49.681934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:49.682434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:49.682876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:49.683594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:49.684053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:49.684750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:49.798931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:49.807825 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c29068f-4b73-46d9-bc6c-bece8c7aa416 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 0.439759 Oct 28 10:19:49.811293 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2920/5867] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:49 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:50.004431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:50.005121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:50.012307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:50.013417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:50.014673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:50.015732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:50.016420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:50.017143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:50.161281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:50.173790 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fab851a1-cf30-422b-88ed-d392ad10e76e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.511483 Oct 28 10:19:50.176329 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2948/5868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:49 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:50.333383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:50.348311 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e807ef6-cda8-4ad4-b831-2eb54eeef7a7 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1365 microversion: 2.1 time: 0.346094 Oct 28 10:19:50.351487 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2921/5869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:49 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:50.837776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:50.838412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:50.847763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:50.848570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:50.849167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:50.849889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:50.850548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:50.850983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:51.136384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:51.156265 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4933a8ef-904a-4871-a089-f1403ef6b1d9 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 0.324138 Oct 28 10:19:51.157452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2949/5870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:50 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:51.199522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:51.201511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:51.211237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:51.212147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:51.212812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:51.213943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:51.214751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:51.215404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:51.375903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:51.379150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:51.388389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:51.389452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:51.389899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:51.390930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:51.391555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:51.392400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:51.451978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:51.462407 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1c3bc92-57a5-4d5a-9335-11e531efe8d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.267153 Oct 28 10:19:51.465039 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2922/5871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:51 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:51.637503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:51.647306 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b478b4f7-448d-48f0-bb3f-ac528c46902c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1555 microversion: 2.1 time: 0.279339 Oct 28 10:19:51.649584 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2950/5872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:51 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1555 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:51.677404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:51.677910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:51.697025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:51.698058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:51.698895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:51.699902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:51.700526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:51.701189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:51.943790 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-167862db-ee77-482c-b81a-65db4d85871b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.271188 Oct 28 10:19:51.945116 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2923/5873] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:19:51 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-interface => generated 284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:52.182952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:52.183958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:52.197012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:52.199705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:52.200491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:52.203001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:52.204564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:52.205796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:52.493169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:52.494786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:52.498785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:52.499482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:52.518452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:52.518942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:52.519571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:52.520442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:52.521103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:52.521685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:52.864550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:52.877808 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-066e8348-58bd-417b-86f5-a74a9f176073 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.385365 Oct 28 10:19:52.894846 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2924/5874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:52 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:53.014647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:53.027149 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-174327ea-3711-4c0a-927d-4014ed9aec2f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 0.849310 Oct 28 10:19:53.028095 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2951/5875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:52 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:19:53.906200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:53.906988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:53.918970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:53.919841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:53.923233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:53.924610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:53.925571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:53.935344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:54.053609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:54.054795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:54.066052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:54.068377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:54.072812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:54.073893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:54.074723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:54.075590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:54.443142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:54.456870 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d393f6eb-1a85-478e-af50-8660ce41a64e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.555260 Oct 28 10:19:54.463862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2925/5876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:53 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:55.152118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:55.172937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5508586b-5394-406b-b0f9-daa00b08dd0d tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 1.123138 Oct 28 10:19:55.177650 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2952/5877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:54 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:55.494549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:55.495282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:55.516204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:55.521578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:55.523539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:55.525116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:55.530268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:55.531499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:55.605569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5d8b2b04-6ed0-4c21-b00b-29bd6cac4fec req-d12b5a46-13d4-48bf-b3a7-d148e9552375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a2778-8256-44e7-ab19-f6acf03b5819", "tag": "6ab96304-52b0-4a46-8026-91ac10820ca0"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:55.667111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5d8b2b04-6ed0-4c21-b00b-29bd6cac4fec req-d12b5a46-13d4-48bf-b3a7-d148e9552375 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:55.676150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5d8b2b04-6ed0-4c21-b00b-29bd6cac4fec req-d12b5a46-13d4-48bf-b3a7-d148e9552375 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:55.676821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5d8b2b04-6ed0-4c21-b00b-29bd6cac4fec req-d12b5a46-13d4-48bf-b3a7-d148e9552375 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:55.719703 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5d8b2b04-6ed0-4c21-b00b-29bd6cac4fec req-d12b5a46-13d4-48bf-b3a7-d148e9552375 service nova] Creating event network-changed:6ab96304-52b0-4a46-8026-91ac10820ca0 for instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 on n-h1-zed-1 Oct 28 10:19:55.731885 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5d8b2b04-6ed0-4c21-b00b-29bd6cac4fec req-d12b5a46-13d4-48bf-b3a7-d148e9552375 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130935 Oct 28 10:19:55.733268 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2953/5878] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:19:56.209408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:56.210136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:56.223741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:56.224443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:56.224999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:56.225708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:56.226174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:56.230052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:56.374019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:56.388308 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9422bcc3-ee96-4885-ac31-ccc8062e9993 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.898295 Oct 28 10:19:56.396924 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2926/5879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:55 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:56.418467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a5802919-da97-411e-88fa-ca9ebe27e04c req-d27a9fb5-ea03-432b-814d-7dee828183a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffcfe60-8da8-4af8-a192-81b087d04134", "name": "network-vif-plugged", "status": "completed", "tag": "62f0460f-920b-4f25-aa74-22315aae0fbf"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:56.455836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a5802919-da97-411e-88fa-ca9ebe27e04c req-d27a9fb5-ea03-432b-814d-7dee828183a6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:56.458883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a5802919-da97-411e-88fa-ca9ebe27e04c req-d27a9fb5-ea03-432b-814d-7dee828183a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:56.459588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a5802919-da97-411e-88fa-ca9ebe27e04c req-d27a9fb5-ea03-432b-814d-7dee828183a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:56.490591 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a5802919-da97-411e-88fa-ca9ebe27e04c req-d27a9fb5-ea03-432b-814d-7dee828183a6 service nova] Creating event network-vif-plugged:62f0460f-920b-4f25-aa74-22315aae0fbf for instance 0ffcfe60-8da8-4af8-a192-81b087d04134 on n-h2-zed-1 Oct 28 10:19:56.506895 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a5802919-da97-411e-88fa-ca9ebe27e04c req-d27a9fb5-ea03-432b-814d-7dee828183a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107706 Oct 28 10:19:56.515693 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2927/5880] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:57.092127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:57.111819 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aba7b969-907c-461f-b8cf-dac4cb47f948 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 0.903804 Oct 28 10:19:57.115205 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2954/5881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:56 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:57.421549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:57.422270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:57.424833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:57.454403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:57.456690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:57.457286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:57.458075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:57.459829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:57.460336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:57.814894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:57.828103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2f2faefe-eefb-42ca-a9d4-695bf1dc1f0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1511 microversion: 2.1 time: 0.410906 Oct 28 10:19:57.829059 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2928/5882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:57 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1511 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:58.137442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:58.138639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:58.145697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:58.157639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:58.158092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:58.158836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:58.159296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:58.159723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:58.192230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:19:58.687314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:58.698430 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-98c5bd1f-fbd1-4ef1-946b-d229d1565eea tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1319 microversion: 2.1 time: 0.564983 Oct 28 10:19:58.706103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2955/5883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:58 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1319 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:58.855121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:58.855121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:58.864567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:58.865141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:58.865653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:58.877291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:58.877915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:58.878368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.269430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:59.277622 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9a8ecf5-d340-4ed5-b554-87cb589fdea9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1488 microversion: 2.1 time: 0.428260 Oct 28 10:19:59.281722 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2929/5884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:58 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1488 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:59.308596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:19:59.311323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:59.335716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.336323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.339569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.343706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.344976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.345482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.488314 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81c069d0-f8f2-4d0b-95e8-20471dd37757 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 200 len: 151 microversion: 2.1 time: 0.184152 Oct 28 10:19:59.489147 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2956/5885] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:19:59 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 151 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:19:59.500711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:59.501845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:59.515187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.522627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.523511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.531177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.532602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.534212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.736183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:59.737645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:59.758308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.763121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.763121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.763121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.763121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.767055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.865859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:19:59.881076 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2087ec4b-baf3-4a03-93c5-c4be11c0c09f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.385737 Oct 28 10:19:59.881994 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2930/5886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:59 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:19:59.920682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:19:59.921749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:19:59.946536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.949390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.950606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:19:59.953445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:19:59.957969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:19:59.958609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:00.271900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:00.283845 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dbe63d5f-9e6c-449c-b928-8fe0f0ed8d85 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1509 microversion: 2.1 time: 0.565080 Oct 28 10:20:00.285027 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2957/5887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:59 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1509 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:00.286220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:00.297424 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d8644e5-d177-4908-a740-6fa88e9fca26 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.378638 Oct 28 10:20:00.317114 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2931/5888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:19:59 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:00.327561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:00.328767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:00.337206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:00.337870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:00.338466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:00.339911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:00.340530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:00.341134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:00.647056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:00.663505 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31b26951-5b65-452b-bf0d-94c656e4f594 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.335432 Oct 28 10:20:00.672762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2958/5889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:00 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:00.695251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:00.696719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:00.707749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:00.711439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:00.712099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:00.713027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:00.714401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:00.715171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:01.253302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:01.266290 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96e10bc5-51ba-4e2e-832d-673d7b1d6844 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.576067 Oct 28 10:20:01.268271 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2932/5890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:00 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:01.534031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1848659148", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "211d510d-dd8f-46be-8306-141acae1af62"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:01.660417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] validate_networks() for [('211d510d-dd8f-46be-8306-141acae1af62', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:20:02.350923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:20:02.351356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:20:02.351833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:20:02.352312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:20:02.352779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:20:02.367798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:02.368989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:02.369596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:02.370821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:02.371483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:02.372115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:02.421799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:20:02.427390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for user 1b327af221c94695bc5b82fa49e3c448 and project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:20:02.443018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:20:02.446616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:20:02.512698 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-86a07d7b-48d6-439d-aedd-34c1aa86f321 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.983056 Oct 28 10:20:02.514002 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2959/5891] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:20:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:20:02.526860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c89ac80e-bf7c-4036-b18f-086eccf590a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:02.528205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c89ac80e-bf7c-4036-b18f-086eccf590a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:02.661563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c89ac80e-bf7c-4036-b18f-086eccf590a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:02.671060 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c89ac80e-bf7c-4036-b18f-086eccf590a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1215 microversion: 2.1 time: 0.149145 Oct 28 10:20:02.672811 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2933/5892] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:02 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1215 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:03.700547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:03.702747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:03.716257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:03.717853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:03.719397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:03.721002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:03.723119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:03.725983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:03.823181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:03.835562 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-186bfa1e-e961-4985-b13c-ca1f481416b1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1211 microversion: 2.1 time: 0.139627 Oct 28 10:20:03.837390 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2960/5893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:03 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1211 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:04.863972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:04.865455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:04.875143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:04.875652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:04.876101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:04.876818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:04.877304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:04.878141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:04.998806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:05.008060 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-78ddf4ab-e3ce-4b87-9bdb-8deaef962a78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1273 microversion: 2.1 time: 0.148567 Oct 28 10:20:05.011676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2934/5894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:04 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1273 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:06.032755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:06.034134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:06.048847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:06.051404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:06.051866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:06.052613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:06.053131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:06.055587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:06.329536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:06.340664 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b1c8f48-5603-4723-a898-b701994ba166 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1315 microversion: 2.1 time: 0.312685 Oct 28 10:20:06.342594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2961/5895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:06 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:06.674354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f667c9c0-5be0-40a5-9f01-3496ff7dcf60 req-f02fc8f6-7e81-465d-870d-f3db7ad5d5bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8cbfe95-1b03-45d9-bdf8-0865b985bd35", "tag": "11be2be6-0bbd-428c-a3b0-1637accf1cfc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:06.697420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f667c9c0-5be0-40a5-9f01-3496ff7dcf60 req-f02fc8f6-7e81-465d-870d-f3db7ad5d5bf service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:06.698250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f667c9c0-5be0-40a5-9f01-3496ff7dcf60 req-f02fc8f6-7e81-465d-870d-f3db7ad5d5bf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:06.699194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f667c9c0-5be0-40a5-9f01-3496ff7dcf60 req-f02fc8f6-7e81-465d-870d-f3db7ad5d5bf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:06.722691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f667c9c0-5be0-40a5-9f01-3496ff7dcf60 req-f02fc8f6-7e81-465d-870d-f3db7ad5d5bf service nova] Creating event network-changed:11be2be6-0bbd-428c-a3b0-1637accf1cfc for instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 on n-h2-zed-1 Oct 28 10:20:06.730061 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f667c9c0-5be0-40a5-9f01-3496ff7dcf60 req-f02fc8f6-7e81-465d-870d-f3db7ad5d5bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062098 Oct 28 10:20:06.731515 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2935/5896] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:07.364398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:07.365848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:07.374868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:07.376077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:07.379015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:07.379994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:07.380458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:07.380898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:07.607677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:07.617216 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec39f254-4e23-4647-bbfa-29203fb6c6ef tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1315 microversion: 2.1 time: 0.255551 Oct 28 10:20:07.619870 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2962/5897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:07 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:08.643490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:08.644199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:08.656288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:08.656609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:08.657095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:08.663861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:08.664895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:08.665426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:08.955811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:08.967603 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f44c3e7d-4b7d-46a4-a660-f1495f9edc78 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1315 microversion: 2.1 time: 0.328392 Oct 28 10:20:08.968798 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2936/5898] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:08 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:09.430328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cce88f17-ca81-41f5-8ce9-6c2cdb09e625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: .version_select at 0x7fca32168310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1045512326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMljaww33U2t7I2Y6KnkTdznTfxNUGb26J9jbLa90inw176JmULyDD4b2Rzm2CnZD5d4MEpBN4zuQsJNrG7iFnyqo6+ClHQTpCfLPSlEFRqB3702FYvRz1lv/6arP4iw3A=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:09.488390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-cce88f17-ca81-41f5-8ce9-6c2cdb09e625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:20:09.516475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-cce88f17-ca81-41f5-8ce9-6c2cdb09e625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:20:09.600648 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cce88f17-ca81-41f5-8ce9-6c2cdb09e625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.645542 Oct 28 10:20:09.601372 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2963/5899] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:20:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:20:09.991821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:09.994242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:10.005909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:10.006411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:10.011886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:10.018407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:10.019182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:10.020661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:10.081931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:10.468024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:10.481300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0569cf4b-c0cf-4f2e-9106-2302b1266007 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1315 microversion: 2.1 time: 0.493480 Oct 28 10:20:10.482297 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2937/5900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:09 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:11.516706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:11.518175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:11.535577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:11.538171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:11.539748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:11.540828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:11.542891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:11.544865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:11.545559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:11.908270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-76ee8b5c-8d54-46c2-bf9e-f7917c94d491 req-76b1095e-87e5-450a-b8e6-ded5432a6a56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cbfe95-1b03-45d9-bdf8-0865b985bd35", "name": "network-vif-plugged", "status": "completed", "tag": "11be2be6-0bbd-428c-a3b0-1637accf1cfc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:11.927765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:11.947552 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf106d88-b52e-4d0e-abc2-b0680b242988 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1315 microversion: 2.1 time: 0.442631 Oct 28 10:20:11.948578 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2964/5901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:11 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:11.949177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-76ee8b5c-8d54-46c2-bf9e-f7917c94d491 req-76b1095e-87e5-450a-b8e6-ded5432a6a56 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:11.949946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-76ee8b5c-8d54-46c2-bf9e-f7917c94d491 req-76b1095e-87e5-450a-b8e6-ded5432a6a56 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:11.950876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-76ee8b5c-8d54-46c2-bf9e-f7917c94d491 req-76b1095e-87e5-450a-b8e6-ded5432a6a56 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:11.980874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-76ee8b5c-8d54-46c2-bf9e-f7917c94d491 req-76b1095e-87e5-450a-b8e6-ded5432a6a56 service nova] Creating event network-vif-plugged:11be2be6-0bbd-428c-a3b0-1637accf1cfc for instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 on n-h2-zed-1 Oct 28 10:20:11.987251 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-76ee8b5c-8d54-46c2-bf9e-f7917c94d491 req-76b1095e-87e5-450a-b8e6-ded5432a6a56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082997 Oct 28 10:20:11.989635 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2938/5902] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:20:12.974538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:12.975768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:12.978543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:12.998900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:12.999788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:13.000214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:13.001017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:13.001649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:13.002279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:13.625339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:13.642100 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a134aa29-374a-4527-a02d-7906b4c5159f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1315 microversion: 2.1 time: 0.665011 Oct 28 10:20:13.664894 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2965/5903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:12 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:14.672588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:14.687538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:14.690755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:14.709537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:14.710189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:14.713008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:14.714735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:14.715219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:14.715659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:15.745601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:15.756660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5cb36004-7ba6-42ae-b1c3-0deaa641834e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1502 microversion: 2.1 time: 1.087890 Oct 28 10:20:15.766892 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2939/5904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:14 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1502 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:15.786692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:15.790801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:15.801670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:15.802691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:15.803410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:15.805147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:15.805911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:15.807595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:15.916115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-86a3d699-577d-4b2e-9674-0c42130e8306 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.137623 Oct 28 10:20:15.921117 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2966/5905] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:15 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:16.571048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Calling method '.version_select at 0x7fca3301baf0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:16.574632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:16.576312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:16.577025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:16.603323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:16.604008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:16.605191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:16.621325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:16.622360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:16.622985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:16.631593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ded266c4-b2c3-490f-86aa-efdddd0a1f24 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099 tempest-PortsAdminExtendedAttrsIpV6TestJSON-424780099-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.506189 Oct 28 10:20:16.633794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2940/5906] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:20:16 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:16.929263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:16.933803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:16.964882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:16.966055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:16.968557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:16.969836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:16.971309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:16.976196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:17.071314 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a60d44ee-8826-4f9b-998f-e722722a5e2e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.146964 Oct 28 10:20:17.073023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2967/5907] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:16 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:18.084132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:18.087252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:18.107484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:18.111148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:18.121476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:18.125333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:18.127472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:18.128998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:18.287211 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-86aea0a0-cdf5-49ee-9bb2-cb9766c88a47 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.207323 Oct 28 10:20:18.291579 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2941/5908] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:18 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:19.307752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:19.310550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:19.325985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:19.333408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:19.334121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:19.335363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:19.336129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:19.336859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:19.409095 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-30395f0c-0870-4c1c-bdd7-39171a5ccf16 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.105867 Oct 28 10:20:19.415239 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2968/5909] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:19 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:20.432011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:20.436644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:20.481223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:20.486094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:20.488429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:20.489505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:20.491141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:20.495533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:20.644661 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe0a2568-2cf3-4c98-aa1f-d20eac9a06b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.226680 Oct 28 10:20:20.646618 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2942/5910] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:20 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:21.656450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:21.659049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:21.683490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:21.688649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:21.691607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:21.692307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:21.693253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:21.697750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:21.698448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:21.801319 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab22de52-ca4e-457a-9ea2-55883eec7430 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.149019 Oct 28 10:20:21.806193 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2969/5911] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:21 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:22.814160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:22.818588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:22.838608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:22.839421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:22.840079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:22.843244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:22.843949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:22.844560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:22.960512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50e79d2f-b24b-4dea-8832-d9fc425dc03b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.150669 Oct 28 10:20:22.962099 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2943/5912] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:22 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:23.436809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:23.438300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:23.461700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:23.462383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:23.462853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:23.463621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:23.464092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:23.464535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:23.538214 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c0e8e63-187a-4818-81ac-8a8204e08297 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/ips" status: 200 len: 150 microversion: 2.1 time: 0.469932 Oct 28 10:20:23.548441 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2970/5913] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:20:23 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/ips => generated 150 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:23.684054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1875149978", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "39cda6df-6b59-4b35-94ae-0c0682df2640"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1045512326", "security_groups": [{"name": "tempest-secgroup-smoke-198264050"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:23.972960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:23.976583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:23.995460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:24.000892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:24.005900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:24.006923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:24.008212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:24.009177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:24.145754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] validate_networks() for [('39cda6df-6b59-4b35-94ae-0c0682df2640', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:20:24.151001 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-689d9a67-2b90-4625-aed3-ae6b9c7e0723 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.182713 Oct 28 10:20:24.155033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2971/5914] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:23 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:25.163457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:25.166625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:25.181315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:25.189769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:25.191917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:25.192806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:25.194868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:25.195457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:25.326094 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-23cfab96-7a9c-4926-9884-2ca01f5e664c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 14 microversion: 2.1 time: 0.167012 Oct 28 10:20:25.332255 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2972/5915] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:25 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:25.367990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:20:25.368405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:20:25.369117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:20:25.369769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:20:25.370352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:20:25.392824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:25.393651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:25.394290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:25.395068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:25.397156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:25.400266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:25.472788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:20:25.502700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:20:25.562106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:20:25.568918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:20:25.737685 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-339c879e-4487-4431-b55e-13887de9009a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.057078 Oct 28 10:20:25.741047 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2944/5916] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:20:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 2062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:20:25.752623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0a8f03f-dbaf-4b3c-a440-7489356cd8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:25.753660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0a8f03f-dbaf-4b3c-a440-7489356cd8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:26.259400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0a8f03f-dbaf-4b3c-a440-7489356cd8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:26.270152 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0a8f03f-dbaf-4b3c-a440-7489356cd8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1267 microversion: 2.1 time: 0.522063 Oct 28 10:20:26.271248 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2973/5917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:25 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1267 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:26.342202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:26.348490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:26.373563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:26.374542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:26.375075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:26.375973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:26.376453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:26.376894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:26.532608 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-307c780d-9c58-4c48-8911-3eac144aa874 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action" status: 200 len: 8205 microversion: 2.1 time: 0.197187 Oct 28 10:20:26.533786 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2945/5918] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:26 2022] POST /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35/action => generated 8205 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:26.546130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:26.546758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:26.568055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:26.570378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:26.571089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:26.572742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:26.573937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:26.574879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:26.715876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ba9d646-c133-4058-9e47-0a54f730fe0b"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:26.720842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:26.749600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:26.750739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:26.751939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:26.753601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:26.754789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:26.755911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:27.472525 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bfe1f162-bf91-446d-aad6-ad924b4396ec tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.771073 Oct 28 10:20:27.474412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2946/5919] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:20:26 2022] POST /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 194 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:27.494418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:27.501342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:27.505924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:27.542010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:27.542909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:27.543673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:27.544957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:27.559799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:27.561249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:27.859040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:27.882189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:27.889190 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1f39f5b4-a2a9-414a-81b9-b34b81e5d197 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 1.344738 Oct 28 10:20:27.894437 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2974/5920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:26 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:27.905837 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-133a7598-dd14-4463-b7fa-a19ab7021a04 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1319 microversion: 2.1 time: 0.428542 Oct 28 10:20:27.906922 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2947/5921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:27 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:27.936544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:27.938806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:27.970287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:27.972119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:27.973004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:27.980077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:27.981118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:27.982137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:28.513741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:28.516128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=89 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:28.541429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ddfe9003-b4b6-477e-be33-3623effd3695 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.605117 Oct 28 10:20:28.543598 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2975/5922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:27 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:28.573860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:28.575381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:28.625250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:28.627484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:28.636710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:28.637878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:28.642049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:28.645443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:28.939141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:28.939920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:28.966874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:28.968242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:28.973048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:28.981045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:28.986616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:28.987536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:29.347707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:29.361631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-26e82dd0-34a6-4e9c-9425-224db40b707f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1325 microversion: 2.1 time: 0.427501 Oct 28 10:20:29.363961 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2976/5923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:28 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1325 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:29.683290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:29.693358 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-87d30a33-e34e-4595-8d5b-f4cb1d5485ec tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 1.124936 Oct 28 10:20:29.698589 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2948/5924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:28 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:29.725579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:29.726412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:29.739264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:29.741855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:29.743381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:29.746684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:29.749574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:29.751033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:30.387512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:30.388723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:30.401286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:30.402077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:30.402789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:30.403754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:30.409611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:30.410386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:30.505830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:30.518939 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-80ecd433-d6b7-4176-9680-cc394ac57014 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.799215 Oct 28 10:20:30.519801 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2977/5925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:29 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:30.546411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:30.547530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:30.556877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:30.559355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:30.560304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:30.562042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:30.564280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:30.566100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:30.660524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Locking {{(pid=128748) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 28 10:20:30.781828 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70fd1452-7ab0-4b47-829c-7f4611d00632 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.239291 Oct 28 10:20:30.783039 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2978/5926] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:30 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:20:30.796804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:30.807563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:30.821216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:30.831654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:30.837931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:30.841703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:30.842696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:30.843366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:31.021882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:31.033523 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6a4f4a7d-b029-4d98-a139-9561a494ae12 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.649885 Oct 28 10:20:31.053277 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2949/5927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:30 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:31.514615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:31.523083 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06d4a815-5e6c-4516-947a-18e06c2c0a8d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.735166 Oct 28 10:20:31.533733 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2979/5928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:30 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:31.557255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:31.565204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:31.565932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:31.566751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:31.621276 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] HTTP exception thrown: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a is locked Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Request method failure captured: Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action HTTP/1.1 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 15 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6vlrJYCf_Dg7Kfb44N26_ij3WM0ja6IaeUGKBN3__kljfDcVQmcw97kaDW38Vjj5LjXpwjDQflsstZSp-FK8iLAVZ1mo3C6Hs3HzVTtHETUYWVN-sG5pClX7ZYYJC3q4AB5mGZ-MZbnfL6XtWp8X-Yf8p_DQHzn9nCYeqVmtE3FXrE Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_647a75e417314ddbb20364530ad36c54", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/647a75e417314ddbb20364530ad36c54"}]}] Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1b327af221c94695bc5b82fa49e3c448 Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: {"os-stop": {}} Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a is locked Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7dcd0a6b-eda6-43de-b69e-7da5c7807c5a', 'body': {'os-stop': {}}} Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a is locked Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a is locked Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a is locked Oct 28 10:20:31.623855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:31.629620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Returning 409 to user: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a is locked {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:20:31.634039 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ce305e4-f0ec-42ea-9a70-631ce5b1b638 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 409 len: 107 microversion: 2.1 time: 0.081851 Oct 28 10:20:31.640044 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2950/5929] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:31 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 107 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 28 10:20:31.645537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:31.646479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:31.655145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:31.656603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:31.661098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:31.662585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:31.663681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:31.664365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:31.795429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Unlocking {{(pid=128748) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 10:20:31.896769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-297d801e-1eb1-40e6-97e9-2b508a2c8e04 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.255642 Oct 28 10:20:31.906849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e67d58f-1ac0-4b26-9ef7-5f0e230e7137 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:31.912693 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2980/5930] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:31 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:20:31.915273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e67d58f-1ac0-4b26-9ef7-5f0e230e7137 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:31.915987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e67d58f-1ac0-4b26-9ef7-5f0e230e7137 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:31.916610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e67d58f-1ac0-4b26-9ef7-5f0e230e7137 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:31.959724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3e67d58f-1ac0-4b26-9ef7-5f0e230e7137 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Going to try to stop instance {{(pid=128747) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:20:32.076088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:32.077962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:32.085690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e67d58f-1ac0-4b26-9ef7-5f0e230e7137 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.151379 Oct 28 10:20:32.090587 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2951/5931] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:31 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:20:32.105286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:32.110909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:32.115360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:32.115868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:32.125794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:32.126341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:32.126853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:32.127196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:32.127320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:32.127935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:32.128065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:32.128457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:32.128808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:32.128976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:32.738610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:32.753360 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6804ae44-cc89-4003-9f24-2dfc6483d834 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.658411 Oct 28 10:20:32.755753 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2952/5932] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:32 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:32.769344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82dcc0a5-c30d-4e28-8fb1-a32166f6836f", "device": "/dev/sdb"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:32.776208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:32.793171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:32.794560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:32.796146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:32.797546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:32.798273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:32.799172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:32.874622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:32.883907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-742c06f8-db91-4ed4-87f1-7f06828199d2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.825755 Oct 28 10:20:32.907495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2981/5933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:32 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:33.226086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:33.283225 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc3102ec-ca32-4580-bcdc-f4b2091f41d4 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "POST /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.525948 Oct 28 10:20:33.284433 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2953/5934] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:20:32 2022] POST /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:33.507598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f8a0317d-9353-430f-a376-a31919d6d0ba req-7e6c3bf0-90d3-4a91-8799-63c14a883370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:33.533551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f8a0317d-9353-430f-a376-a31919d6d0ba req-7e6c3bf0-90d3-4a91-8799-63c14a883370 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:33.542477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f8a0317d-9353-430f-a376-a31919d6d0ba req-7e6c3bf0-90d3-4a91-8799-63c14a883370 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:33.542946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f8a0317d-9353-430f-a376-a31919d6d0ba req-7e6c3bf0-90d3-4a91-8799-63c14a883370 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:33.607007 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f8a0317d-9353-430f-a376-a31919d6d0ba req-7e6c3bf0-90d3-4a91-8799-63c14a883370 service nova] Creating event network-changed:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h1-zed-1 Oct 28 10:20:33.613743 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f8a0317d-9353-430f-a376-a31919d6d0ba req-7e6c3bf0-90d3-4a91-8799-63c14a883370 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109484 Oct 28 10:20:33.615040 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2982/5935] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:33.783837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:33.785165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:33.817422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:33.817965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:33.818418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:33.819155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:33.819623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:33.820087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:33.916445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:33.917224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:33.944559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:33.948966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:33.949504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:33.950284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:33.950772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:33.952581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:34.502543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:34.516779 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8bba2eb8-1d28-4104-b08f-f327556ce29c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.606107 Oct 28 10:20:34.519904 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2983/5936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:33 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:35.424360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:35.477267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:35.493686 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5a3361aa-76a8-4285-b449-97ff4aae4bba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 1.715852 Oct 28 10:20:35.494387 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2954/5937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:33 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 1717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:35.551703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:35.555505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:35.571574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:35.574485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:35.575200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:35.578435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:35.592505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:35.592893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:36.269823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:36.519226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:36.525797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:36.527833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:36.548312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:36.548822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:36.553277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:36.558730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:36.559887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:36.560553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:36.693707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:36.704772 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7074df9-aa3c-4147-a299-db1df08591ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 1.159032 Oct 28 10:20:36.709843 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2984/5938] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:35 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:37.360490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:37.378447 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-441d218d-d689-4078-ade0-da30d1c53018 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.863045 Oct 28 10:20:37.379754 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2955/5939] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:36 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:37.738752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:37.739543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:37.757411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:37.758311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:37.760174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:37.763086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:37.764247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:37.766220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:38.064099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:38.074121 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1acf38b7-82bf-4c9d-9b8b-37ab14680e1a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.340878 Oct 28 10:20:38.089520 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2985/5940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:37 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:38.402700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:38.404025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:38.418045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:38.418811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:38.419424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:38.420313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:38.420783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:38.421242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:38.659935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:38.671698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6c6a3877-d9d8-4259-b194-8dd7b70fcac4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.272733 Oct 28 10:20:38.672303 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2956/5941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:38 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:39.107130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:39.107670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:39.115051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:39.115676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:39.116196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:39.117781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:39.118478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:39.119007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:39.419843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:39.435496 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a73ef3e-9d2a-4b98-a98b-d9df2576e07c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.332313 Oct 28 10:20:39.439700 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2986/5942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:39 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:39.699873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:39.700811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:39.716245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:39.717183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:39.717812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:39.722335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:39.722999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:39.723615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:40.203812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:40.218093 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98d89b8d-bb52-4edc-a9a9-ae3e3730cd43 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.526346 Oct 28 10:20:40.228929 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2957/5943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:39 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:40.461415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:40.461998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:40.474194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:40.475894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:40.476666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:40.479569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:40.481354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:40.482086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:40.855271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:40.873612 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75b89fbc-5758-471d-9ac2-964572c527a9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.416336 Oct 28 10:20:40.889582 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2987/5944] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:40 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:41.249399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:41.250055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:41.265904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:41.266617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:41.267401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:41.268324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:41.268974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:41.269567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:41.817096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:41.831252 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9ab232b-96c8-4abc-82e4-ecbf819a225c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.588315 Oct 28 10:20:41.851081 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2958/5945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:41 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:41.897208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:41.897840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:41.902670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=50 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:41.918159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:41.918917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:41.919543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:41.920709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:41.921360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:41.922291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:41.968417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=4,nova_cell1:UPDATE=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:42.268875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:42.290777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cae8ba46-84f6-4858-adf1-b9258f28110b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.397593 Oct 28 10:20:42.291373 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2988/5946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:41 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:42.456732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e969421a-43ae-4546-ac0a-ef6ebd04e21c req-1201c320-fc2c-48a0-9933-1c6e8e310c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "name": "network-vif-plugged", "status": "completed", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:42.489421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e969421a-43ae-4546-ac0a-ef6ebd04e21c req-1201c320-fc2c-48a0-9933-1c6e8e310c59 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:42.490649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e969421a-43ae-4546-ac0a-ef6ebd04e21c req-1201c320-fc2c-48a0-9933-1c6e8e310c59 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:42.493958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e969421a-43ae-4546-ac0a-ef6ebd04e21c req-1201c320-fc2c-48a0-9933-1c6e8e310c59 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:42.522495 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e969421a-43ae-4546-ac0a-ef6ebd04e21c req-1201c320-fc2c-48a0-9933-1c6e8e310c59 service nova] Creating event network-vif-plugged:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h1-zed-1 Oct 28 10:20:42.529232 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e969421a-43ae-4546-ac0a-ef6ebd04e21c req-1201c320-fc2c-48a0-9933-1c6e8e310c59 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076483 Oct 28 10:20:42.530556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2959/5947] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:42.859789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:42.860801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:42.877823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:42.878514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:42.879894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:42.881857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:42.885134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:42.885635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:43.292511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:43.302623 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46c84c29-8f6e-4306-a657-7839dca1d893 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1654 microversion: 2.1 time: 0.446734 Oct 28 10:20:43.305145 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2989/5948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:42 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1654 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:43.330681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:43.331387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:43.331927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76b0e8b5-2d85-42a5-9765-fb9251da4b72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:43.341599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76b0e8b5-2d85-42a5-9765-fb9251da4b72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:43.342802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76b0e8b5-2d85-42a5-9765-fb9251da4b72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:43.344354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76b0e8b5-2d85-42a5-9765-fb9251da4b72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:43.345205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:43.345911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:43.346525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:43.347530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:43.348152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:43.348867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:43.410905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76b0e8b5-2d85-42a5-9765-fb9251da4b72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Going to try to start instance {{(pid=128748) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 10:20:43.519047 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76b0e8b5-2d85-42a5-9765-fb9251da4b72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.191458 Oct 28 10:20:43.522456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2990/5949] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:43 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:20:43.535595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:43.537041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:43.553808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:43.556731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:43.557323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:43.559903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:43.561266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:43.562912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:43.888144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:43.900388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04455b3b-8658-41ff-b2e6-d1b84455a13a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1392 microversion: 2.1 time: 0.577861 Oct 28 10:20:43.901780 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2960/5950] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:43 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1392 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:44.074102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:44.087409 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0df06654-71ab-42c5-b769-0735a8af3700 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1663 microversion: 2.1 time: 0.559865 Oct 28 10:20:44.088795 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2991/5951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:43 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1663 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:44.926825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:44.927437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:44.939221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:44.941268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:44.941895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:44.943322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:44.950947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:44.951640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:45.115171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:45.116462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:45.190444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:45.193028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:45.193852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:45.198453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:45.203206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:45.204340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:45.399454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:45.412472 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7950497-74fd-48f3-a779-ac4bf19b9bdd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1564 microversion: 2.1 time: 0.489594 Oct 28 10:20:45.423014 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2961/5952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:44 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1564 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:45.449085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:45.451098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:45.469489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:45.470316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:45.471014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:45.471966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:45.472931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:45.473649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:45.541277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:45.552147 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1428fc48-160d-4f42-9392-d11b9d52afe3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1663 microversion: 2.1 time: 0.442712 Oct 28 10:20:45.553947 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2992/5953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:45 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1663 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:45.824124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:45.836055 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a5c9c99-259f-478a-a850-7c893c7ec692 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1564 microversion: 2.1 time: 0.396976 Oct 28 10:20:45.839756 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2962/5954] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:45 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1564 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:46.585630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:46.585630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:46.594921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:46.603125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:46.604086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:46.605440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:46.606568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:46.607377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.100573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:47.113510 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-adb7ba88-f213-4a4c-a5d8-3147f0a479f3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.533834 Oct 28 10:20:47.119730 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2993/5955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:46 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:47.142943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:47.143679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:47.156871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.157377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.157816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.158518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.158964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.159391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.455082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:47.466964 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ee5a1c1-fdd3-4d7c-ba6e-70477adbc87c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.325820 Oct 28 10:20:47.468363 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2963/5956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:47 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:47.494815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:47.494815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:47.522493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.528085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.528720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.533959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.534550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.535013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.657264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Unlocking {{(pid=128748) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 28 10:20:47.730225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ba9d646-c133-4058-9e47-0a54f730fe0b"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:47.733082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:47.754241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.754912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.755646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.756518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.757154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.758302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.773691 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7a36be6-9def-4e2c-925a-39cdfa025140 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.284894 Oct 28 10:20:47.774665 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2994/5957] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:47 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:20:47.795279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:47.799044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:47.817986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.820857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.822432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.823930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:47.825627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:47.826099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:47.918300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Invalid volume: volume 4ba9d646-c133-4058-9e47-0a54f730fe0b is already attached to instances: 8d9a2778-8256-44e7-ab19-f6acf03b5819 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments HTTP/1.1 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 74 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: {"volumeAttachment": {"volumeId": "4ba9d646-c133-4058-9e47-0a54f730fe0b"}} Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: exception: Invalid volume: volume 4ba9d646-c133-4058-9e47-0a54f730fe0b is already attached to instances: 8d9a2778-8256-44e7-ab19-f6acf03b5819 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': '8d9a2778-8256-44e7-ab19-f6acf03b5819', 'body': {'volumeAttachment': {'volumeId': '4ba9d646-c133-4058-9e47-0a54f730fe0b'}}} Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4ba9d646-c133-4058-9e47-0a54f730fe0b is already attached to instances: 8d9a2778-8256-44e7-ab19-f6acf03b5819 Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:20:47.920055 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4ba9d646-c133-4058-9e47-0a54f730fe0b is already attached to instances: 8d9a2778-8256-44e7-ab19-f6acf03b5819 Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4ba9d646-c133-4058-9e47-0a54f730fe0b is already attached to instances: 8d9a2778-8256-44e7-ab19-f6acf03b5819 Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 400 to user: Invalid volume: volume 4ba9d646-c133-4058-9e47-0a54f730fe0b is already attached to instances: 8d9a2778-8256-44e7-ab19-f6acf03b5819 {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-61b7c39b-3383-40fc-91c9-7b92c4f043aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.196131 Oct 28 10:20:47.929812 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2964/5958] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:20:47 2022] POST /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 174 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 28 10:20:48.010174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:48.011061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:48.017684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.020469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.021150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:48.022422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.023121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.023950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:48.193972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lazy-loading 'services' on Instance uuid 8d9a2778-8256-44e7-ab19-f6acf03b5819 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:20:48.231561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:48.245951 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aaafdbf6-128b-4861-9062-ade62bb85d67 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.463987 Oct 28 10:20:48.247175 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2995/5959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:47 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:48.272506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:48.273411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:48.283443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.284552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.286193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:48.287762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.288404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.291408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:48.293693 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a343028c-e381-4519-8ee0-35c9908020c8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments/4ba9d646-c133-4058-9e47-0a54f730fe0b" status: 202 len: 0 microversion: 2.1 time: 0.288297 Oct 28 10:20:48.297549 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2965/5960] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:20:48 2022] DELETE /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments/4ba9d646-c133-4058-9e47-0a54f730fe0b => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:20:48.305722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:48.313085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:48.326651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.327162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.327612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:48.328325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.334396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.334856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:48.399781 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9125bb5e-d6d3-4306-a19c-430eadf4a0ac tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100636 Oct 28 10:20:48.404216 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2966/5961] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:48 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:48.603811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:48.612358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d4540aa-3ec2-486f-92b3-4eaf4d4b3e82 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.343935 Oct 28 10:20:48.631045 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2996/5962] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:48 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:48.641087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:48.641800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:48.649437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.650239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.650909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:48.651807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:48.652488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:48.653120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.091329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:49.099616 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5df39797-b01b-4b8a-abe0-7e775daa9ade tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.463053 Oct 28 10:20:49.103847 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2967/5963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:48 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:49.128766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:49.130759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:49.137955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.138811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.140374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.141383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.142050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.142658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.254940 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19bd2f31-5f3f-4692-9c0c-1548e542ba33 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.129779 Oct 28 10:20:49.256792 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2997/5964] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:49 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:20:49.273549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:49.273922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:49.295103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.296176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.301688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.306361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.306870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.308253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.416678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:49.419858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:49.446967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.447649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.449748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.450723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.452883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.453653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.518013 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cafa361b-1f61-4a3c-8fed-1a57d900297a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105993 Oct 28 10:20:49.519217 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2998/5965] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:49 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:20:49.689227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:49.689994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:49.706457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.707061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.710142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.711016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.711685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.713535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.828227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:49.837734 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bec42770-fb76-4303-8373-47a093fa9e0c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1672 microversion: 2.1 time: 0.576557 Oct 28 10:20:49.841767 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2968/5966] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:49 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1672 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:49.857680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4cd3c11e-01e4-43f1-9b30-461a32eb06eb req-801bc082-af59-47ed-a75f-ed13f09b7b32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:49.883547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4cd3c11e-01e4-43f1-9b30-461a32eb06eb req-801bc082-af59-47ed-a75f-ed13f09b7b32 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:49.884359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4cd3c11e-01e4-43f1-9b30-461a32eb06eb req-801bc082-af59-47ed-a75f-ed13f09b7b32 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:49.884879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4cd3c11e-01e4-43f1-9b30-461a32eb06eb req-801bc082-af59-47ed-a75f-ed13f09b7b32 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:49.908001 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4cd3c11e-01e4-43f1-9b30-461a32eb06eb req-801bc082-af59-47ed-a75f-ed13f09b7b32 service nova] Creating event network-changed:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h1-zed-1 Oct 28 10:20:49.926689 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4cd3c11e-01e4-43f1-9b30-461a32eb06eb req-801bc082-af59-47ed-a75f-ed13f09b7b32 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082975 Oct 28 10:20:49.939909 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2969/5967] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:50.196375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:50.205830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b88c19f-df53-460a-82e6-97302a20102f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1564 microversion: 2.1 time: 0.521282 Oct 28 10:20:50.209196 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 2999/5968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:49 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1564 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:20:50.535293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:50.544710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:50.573723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:50.574239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:50.574691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:50.575413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:50.575873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:50.576359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:50.695677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:50.710045 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea1afa98-37de-4953-b5f0-1b315b8b61d6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179878 Oct 28 10:20:50.716708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2970/5969] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:50 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:50.869249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:50.870055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:50.888890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:50.891445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:50.892028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:50.892801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:50.893307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:50.893749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:50.948712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:51.399259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:51.425927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7cddca4b-6ba4-4676-8585-d76abafe10be tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1652 microversion: 2.1 time: 0.563895 Oct 28 10:20:51.430670 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3000/5970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:50 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1652 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:51.455892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:20:51.456369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:51.470501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:51.471005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:51.473211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:51.473954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:51.474426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:51.474859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:51.697666 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0ce8b65-71bb-4929-94a9-c81dc3d5ded8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.245668 Oct 28 10:20:51.701500 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2971/5971] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:20:51 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:20:51.707099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:51.707725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:51.723437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:51.725057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:51.725534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:51.729428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:51.729932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:51.731830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:51.732877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:51.735799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:51.753591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:51.755301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:51.756000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:51.757347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:51.759264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:51.760994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:51.848880 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10fe147c-be1a-4eff-a48d-027845d084bf tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124049 Oct 28 10:20:51.849883 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2972/5972] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:51 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:20:52.640245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:52.650393 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e8280e53-7144-42e4-8f0a-3992058b8777 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1659 microversion: 2.1 time: 0.947275 Oct 28 10:20:52.658569 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3001/5973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:51 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1659 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:52.863557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:52.870428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:52.902506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:52.902932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:52.905086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:52.909061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:52.909884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:52.910497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:53.015632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9317f67a-cdb9-44d7-b481-f9cdcb7c2264 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156853 Oct 28 10:20:53.017426 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2973/5974] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:52 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:53.690745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:53.690745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:53.712388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:53.713555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:53.714279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:53.715231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:53.715895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:53.716661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:54.029455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:54.031696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:54.048708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:54.049250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:54.049891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:54.050777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:54.052024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:54.052476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:54.131850 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd3ef437-1e91-4f81-80d4-75b282eb4167 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106521 Oct 28 10:20:54.132941 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2974/5975] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:54 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:20:54.186304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:54.207573 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc673401-ac4a-4bb6-a6b2-28cbb5c101e1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.524933 Oct 28 10:20:54.209557 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3002/5976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:53 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:54.232967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:54.233597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:54.245258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:54.254255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:54.255353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:54.256293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:54.257018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:54.258100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:54.492534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:54.504962 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a9a31cfb-28da-40a1-82f8-33e150ae37f7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.276710 Oct 28 10:20:54.508947 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2975/5977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:54 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:54.532352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:54.533255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:54.542144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:54.542701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:54.543329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:54.544136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:54.544610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:54.545087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:55.016111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:55.036479 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7a09f077-7428-4439-a56f-f9e1c3049220 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.507541 Oct 28 10:20:55.037534 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3003/5978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:54 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:55.065036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:55.065931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:55.087036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:55.087555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:55.097665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:55.098478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:55.099082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:55.099403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:55.154876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:55.154876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:55.157151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:55.157621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:55.158054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:55.158782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:55.159254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:55.159687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:55.235724 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1935abce-6c7f-4f99-9852-8f4c59778756 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095935 Oct 28 10:20:55.240646 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3004/5979] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:55 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:20:56.250925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:56.253875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:56.273520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:56.278821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:56.279494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:56.280935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:56.283832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:56.285193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:56.316933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:56.325853 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-03ef61df-6e90-43ac-9313-c332347b551a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 1.265897 Oct 28 10:20:56.333159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2976/5980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:55 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:56.357473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:56.358295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:56.360067 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50fd5fcd-0f7b-495c-8a3e-56294de44cb3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109492 Oct 28 10:20:56.363448 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3005/5981] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:56 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:20:56.372027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:56.372535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:56.373009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:56.373734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:56.374201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:56.374636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:56.738998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:56.747167 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2839800e-b1c8-484b-884d-c60c4dd26e0d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.402508 Oct 28 10:20:56.757506 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2977/5982] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:56 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:56.770289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:56.770909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:56.784031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:56.784531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:56.785013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:56.785729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:56.786183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:56.786801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:57.045397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:57.055799 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d16254fb-f478-48bd-aec5-6cc84ff3d4e2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.288311 Oct 28 10:20:57.059173 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3006/5983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:56 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:57.375336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:57.378271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:57.415848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:57.416640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:57.417431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:57.418344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:57.418964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:57.420145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:57.490863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e61b9beb-1963-4d41-b785-f36cfbe494ce tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119697 Oct 28 10:20:57.493329 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2978/5984] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:20:57 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819/os-volume_attachments => generated 25 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:20:57.591430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:57.591839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:57.603794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:57.604674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:57.605421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:57.606651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:57.607292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:57.607877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:57.642326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:20:57.793800 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-839a6de5-ab43-4d76-a92b-5ded394dd130 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 204 len: 0 microversion: 2.1 time: 0.203979 Oct 28 10:20:57.797713 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3007/5985] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:20:57 2022] DELETE /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:20:57.806915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:57.807530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:57.815068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=64 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:20:57.816669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:57.821824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:57.822328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:57.823507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:57.824137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:57.828119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:58.130756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:58.141279 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-db24f87f-599f-4dc7-8506-8647fb9b0a5a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1680 microversion: 2.1 time: 0.338692 Oct 28 10:20:58.146110 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2979/5986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:57 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1680 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:20:59.174350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:20:59.175254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:20:59.198094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:59.200819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:59.202252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:59.206368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:20:59.207376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:20:59.224051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:20:59.543443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:20:59.557275 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93b4062e-f592-4f2b-bf4f-f053920c3044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1680 microversion: 2.1 time: 0.384016 Oct 28 10:20:59.561737 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3008/5987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:20:59 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1680 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:00.584388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:00.586838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:00.607810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:00.608419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:00.611057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:00.614083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:00.614515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:00.618188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:01.254000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:01.266480 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00486114-7511-4a21-9360-73e6806cbe95 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1680 microversion: 2.1 time: 0.685003 Oct 28 10:21:01.285988 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2980/5988] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:00 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1680 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:02.007969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0f6b90bc-2181-4f93-8a86-b45399648d0c req-29dc46aa-bfcd-45d7-b894-140a977a28d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a2778-8256-44e7-ab19-f6acf03b5819", "name": "network-vif-deleted", "tag": "6ab96304-52b0-4a46-8026-91ac10820ca0"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:02.047633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0f6b90bc-2181-4f93-8a86-b45399648d0c req-29dc46aa-bfcd-45d7-b894-140a977a28d7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:02.049541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0f6b90bc-2181-4f93-8a86-b45399648d0c req-29dc46aa-bfcd-45d7-b894-140a977a28d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:02.051052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0f6b90bc-2181-4f93-8a86-b45399648d0c req-29dc46aa-bfcd-45d7-b894-140a977a28d7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:02.120754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0f6b90bc-2181-4f93-8a86-b45399648d0c req-29dc46aa-bfcd-45d7-b894-140a977a28d7 service nova] Creating event network-vif-deleted:6ab96304-52b0-4a46-8026-91ac10820ca0 for instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 on n-h1-zed-1 Oct 28 10:21:02.147484 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0f6b90bc-2181-4f93-8a86-b45399648d0c req-29dc46aa-bfcd-45d7-b894-140a977a28d7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138984 Oct 28 10:21:02.153910 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3009/5989] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:02.294112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:02.295335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:02.304463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:02.310157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:02.310877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:02.311834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:02.318198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:02.318957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:02.406874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:02.407389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:02.413142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:02.413763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lazy-loading 'fault' on Instance uuid 8d9a2778-8256-44e7-ab19-f6acf03b5819 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:21:02.695499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:02.725443 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-59d3bfda-f107-4665-a06d-cdddf28da5ee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 200 len: 1330 microversion: 2.1 time: 0.432879 Oct 28 10:21:02.747049 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2981/5990] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:02 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 1330 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:03.758791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:03.760688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:03.774474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:03.775424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:03.776714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:03.778138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:03.778878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:03.779606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:03.808500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 HTTP/1.1 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '8d9a2778-8256-44e7-ab19-f6acf03b5819'} Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:21:03.811186 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:21:03.816707 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:21:03.816707 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:21:03.816707 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:21:03.816707 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:21:03.816707 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:21:03.816707 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:21:03.816707 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:21:03.820722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:21:03.822740 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc2188b1-59e8-48fe-b29b-69727abb29e2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 404 len: 111 microversion: 2.1 time: 0.072023 Oct 28 10:21:03.824006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3010/5991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:03 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:21:03.833284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bcf7b69f-645f-4505-8959-bdc134d2ebdc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '.version_select at 0x7fca326504c0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:03.888737 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bcf7b69f-645f-4505-8959-bdc134d2ebdc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-123818722" status: 202 len: 0 microversion: 2.1 time: 0.059901 Oct 28 10:21:03.895472 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2982/5992] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-123818722 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:21:05.474625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8389d260-36ff-453f-8fa8-be6bd85bea28 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: .version_select at 0x7fca324f2790>, body: {"keypair": {"name": "tempest-keypair-1303586598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGYO7Wuoy+RN+tnvzvxf5Djuntc8zihxgFxGsWJA1TUijBKGPvjKHCoAZMUcf6pKMXm5bwLLlBFSdpDC7LXb1T51g6p+EVnP1mIlEPQoHz+KYpZGspBQdC7De+vog2/lA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:05.507166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-8389d260-36ff-453f-8fa8-be6bd85bea28 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:21:05.538750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-8389d260-36ff-453f-8fa8-be6bd85bea28 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:21:05.599942 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8389d260-36ff-453f-8fa8-be6bd85bea28 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129251 Oct 28 10:21:05.620932 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3011/5993] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:21:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:08.106005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1562600512", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21470466-36a9-45e2-955b-c7288f1075a0"}], "security_groups": [{"name": "tempest-securitygroup--23147973"}], "key_name": "tempest-keypair-1303586598", "user_data": "}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:08.345409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] validate_networks() for [('21470466-36a9-45e2-955b-c7288f1075a0', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:21:09.163876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:09.167274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:09.177385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:09.178091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:09.178757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:09.180150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:09.180783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:09.181571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:09.290114 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-392b2a9e-775b-4542-960b-67f4b993ac5d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action" status: 200 len: 24569 microversion: 2.1 time: 0.135876 Oct 28 10:21:09.291030 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3012/5994] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:21:09 2022] POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action => generated 24569 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:21:09.390819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:21:09.391588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:21:09.392244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:21:09.392798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:21:09.393357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:21:09.425873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:09.427204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:09.428085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:09.430241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:09.433004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:09.434320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:09.480297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:21:09.496021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Getting quotas for user b34b183f2b0b4a4597fb2e3b6495268a and project 953dcbea116f45439fa6f2162591e611. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:21:09.522127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:21:09.524894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:21:09.591485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0cfbf73-c46d-4fbb-815d-fcca0f8b8691 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.500471 Oct 28 10:21:09.605081 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2983/5995] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:21:08 2022] POST /compute/v2.1/servers => generated 400 bytes in 1515 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:21:09.617081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80ef7b02-4842-4365-b422-c29297a86bb2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:09.617791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-80ef7b02-4842-4365-b422-c29297a86bb2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:09.773203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-80ef7b02-4842-4365-b422-c29297a86bb2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:09.781586 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-80ef7b02-4842-4365-b422-c29297a86bb2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1242 microversion: 2.1 time: 0.169163 Oct 28 10:21:09.784290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3013/5996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:09 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1242 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:10.164798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:10.165566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:10.175854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:10.176357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:10.176978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:10.177687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:10.201646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:10.201954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:10.365127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lazy-loading 'services' on Instance uuid 0ffcfe60-8da8-4af8-a192-81b087d04134 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:21:10.508463 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a7cb5a9-55be-41fa-a137-78bc50d36888 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134/os-volume_attachments/82dcc0a5-c30d-4e28-8fb1-a32166f6836f" status: 202 len: 0 microversion: 2.1 time: 0.348946 Oct 28 10:21:10.511432 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2984/5997] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:21:10 2022] DELETE /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134/os-volume_attachments/82dcc0a5-c30d-4e28-8fb1-a32166f6836f => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:21:10.822169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:10.823141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:10.832073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:10.833082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:10.835517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:10.836646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:10.837493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:10.838105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:10.992611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:11.011427 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ac8e2575-b775-4d35-90fa-78408d510216 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1294 microversion: 2.1 time: 0.193972 Oct 28 10:21:11.013784 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3014/5998] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:10 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:12.045674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:12.049903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:12.076583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:12.077502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:12.089274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:12.090339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:12.092002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:12.093368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:12.343626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:12.359925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1f508a37-8d1f-42d0-919a-512fa9f18421 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1300 microversion: 2.1 time: 0.324172 Oct 28 10:21:12.375532 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2985/5999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:12 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1300 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:13.387464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:13.388194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:13.400761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:13.405328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:13.405841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:13.406292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:13.407027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:13.416993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:13.417559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:13.708888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:13.720660 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b626597-40f1-48e0-8b84-b20e3a7979b1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1300 microversion: 2.1 time: 0.337161 Oct 28 10:21:13.721601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3015/6000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:13 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1300 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:14.753938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:14.758366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:14.773170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:14.773691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:14.774145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:14.774882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:14.775513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:14.775961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:14.949009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:14.957705 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6f843f1-28af-4035-93ec-03f7b091ed88 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1300 microversion: 2.1 time: 0.207817 Oct 28 10:21:14.958531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2986/6001] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:14 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1300 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:15.983461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:15.984191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:16.004280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:16.008536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:16.009044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:16.010106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:16.010764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:16.011373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:16.506563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:16.524403 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01ac05b5-3947-486d-919b-24875072466b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.544587 Oct 28 10:21:16.530978 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3016/6002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:15 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:17.556053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:17.557234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:17.573355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:17.589608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:17.590738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:17.591759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:17.594383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:17.596232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:17.614138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:17.811103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:17.853976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57762f5f-3381-4186-94c7-4e4d9fa31d44 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.272373 Oct 28 10:21:17.856770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2987/6003] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:17 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:18.311966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-2008c63f-9a37-4988-9e5d-79c9d8cc2251 req-38f8ec31-8fb2-4274-bd8b-493678b3692e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41aa903-73a7-4f37-8229-57346e0da041", "tag": "ef4167c3-8ae7-46fe-bc59-55e954df8f0b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:18.337195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2008c63f-9a37-4988-9e5d-79c9d8cc2251 req-38f8ec31-8fb2-4274-bd8b-493678b3692e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:18.337651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2008c63f-9a37-4988-9e5d-79c9d8cc2251 req-38f8ec31-8fb2-4274-bd8b-493678b3692e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:18.338090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2008c63f-9a37-4988-9e5d-79c9d8cc2251 req-38f8ec31-8fb2-4274-bd8b-493678b3692e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:18.367319 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-2008c63f-9a37-4988-9e5d-79c9d8cc2251 req-38f8ec31-8fb2-4274-bd8b-493678b3692e service nova] Creating event network-changed:ef4167c3-8ae7-46fe-bc59-55e954df8f0b for instance c41aa903-73a7-4f37-8229-57346e0da041 on n-h2-zed-1 Oct 28 10:21:18.378813 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-2008c63f-9a37-4988-9e5d-79c9d8cc2251 req-38f8ec31-8fb2-4274-bd8b-493678b3692e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072383 Oct 28 10:21:18.380241 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3017/6004] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:18.426091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:18.426866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:18.435358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:18.436111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:18.436772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:18.437773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:18.438451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:18.439101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:18.485292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:21:18.643514 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc7e1143-54f6-42d3-a456-a99e55afeaf0 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 204 len: 0 microversion: 2.1 time: 0.222094 Oct 28 10:21:18.645318 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2988/6005] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:21:18 2022] DELETE /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:21:18.656514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:18.657844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:18.668407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:18.669551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:18.670487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:18.671654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:18.672638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:18.673336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:18.840090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:18.852683 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f9c2c59-0c14-4280-94ca-5151f6a861c5 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1515 microversion: 2.1 time: 0.201944 Oct 28 10:21:18.853805 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3018/6006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:18 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1515 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:18.878389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:18.879391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:18.889123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:18.890343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:18.891330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:18.892646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:18.893712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:18.894304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:19.456789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:19.517774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:19.520618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:19.534498 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1fa77b6f-3a6f-4d3a-8647-f73d8cff4829 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.660034 Oct 28 10:21:19.536070 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2989/6007] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:18 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:19.880637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:19.884706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:19.898560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:19.908380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:19.910427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:19.911606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:19.914238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:19.915646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:19.919568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:19.976690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:20.014780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:20.016039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:20.029959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:20.033101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:20.037409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:20.039025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:20.043364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:20.043821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:20.565513 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8cc35e3c-c74b-447e-aa51-0432e4dbfd54 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1828 microversion: 2.1 time: 0.554431 Oct 28 10:21:20.568563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2990/6008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:20 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1828 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:20.581582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:20.590270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:20.607307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:20.607736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:20.608182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:20.608927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:20.609387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:20.609822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:21.090871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:21.105608 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d6ba2d2-5ee3-4349-ba89-881e9a8867bc tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.529672 Oct 28 10:21:21.106853 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2991/6009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:20 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:21.123027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:21.124098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:21.132128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:21.133207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:21.134000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:21.135140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:21.135714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:21.136400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:21.282878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:21.296185 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-337e8d4e-ebb0-4040-8bca-7b3d49975c45 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1515 microversion: 2.1 time: 1.417299 Oct 28 10:21:21.297364 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3019/6010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:19 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1515 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:21.488979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:21.504496 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ccc81d40-a516-4c5e-9546-062fcc1e6d74 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1683 microversion: 2.1 time: 0.396261 Oct 28 10:21:21.507524 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2992/6011] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:21 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1683 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:21.699699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:21.702444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:21.715469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:21.716202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:21.716868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:21.717744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:21.720164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:21.720807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:21.832112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a91e5a29-8c24-444a-b544-0e66c28ed5e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action" status: 200 len: 32644 microversion: 2.1 time: 0.143063 Oct 28 10:21:21.833688 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3020/6012] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:21:21 2022] POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action => generated 32644 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:21:21.979312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:21.979910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:21.993788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:21.994622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:21.995084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:21.995806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:21.996459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:21.997092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.136648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:22.137590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:22.142679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9af7e368832b4ccfa10ac8539b8723ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66ba8a4e3c8436aae7b71a9d9266255', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:22.144411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] flavor_id is None. Assuming migration. {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 10:21:22.145061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:21:22.153960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:22.154490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:22.155463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.156038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:22.156511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:22.156962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.649844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:22.679985 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-788a2ed1-a1ba-415b-8019-48c00e03925c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.538493 Oct 28 10:21:22.700744 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3021/6013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:22 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:22.712609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-795e19a5-1dc2-4b8d-ab0e-862cf12ea7dd req-ec67de4f-0a77-432b-a38b-fefcf40b8796 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ffcfe60-8da8-4af8-a192-81b087d04134", "name": "network-vif-deleted", "tag": "62f0460f-920b-4f25-aa74-22315aae0fbf"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:22.730559 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-93ff7fcf-0d6c-49b8-b609-2be330de695d tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action" status: 202 len: 0 microversion: 2.1 time: 0.756005 Oct 28 10:21:22.737099 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2993/6014] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:21:21 2022] POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action => generated 0 bytes in 763 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:21:22.743028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:22.745440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:22.759123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:22.760536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:22.761516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.764194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:22.764804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:22.765340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.776266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-795e19a5-1dc2-4b8d-ab0e-862cf12ea7dd req-ec67de4f-0a77-432b-a38b-fefcf40b8796 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:22.787426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-795e19a5-1dc2-4b8d-ab0e-862cf12ea7dd req-ec67de4f-0a77-432b-a38b-fefcf40b8796 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:22.789289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-795e19a5-1dc2-4b8d-ab0e-862cf12ea7dd req-ec67de4f-0a77-432b-a38b-fefcf40b8796 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.813093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-795e19a5-1dc2-4b8d-ab0e-862cf12ea7dd req-ec67de4f-0a77-432b-a38b-fefcf40b8796 service nova] Creating event network-vif-deleted:62f0460f-920b-4f25-aa74-22315aae0fbf for instance 0ffcfe60-8da8-4af8-a192-81b087d04134 on n-h2-zed-1 Oct 28 10:21:22.820371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-795e19a5-1dc2-4b8d-ab0e-862cf12ea7dd req-ec67de4f-0a77-432b-a38b-fefcf40b8796 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117532 Oct 28 10:21:22.821694 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3022/6015] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:22.827776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:22.828712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:22.836798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:22.837782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:22.838427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.839626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:22.840301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:22.841063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:22.949821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:22.965102 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ce11308-618a-49f0-af7e-cdf5457c8802 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1473 microversion: 2.1 time: 0.226472 Oct 28 10:21:22.969372 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2994/6016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:22 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:23.254346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Calling method '.version_select at 0x7fca325e68b0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:23.256612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:23.258138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:23.258662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:23.278801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:23.279406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:23.279961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:23.295107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:23.295692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:23.296653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:23.307879 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c4fdd4e4-a519-47a8-a286-9f3287e13de4 tempest-PortsAdminExtendedAttrsTestJSON-1248598815 tempest-PortsAdminExtendedAttrsTestJSON-1248598815-project-admin] 10.222.0.16 "GET /compute/v2.1/os-hypervisors" status: 200 len: 185 microversion: 2.1 time: 0.233851 Oct 28 10:21:23.316578 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2995/6017] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:21:23 2022] GET /compute/v2.1/os-hypervisors => generated 185 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:23.316838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:23.335673 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2f2b3784-01ee-4a9a-a7d9-23cf43ac0b27 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1692 microversion: 2.1 time: 0.509706 Oct 28 10:21:23.349103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3023/6018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:22 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1692 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:23.711291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:23.712145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:23.723213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:23.723905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:23.726647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:23.733102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:23.733780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:23.734949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:23.991897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:23.992609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:24.004720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:24.005380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:24.006072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:24.006945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:24.016931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:24.017958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:24.147100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:24.162503 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a605bc48-62a8-4815-91a8-b5597989c5d6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 200 len: 1473 microversion: 2.1 time: 0.174544 Oct 28 10:21:24.165600 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3024/6019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:23 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:24.362407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:24.363465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:24.393958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:24.396564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:24.398029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:24.402324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:24.404194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:24.406968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:24.496037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:24.509477 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fa9d9d0c-7a0f-4297-ade3-d4261a296e08 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.801625 Oct 28 10:21:24.511366 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2996/6020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:23 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:24.942569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:24.955358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f67ddbd8-72d5-4de3-8034-0149e895002a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1692 microversion: 2.1 time: 0.598757 Oct 28 10:21:24.960809 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3025/6021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:24 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1692 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:25.190030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:25.190871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: 0ffcfe60-8da8-4af8-a192-81b087d04134] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:25.217966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:25.219227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:25.220675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:25.223753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:25.224752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:25.226629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:25.262448 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] HTTP exception thrown: Instance 0ffcfe60-8da8-4af8-a192-81b087d04134 could not be found. Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Request method failure captured: Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 HTTP/1.1 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6xN3tXJZxNa2JRNga1zrurJxMeptzpNCzYSGoFRauQkVs9Tk9WEv4EVG1lqPiqV02h6cvSveqfGwnH0idNudFZLeD5dWodG2NQfZD_8I0AOjV3C25k0o7imfYvRxU7aCde8hkyK8l_SvsL-uw4zG1Gra6rNdBprzym30_KteNMXfSU Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: e901c15dac8e49e5b0e0ead18d6cd6b5 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1052637199 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e901c15dac8e49e5b0e0ead18d6cd6b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e901c15dac8e49e5b0e0ead18d6cd6b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e901c15dac8e49e5b0e0ead18d6cd6b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e901c15dac8e49e5b0e0ead18d6cd6b5"}]}] Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-VolumesSnapshotTestJSON-1052637199 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: e901c15dac8e49e5b0e0ead18d6cd6b5 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1052637199 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-VolumesSnapshotTestJSON-1052637199-project Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 839e2104bc0d4b1fb55d69966eedd998 Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-VolumesSnapshotTestJSON-1052637199-project Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0ffcfe60-8da8-4af8-a192-81b087d04134 could not be found. Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0ffcfe60-8da8-4af8-a192-81b087d04134'} Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ffcfe60-8da8-4af8-a192-81b087d04134 could not be found. Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ffcfe60-8da8-4af8-a192-81b087d04134 could not be found. Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:21:25.265579 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:21:25.270035 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:21:25.270035 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:21:25.270035 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:21:25.270035 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:21:25.270035 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:21:25.270035 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ffcfe60-8da8-4af8-a192-81b087d04134 could not be found. Oct 28 10:21:25.270035 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:21:25.271753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Returning 404 to user: Instance 0ffcfe60-8da8-4af8-a192-81b087d04134 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:21:25.273485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4edab82f-70c3-4f0e-b674-49fdd8924c66 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134" status: 404 len: 111 microversion: 2.1 time: 0.087628 Oct 28 10:21:25.275346 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2997/6022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:25 2022] GET /compute/v2.1/servers/0ffcfe60-8da8-4af8-a192-81b087d04134 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:21:25.539681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:25.541221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:25.548383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:25.549309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:25.550120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:25.551915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:25.552649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:25.553500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:25.986521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:25.987760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:25.989259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:25.997573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:26.001784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:26.002703 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9c8374b-0dff-40c2-aff4-e59c36a388c9 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.470590 Oct 28 10:21:26.004059 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3026/6023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:25 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:26.009351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:26.010228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:26.010726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:26.011183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:26.612657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:26.625130 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d7680af-92df-485c-9c7a-7e81759b9c93 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1692 microversion: 2.1 time: 0.643068 Oct 28 10:21:26.639034 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2998/6024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:25 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1692 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:27.030461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:27.031277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:27.043470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:27.045468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:27.048396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:27.049669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:27.050806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:27.054796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:27.447412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:27.475045 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bc6e8645-e282-4bd6-9a7d-f05d4825054a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.450868 Oct 28 10:21:27.517316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3027/6025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:27 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:27.655182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:27.656350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:27.668112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:27.669088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:27.669594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:27.670842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:27.671657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:27.672118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:28.081712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:28.094041 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec8d2e48-37e9-478c-a48f-08c3f23b8872 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1692 microversion: 2.1 time: 0.444451 Oct 28 10:21:28.114299 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 2999/6026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:27 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1692 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:28.302400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ec975f96-0a49-41f6-8d7a-1071bd35afe4 req-804aeb10-a64b-4355-a7b7-d1cfdef4e172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41aa903-73a7-4f37-8229-57346e0da041", "name": "network-vif-plugged", "status": "completed", "tag": "ef4167c3-8ae7-46fe-bc59-55e954df8f0b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:28.323126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec975f96-0a49-41f6-8d7a-1071bd35afe4 req-804aeb10-a64b-4355-a7b7-d1cfdef4e172 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:28.323789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec975f96-0a49-41f6-8d7a-1071bd35afe4 req-804aeb10-a64b-4355-a7b7-d1cfdef4e172 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:28.324243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec975f96-0a49-41f6-8d7a-1071bd35afe4 req-804aeb10-a64b-4355-a7b7-d1cfdef4e172 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:28.351822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ec975f96-0a49-41f6-8d7a-1071bd35afe4 req-804aeb10-a64b-4355-a7b7-d1cfdef4e172 service nova] Creating event network-vif-plugged:ef4167c3-8ae7-46fe-bc59-55e954df8f0b for instance c41aa903-73a7-4f37-8229-57346e0da041 on n-h2-zed-1 Oct 28 10:21:28.363216 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ec975f96-0a49-41f6-8d7a-1071bd35afe4 req-804aeb10-a64b-4355-a7b7-d1cfdef4e172 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.224907 Oct 28 10:21:28.364579 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3028/6027] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:28.501914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:28.502874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:28.505031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:28.512472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:28.513621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:28.514143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:28.514931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:28.515457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:28.516270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:28.914703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:28.934497 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29ecdeea-b6b2-40e8-9385-3e3ac39e43c5 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.436393 Oct 28 10:21:28.951586 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3000/6028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:28 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:29.122746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:29.123658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:29.139668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.140168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.140613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:29.141531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.141988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.142464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:29.494707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:29.510865 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9ca3970-4473-49b5-a80a-7f87f77d8623 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.386907 Oct 28 10:21:29.529085 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3029/6029] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:29 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:29.684942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:29.687981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:29.697396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.698386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.699089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:29.699979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.700556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.701228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:29.718420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:29.830814 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6dc37ff-6723-4fe7-bdaf-90c1c1db7f11 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.324156 Oct 28 10:21:29.835911 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3001/6030] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:21:29 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:21:29.842969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:29.843582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:29.850110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.851402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.852087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:29.852999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.853735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.854176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:29.958392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:29.961064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:29.977858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.984758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.985544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:29.986867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:29.987579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:29.988028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:30.415011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:30.428422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f66318b3-5f32-43e0-bd80-2a65f488871c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1366 microversion: 2.1 time: 0.473968 Oct 28 10:21:30.443038 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3002/6031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:29 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:30.540270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:30.542228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:30.562446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:30.563411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:30.564968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:30.566443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:30.567255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:30.569826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:30.578201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:30.590573 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b37e8f98-007d-4d28-97b6-07b6e42d025a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1669 microversion: 2.1 time: 0.751110 Oct 28 10:21:30.591361 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3030/6032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:29 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1669 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:30.969441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:30.980083 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b04b61cc-cd06-47e4-b2b3-f84ea84a207e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.448109 Oct 28 10:21:30.980935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3003/6033] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:30 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:31.455490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:31.456534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:31.464193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:31.464686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:31.465161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:31.465892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:31.466365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:31.466952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:31.618447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:31.619280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:31.630833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:31.631347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:31.632337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:31.633102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:31.633553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:31.633996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:31.682406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:31.694675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0a1d189-9d47-4f99-934d-0b9a8dab94f6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1557 microversion: 2.1 time: 0.242411 Oct 28 10:21:31.697243 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3031/6034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:31 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1557 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:31.718230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:31.719042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:31.725618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:31.726116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:31.726564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:31.727273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:31.727738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:31.728485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:31.817291 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74984f2c-63d2-47de-8d2c-d16a5b614fea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103217 Oct 28 10:21:31.817895 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3032/6035] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:21:31 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:21:32.009576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:32.010592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:32.017160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:32.017806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:32.018336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:32.019281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:32.019953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:32.020622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:32.311215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:32.329819 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-05f34252-f45b-4f53-beee-c5825a935e4c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.324502 Oct 28 10:21:32.350848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3033/6036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:32 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:32.429934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:32.438498 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-156828d6-7d46-4b9d-bb42-ee7923349ced tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1674 microversion: 2.1 time: 0.824053 Oct 28 10:21:32.439595 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3004/6037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:31 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1674 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:33.357205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:33.358054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:33.374826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:33.377974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:33.378547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:33.379552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:33.382403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:33.383494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:33.474020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6944832b-f84d-40cb-b4ab-26e7b786562c req-49b20558-db9a-4787-a439-8b192d2b601c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c41aa903-73a7-4f37-8229-57346e0da041", "tag": "ef4167c3-8ae7-46fe-bc59-55e954df8f0b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:33.505371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6944832b-f84d-40cb-b4ab-26e7b786562c req-49b20558-db9a-4787-a439-8b192d2b601c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:33.506019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6944832b-f84d-40cb-b4ab-26e7b786562c req-49b20558-db9a-4787-a439-8b192d2b601c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:33.507543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6944832b-f84d-40cb-b4ab-26e7b786562c req-49b20558-db9a-4787-a439-8b192d2b601c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:33.538880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6944832b-f84d-40cb-b4ab-26e7b786562c req-49b20558-db9a-4787-a439-8b192d2b601c service nova] Creating event network-changed:ef4167c3-8ae7-46fe-bc59-55e954df8f0b for instance c41aa903-73a7-4f37-8229-57346e0da041 on n-h2-zed-1 Oct 28 10:21:33.551725 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6944832b-f84d-40cb-b4ab-26e7b786562c req-49b20558-db9a-4787-a439-8b192d2b601c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215302 Oct 28 10:21:33.554077 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3034/6038] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:33.572831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:33.574547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:33.603538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:33.606895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:33.611732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:33.614529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:33.615283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:33.616918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:34.062587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:34.073273 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e5e8575b-c51a-49c4-af24-8b8a95059397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.720493 Oct 28 10:21:34.073273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3005/6039] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:33 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:34.431275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:34.457597 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-50533ba8-22ca-4ecf-bc88-3dcdf44a807c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.899428 Oct 28 10:21:34.462289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3035/6040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:33 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:35.103961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:35.104581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:35.130550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:35.134110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:35.134341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:35.135303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:35.136091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:35.136696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:35.455802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:35.488004 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-465f114d-e193-4e55-a825-030fc6b48208 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.388080 Oct 28 10:21:35.493313 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3006/6041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:35 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:35.882641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-100316149", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "a7779092-7f94-4488-a8de-d63f45f86e75"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:35.956624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] validate_networks() for [('a7779092-7f94-4488-a8de-d63f45f86e75', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:21:36.515093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:36.515701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:36.525451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:36.526211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:36.527000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:36.528019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:36.528679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:36.529370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:36.815632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:36.827309 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80315c4e-aef9-404c-816e-17f0fceb421d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.315112 Oct 28 10:21:36.844521 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3007/6042] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:36 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:37.164372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:21:37.169711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:21:37.171638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:21:37.172926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:21:37.174360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:21:37.201154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:37.202043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:37.202742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:37.203746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:37.204832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:37.205697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:37.243054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Getting quotas for project e901c15dac8e49e5b0e0ead18d6cd6b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:21:37.250895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Getting quotas for user 839e2104bc0d4b1fb55d69966eedd998 and project e901c15dac8e49e5b0e0ead18d6cd6b5. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:21:37.269609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:21:37.272714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:21:37.332853 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14730a8f-65d6-470f-b0cd-11fcefc811b7 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454146 Oct 28 10:21:37.335056 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3036/6043] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:21:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:21:37.346445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0320d52-920c-4c62-9406-0ace0e445db2 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:37.347105 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0320d52-920c-4c62-9406-0ace0e445db2 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:37.532807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c0320d52-920c-4c62-9406-0ace0e445db2 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:37.548992 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0320d52-920c-4c62-9406-0ace0e445db2 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1218 microversion: 2.1 time: 0.205116 Oct 28 10:21:37.551462 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3008/6044] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:37 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1218 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:37.852412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:37.853129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:37.863180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:37.866234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:37.866937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:37.868773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:37.870610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:37.872552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:38.321202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:38.333031 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-063c4db1-5d38-4f4c-8566-7d4947ec8c95 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.484977 Oct 28 10:21:38.334298 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3037/6045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:37 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:38.596859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:38.598599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:38.621680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:38.622597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:38.623899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:38.625233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:38.626031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:38.626766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:38.755232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:38.769761 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4b103dd0-9e18-4d46-a7e2-d23e2e646ede tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1270 microversion: 2.1 time: 0.193972 Oct 28 10:21:38.770930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3009/6046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:38 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1270 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:39.361556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:39.362472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:39.375742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:39.376465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:39.377472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:39.378326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:39.379214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:39.379754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:39.731504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:39.745755 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-697b28bc-03db-4597-bcac-9748ed7af357 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1697 microversion: 2.1 time: 0.387661 Oct 28 10:21:39.747066 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3038/6047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:39 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1697 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:39.799577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:39.800337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:39.823990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:39.823990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:39.824424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:39.827321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:39.828781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:39.832502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:39.930622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:39.939475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6d3ca13-7207-40d3-a0ed-b086935c2f1b tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1270 microversion: 2.1 time: 0.148352 Oct 28 10:21:39.941337 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3010/6048] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:39 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:40.773838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:40.775085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:40.783691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:40.786001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:40.788352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:40.792683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:40.795124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:40.797244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:40.845402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:40.968099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:40.969318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:40.984831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:40.989374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:40.991416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:40.992428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:40.997063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:40.999435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:41.185115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:41.198121 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c268cbab-014e-428b-ad73-616c33485471 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1276 microversion: 2.1 time: 0.235363 Oct 28 10:21:41.200946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3011/6049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:40 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1276 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:41.253977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:41.289516 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1daef2f0-5fae-47b3-8fe9-4a37670c6005 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1696 microversion: 2.1 time: 0.519340 Oct 28 10:21:41.292394 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3039/6050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:40 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1696 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:41.944749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-797bbdf8-2b7b-420e-8719-c9335424af80 req-9e7286c6-0f6d-49f2-aae0-6a0d86eab103 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "name": "network-vif-unplugged", "status": "completed", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:41.967873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-797bbdf8-2b7b-420e-8719-c9335424af80 req-9e7286c6-0f6d-49f2-aae0-6a0d86eab103 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:41.968841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-797bbdf8-2b7b-420e-8719-c9335424af80 req-9e7286c6-0f6d-49f2-aae0-6a0d86eab103 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:41.970562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-797bbdf8-2b7b-420e-8719-c9335424af80 req-9e7286c6-0f6d-49f2-aae0-6a0d86eab103 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:41.998003 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-797bbdf8-2b7b-420e-8719-c9335424af80 req-9e7286c6-0f6d-49f2-aae0-6a0d86eab103 service nova] Creating event network-vif-unplugged:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h2-zed-1 Oct 28 10:21:42.040314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-797bbdf8-2b7b-420e-8719-c9335424af80 req-9e7286c6-0f6d-49f2-aae0-6a0d86eab103 service nova] Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:21:42.052801 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-797bbdf8-2b7b-420e-8719-c9335424af80 req-9e7286c6-0f6d-49f2-aae0-6a0d86eab103 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117796 Oct 28 10:21:42.054182 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3012/6051] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:42.222888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:42.224835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:42.238317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:42.239095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:42.239757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:42.244656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:42.246709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:42.249240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:42.321500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:42.322620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:42.329968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:42.330877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:42.331682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:42.332627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:42.333479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:42.334075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:42.446806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:42.489943 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d88d7450-47de-44f7-abb2-1b288d349a6a tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1276 microversion: 2.1 time: 0.270004 Oct 28 10:21:42.494182 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3040/6052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:42 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:42.933104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:42.957191 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6d85647-103f-4b14-9a9b-82afce07c2b4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1696 microversion: 2.1 time: 0.639107 Oct 28 10:21:42.972450 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3013/6053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:42 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1696 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:43.518810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:43.519448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:43.530135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:43.535796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:43.536314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:43.536762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:43.540462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:43.542535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:43.543170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:43.955301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:43.980803 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-837bfd1f-faee-4828-a386-db94ab1a5d38 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1318 microversion: 2.1 time: 0.463776 Oct 28 10:21:43.982512 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3041/6054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:43 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1318 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:43.996585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:44.001463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:44.015968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:44.016836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:44.018717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:44.021341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:44.022866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:44.025241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:44.211616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f472a85b-a1b5-4cb4-904d-d13b27a79cf3 req-ccc4207c-e11d-4752-a0c9-389ecf5f24db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:44.237403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f472a85b-a1b5-4cb4-904d-d13b27a79cf3 req-ccc4207c-e11d-4752-a0c9-389ecf5f24db service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:44.238002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f472a85b-a1b5-4cb4-904d-d13b27a79cf3 req-ccc4207c-e11d-4752-a0c9-389ecf5f24db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:44.238462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f472a85b-a1b5-4cb4-904d-d13b27a79cf3 req-ccc4207c-e11d-4752-a0c9-389ecf5f24db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:44.271574 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f472a85b-a1b5-4cb4-904d-d13b27a79cf3 req-ccc4207c-e11d-4752-a0c9-389ecf5f24db service nova] Creating event network-changed:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h2-zed-1 Oct 28 10:21:44.291121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-f472a85b-a1b5-4cb4-904d-d13b27a79cf3 req-ccc4207c-e11d-4752-a0c9-389ecf5f24db service nova] Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:21:44.314253 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f472a85b-a1b5-4cb4-904d-d13b27a79cf3 req-ccc4207c-e11d-4752-a0c9-389ecf5f24db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110861 Oct 28 10:21:44.315143 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3042/6055] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:44.680102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-af850dc8-db82-4419-9c86-302ba05b9f6a req-adb1bb6e-aa9b-4c09-ab29-857a176b28dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f48b77f2-a384-4068-936a-6b8673d53323", "tag": "bb4a1231-ee0a-454e-8790-cc703eee672f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:44.699303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-af850dc8-db82-4419-9c86-302ba05b9f6a req-adb1bb6e-aa9b-4c09-ab29-857a176b28dc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:44.700805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-af850dc8-db82-4419-9c86-302ba05b9f6a req-adb1bb6e-aa9b-4c09-ab29-857a176b28dc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:44.701659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-af850dc8-db82-4419-9c86-302ba05b9f6a req-adb1bb6e-aa9b-4c09-ab29-857a176b28dc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:44.732938 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-af850dc8-db82-4419-9c86-302ba05b9f6a req-adb1bb6e-aa9b-4c09-ab29-857a176b28dc service nova] Creating event network-changed:bb4a1231-ee0a-454e-8790-cc703eee672f for instance f48b77f2-a384-4068-936a-6b8673d53323 on n-h1-zed-1 Oct 28 10:21:44.739386 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-af850dc8-db82-4419-9c86-302ba05b9f6a req-adb1bb6e-aa9b-4c09-ab29-857a176b28dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069634 Oct 28 10:21:44.740407 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3043/6056] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:21:44.865676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:44.877228 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-84ed94a8-d843-4dc0-b20a-63e66339c4d6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1696 microversion: 2.1 time: 0.897589 Oct 28 10:21:44.879812 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3014/6057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:43 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1696 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:45.010161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:45.011885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:45.027977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:45.030775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:45.031972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:45.041144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:45.042595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:45.043295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:45.566473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:45.583577 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c315972-c678-4f61-9bf8-9e8a071ee4ee tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1318 microversion: 2.1 time: 0.574654 Oct 28 10:21:45.584496 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3044/6058] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:45 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1318 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:45.905941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:45.906564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:45.920475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:45.921283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:45.921725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:45.924423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:45.924945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:45.925370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:46.411541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:46.447548 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce44259c-3b55-4ed4-be43-5ec6f077e60e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1694 microversion: 2.1 time: 0.546378 Oct 28 10:21:46.449879 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3015/6059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:45 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1694 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:46.611327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:46.613260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:46.620255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:46.621082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:46.621721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:46.623478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:46.623988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:46.625259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:47.158573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:47.173188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6893367a-89bf-4d7f-87fb-88539982b53e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1318 microversion: 2.1 time: 0.568717 Oct 28 10:21:47.185892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3045/6060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:46 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:47.472664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:47.473916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:47.483125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:47.483898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:47.484514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:47.485438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:47.486062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:47.486685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:47.545454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:47.942657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:47.953010 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5cfe3d6-7404-4f9b-942a-3fb18f6fe772 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1694 microversion: 2.1 time: 0.484025 Oct 28 10:21:47.954855 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3016/6061] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:47 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1694 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:48.198744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:48.199472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:48.202152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:48.203051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:48.228149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:48.228632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:48.229111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:48.230004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:48.230624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:48.231204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:48.831944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:48.843471 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cacfde95-0702-4be4-a83b-18beafe247da tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1318 microversion: 2.1 time: 0.648936 Oct 28 10:21:48.844566 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3046/6062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:48 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1318 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:48.983088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:48.984287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:48.992329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:48.993093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:48.993545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:48.994255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:48.994713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:48.995145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:49.477497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:49.487283 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed55a6db-fff9-4770-920b-3e474bd9cb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1691 microversion: 2.1 time: 0.509457 Oct 28 10:21:49.487910 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3017/6063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:48 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1691 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:49.513686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:49.514531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:49.521483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:49.522048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:49.522551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:49.523314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:49.523841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:49.524344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:49.621262 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-821d64ac-5d4b-456c-ae2c-6674128ba0e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action" status: 204 len: 0 microversion: 2.1 time: 0.109693 Oct 28 10:21:49.625340 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3047/6064] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:21:49 2022] POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:21:49.635241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:49.635717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:49.646527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:49.647199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:49.647745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:49.648592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:49.649334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:49.649867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:49.663217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:21:49.874216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:49.875481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:49.887963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:49.889423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:49.890105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:49.893603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:49.895241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:49.895913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:50.270184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:50.283936 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-feb70469-8973-4dc2-8cf0-d4ace3f3355c tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1318 microversion: 2.1 time: 0.415590 Oct 28 10:21:50.302464 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3048/6065] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:49 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1318 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:50.326492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:50.337179 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a51a1556-3dcc-49b7-bf19-7442fc735e29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1691 microversion: 2.1 time: 0.707559 Oct 28 10:21:50.348961 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3018/6066] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:49 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1691 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:21:50.409574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e0fe0ecb-17e2-45c3-8468-e0d4623e5643 req-9cce67ac-c023-4609-858b-0bd5c12c1b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48b77f2-a384-4068-936a-6b8673d53323", "name": "network-vif-plugged", "status": "completed", "tag": "bb4a1231-ee0a-454e-8790-cc703eee672f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:50.420451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e0fe0ecb-17e2-45c3-8468-e0d4623e5643 req-9cce67ac-c023-4609-858b-0bd5c12c1b44 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:50.420984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e0fe0ecb-17e2-45c3-8468-e0d4623e5643 req-9cce67ac-c023-4609-858b-0bd5c12c1b44 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:50.421508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e0fe0ecb-17e2-45c3-8468-e0d4623e5643 req-9cce67ac-c023-4609-858b-0bd5c12c1b44 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:50.436016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e0fe0ecb-17e2-45c3-8468-e0d4623e5643 req-9cce67ac-c023-4609-858b-0bd5c12c1b44 service nova] Creating event network-vif-plugged:bb4a1231-ee0a-454e-8790-cc703eee672f for instance f48b77f2-a384-4068-936a-6b8673d53323 on n-h1-zed-1 Oct 28 10:21:50.441642 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e0fe0ecb-17e2-45c3-8468-e0d4623e5643 req-9cce67ac-c023-4609-858b-0bd5c12c1b44 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035733 Oct 28 10:21:50.442849 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3049/6067] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:51.312957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:51.314103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:51.331709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:51.335195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:51.335836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:51.337647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:51.340283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:51.341013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:51.366687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:51.367635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:51.388522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:51.389346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:51.389980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:51.390884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:51.392757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:51.394474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:51.694913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:51.703429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-21bb4a4a-6065-4274-ab01-6e133ab59f74 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1318 microversion: 2.1 time: 0.395172 Oct 28 10:21:51.707385 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3019/6068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:51 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:51.843996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:51.859551 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-30e96d9a-e427-4f0b-838b-f145499c9f34 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1691 microversion: 2.1 time: 0.497200 Oct 28 10:21:51.874357 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3050/6069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:51 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1691 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:52.735452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:52.736213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:52.752957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:52.753786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:52.754417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:52.755341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:52.756069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:52.756743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:52.890915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:21:52.894774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:52.934771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:52.935234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:52.935948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:52.936681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:52.937188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:52.937652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:53.176132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:53.195987 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37ade384-b22c-41a1-bafe-c8d0d8c05349 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1508 microversion: 2.1 time: 0.465483 Oct 28 10:21:53.197299 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3020/6070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:52 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1508 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:53.202560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ebaafa32-a829-4cd1-95d0-8081f162f797 req-a4cad6f0-9636-446a-9c31-595b753fb28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "name": "network-vif-plugged", "status": "completed", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:53.220960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ebaafa32-a829-4cd1-95d0-8081f162f797 req-a4cad6f0-9636-446a-9c31-595b753fb28b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:53.221524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ebaafa32-a829-4cd1-95d0-8081f162f797 req-a4cad6f0-9636-446a-9c31-595b753fb28b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:53.221967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ebaafa32-a829-4cd1-95d0-8081f162f797 req-a4cad6f0-9636-446a-9c31-595b753fb28b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:53.240188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ebaafa32-a829-4cd1-95d0-8081f162f797 req-a4cad6f0-9636-446a-9c31-595b753fb28b service nova] Creating event network-vif-plugged:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h2-zed-1 Oct 28 10:21:53.247882 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ebaafa32-a829-4cd1-95d0-8081f162f797 req-a4cad6f0-9636-446a-9c31-595b753fb28b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048833 Oct 28 10:21:53.249788 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3021/6071] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:21:53.260201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dda0773c-c47f-4446-9b7f-8236dc18c867", "device": "/dev/sdb"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:21:53.263601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:21:53.294521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:53.295121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:53.295655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:53.296453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:21:53.297197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:21:53.297802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:21:53.387468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:21:53.398657 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-053ef151-b154-4ab1-9307-aeff6fcfb9bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1683 microversion: 2.1 time: 0.512190 Oct 28 10:21:53.402561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3051/6072] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:21:52 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1683 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:21:53.827255 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e8e247ad-c14a-42c5-953b-4d50cf2395e6 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "POST /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.574513 Oct 28 10:21:53.829312 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3022/6073] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:21:53 2022] POST /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323/os-volume_attachments => generated 194 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:06.765422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:06.766044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:06.779208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=21 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:06.780322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:06.782525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:06.783091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:06.783600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:06.792143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:06.792650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:06.793307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:07.162308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:07.176394 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce27aa89-2771-4ec9-8e3a-5862c1be669b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.415380 Oct 28 10:22:07.177722 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3052/6074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:06 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:07.208128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:07.210030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:07.223008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=47 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:07.225943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:07.234674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:07.242101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:07.242929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:07.243883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:07.244832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:07.245513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:07.922792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:07.934407 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81f5b486-3a82-4ad2-8d83-32186b28ecbf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.730832 Oct 28 10:22:07.935740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3023/6075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:07 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:07.960353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:07.961027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:07.978586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:07.979103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:07.987548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:07.988331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:07.988823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:07.989928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:08.247150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:08.276396 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fda3858f-d678-4dc3-a3ee-d424d1140582 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.321590 Oct 28 10:22:08.278784 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3053/6076] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:07 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:08.301420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:08.303177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:08.311812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:08.312592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:08.313422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:08.315450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:08.316162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:08.317286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:08.634514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:08.654832 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23375adb-37a0-4d7f-85fb-0230560849b3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.357039 Oct 28 10:22:08.656359 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3024/6077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:08 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:08.845161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1852947168", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "211d510d-dd8f-46be-8306-141acae1af62"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:09.002770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] validate_networks() for [('211d510d-dd8f-46be-8306-141acae1af62', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:22:10.333041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:22:10.333592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:22:10.334065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:22:10.334484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:22:10.334910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:22:10.370506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:10.381485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:10.383158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:10.389341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:10.390911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:10.391699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:10.438765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:22:10.447309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for user 1b327af221c94695bc5b82fa49e3c448 and project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:22:10.464154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:22:10.467329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:22:10.524806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c90ae7b-1cc8-44e6-9a3c-d0ed7086b68e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.703615 Oct 28 10:22:10.534161 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3054/6078] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:22:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:22:10.539459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-68f68321-8fe3-4e4e-ab60-536650bb850f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:10.540280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-68f68321-8fe3-4e4e-ab60-536650bb850f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:10.654371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68f68321-8fe3-4e4e-ab60-536650bb850f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:10.664886 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-68f68321-8fe3-4e4e-ab60-536650bb850f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1215 microversion: 2.1 time: 0.131083 Oct 28 10:22:10.670072 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3025/6079] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:10 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:22:11.718544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:11.719588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:11.770244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:11.785177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:11.794239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:11.811712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:11.815533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:11.819324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:12.062279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:12.071728 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7a6901b-9bc4-4773-98e2-dd66c74f064a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1219 microversion: 2.1 time: 0.377275 Oct 28 10:22:12.077798 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3055/6080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:11 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1219 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:13.104855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:13.107538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:13.127057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:13.128507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:13.129428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:13.130464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:13.133269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:13.134565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:13.313885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:13.330423 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e80e0047-2dee-4bb4-a05c-6b489e4cdb93 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1273 microversion: 2.1 time: 0.232244 Oct 28 10:22:13.331396 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3026/6081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:13 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1273 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:22:14.358298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:14.359668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:14.368730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:14.369886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:14.370511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:14.371390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:14.371997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:14.373377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:14.445507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:14.459590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0ffdc524-ae1c-401a-aa1d-fd593e1948c1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1273 microversion: 2.1 time: 0.104375 Oct 28 10:22:14.460773 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3056/6082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:14 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:15.483902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:15.486308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:15.503486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:15.504855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:15.506458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:15.507469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:15.508145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:15.509048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:15.910662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:15.925670 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e5023aa-9178-4d2b-9bb8-3aea2c054b35 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.444653 Oct 28 10:22:15.937553 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3027/6083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:15 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:16.952382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:16.953913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:16.962359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:16.962851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:16.963457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:16.964200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:16.964657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:16.965362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:17.200930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-abedf598-0493-4c91-a602-bd716f452d9b req-ba28b115-02b9-4eed-978a-f99f07efddec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1415e64e-7e90-4706-98a5-c6e1edc0d2cf", "tag": "9d64f742-4ca2-4d0a-8f76-615a70d4cde8"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:17.221277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-abedf598-0493-4c91-a602-bd716f452d9b req-ba28b115-02b9-4eed-978a-f99f07efddec service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:17.222068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-abedf598-0493-4c91-a602-bd716f452d9b req-ba28b115-02b9-4eed-978a-f99f07efddec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:17.225392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-abedf598-0493-4c91-a602-bd716f452d9b req-ba28b115-02b9-4eed-978a-f99f07efddec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:17.242410 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-abedf598-0493-4c91-a602-bd716f452d9b req-ba28b115-02b9-4eed-978a-f99f07efddec service nova] Creating event network-changed:9d64f742-4ca2-4d0a-8f76-615a70d4cde8 for instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf on n-h2-zed-1 Oct 28 10:22:17.252892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-abedf598-0493-4c91-a602-bd716f452d9b req-ba28b115-02b9-4eed-978a-f99f07efddec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055719 Oct 28 10:22:17.254346 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3028/6084] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:22:17.457454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:17.484690 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93229c0d-9fc8-4c3e-ae10-84fc6967eeb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.537107 Oct 28 10:22:17.493061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3057/6085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:16 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:18.514396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:18.515817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:18.531714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:18.532224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:18.532653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:18.533391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:18.536504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:18.537656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:18.971919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:18.982614 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-362447b0-58f6-47ce-8d67-37e1ef6fa884 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.478277 Oct 28 10:22:18.997642 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3029/6086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:18 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:20.005329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:20.006514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:20.013466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:20.013928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:20.017888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:20.018791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:20.019423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:20.020022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:20.425653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:20.457915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:20.475427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:20.483686 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dcf8c1dd-63ec-4e5f-af9d-ff769c1ebfc3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.482198 Oct 28 10:22:20.484366 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3058/6087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:20 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:20.577220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:20.578315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:20.585584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:20.586291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:20.586899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:20.587812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:20.588434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:20.589782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:20.663489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:20.690211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lazy-loading 'services' on Instance uuid f48b77f2-a384-4068-936a-6b8673d53323 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:22:20.788891 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b65d022e-45f5-4332-b6ca-1e65cb88ac1e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323/os-volume_attachments/dda0773c-c47f-4446-9b7f-8236dc18c867" status: 202 len: 0 microversion: 2.1 time: 0.215252 Oct 28 10:22:20.789519 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3030/6088] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:22:20 2022] DELETE /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323/os-volume_attachments/dda0773c-c47f-4446-9b7f-8236dc18c867 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:22:21.508701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:21.511486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:21.522858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:21.523912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:21.524589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:21.526283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:21.526978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:21.528234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:21.922983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:21.935202 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d43fad66-6a4d-400d-8c09-8f8b22210333 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.431932 Oct 28 10:22:21.937864 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3059/6089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:21 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:22.963006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:22.964374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:22.977904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:22.980081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:22.980972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:22.983360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:22.985491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:22.986931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:23.338969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:23.354203 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f071394-aeb7-486a-be33-77ff4a89e964 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.396927 Oct 28 10:22:23.355420 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3031/6090] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:22 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:24.277187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:24.281855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:24.292383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:24.293389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:24.295099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:24.296757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:24.297542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:24.298987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:24.402561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:24.403198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:24.410737 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ae146445-0a77-4f18-97bd-6e87827f17c4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action" status: 200 len: 24575 microversion: 2.1 time: 0.139078 Oct 28 10:22:24.417707 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3060/6091] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:22:24 2022] POST /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9/action => generated 24575 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:22:24.417892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:24.417892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:24.417892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:24.425152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:24.425922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:24.436189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:24.719296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:24.733572 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f5262f5-e3a6-4db9-b11b-1536d0db71a4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.351888 Oct 28 10:22:24.735178 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3032/6092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:24 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:25.457784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-98dfb5c3-7bda-436f-8ffc-734b40411dd9 req-3c8cb3bc-9c30-4af2-8d61-9964f46bac0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415e64e-7e90-4706-98a5-c6e1edc0d2cf", "name": "network-vif-plugged", "status": "completed", "tag": "9d64f742-4ca2-4d0a-8f76-615a70d4cde8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:25.478645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-98dfb5c3-7bda-436f-8ffc-734b40411dd9 req-3c8cb3bc-9c30-4af2-8d61-9964f46bac0b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:25.479130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-98dfb5c3-7bda-436f-8ffc-734b40411dd9 req-3c8cb3bc-9c30-4af2-8d61-9964f46bac0b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:25.479566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-98dfb5c3-7bda-436f-8ffc-734b40411dd9 req-3c8cb3bc-9c30-4af2-8d61-9964f46bac0b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:25.508407 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-98dfb5c3-7bda-436f-8ffc-734b40411dd9 req-3c8cb3bc-9c30-4af2-8d61-9964f46bac0b service nova] Creating event network-vif-plugged:9d64f742-4ca2-4d0a-8f76-615a70d4cde8 for instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf on n-h2-zed-1 Oct 28 10:22:25.521947 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-98dfb5c3-7bda-436f-8ffc-734b40411dd9 req-3c8cb3bc-9c30-4af2-8d61-9964f46bac0b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067347 Oct 28 10:22:25.522645 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3061/6093] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:22:25.760278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:25.765319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:25.777194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:25.778885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:25.779526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:25.780696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:25.782860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:25.783577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:25.980311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:25.988757 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b9069d8b-a4e6-49d1-8414-e8746072a79a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.234108 Oct 28 10:22:25.989544 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3033/6094] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:25 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:27.015310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:27.016032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:27.031910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:27.033991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:27.034551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:27.036773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:27.039064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:27.041156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:27.343410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:27.355393 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dad719c2-9023-4b62-bc49-84da340ee0c9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1315 microversion: 2.1 time: 0.344479 Oct 28 10:22:27.358457 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3062/6095] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:27 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:27.883791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:27.886044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:27.912885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:27.914902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:27.915612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:27.917444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:27.919206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:27.919903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:27.975351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:22:28.171636 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7667b471-18b8-48e0-90d6-1558f85a663e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 204 len: 0 microversion: 2.1 time: 0.298143 Oct 28 10:22:28.174251 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3034/6096] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:22:27 2022] DELETE /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:22:28.182985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:28.184704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:28.194300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:28.194947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:28.195566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:28.196408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:28.197022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:28.197631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:28.384656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:28.386699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:28.401948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:28.402620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:28.403203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:28.404038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:28.404620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:28.406153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:28.456211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:28.465131 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb451f75-115e-4658-a211-281643be1b84 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1514 microversion: 2.1 time: 0.286643 Oct 28 10:22:28.466132 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3063/6097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:28 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:28.700725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:28.715033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98ffbc66-c486-4c57-a6a3-c26b513c312f tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1502 microversion: 2.1 time: 0.336684 Oct 28 10:22:28.719734 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3035/6098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:28 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1502 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:28.739357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:28.739940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:28.750069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:28.750568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:28.751014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:28.757215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:28.757711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:28.758158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:29.479301 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.network.security_group_api [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Removing security group 403b1d95-4a98-46aa-a8f9-b786511b77f0 from port 9d64f742-4ca2-4d0a-8f76-615a70d4cde8 Oct 28 10:22:29.491083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:29.491706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:29.506835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:29.507349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:29.507834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:29.508592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:29.509327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:29.509954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:29.772945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:29.784706 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c86ddbad-252b-4a59-86e2-e9c52a3b06f1 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1514 microversion: 2.1 time: 0.298284 Oct 28 10:22:29.786029 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3036/6099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:29 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1514 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:30.486078 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dccbc1ee-511d-47d8-8ec0-4900735a8d58 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf/action" status: 202 len: 0 microversion: 2.1 time: 1.750771 Oct 28 10:22:30.490336 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3064/6100] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:22:28 2022] POST /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf/action => generated 0 bytes in 1752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:22:30.499706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9a8e9559-0dd6-4da9-854f-8d1d01567202 req-7ed56f78-98af-4a14-8d12-f1e6106f0a73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1415e64e-7e90-4706-98a5-c6e1edc0d2cf", "tag": "9d64f742-4ca2-4d0a-8f76-615a70d4cde8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:30.516816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:30.517948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:30.526976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9a8e9559-0dd6-4da9-854f-8d1d01567202 req-7ed56f78-98af-4a14-8d12-f1e6106f0a73 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:30.527468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9a8e9559-0dd6-4da9-854f-8d1d01567202 req-7ed56f78-98af-4a14-8d12-f1e6106f0a73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:30.527907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9a8e9559-0dd6-4da9-854f-8d1d01567202 req-7ed56f78-98af-4a14-8d12-f1e6106f0a73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:30.534737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:30.548264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:30.550137 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9a8e9559-0dd6-4da9-854f-8d1d01567202 req-7ed56f78-98af-4a14-8d12-f1e6106f0a73 service nova] Creating event network-changed:9d64f742-4ca2-4d0a-8f76-615a70d4cde8 for instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf on n-h2-zed-1 Oct 28 10:22:30.550830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:30.556532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:30.559490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:30.560017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:30.561843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9a8e9559-0dd6-4da9-854f-8d1d01567202 req-7ed56f78-98af-4a14-8d12-f1e6106f0a73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066655 Oct 28 10:22:30.562635 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3065/6101] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:30.716197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:30.725459 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5b71a79c-2afc-4a3c-9627-a7fc14b7e7b2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1460 microversion: 2.1 time: 0.232132 Oct 28 10:22:30.729741 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3037/6102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:30 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1460 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:30.753875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:30.754594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:30.762540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:30.763046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:30.763491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:30.764300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:30.764819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:30.765327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:30.814248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:30.815100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:30.825860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:30.826386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:30.826829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:30.827556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:30.828023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:30.828456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:31.095925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:31.100643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:31.118048 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dca97c84-b56a-4906-b26a-7b2c34fb464f tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1514 microversion: 2.1 time: 0.308200 Oct 28 10:22:31.118657 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3038/6103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:30 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:22:31.215038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:31.231414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-77f78800-8261-4bb0-a314-eb6d22aa6786 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.477710 Oct 28 10:22:31.232080 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3066/6104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:30 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:31.268446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:31.269821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:31.292013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:31.293033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:31.293995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:31.295419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:31.296069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:31.297146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:31.643146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:31.654450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12f68bf5-d021-449c-94a6-b85d990d03aa tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.394934 Oct 28 10:22:31.657003 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3039/6105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:31 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:31.681213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:31.681877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:31.701497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:31.702031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:31.702474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:31.706934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:31.707789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:31.708416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:32.059843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:32.081100 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe79f259-28e6-49d3-a072-e2efe568edf0 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.404811 Oct 28 10:22:32.082404 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3067/6106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:31 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:32.108871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:32.109760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:32.117553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:32.118352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:32.118800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:32.119768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:32.120467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:32.121165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:32.147178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:32.148463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:32.168210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:32.169051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:32.169667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:32.170624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:32.173250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:32.173939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:32.251921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:32.252419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:32.252861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:32.253355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lazy-loading 'fault' on Instance uuid f48b77f2-a384-4068-936a-6b8673d53323 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:22:32.324663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '839e2104bc0d4b1fb55d69966eedd998', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e901c15dac8e49e5b0e0ead18d6cd6b5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:32.347327 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f95426f9-086a-402f-aca6-4510fc119c4e tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 200 len: 1308 microversion: 2.1 time: 0.191198 Oct 28 10:22:32.360940 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3068/6107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:32 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 1308 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:32.489452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:32.498436 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a78bc84-732f-4c75-b3c3-35f16deb190d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.393345 Oct 28 10:22:32.499197 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3040/6108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:32 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:32.618728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c3bca314-84da-48c4-8851-7c5883f8cd64 req-12bc8fcf-4134-4167-9fac-0ee4a0fa6019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f48b77f2-a384-4068-936a-6b8673d53323", "name": "network-vif-deleted", "tag": "bb4a1231-ee0a-454e-8790-cc703eee672f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:32.641220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c3bca314-84da-48c4-8851-7c5883f8cd64 req-12bc8fcf-4134-4167-9fac-0ee4a0fa6019 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:32.644816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c3bca314-84da-48c4-8851-7c5883f8cd64 req-12bc8fcf-4134-4167-9fac-0ee4a0fa6019 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:32.645454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c3bca314-84da-48c4-8851-7c5883f8cd64 req-12bc8fcf-4134-4167-9fac-0ee4a0fa6019 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:32.682114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-837255861", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "211d510d-dd8f-46be-8306-141acae1af62"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:32.698916 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c3bca314-84da-48c4-8851-7c5883f8cd64 req-12bc8fcf-4134-4167-9fac-0ee4a0fa6019 service nova] Creating event network-vif-deleted:bb4a1231-ee0a-454e-8790-cc703eee672f for instance f48b77f2-a384-4068-936a-6b8673d53323 on n-h1-zed-1 Oct 28 10:22:32.709491 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c3bca314-84da-48c4-8851-7c5883f8cd64 req-12bc8fcf-4134-4167-9fac-0ee4a0fa6019 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093988 Oct 28 10:22:32.710125 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3069/6109] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:32.780992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] validate_networks() for [('211d510d-dd8f-46be-8306-141acae1af62', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:22:33.391740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:33.393130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] [instance: f48b77f2-a384-4068-936a-6b8673d53323] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:33.415135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:33.421277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:33.421958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:33.424533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:33.426759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:33.430546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:33.472282 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] HTTP exception thrown: Instance f48b77f2-a384-4068-936a-6b8673d53323 could not be found. Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Request method failure captured: Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 HTTP/1.1 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6xN3tXJZxNa2JRNga1zrurJxMeptzpNCzYSGoFRauQkVs9Tk9WEv4EVG1lqPiqV02h6cvSveqfGwnH0idNudFZLeD5dWodG2NQfZD_8I0AOjV3C25k0o7imfYvRxU7aCde8hkyK8l_SvsL-uw4zG1Gra6rNdBprzym30_KteNMXfSU Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: e901c15dac8e49e5b0e0ead18d6cd6b5 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1052637199 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e901c15dac8e49e5b0e0ead18d6cd6b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e901c15dac8e49e5b0e0ead18d6cd6b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e901c15dac8e49e5b0e0ead18d6cd6b5", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e901c15dac8e49e5b0e0ead18d6cd6b5"}]}] Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesSnapshotTestJSON-1052637199 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: e901c15dac8e49e5b0e0ead18d6cd6b5 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1052637199 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesSnapshotTestJSON-1052637199-project Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 839e2104bc0d4b1fb55d69966eedd998 Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesSnapshotTestJSON-1052637199-project Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance f48b77f2-a384-4068-936a-6b8673d53323 could not be found. Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f48b77f2-a384-4068-936a-6b8673d53323'} Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f48b77f2-a384-4068-936a-6b8673d53323 could not be found. Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f48b77f2-a384-4068-936a-6b8673d53323 could not be found. Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:22:33.474141 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:33.478975 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:22:33.478975 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:22:33.478975 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:22:33.478975 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:22:33.478975 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:22:33.478975 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f48b77f2-a384-4068-936a-6b8673d53323 could not be found. Oct 28 10:22:33.478975 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:33.480384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] Returning 404 to user: Instance f48b77f2-a384-4068-936a-6b8673d53323 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:22:33.481477 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1e3fdf1e-ee2a-4c49-be8c-f65c35e73243 tempest-VolumesSnapshotTestJSON-1052637199 tempest-VolumesSnapshotTestJSON-1052637199-project] 10.222.0.16 "GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323" status: 404 len: 111 microversion: 2.1 time: 0.105460 Oct 28 10:22:33.482229 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3070/6110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:33 2022] GET /compute/v2.1/servers/f48b77f2-a384-4068-936a-6b8673d53323 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:22:33.650552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:22:33.651524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:22:33.652198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:22:33.653312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:22:33.653954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:22:33.680204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:33.681524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:33.682724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:33.684644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:33.686923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:33.687324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:33.730841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:22:33.744049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Getting quotas for user 1b327af221c94695bc5b82fa49e3c448 and project 647a75e417314ddbb20364530ad36c54. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:22:33.774907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:22:33.777971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:22:33.861874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a373e60b-c8c5-4754-889e-db2bbf3f701b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185727 Oct 28 10:22:33.868372 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3041/6111] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:22:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:22:33.875991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d620a004-0574-468d-bb7e-de087b5e02d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:33.877610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d620a004-0574-468d-bb7e-de087b5e02d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:34.158687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d620a004-0574-468d-bb7e-de087b5e02d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:34.174299 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d620a004-0574-468d-bb7e-de087b5e02d6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1214 microversion: 2.1 time: 0.302072 Oct 28 10:22:34.175625 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3071/6112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:33 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1214 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:35.203219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:35.203860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:35.216951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:35.217637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:35.218082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:35.218893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:35.219640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:35.220077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:35.335385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:35.360018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d385a075-ba55-4a73-a9db-5583fc9ea09a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1266 microversion: 2.1 time: 0.158563 Oct 28 10:22:35.360946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3042/6113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:35 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:36.385301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:36.386246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:36.403090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:36.406336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:36.407094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:36.410159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:36.410892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:36.413110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:36.619316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:36.629470 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dea001e1-77b9-4d1e-b7d1-18dc45d03cdc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1272 microversion: 2.1 time: 0.249304 Oct 28 10:22:36.633250 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3072/6114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:36 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:37.653934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:37.654756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:37.666146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:37.690638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:37.709507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:37.710128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:37.713399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:37.714123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:37.714704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:38.644063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:38.682920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4a31f44-942f-4d99-be95-cf813e75c5de tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 1.032820 Oct 28 10:22:38.689291 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3043/6115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:37 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:39.712871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:39.713573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:39.730449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:39.732992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:39.734722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:39.735352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:39.737645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:39.738287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:39.738911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:39.749842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:40.227640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:40.239552 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba0d8f51-5803-4b37-9139-c4db3e3fb17a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 0.534166 Oct 28 10:22:40.240961 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3073/6116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:39 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:41.277572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:41.278492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:41.304666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:41.305525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:41.306109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:41.306998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:41.307597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:41.308315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:41.534482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:41.556432 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f659a054-555e-444e-8bdc-6c4911cc28cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 0.295830 Oct 28 10:22:41.572253 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3044/6117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:41 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:42.031176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5bc9c821-c6e3-47c8-a3d9-a84e50dc1519 req-b20180e5-3528-4919-8afe-13ec204190ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "548d1c2c-a136-4d23-af0b-cdb57cfacc2c", "tag": "301ab369-a98f-4ff8-8ce2-5bf7ee64ce12"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:42.066073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5bc9c821-c6e3-47c8-a3d9-a84e50dc1519 req-b20180e5-3528-4919-8afe-13ec204190ed service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:42.072921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5bc9c821-c6e3-47c8-a3d9-a84e50dc1519 req-b20180e5-3528-4919-8afe-13ec204190ed service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:42.073832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5bc9c821-c6e3-47c8-a3d9-a84e50dc1519 req-b20180e5-3528-4919-8afe-13ec204190ed service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:42.108451 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5bc9c821-c6e3-47c8-a3d9-a84e50dc1519 req-b20180e5-3528-4919-8afe-13ec204190ed service nova] Creating event network-changed:301ab369-a98f-4ff8-8ce2-5bf7ee64ce12 for instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c on n-h1-zed-1 Oct 28 10:22:42.129195 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5bc9c821-c6e3-47c8-a3d9-a84e50dc1519 req-b20180e5-3528-4919-8afe-13ec204190ed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099785 Oct 28 10:22:42.134268 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3074/6118] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:42.581684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:42.582373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:42.592571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:42.596735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:42.597461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:42.598599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:42.600009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:42.601418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:43.041823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:43.054321 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f59d2559-c6dc-4c87-bded-7b2786b386cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 0.473834 Oct 28 10:22:43.056005 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3045/6119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:42 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:44.086909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:44.088682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:44.103510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:44.108683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:44.110113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:44.111090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:44.111773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:44.114954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:44.170529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:44.495773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:44.515766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eeddc4dd-284d-4918-ad2f-6f84509c3cfc tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 0.436209 Oct 28 10:22:44.516800 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3075/6120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:44 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:45.546474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:45.549304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:45.554399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:45.562980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:45.586176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:45.591496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:45.592030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:45.592787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:45.593278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:45.593716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:45.990501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:46.001521 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1a910347-bd46-48b0-b40e-91423db56a80 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 0.466772 Oct 28 10:22:46.012380 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3046/6121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:45 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:46.720180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-eca233b7-0ac1-426e-889c-1cb88d3a45d1 req-466bd6ce-29f4-412c-a910-19a4c591a660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548d1c2c-a136-4d23-af0b-cdb57cfacc2c", "name": "network-vif-plugged", "status": "completed", "tag": "301ab369-a98f-4ff8-8ce2-5bf7ee64ce12"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:46.787572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-eca233b7-0ac1-426e-889c-1cb88d3a45d1 req-466bd6ce-29f4-412c-a910-19a4c591a660 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:46.790652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-eca233b7-0ac1-426e-889c-1cb88d3a45d1 req-466bd6ce-29f4-412c-a910-19a4c591a660 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:46.801269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-eca233b7-0ac1-426e-889c-1cb88d3a45d1 req-466bd6ce-29f4-412c-a910-19a4c591a660 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:46.844291 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-eca233b7-0ac1-426e-889c-1cb88d3a45d1 req-466bd6ce-29f4-412c-a910-19a4c591a660 service nova] Creating event network-vif-plugged:301ab369-a98f-4ff8-8ce2-5bf7ee64ce12 for instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c on n-h1-zed-1 Oct 28 10:22:46.878593 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-eca233b7-0ac1-426e-889c-1cb88d3a45d1 req-466bd6ce-29f4-412c-a910-19a4c591a660 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164792 Oct 28 10:22:46.881762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3076/6122] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:47.026483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:47.027103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:47.044756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:47.046588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:47.047049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:47.047785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:47.048260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:47.048700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:47.178352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:47.179529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:47.202305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:47.208177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:47.208510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:47.209369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:47.209854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:47.210294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:47.331210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:47.348510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4465f11-b2ed-489b-96a3-c8f5beee8c5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 0.325234 Oct 28 10:22:47.351561 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3047/6123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:47 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:47.558646 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f7bd1ad9-3ec6-44db-9c49-0d3117b30071 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1828 microversion: 2.1 time: 0.383969 Oct 28 10:22:47.560109 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3077/6124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:47 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1828 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:48.383989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:48.385521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:48.410901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:48.412773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:48.414480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:48.415640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:48.416451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:48.417161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:48.968866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:48.984870 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1b7e1810-b8e5-442e-a15e-03bad6ab1a5b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1314 microversion: 2.1 time: 0.615119 Oct 28 10:22:48.985675 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3048/6125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:48 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:49.168759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:49.170012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:49.179132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:49.180352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:49.181109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:49.182054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:49.182925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:49.184414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:49.243006 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee8e4173-77f5-4780-8955-0c6c1bc8807e tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/ips" status: 200 len: 150 microversion: 2.1 time: 0.086257 Oct 28 10:22:49.246229 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3078/6126] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:22:49 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/ips => generated 150 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:50.021127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:50.022482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:50.052008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:50.053804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:50.056585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:50.059371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:50.060367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:50.062352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:51.293379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:51.293870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:51.325778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:51.331935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:51.336046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:51.341404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:51.343030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:51.346275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:51.454725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:22:51.469362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:51.479375 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10067c7f-54f0-40b4-9b00-a664f2681c1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1500 microversion: 2.1 time: 1.468616 Oct 28 10:22:51.500654 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3049/6127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:50 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1500 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:51.719563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de74a55f-e177-4a0c-9e58-8205bb0bbd67 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 204 len: 0 microversion: 2.1 time: 0.429693 Oct 28 10:22:51.722456 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3079/6128] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:22:51 2022] DELETE /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:22:51.753327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:51.754048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:51.768536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:51.769063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:51.769774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:51.778800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:51.778800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:51.779234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:51.973734 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2d05e4c-a58c-4f61-898d-20391f2fbc5c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.250416 Oct 28 10:22:51.977798 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3080/6129] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:22:51 2022] POST /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:22:51.980515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:51.980515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:51.993245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:51.993245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:51.993245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:51.996515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:51.996515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:52.006655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:52.025424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e9117d7c-fdd9-4676-9689-bc5bffc326f7 req-b9472dde-63a0-4cfa-a7f3-66f77f9c731a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:52.038209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9117d7c-fdd9-4676-9689-bc5bffc326f7 req-b9472dde-63a0-4cfa-a7f3-66f77f9c731a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:52.038951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9117d7c-fdd9-4676-9689-bc5bffc326f7 req-b9472dde-63a0-4cfa-a7f3-66f77f9c731a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:52.039592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9117d7c-fdd9-4676-9689-bc5bffc326f7 req-b9472dde-63a0-4cfa-a7f3-66f77f9c731a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:52.079851 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e9117d7c-fdd9-4676-9689-bc5bffc326f7 req-b9472dde-63a0-4cfa-a7f3-66f77f9c731a service nova] Creating event network-changed:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h2-zed-1 Oct 28 10:22:52.088169 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e9117d7c-fdd9-4676-9689-bc5bffc326f7 req-b9472dde-63a0-4cfa-a7f3-66f77f9c731a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.584916 Oct 28 10:22:52.089339 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3050/6130] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:52.097678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:52.099725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:52.108003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:52.109083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:52.109968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:52.111230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:52.112081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:52.113159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:52.435348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:52.444752 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-db7b29b0-5459-4042-9173-a9ba84c6d824 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1505 microversion: 2.1 time: 0.353606 Oct 28 10:22:52.450264 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3051/6131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:52 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:52.466458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66b8dce7-9ed3-4661-a9c9-d2797b0244de"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:52.473839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:52.484130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:52.485032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:52.485747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:52.486731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:52.487428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:52.488303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:52.977443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:52.988078 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d03b3b5a-96ad-4425-85ce-0bd8c804ea29 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1689 microversion: 2.1 time: 1.012504 Oct 28 10:22:52.990523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3081/6132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:51 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1689 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:53.143583 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb0a1ba8-54f7-4d55-a4f5-dc7688b33d7b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "POST /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691661 Oct 28 10:22:53.144224 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3052/6133] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:22:52 2022] POST /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:53.472750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:53.473398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:53.484845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:53.501727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:53.502865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:53.503793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:53.504424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:53.505110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:54.016949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:54.018250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:54.031969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:54.032782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:54.033434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:54.034344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:54.034976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:54.035581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:54.294399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:54.308861 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a804bb4b-f6fb-4473-8aad-88f34383b1ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1570 microversion: 2.1 time: 0.295980 Oct 28 10:22:54.326812 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3053/6134] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:54 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1570 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:22:54.650566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:54.659782 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0cccdb55-e74f-4b56-84ae-6d924e639641 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1485 microversion: 2.1 time: 1.191199 Oct 28 10:22:54.660959 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3082/6135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:53 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1485 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:54.691244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:54.692520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:54.707067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:54.708477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:54.709911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:54.710952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:54.716924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:54.717978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:54.770101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lazy-loading 'flavor' on Instance uuid 548d1c2c-a136-4d23-af0b-cdb57cfacc2c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:22:54.857131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:22:55.122221 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af35afa0-ad7b-4807-b2ba-c5cf4344b0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c/action" status: 202 len: 0 microversion: 2.1 time: 0.434418 Oct 28 10:22:55.161531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3054/6136] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:22:54 2022] POST /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:22:55.170361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:55.171000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:55.191132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:55.191639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:55.192077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:55.193382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:55.193839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:55.194263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:55.343224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:55.344616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:55.361430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:55.363446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:55.363868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:55.368583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:55.369364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:55.370022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:55.724764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:55.740543 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b668675-09d5-4ec9-a70d-16bb88d18395 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1570 microversion: 2.1 time: 0.406817 Oct 28 10:22:55.761879 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3055/6137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:55 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1570 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:56.082091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:56.090893 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a415d369-b10b-422b-b076-e9f4f8ed6c20 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1491 microversion: 2.1 time: 0.924646 Oct 28 10:22:56.103881 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3083/6138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:55 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1491 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:56.308992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8b5aaef3-98b2-41c9-b95b-ca47293311cb req-f4d89d6d-8d1d-4a24-818e-f33266e5df4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f19be6-03d9-4876-97cb-41645f29a5b9", "name": "network-vif-deleted", "tag": "a851c2b9-29bd-41a2-a819-e12dec63dec5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:22:56.337388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b5aaef3-98b2-41c9-b95b-ca47293311cb req-f4d89d6d-8d1d-4a24-818e-f33266e5df4b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:56.337881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b5aaef3-98b2-41c9-b95b-ca47293311cb req-f4d89d6d-8d1d-4a24-818e-f33266e5df4b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:56.338326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8b5aaef3-98b2-41c9-b95b-ca47293311cb req-f4d89d6d-8d1d-4a24-818e-f33266e5df4b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:56.385758 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8b5aaef3-98b2-41c9-b95b-ca47293311cb req-f4d89d6d-8d1d-4a24-818e-f33266e5df4b service nova] Creating event network-vif-deleted:a851c2b9-29bd-41a2-a819-e12dec63dec5 for instance f7f19be6-03d9-4876-97cb-41645f29a5b9 on n-h2-zed-1 Oct 28 10:22:56.415064 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8b5aaef3-98b2-41c9-b95b-ca47293311cb req-f4d89d6d-8d1d-4a24-818e-f33266e5df4b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110099 Oct 28 10:22:56.423118 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3056/6139] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:22:56.780941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:56.781805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:56.793851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:56.798319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:56.798878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:56.802054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:56.803044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:56.803624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:56.904014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:56.905395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:56.909262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:56.910103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lazy-loading 'fault' on Instance uuid f7f19be6-03d9-4876-97cb-41645f29a5b9 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:22:57.124640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:57.132451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:57.133694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:57.135444 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a5e4a808-791a-47f9-bf37-e6dd5d0c2fd6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 200 len: 1357 microversion: 2.1 time: 0.361060 Oct 28 10:22:57.137567 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3084/6140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:56 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 1357 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:57.148402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:57.148925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:57.149387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:57.156877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:57.157407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:57.160547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:57.521721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:57.533456 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5ae6d76-de9c-4e23-8ec7-af3650c03b62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1512 microversion: 2.1 time: 0.405340 Oct 28 10:22:57.535872 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3057/6141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:57 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:22:58.164048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:58.168947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: f7f19be6-03d9-4876-97cb-41645f29a5b9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:58.184480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:58.185966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:58.191314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:58.197924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:58.201971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:58.203800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:58.248649 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] HTTP exception thrown: Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 could not be found. Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Request method failure captured: Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 HTTP/1.1 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6zXHm2C0MBZyh1v9W7qaCMezuCetEchcqsk_b8RAoux6fJEz9I9HuMCo8PBbtHPGu0VR2DyPC7nyw8kroAbJeUqYDYl7PHuIuZvlES9rmLvMQK9_o0rbBvOeJu953NpDPOD8Hi-3tTGWLZcp5HaeSQhjwgaPVolC0PCrS_HHPl8_Bc Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43f3d1244dc147c398fc24ddcfc6da34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43f3d1244dc147c398fc24ddcfc6da34"}]}] Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 608b9dc1a00d489a94524f99820022f6 Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 could not be found. Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f7f19be6-03d9-4876-97cb-41645f29a5b9'} Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 could not be found. Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 could not be found. Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:58.267658 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 could not be found. Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Returning 404 to user: Instance f7f19be6-03d9-4876-97cb-41645f29a5b9 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:22:58.273469 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d08567b-74dd-43d3-b94d-5a5d232194cb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9" status: 404 len: 111 microversion: 2.1 time: 0.109466 Oct 28 10:22:58.279118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3085/6142] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:58 2022] GET /compute/v2.1/servers/f7f19be6-03d9-4876-97cb-41645f29a5b9 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:22:58.559811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:22:58.560435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:22:58.574728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:58.575100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:58.575552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:58.576257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:22:58.584960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:22:58.587126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:22:59.326736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:22:59.336587 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-245b9692-28e6-4666-91b2-724ab949bf39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.780660 Oct 28 10:22:59.337219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3058/6143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:22:58 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:00.362996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:00.365504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:00.373478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:00.380671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:00.381176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:00.381947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:00.382417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:00.382854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:00.640226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-9d5bb737-28ea-4cca-b43a-b439750f4689 req-994a516a-834b-441a-962c-893821419bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548d1c2c-a136-4d23-af0b-cdb57cfacc2c", "name": "network-vif-plugged", "status": "completed", "tag": "301ab369-a98f-4ff8-8ce2-5bf7ee64ce12"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:00.684711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9d5bb737-28ea-4cca-b43a-b439750f4689 req-994a516a-834b-441a-962c-893821419bde service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:00.688373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9d5bb737-28ea-4cca-b43a-b439750f4689 req-994a516a-834b-441a-962c-893821419bde service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:00.691150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9d5bb737-28ea-4cca-b43a-b439750f4689 req-994a516a-834b-441a-962c-893821419bde service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:00.747708 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-9d5bb737-28ea-4cca-b43a-b439750f4689 req-994a516a-834b-441a-962c-893821419bde service nova] Creating event network-vif-plugged:301ab369-a98f-4ff8-8ce2-5bf7ee64ce12 for instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c on n-h1-zed-1 Oct 28 10:23:00.768581 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-9d5bb737-28ea-4cca-b43a-b439750f4689 req-994a516a-834b-441a-962c-893821419bde service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133948 Oct 28 10:23:00.769531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3059/6144] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:01.193567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:01.203089 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12d6431a-d565-4ae2-b64b-862181d25f4d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.843981 Oct 28 10:23:01.203683 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3086/6145] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:00 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:02.229924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:02.230646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:02.251617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:02.259091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:02.277500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:02.281684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:02.285152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:02.288281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:02.842274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:02.856883 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c09cb623-747e-413b-8857-55cf1b7e7a72 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.629050 Oct 28 10:23:02.860587 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3060/6146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:02 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:03.880350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:03.882083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:03.906829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:03.907339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:03.928883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:03.929766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:03.937361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:03.937829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:04.562911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:04.573957 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c86be703-f402-48d1-8e1e-c10157958cb2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.698038 Oct 28 10:23:04.574548 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3087/6147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:03 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:05.600185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:05.600818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:05.621028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:05.624107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:05.625812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:05.629200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:05.630693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:05.631321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:06.088598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:06.118791 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d6b4bc1e-cae5-4736-9c20-4507ff7461e9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.524303 Oct 28 10:23:06.147340 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3061/6148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:05 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:07.151987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:07.152470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:07.166467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:07.167494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:07.173284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:07.174299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:07.174950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:07.175561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:08.081498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:08.094528 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6d1c45ec-e524-4eb5-9932-c1dc395031fe tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.946873 Oct 28 10:23:08.109832 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3088/6149] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:07 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:09.122851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:09.123675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:09.128273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=38 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:09.146345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:09.148389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:09.150644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:09.151797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:09.153490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:09.154805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:10.031861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:10.041048 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a4c4afa-ab03-4ce7-8ea7-ba3a5270fa08 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.924658 Oct 28 10:23:10.041643 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3062/6150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:09 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:11.068987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:11.070236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:11.074309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:11.103905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:11.104432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:11.104890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:11.105661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:11.106133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:11.106578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:11.127348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:11.577879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4b4dfff-274c-43b8-901b-93a4d062d575 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '.version_select at 0x7fca323fe550>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:11.585854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:11.598917 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6216a64-325c-4632-90a7-da4f548fd4ce tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.534443 Oct 28 10:23:11.611142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3089/6151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:11 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:11.656692 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4b4dfff-274c-43b8-901b-93a4d062d575 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1045512326" status: 202 len: 0 microversion: 2.1 time: 0.084224 Oct 28 10:23:11.657547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3063/6152] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 10:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1045512326 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:23:11.693663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34028286-050a-4fa7-b8ba-a029f13fb806 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: .version_select at 0x7fca338778b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-202653064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8WCNQoukY3BuePvPjThXXGTBe6HsM8e2Y7gn7NIpkInCG7VMQ+BSL2S0qsKDrACtvzazuCi4F7nlux8LiOdrYR9nF4Rden/gKU2Q5PxUL7CrNciAXKLCnhwtRnG4wtGA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:11.731350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-34028286-050a-4fa7-b8ba-a029f13fb806 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:23:11.743142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-34028286-050a-4fa7-b8ba-a029f13fb806 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:23:11.825855 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34028286-050a-4fa7-b8ba-a029f13fb806 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.137097 Oct 28 10:23:11.826970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3090/6153] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:23:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:12.259372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:12.259892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:12.288394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:12.289341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:12.291472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:12.292205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:12.301961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:12.302549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:12.541089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lazy-loading 'services' on Instance uuid c41aa903-73a7-4f37-8229-57346e0da041 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:23:12.626477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:12.627917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:12.641267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:12.642026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:12.642655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:12.643605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:12.644244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:12.645613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:12.729204 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c6cb0810-0962-4978-8c26-5d1814dbad10 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments/66b8dce7-9ed3-4661-a9c9-d2797b0244de" status: 202 len: 0 microversion: 2.1 time: 0.473456 Oct 28 10:23:12.732563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3064/6154] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:23:12 2022] DELETE /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments/66b8dce7-9ed3-4661-a9c9-d2797b0244de => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:23:12.771111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:12.776541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:12.787859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:12.788707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:12.789585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:12.791208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:12.792054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:12.793293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:12.858561 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4519ebd3-3dd3-44fb-b37e-531aa0bb0854 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120025 Oct 28 10:23:12.868516 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3065/6155] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:12 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:13.237151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:13.246806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29c46be6-353b-4e60-ba20-56dc6fa6afe1 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.626899 Oct 28 10:23:13.277275 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3091/6156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:12 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:13.882181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:13.885087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:13.945159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:13.945795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:13.955774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:13.963311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:13.969497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:13.972003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:14.125268 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb60e3c2-8e57-4baf-9182-ad42ba3424d8 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.249590 Oct 28 10:23:14.130199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3066/6157] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:13 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:14.288636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:14.289917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:14.303022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:14.305550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:14.306237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:14.311579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:14.312322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:14.313002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:15.157550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:15.167899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:15.227477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:15.228025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:15.233280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:15.234130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:15.242793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:15.243363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:15.495420 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb9b3a6d-c920-4a15-a0cb-f7079226f5ad tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.344655 Oct 28 10:23:15.496134 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3067/6158] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:15 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:23:15.564704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:15.575418 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ffd52a8-b1ff-4e79-9a16-c1f2f6703bee tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 1.291501 Oct 28 10:23:15.581593 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3092/6159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:14 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:16.559671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:16.568168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:16.610096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:16.610853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:16.621397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:16.632829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:16.633692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:16.640091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:16.642903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:16.647317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:16.705443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:16.711480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:16.716071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:16.717555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:16.724767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:16.726772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:16.880498 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-301e5042-24b8-4d51-b0d9-a4852ba684e3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.365645 Oct 28 10:23:16.886673 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3068/6160] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:16 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:17.911261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:17.915415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:17.955383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:17.955889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:17.956337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:17.978242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:17.982442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:17.983055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:17.993853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:17.997486 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-920761a3-e666-4974-b7f4-f9e1aad35bd6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 1.390855 Oct 28 10:23:17.999286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3093/6161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:16 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:18.177993 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af2b537e-92da-464d-a18f-95bad27842ea tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.283704 Oct 28 10:23:18.178272 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3069/6162] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:17 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:23:19.027309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:19.034812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:19.080965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:19.086798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:19.095764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:19.098796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:19.100335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:19.101009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:19.191125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:19.194675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:19.215283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:19.220323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:19.221146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:19.222716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:19.223561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:19.224272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:19.322868 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96d76bb1-9c07-48a5-a3bd-c72d99b806aa tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136327 Oct 28 10:23:19.325865 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3070/6163] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:19 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:23:19.651609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:19.667606 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de94ddbd-678d-4cf8-900b-848d51694010 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.649129 Oct 28 10:23:19.681317 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3094/6164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:19 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:20.341587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:20.353949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:20.418214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:20.427665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:20.429085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:20.434193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:20.437365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:20.444997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:20.658663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:20.667889 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0987c92-f172-46a3-a6ac-8d3ab5d57044 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.329725 Oct 28 10:23:20.672655 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3071/6165] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:20 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:20.698971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:20.701120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:20.738121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:20.740623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:20.741432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:20.742631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:20.743480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:20.744420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:21.685522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:21.688229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:21.718211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:21.718702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:21.730784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:21.734328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:21.734813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:21.735259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:21.765956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:21.891976 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5d707d8-304b-494f-b3be-77fd6bb278fd tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209816 Oct 28 10:23:21.901051 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3072/6166] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:21 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:22.159974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:22.172148 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e41d3541-c5aa-4239-8101-6ebb45d15a6e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 1.474395 Oct 28 10:23:22.173409 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3095/6167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:20 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:22.913630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:22.916600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:22.950008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:22.952653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:22.953295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:22.961727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:22.963553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:22.969810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:23.083939 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1924a63d-57db-4012-8788-228d114b921b tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.181451 Oct 28 10:23:23.091321 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3073/6168] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:22 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:23.201600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:23.202991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:23.218644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:23.221324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:23.222035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:23.224590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:23.225923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:23.227416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:23.961509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:23.978444 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f6c40cba-2052-4c20-9067-32164f6266d5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.778165 Oct 28 10:23:23.984218 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3096/6169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:23 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:24.096633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:24.106786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:24.119092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:24.119586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:24.120070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:24.120781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:24.127523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:24.128227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:24.252943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3ea6ab04-62b8-40f6-817d-aa9af042d8b6 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.153389 Oct 28 10:23:24.252943 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3074/6170] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:24 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:25.008018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:25.008681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:25.026659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:25.027172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:25.027619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:25.036188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:25.036728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:25.040184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:25.261844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:25.267114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:25.284350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:25.289618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:25.290354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:25.292424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:25.293678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:25.296202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:25.404382 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d337a577-1eaa-4eb5-a578-0fb13c90503d tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150106 Oct 28 10:23:25.412258 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3075/6171] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:25 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:23:26.335584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:26.353463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-055907d1-1f61-420f-b024-beb6acd6c42d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 1.351608 Oct 28 10:23:26.355641 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3097/6172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:25 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:26.421834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:26.424724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:26.453069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:26.453747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:26.457564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:26.461616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:26.462708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:26.464505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:26.579707 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-25ab0ec1-8cd6-41dc-8fde-d52b134b5d37 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.162437 Oct 28 10:23:26.595888 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3076/6173] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:23:26 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041/os-volume_attachments => generated 25 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:23:26.788149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:26.789305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:26.806271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:26.807483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:26.808568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:26.809981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:26.810778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:26.811854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:26.844772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:23:27.061177 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3500ae1a-8147-4921-9004-76f3c33c3d18 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 204 len: 0 microversion: 2.1 time: 0.297565 Oct 28 10:23:27.063649 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3098/6174] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:23:26 2022] DELETE /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:23:27.073224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:27.073854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:27.089199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:27.089692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:27.090131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:27.106453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:27.107226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:27.110702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:27.381461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:27.383065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:27.399304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:27.400741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:27.402535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:27.405864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:27.406722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:27.411725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:27.990087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:28.003797 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a282e29a-df35-46ab-a06a-bb627df81257 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1681 microversion: 2.1 time: 0.934628 Oct 28 10:23:28.014146 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3077/6175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:27 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1681 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:28.657850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:28.691864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1423380-f90c-4cbc-a608-cc9baf56c860 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 1.309319 Oct 28 10:23:28.696172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3099/6176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:27 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:29.031644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:29.034331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:29.061820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:29.062341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:29.074939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:29.077794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:29.081215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:29.085453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:29.724314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:29.725143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:29.742998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:29.744015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:29.745081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:29.746583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:29.748710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:29.750799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:30.545064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:30.557754 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fed080ca-b2f6-44b8-8cff-e03dfd7d577a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1681 microversion: 2.1 time: 1.529836 Oct 28 10:23:30.573040 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3078/6177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:29 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1681 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:30.713525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:30.726114 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8794391e-1381-45c9-a70a-8ed4da880aa5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 1.007531 Oct 28 10:23:30.761331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3100/6178] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:29 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:31.586825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:31.591176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:31.603271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:31.606767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:31.608428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:31.609579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:31.614549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:31.626854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:31.758523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:31.759878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:31.780253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:31.781405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:31.782101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:31.783093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:31.784029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:31.784698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:33.251353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:33.260110 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d24880e6-ed80-436c-9545-271f8cf80a2a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1681 microversion: 2.1 time: 1.677119 Oct 28 10:23:33.263155 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3079/6179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:31 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1681 bytes in 1681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:34.013185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:34.027666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1bd6b27-73cc-4466-98d0-1c23eb8990cd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 2.277642 Oct 28 10:23:34.028646 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3101/6180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:31 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:34.287992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:34.288817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:34.302649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:34.304165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:34.304736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:34.305666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:34.308360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:34.308951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:34.349025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a9e777fb-b807-4094-a992-7f340ccf333d req-3a7f7ae7-a0d2-4759-93ac-19b39287e0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c41aa903-73a7-4f37-8229-57346e0da041", "name": "network-vif-deleted", "tag": "ef4167c3-8ae7-46fe-bc59-55e954df8f0b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:34.377370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a9e777fb-b807-4094-a992-7f340ccf333d req-3a7f7ae7-a0d2-4759-93ac-19b39287e0b5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:34.390796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a9e777fb-b807-4094-a992-7f340ccf333d req-3a7f7ae7-a0d2-4759-93ac-19b39287e0b5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:34.390796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a9e777fb-b807-4094-a992-7f340ccf333d req-3a7f7ae7-a0d2-4759-93ac-19b39287e0b5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:34.462665 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a9e777fb-b807-4094-a992-7f340ccf333d req-3a7f7ae7-a0d2-4759-93ac-19b39287e0b5 service nova] Creating event network-vif-deleted:ef4167c3-8ae7-46fe-bc59-55e954df8f0b for instance c41aa903-73a7-4f37-8229-57346e0da041 on n-h2-zed-1 Oct 28 10:23:34.495180 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a9e777fb-b807-4094-a992-7f340ccf333d req-3a7f7ae7-a0d2-4759-93ac-19b39287e0b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145723 Oct 28 10:23:34.496741 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3102/6181] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:34.611192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34b183f2b0b4a4597fb2e3b6495268a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '953dcbea116f45439fa6f2162591e611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:34.627370 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a17ada0e-576b-4571-b548-e59c22712e06 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 200 len: 1615 microversion: 2.1 time: 0.343980 Oct 28 10:23:34.629885 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3080/6182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:34 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 1615 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:35.051535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:35.052241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:35.070309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:35.073572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:35.076083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:35.077028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:35.086176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:35.086689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:35.444882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:35.458181 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-306f5c2f-cd55-4f14-9243-bfebdcbc3e31 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1507 microversion: 2.1 time: 0.411252 Oct 28 10:23:35.460766 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3103/6183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:35 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:35.655768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:35.656389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:35.675147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:35.683074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:35.683861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:35.687036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:35.691287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:35.692080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:35.749868 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 HTTP/1.1 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'c41aa903-73a7-4f37-8229-57346e0da041'} Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:35.759211 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:35.763679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:35.763679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:35.763679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:35.763679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:23:35.763679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:23:35.763679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:35.763679 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:35.765791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:23:35.766865 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d706b2c1-e3d7-487e-a337-f03be2b4b3d3 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 404 len: 111 microversion: 2.1 time: 0.115913 Oct 28 10:23:35.767670 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3081/6184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:35 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:23:35.776549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0090a1f1-9c9b-4bcc-a731-a17d80b82fee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '.version_select at 0x7fca338eca60>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:35.815744 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0090a1f1-9c9b-4bcc-a731-a17d80b82fee tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303586598" status: 202 len: 0 microversion: 2.1 time: 0.042860 Oct 28 10:23:35.816979 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3104/6185] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:23:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1303586598 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:23:36.483443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:36.484059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:36.499185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:36.500020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:36.500851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:36.502091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:36.502774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:36.503272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:37.134912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:37.153109 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba09f3f4-5209-4e0f-9a43-e0f5dcfded1c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1504 microversion: 2.1 time: 0.673264 Oct 28 10:23:37.153916 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3082/6186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:36 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1504 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:38.180017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:38.182241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:38.201638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:38.202143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:38.206502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:38.207935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:38.208409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:38.217611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:38.737349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1881093127", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "954c54f6-1098-4653-a560-d2de139014cf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-202653064", "security_groups": [{"name": "tempest-secgroup-smoke-396039057"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:38.941613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:38.953461 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc7fe954-ba60-47cc-bfeb-e4224abf0b2b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1504 microversion: 2.1 time: 0.777833 Oct 28 10:23:38.954473 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3105/6187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:38 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1504 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:39.031895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] validate_networks() for [('954c54f6-1098-4653-a560-d2de139014cf', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:23:39.456980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:39.775104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-3357c9fb-d3fe-4d47-9c9a-e7aa1abf37b4 req-2878f2ce-d8cd-4739-8756-ea70d75fde7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548d1c2c-a136-4d23-af0b-cdb57cfacc2c", "name": "network-vif-unplugged", "status": "completed", "tag": "301ab369-a98f-4ff8-8ce2-5bf7ee64ce12"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:39.800691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3357c9fb-d3fe-4d47-9c9a-e7aa1abf37b4 req-2878f2ce-d8cd-4739-8756-ea70d75fde7c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:39.804376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3357c9fb-d3fe-4d47-9c9a-e7aa1abf37b4 req-2878f2ce-d8cd-4739-8756-ea70d75fde7c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:39.805605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3357c9fb-d3fe-4d47-9c9a-e7aa1abf37b4 req-2878f2ce-d8cd-4739-8756-ea70d75fde7c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:39.832677 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-3357c9fb-d3fe-4d47-9c9a-e7aa1abf37b4 req-2878f2ce-d8cd-4739-8756-ea70d75fde7c service nova] Creating event network-vif-unplugged:301ab369-a98f-4ff8-8ce2-5bf7ee64ce12 for instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c on n-h1-zed-1 Oct 28 10:23:39.852408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-3357c9fb-d3fe-4d47-9c9a-e7aa1abf37b4 req-2878f2ce-d8cd-4739-8756-ea70d75fde7c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080882 Oct 28 10:23:39.855421 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3106/6188] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:23:39.978945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:39.980056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:39.995762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:39.997256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:39.997952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:39.998937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:40.002067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:40.002781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:40.046399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:23:40.046958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:23:40.047558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:23:40.048086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:23:40.048624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:23:40.057335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:40.068446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:40.074311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:40.075089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:40.076551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:40.077447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:40.078156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:40.122579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:23:40.129403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:23:40.144022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:23:40.147045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:23:40.250139 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83bfe887-26d0-49d9-9ade-337cda7328e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.516297 Oct 28 10:23:40.254865 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3083/6189] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:23:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:23:40.270871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-43f44a73-ddd6-482f-a648-d1268bc4fee1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:40.274245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-43f44a73-ddd6-482f-a648-d1268bc4fee1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:40.462727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-43f44a73-ddd6-482f-a648-d1268bc4fee1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:40.474028 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-43f44a73-ddd6-482f-a648-d1268bc4fee1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1266 microversion: 2.1 time: 0.211133 Oct 28 10:23:40.475782 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3084/6190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:40 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1266 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:41.508146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:41.517307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:41.519660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:41.548019 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6dff9e45-adad-48ec-ad3b-1d48b1cd1ed8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1504 microversion: 2.1 time: 1.568088 Oct 28 10:23:41.557653 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3107/6191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:39 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1504 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:41.561067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:41.562502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:41.563759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:41.566874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:41.568775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:41.569491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:41.924776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:41.954749 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6527088b-16c9-408c-939b-47c00db7c558 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1262 microversion: 2.1 time: 0.456569 Oct 28 10:23:41.958757 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3085/6192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:41 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1262 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:42.583451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:42.584300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:42.595063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:42.631032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:42.631546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:42.631990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:42.632714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:42.633262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:42.639738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:42.979292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:42.980626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:42.999502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:43.001033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:43.001611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:43.002505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:43.003143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:43.003707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:43.127565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:43.155241 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4f87c07c-ea43-4f3f-8b7a-cab6f0b77a1a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 200 len: 1447 microversion: 2.1 time: 0.577284 Oct 28 10:23:43.157374 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3108/6193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:42 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 1447 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:43.172069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:43.184850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:43.185392 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-97dd5805-3915-46cc-a1f7-eb48718a90ee tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1324 microversion: 2.1 time: 0.209985 Oct 28 10:23:43.185989 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3086/6194] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:42 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:43.187696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:43.200111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:43.201331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:43.202876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:43.203838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:43.207008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:43.208474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:44.215728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:44.217019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:44.250322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:44.250848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:44.251307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:44.262551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:44.264543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:44.268143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:44.343845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:44.364683 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9e22be1-2264-4f86-8384-69458557deb4 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 1.183398 Oct 28 10:23:44.367583 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3109/6195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:43 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:44.401447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:44.402058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:44.415792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:44.424689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:44.425401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:44.426231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:44.426708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:44.427149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:44.669251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:44.702185 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d1d36af6-256a-4c91-80e4-cffe1189bb23 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1324 microversion: 2.1 time: 0.478177 Oct 28 10:23:44.724252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3087/6196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:44 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1324 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:45.258793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:45.272396 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-430c7338-d42f-4646-b486-a3e0c70ebbd9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.869417 Oct 28 10:23:45.273400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3110/6197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:44 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:45.305163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:45.305916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:45.317640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:45.322453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:45.322941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:45.325910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:45.327542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:45.328369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:45.736975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:45.738080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:45.750685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:45.755642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:45.756354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:45.757025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:45.757904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:45.758528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:45.760139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:45.773644 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44eb3d39-f110-4152-a9d2-4890743693ba tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.476515 Oct 28 10:23:45.777129 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3088/6198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:45 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:45.808492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:45.810369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:45.838583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:45.839033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:45.839539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:45.840234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:45.840701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:45.841157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:45.963496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:45.973820 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-608382cd-8cbb-4e72-a218-77b8671f9977 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1324 microversion: 2.1 time: 0.242176 Oct 28 10:23:45.979220 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3111/6199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:45 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1324 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:46.257368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:46.269119 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f5d5fae-2174-45a9-87fb-63cc0e054ed3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.469731 Oct 28 10:23:46.270273 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3089/6200] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:45 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:46.295833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2cfb5c50-c274-4a53-b297-cf5ac9887cd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:46.314676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cfb5c50-c274-4a53-b297-cf5ac9887cd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:46.315197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cfb5c50-c274-4a53-b297-cf5ac9887cd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:46.315643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cfb5c50-c274-4a53-b297-cf5ac9887cd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:46.391315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2cfb5c50-c274-4a53-b297-cf5ac9887cd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Going to try to stop instance {{(pid=128748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:23:46.521302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2cfb5c50-c274-4a53-b297-cf5ac9887cd3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.229307 Oct 28 10:23:46.530619 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3112/6201] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:23:46 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:23:46.536123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:46.537436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:46.551443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:46.552559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:46.554276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:46.555200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:46.556551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:46.557902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:47.012389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:47.013127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:47.037028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:47.037532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:47.037971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:47.038693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:47.039150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:47.039579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:47.655523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:47.659561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:47.667587 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-27272eaa-776d-4493-90d5-83ecc2f8305c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 1.135200 Oct 28 10:23:47.668415 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3090/6202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:46 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:47.702838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:47.718344 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b897b056-4419-41a4-aeef-9105e9422d8b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1391 microversion: 2.1 time: 0.709125 Oct 28 10:23:47.719566 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3113/6203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:47 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1391 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:48.696173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:48.697695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:48.709103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:48.709704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:48.710217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:48.711175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:48.711852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:48.712678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:48.752232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:48.752852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:48.775006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:48.784701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:48.790092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:48.797495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:48.798235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:48.801691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:49.232460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:49.247442 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ebb68915-8b4d-494d-a16f-592e878f0d8a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.558356 Oct 28 10:23:49.251069 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3091/6204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:48 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:49.724125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:49.724799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:49.743724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:49.745185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:49.746839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:49.749111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:49.751714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:49.754851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:49.797889 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 HTTP/1.1 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'c41aa903-73a7-4f37-8229-57346e0da041'} Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:23:49.806120 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.814292 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.818494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:23:49.819424 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6eed1a3-bc7d-45d7-a734-b58d22a693d1 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 404 len: 111 microversion: 2.1 time: 0.099421 Oct 28 10:23:49.823060 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3092/6205] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:23:49 2022] DELETE /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:23:49.835252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:49.835921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: c41aa903-73a7-4f37-8229-57346e0da041] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:49.850952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:49.851460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:49.860816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:49.861880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:49.862561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:49.863224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:49.882638 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 HTTP/1.1 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'c41aa903-73a7-4f37-8229-57346e0da041'} Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:49.884505 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.889179 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:49.889179 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:49.889179 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:49.889179 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:23:49.889179 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:23:49.889179 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. Oct 28 10:23:49.889179 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:49.891942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance c41aa903-73a7-4f37-8229-57346e0da041 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:23:49.893112 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b462cc7-0f37-4fdc-8a29-d148d1b55660 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041" status: 404 len: 111 microversion: 2.1 time: 0.061890 Oct 28 10:23:49.894213 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3093/6206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:49 2022] GET /compute/v2.1/servers/c41aa903-73a7-4f37-8229-57346e0da041 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:23:50.143751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:50.156599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e46c003-6b81-4f06-9390-ecb3a195159c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1391 microversion: 2.1 time: 1.417124 Oct 28 10:23:50.165135 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3114/6207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:48 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1391 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:50.282542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:50.283448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:50.301225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:50.303687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:50.306131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:50.306786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:50.309969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:50.310660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:50.311341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:50.471178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:23:50.803308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:50.819455 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6908a17b-6932-4872-b96a-f9cf8d7c7f39 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.541990 Oct 28 10:23:50.820552 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3094/6208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:50 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:51.182267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:51.183649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:51.197864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:51.198430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:51.198891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:51.201224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:51.201706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:51.202152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:51.289172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1760d474-8dd0-46a0-b3e9-fec71281b12f req-55f90f6d-f17d-4a8b-98c8-5867eb7fc80b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:51.310377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1760d474-8dd0-46a0-b3e9-fec71281b12f req-55f90f6d-f17d-4a8b-98c8-5867eb7fc80b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:51.311158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1760d474-8dd0-46a0-b3e9-fec71281b12f req-55f90f6d-f17d-4a8b-98c8-5867eb7fc80b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:51.312224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1760d474-8dd0-46a0-b3e9-fec71281b12f req-55f90f6d-f17d-4a8b-98c8-5867eb7fc80b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:51.380287 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1760d474-8dd0-46a0-b3e9-fec71281b12f req-55f90f6d-f17d-4a8b-98c8-5867eb7fc80b service nova] Creating event network-changed:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:23:51.394082 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1760d474-8dd0-46a0-b3e9-fec71281b12f req-55f90f6d-f17d-4a8b-98c8-5867eb7fc80b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105563 Oct 28 10:23:51.396998 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3095/6209] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:51.582365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:51.603909 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52ce4255-3a7e-47a9-bc2e-f6b98a5e9b2a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1391 microversion: 2.1 time: 0.425510 Oct 28 10:23:51.617185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3115/6210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:51 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1391 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:51.850153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:51.850877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:51.883287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:51.883863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:51.891819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:51.892706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:51.893237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:51.893693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:52.357131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:52.373512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2657924-3558-41e9-ac38-bc4a321e8c45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.528576 Oct 28 10:23:52.374841 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3096/6211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:51 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:52.627334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:52.628521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:52.641648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:52.643254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:52.648871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:52.649878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:52.650528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:52.652156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:52.900730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:52.919482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c625fa52-c34d-4391-b5b5-5535e19a81b0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1391 microversion: 2.1 time: 0.296528 Oct 28 10:23:52.952331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3116/6212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:52 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1391 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:53.398178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:53.398800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:53.411296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:53.411795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:53.412238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:53.412975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:53.413591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:53.413859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:53.948311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:53.950381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:53.973980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:53.979462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:53.981698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:53.985135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:53.985697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:53.988048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:53.990508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:54.004628 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3971e8b-7115-4145-a06a-dfc8b3e8b8b8 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.609376 Oct 28 10:23:54.008740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3097/6213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:53 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:54.805897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:54.826322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b083311f-6c72-4b6b-ab09-17b6fd103fff tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1391 microversion: 2.1 time: 0.879559 Oct 28 10:23:54.828246 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3117/6214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:53 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1391 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:55.039444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:55.040781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:55.059872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:55.064084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:55.064820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:55.067329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:55.070731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:55.073405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:55.369824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:55.382172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e351c946-88b0-4ea2-88b5-88ed7ca1eb09 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.350084 Oct 28 10:23:55.383042 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3098/6215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:55 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:55.851794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:55.853168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:55.865792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:55.868480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:55.869260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:55.870619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:55.873616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:55.874140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:56.413797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:56.414925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:56.436347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:56.444966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:56.446208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:56.446985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:56.450651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:56.451597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:56.641468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:56.660456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b11467f4-4f56-4068-8a5d-93cdba339add tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1391 microversion: 2.1 time: 0.812914 Oct 28 10:23:56.661099 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3118/6216] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:55 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1391 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:56.693671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:56.695265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:56.721694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:56.725743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:56.727345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:56.731002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:56.734400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:56.735712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:56.775245 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 HTTP/1.1 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '8d9a2778-8256-44e7-ab19-f6acf03b5819'} Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:23:56.777105 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b63be7a-6b03-434b-bb6e-9c8a92425fe0 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 404 len: 111 microversion: 2.1 time: 0.115152 Oct 28 10:23:56.783114 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3119/6217] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:23:56 2022] DELETE /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:23:56.798206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:56.798877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 8d9a2778-8256-44e7-ab19-f6acf03b5819] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:56.825061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:56.831319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:56.832130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:56.833101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:56.833844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:56.834454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:56.897652 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 HTTP/1.1 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '8d9a2778-8256-44e7-ab19-f6acf03b5819'} Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:56.900746 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.906330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:56.906330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:56.906330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:56.906330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:23:56.906330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:23:56.906330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. Oct 28 10:23:56.906330 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:56.911580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 8d9a2778-8256-44e7-ab19-f6acf03b5819 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:23:56.915675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19ff0661-593c-40e8-8289-8c3d04f7e328 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819" status: 404 len: 111 microversion: 2.1 time: 0.119381 Oct 28 10:23:56.921194 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3120/6218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:56 2022] GET /compute/v2.1/servers/8d9a2778-8256-44e7-ab19-f6acf03b5819 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:23:56.957981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:56.962269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:56.991814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:57.017580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:57.020419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:57.022319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:57.023776 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f612a9d8-81f9-4aa5-b62d-661832c540ae tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1677 microversion: 2.1 time: 0.619283 Oct 28 10:23:57.024509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:57.026104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:57.036145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:57.036370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3099/6219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:56 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1677 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:57.059767 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c HTTP/1.1 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5fa93feb-174d-4a13-869f-ece3341a8d3c'} Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:23:57.065166 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a96b4aa-8ed9-47ce-ac51-88c0c4204686 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 404 len: 111 microversion: 2.1 time: 0.144560 Oct 28 10:23:57.073631 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3121/6220] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:23:56 2022] DELETE /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:23:57.079019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:57.079712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 5fa93feb-174d-4a13-869f-ece3341a8d3c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:57.093577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:57.095444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:57.098668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:57.099471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:57.099969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:57.100421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:57.118302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c HTTP/1.1 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '5fa93feb-174d-4a13-869f-ece3341a8d3c'} Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:23:57.120272 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 5fa93feb-174d-4a13-869f-ece3341a8d3c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-adba935f-4c66-4700-9467-f9610e731b2c tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c" status: 404 len: 111 microversion: 2.1 time: 0.047873 Oct 28 10:23:57.125410 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3100/6221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:57 2022] GET /compute/v2.1/servers/5fa93feb-174d-4a13-869f-ece3341a8d3c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:23:57.634076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5f91bfa3-d180-4e51-9580-080b23b783dd req-2927c26d-c88d-46d8-b46a-f8eeb7445830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "name": "network-vif-plugged", "status": "completed", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:57.664138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f91bfa3-d180-4e51-9580-080b23b783dd req-2927c26d-c88d-46d8-b46a-f8eeb7445830 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:57.665659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f91bfa3-d180-4e51-9580-080b23b783dd req-2927c26d-c88d-46d8-b46a-f8eeb7445830 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:57.666198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f91bfa3-d180-4e51-9580-080b23b783dd req-2927c26d-c88d-46d8-b46a-f8eeb7445830 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:57.688589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:57.690110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:57.702222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:57.705854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5f91bfa3-d180-4e51-9580-080b23b783dd req-2927c26d-c88d-46d8-b46a-f8eeb7445830 service nova] Creating event network-vif-plugged:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:23:57.706711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:57.708006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:57.709062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:57.712245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:57.712971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:57.719851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5f91bfa3-d180-4e51-9580-080b23b783dd req-2927c26d-c88d-46d8-b46a-f8eeb7445830 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094199 Oct 28 10:23:57.724258 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3122/6222] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:23:58.055778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:58.056600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:58.072580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:58.079776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:58.080497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:58.081629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:58.082382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:58.086666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:58.236544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:58.249342 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-330c7bb6-895e-431b-acb8-d544a774f459 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1391 microversion: 2.1 time: 0.566133 Oct 28 10:23:58.251451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3101/6223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:57 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1391 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:58.469228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:58.481955 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fc8f94f6-791a-4550-b48b-a50a8f35481e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1654 microversion: 2.1 time: 0.431097 Oct 28 10:23:58.482725 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3123/6224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:58 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1654 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:58.511154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf406500-672e-4abf-8551-260818263682 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:23:58.520460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf406500-672e-4abf-8551-260818263682 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:58.521284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf406500-672e-4abf-8551-260818263682 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:58.525158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf406500-672e-4abf-8551-260818263682 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:58.600345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf406500-672e-4abf-8551-260818263682 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Going to try to start instance {{(pid=128747) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 10:23:58.695881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf406500-672e-4abf-8551-260818263682 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.188295 Oct 28 10:23:58.696517 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3102/6225] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:23:58 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:23:58.705488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:58.706121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:58.715903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:58.718296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:58.728700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:58.729525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:58.731577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:58.732026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:59.278099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:59.280128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:59.293756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:59.303240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:59.304797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:59.307211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:59.308252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:59.311759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:59.340958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:59.349867 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dde493e3-3f98-48d0-aaf5-1fe070292ec6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1663 microversion: 2.1 time: 0.649020 Oct 28 10:23:59.365243 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3124/6226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:58 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1663 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:23:59.563931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:23:59.572492 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f1dbc45-bbf1-48f7-848f-ea05d87e9632 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1563 microversion: 2.1 time: 0.299812 Oct 28 10:23:59.573758 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3103/6227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:59 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1563 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:23:59.599599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:23:59.603151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:23:59.614913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:59.616161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:59.617376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:23:59.622585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:23:59.625265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:23:59.625999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:00.380053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:00.382351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:00.393887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:00.395952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:00.397137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:00.398116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:00.399084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:00.400578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:00.615223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:00.617444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:00.640275 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a8a9365b-c72a-4829-9223-fa349990c759 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1563 microversion: 2.1 time: 1.034393 Oct 28 10:24:00.640979 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3125/6228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:23:59 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1563 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:00.681483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:00.690779 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d9b2fd9-9341-447a-a8e8-aed53799cc36 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1663 microversion: 2.1 time: 0.320233 Oct 28 10:24:00.702563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3104/6229] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:00 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1663 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:01.751196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:01.752959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:01.792784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:01.794000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:01.797114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:01.798261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:01.800703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:01.803415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:02.347235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:02.384734 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2952c02d-8db4-4262-bcfa-9e7e3bd8c0af tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1663 microversion: 2.1 time: 0.650432 Oct 28 10:24:02.390206 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3126/6230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:01 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1663 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:02.783736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:02.784269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:02.805339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:02.807239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:02.809309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:02.814745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:02.817848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:02.819782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:02.858851 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 HTTP/1.1 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '9399955c-6dee-411c-8c04-34ff847396e3'} Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:24:02.862557 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.869952 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.875366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:24:02.876569 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12ac4e0e-7343-451c-9ea9-f3c73214d1f2 tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 404 len: 111 microversion: 2.1 time: 0.101837 Oct 28 10:24:02.880075 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3105/6231] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:24:02 2022] DELETE /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:02.887351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:02.888003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] [instance: 9399955c-6dee-411c-8c04-34ff847396e3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:02.901823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:02.902324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:02.902787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:02.903521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:02.903984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:02.904414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:02.957095 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] HTTP exception thrown: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Request method failure captured: Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 HTTP/1.1 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6ul72larsYvmLXxVaQWTpGnwGF2oMkDBTwQuQrvydqcso-yp521Dg8vQ-NOWu4_B5XzpdtN-F67_fXdFN0ZA-iOiM4VveLzF4Ph4KcsLB4WckKJzOffxnp6o8hbNCKPIEfpp54j7WpPTmnPqRcx6B_FKfLb9gn6GHaabH0D6708Rbk Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/953dcbea116f45439fa6f2162591e611"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_953dcbea116f45439fa6f2162591e611", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/953dcbea116f45439fa6f2162591e611"}]}] Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 953dcbea116f45439fa6f2162591e611 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1344142599 Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b34b183f2b0b4a4597fb2e3b6495268a Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeNegativeTest-1344142599-project Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '9399955c-6dee-411c-8c04-34ff847396e3'} Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:02.959028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] Returning 404 to user: Instance 9399955c-6dee-411c-8c04-34ff847396e3 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aff2b3c9-ec7e-4e27-ba1f-fcf2db6c8c7a tempest-AttachVolumeNegativeTest-1344142599 tempest-AttachVolumeNegativeTest-1344142599-project] 10.222.0.16 "GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3" status: 404 len: 111 microversion: 2.1 time: 0.077052 Oct 28 10:24:02.968386 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3127/6232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:02 2022] GET /compute/v2.1/servers/9399955c-6dee-411c-8c04-34ff847396e3 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:03.416205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:03.417141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:03.424715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:03.431626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:03.432318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:03.433569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:03.434241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:03.434843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:04.064811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:04.089449 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfd73823-3819-4461-9a51-824d62c6a8d3 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.677060 Oct 28 10:24:04.101276 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3106/6233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:03 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:04.117646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:04.118868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:04.126606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:04.127393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:04.129400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:04.130345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:04.131024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:04.131692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:04.424352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:04.433270 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dd68d21e-5fbc-4351-8bc1-a6bf3c2f2dfd tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.319240 Oct 28 10:24:04.433852 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3128/6234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:04 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:04.459726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:04.460364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:04.475847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:04.476368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:04.476827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:04.477834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:04.478311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:04.478748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:05.544605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:05.565963 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ebf1956-4b99-4218-a8fb-616eb42f6dde tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 1.107295 Oct 28 10:24:05.582314 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3107/6235] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:04 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:05.592555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:05.593798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:05.602817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:05.603595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:05.605303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:05.606335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:05.607444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:05.608112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:06.033392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:06.042795 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ea89b47-675c-4d00-a2d5-b108d33365f6 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.455486 Oct 28 10:24:06.058439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3129/6236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:05 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:24:06.068097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:06.068730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:06.084813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:06.085750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:06.086436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:06.088120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:06.089197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:06.089956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:06.661992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:06.684985 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3dd143ff-6703-4389-a7db-b1530b491609 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.620669 Oct 28 10:24:06.697988 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3108/6237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:06 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:06.713984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:06.715167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:06.724262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:06.725066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:06.725683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:06.726631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:06.727260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:06.727977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:06.765337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lazy-loading 'flavor' on Instance uuid 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:24:06.889621 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-73d75a97-3e0f-4f6b-96f3-c0d70df0505a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.182076 Oct 28 10:24:06.902563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:06.903206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:06.909312 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3130/6238] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:24:06 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:24:06.915144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:06.916529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:06.917392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:06.918840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:06.919374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:06.919867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:08.295138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:08.301916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:08.314766 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf0354af-850d-4e1a-8c09-60564d71059e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1675 microversion: 2.1 time: 1.417994 Oct 28 10:24:08.315605 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3109/6239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:06 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1675 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:08.341728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:08.343325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:08.357434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:08.357939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:08.359718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-868cf1a5-e3ef-4372-97df-c4089dd4f00e req-1caa9017-d36d-4b0a-a57c-810d28355405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:08.369911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:08.371101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:08.371794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:08.377074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:08.391304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-868cf1a5-e3ef-4372-97df-c4089dd4f00e req-1caa9017-d36d-4b0a-a57c-810d28355405 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:08.395302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-868cf1a5-e3ef-4372-97df-c4089dd4f00e req-1caa9017-d36d-4b0a-a57c-810d28355405 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:08.397279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-868cf1a5-e3ef-4372-97df-c4089dd4f00e req-1caa9017-d36d-4b0a-a57c-810d28355405 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:08.437809 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-868cf1a5-e3ef-4372-97df-c4089dd4f00e req-1caa9017-d36d-4b0a-a57c-810d28355405 service nova] Creating event network-changed:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:24:08.465509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-868cf1a5-e3ef-4372-97df-c4089dd4f00e req-1caa9017-d36d-4b0a-a57c-810d28355405 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126033 Oct 28 10:24:08.472102 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3110/6240] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:24:09.352338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:09.356571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:09.379722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:09.385127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:09.387355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:09.390256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:09.397541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:09.399417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:09.944925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:09.954981 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b28627b-7810-4599-addd-105adb1f6f28 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1658 microversion: 2.1 time: 0.612349 Oct 28 10:24:09.957244 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3111/6241] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:09 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1658 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:09.983771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:09.984683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:09.997315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:09.999761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:10.000858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:10.004401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:10.005587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:10.006307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:10.007003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:10.157737 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a21446e1-0e9f-46df-a017-82d82538cbc5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action" status: 202 len: 0 microversion: 2.1 time: 0.178358 Oct 28 10:24:10.159150 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3112/6242] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:24:09 2022] POST /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a/action => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:24:10.191073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:10.193602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:10.209555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:10.210773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:10.211490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:10.215352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:10.217257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:10.223413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:10.535438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:10.571487 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c9294c1-59b5-4104-9bef-9eb0854fbe13 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1563 microversion: 2.1 time: 2.242547 Oct 28 10:24:10.583212 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3131/6243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:08 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1563 bytes in 2255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:11.132340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:11.155438 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e3c1741a-f343-43b3-9b26-5e2b70e68acb tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1664 microversion: 2.1 time: 0.983546 Oct 28 10:24:11.156660 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3113/6244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:10 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1664 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:12.183711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:12.184770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:12.203011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:12.203673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:12.204227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:12.205086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:12.205657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:12.206198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:12.974332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:12.989545 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84e0e1c6-6385-4629-a2e0-2a308f84b662 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1664 microversion: 2.1 time: 0.809597 Oct 28 10:24:12.990788 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3132/6245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:12 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1664 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:14.017332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:14.018887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:14.050821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:14.051290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:14.051838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:14.053281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:14.056387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:14.057098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:14.561265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:14.601062 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40f1fdf6-d53c-42da-ae39-e6587605b06c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1664 microversion: 2.1 time: 0.586321 Oct 28 10:24:14.607252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3114/6246] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:14 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1664 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:15.625710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:15.626600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:15.638444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=50 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:15.644948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:15.646288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:15.646999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:15.648920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:15.656273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:15.657508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:16.038568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:16.051741 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9141e210-badd-4db9-8866-be3f9c801ef9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.428778 Oct 28 10:24:16.058178 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3133/6247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:15 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:16.088944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:16.089543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:16.112057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:16.113719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:16.114382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:16.118564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:16.121141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:16.122192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:16.896701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:16.908483 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-56fecea6-82c7-40bc-8354-bec8e857ee91 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1667 microversion: 2.1 time: 0.824121 Oct 28 10:24:16.920939 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3115/6248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:16 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1667 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:16.944933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:16.945537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:16.986476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:16.989263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:16.990570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:16.991799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:16.994817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:16.995302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:17.058281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:24:17.077330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Working on deleting snapshot ab9e9a18-b3d1-4c18-b821-66087fe1a840 from shelved instance... Oct 28 10:24:18.330175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Doing local delete in cell 308273ef-dc1c-40ee-a51c-31916410c877(cell1) {{(pid=128748) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 28 10:24:18.331004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:18.331553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:18.332496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:18.332941 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 28 10:24:18.349308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] deallocate_for_instance() {{(pid=128748) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 28 10:24:20.110795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Updating instance_info_cache with network_info: [] {{(pid=128748) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 28 10:24:20.157280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-cd591da6-40f1-4f42-90e6-685b5c8a9a59 req-beaa6081-18db-4a8f-9401-ed0c1338b0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "548d1c2c-a136-4d23-af0b-cdb57cfacc2c", "name": "network-vif-deleted", "tag": "301ab369-a98f-4ff8-8ce2-5bf7ee64ce12"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:20.180891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cd591da6-40f1-4f42-90e6-685b5c8a9a59 req-beaa6081-18db-4a8f-9401-ed0c1338b0e3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:20.198335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cd591da6-40f1-4f42-90e6-685b5c8a9a59 req-beaa6081-18db-4a8f-9401-ed0c1338b0e3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:20.198981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-cd591da6-40f1-4f42-90e6-685b5c8a9a59 req-beaa6081-18db-4a8f-9401-ed0c1338b0e3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:20.255878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.server_external_events [req-cd591da6-40f1-4f42-90e6-685b5c8a9a59 req-beaa6081-18db-4a8f-9401-ed0c1338b0e3 service nova] Unable to find a host for instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c. Dropping event network-vif-deleted {{(pid=128747) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 10:24:20.257274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-cd591da6-40f1-4f42-90e6-685b5c8a9a59 req-beaa6081-18db-4a8f-9401-ed0c1338b0e3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.129846 Oct 28 10:24:20.258447 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3116/6249] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 131 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 10:24:20.888301 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09515309-3f8d-44a9-bd1a-eb9d66bff63a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 204 len: 0 microversion: 2.1 time: 3.950735 Oct 28 10:24:20.889055 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3134/6250] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:24:16 2022] DELETE /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 0 bytes in 3952 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:24:20.897550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:20.898182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 548d1c2c-a136-4d23-af0b-cdb57cfacc2c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:20.923216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:20.924191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:20.924812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:20.926308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:20.927326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:20.929701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:20.964755 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] HTTP exception thrown: Instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c could not be found. Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Request method failure captured: Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c HTTP/1.1 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6vlrJYCf_Dg7Kfb44N26_ij3WM0ja6IaeUGKBN3__kljfDcVQmcw97kaDW38Vjj5LjXpwjDQflsstZSp-FK8iLAVZ1mo3C6Hs3HzVTtHETUYWVN-sG5pClX7ZYYJC3q4AB5mGZ-MZbnfL6XtWp8X-Yf8p_DQHzn9nCYeqVmtE3FXrE Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_647a75e417314ddbb20364530ad36c54", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/647a75e417314ddbb20364530ad36c54"}]}] Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1b327af221c94695bc5b82fa49e3c448 Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c could not be found. Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '548d1c2c-a136-4d23-af0b-cdb57cfacc2c'} Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c could not be found. Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c could not be found. Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:20.966725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:20.972070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:20.972070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:20.972070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:20.972070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:24:20.972070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:24:20.972070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c could not be found. Oct 28 10:24:20.972070 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:20.978697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Returning 404 to user: Instance 548d1c2c-a136-4d23-af0b-cdb57cfacc2c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:24:20.979961 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea39a092-bfac-49e3-8eba-30d457486d8c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c" status: 404 len: 111 microversion: 2.1 time: 0.086418 Oct 28 10:24:20.980877 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3117/6251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:20 2022] GET /compute/v2.1/servers/548d1c2c-a136-4d23-af0b-cdb57cfacc2c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:20.990721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:20.991228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:21.001488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:21.001997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:21.002462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:21.003161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:21.004188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:21.004620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:21.022544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:21.061901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:24:21.193006 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a408e7d2-4dfc-494a-ac93-b3b4d3ff849e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 204 len: 0 microversion: 2.1 time: 0.207493 Oct 28 10:24:21.198999 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3135/6252] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:24:20 2022] DELETE /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:24:21.206535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:21.207123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:21.214737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:21.215842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:21.216562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:21.217237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:21.217689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:21.218302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:21.378711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:21.388430 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-87580319-9853-42da-83a9-a199dd07e82d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1466 microversion: 2.1 time: 0.187242 Oct 28 10:24:21.394181 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3118/6253] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:21 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1466 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:24:22.419820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:22.423482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:22.453027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:22.456000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:22.458044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:22.459975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:22.469744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:22.471169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:22.717596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:22.736091 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5894520d-0230-45ca-91f5-89baa29e006a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1466 microversion: 2.1 time: 0.321203 Oct 28 10:24:22.736976 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3136/6254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:22 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1466 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:23.761167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:23.762623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:23.774410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:23.776472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:23.777161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:23.779021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:23.781886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:23.782525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:24.013541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-98680870-3d1b-4c79-ba41-7c26ab1894ed req-dec17856-70bd-48aa-9716-4e5f212b7b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1415e64e-7e90-4706-98a5-c6e1edc0d2cf", "name": "network-vif-deleted", "tag": "9d64f742-4ca2-4d0a-8f76-615a70d4cde8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:24.036557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-98680870-3d1b-4c79-ba41-7c26ab1894ed req-dec17856-70bd-48aa-9716-4e5f212b7b9d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:24.041034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-98680870-3d1b-4c79-ba41-7c26ab1894ed req-dec17856-70bd-48aa-9716-4e5f212b7b9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:24.041756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-98680870-3d1b-4c79-ba41-7c26ab1894ed req-dec17856-70bd-48aa-9716-4e5f212b7b9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:24.098682 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-98680870-3d1b-4c79-ba41-7c26ab1894ed req-dec17856-70bd-48aa-9716-4e5f212b7b9d service nova] Creating event network-vif-deleted:9d64f742-4ca2-4d0a-8f76-615a70d4cde8 for instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf on n-h2-zed-1 Oct 28 10:24:24.126842 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-98680870-3d1b-4c79-ba41-7c26ab1894ed req-dec17856-70bd-48aa-9716-4e5f212b7b9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116987 Oct 28 10:24:24.127500 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3137/6255] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 28 10:24:24.219189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:24.241277 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e2a2e41-3fc7-47e6-86cb-e8570f03f765 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 200 len: 1466 microversion: 2.1 time: 0.473037 Oct 28 10:24:24.242514 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3119/6256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:23 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 1466 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:24.431115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:24.433817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:24.466706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:24.467869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:24.471450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:24.474875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:24.475971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:24.476737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:24.562600 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ab3daa9-eb79-48a6-a4a4-5df78cde50e6 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action" status: 200 len: 24573 microversion: 2.1 time: 0.135427 Oct 28 10:24:24.563455 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3138/6257] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:24:24 2022] POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action => generated 24573 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:24:25.271399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:25.272620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 1415e64e-7e90-4706-98a5-c6e1edc0d2cf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:25.312758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:25.314577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:25.318314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:25.319091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:25.319799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:25.322004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:25.397667 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] HTTP exception thrown: Instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf could not be found. Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Request method failure captured: Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf HTTP/1.1 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6vlrJYCf_Dg7Kfb44N26_ij3WM0ja6IaeUGKBN3__kljfDcVQmcw97kaDW38Vjj5LjXpwjDQflsstZSp-FK8iLAVZ1mo3C6Hs3HzVTtHETUYWVN-sG5pClX7ZYYJC3q4AB5mGZ-MZbnfL6XtWp8X-Yf8p_DQHzn9nCYeqVmtE3FXrE Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_647a75e417314ddbb20364530ad36c54", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/647a75e417314ddbb20364530ad36c54"}]}] Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1b327af221c94695bc5b82fa49e3c448 Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf could not be found. Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '1415e64e-7e90-4706-98a5-c6e1edc0d2cf'} Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf could not be found. Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf could not be found. Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:25.402910 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf could not be found. Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Returning 404 to user: Instance 1415e64e-7e90-4706-98a5-c6e1edc0d2cf could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:24:25.408630 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96d76160-8c2d-429a-8598-380c675f9d62 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf" status: 404 len: 111 microversion: 2.1 time: 0.139786 Oct 28 10:24:25.417207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:25.417823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:25.423806 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3120/6258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:25 2022] GET /compute/v2.1/servers/1415e64e-7e90-4706-98a5-c6e1edc0d2cf => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:25.428392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:25.434365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:25.434823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:25.435580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:25.436050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:25.436485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:25.505032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:24:25.604389 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c9467e19-be4e-4451-b4e6-fd7c027736e7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 204 len: 0 microversion: 2.1 time: 0.189766 Oct 28 10:24:25.605842 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3139/6259] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:24:25 2022] DELETE /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:24:25.615077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:25.616010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:25.623476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:25.624369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:25.624926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:25.625942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:25.626646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:25.627118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:25.957814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:25.980068 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99531290-b47c-4739-8a59-41e87ae1aca7 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1508 microversion: 2.1 time: 0.367964 Oct 28 10:24:25.983304 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3121/6260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:25 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1508 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:27.021122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:27.021837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:27.038715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:27.039616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:27.040260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:27.041022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:27.041492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:27.041931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:27.408138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:27.426063 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9328016-6bb9-48f5-b17a-6a68f990a57b tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1508 microversion: 2.1 time: 0.420398 Oct 28 10:24:27.428444 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3140/6261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:27 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:28.125949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6e3ba38c-167b-4e9b-8843-5e871876e554 req-ebd6b3db-cc6a-4096-8774-c05d2c929ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8cbfe95-1b03-45d9-bdf8-0865b985bd35", "name": "network-vif-deleted", "tag": "11be2be6-0bbd-428c-a3b0-1637accf1cfc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:28.161345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6e3ba38c-167b-4e9b-8843-5e871876e554 req-ebd6b3db-cc6a-4096-8774-c05d2c929ad8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:28.164835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6e3ba38c-167b-4e9b-8843-5e871876e554 req-ebd6b3db-cc6a-4096-8774-c05d2c929ad8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:28.166112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6e3ba38c-167b-4e9b-8843-5e871876e554 req-ebd6b3db-cc6a-4096-8774-c05d2c929ad8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:28.197873 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6e3ba38c-167b-4e9b-8843-5e871876e554 req-ebd6b3db-cc6a-4096-8774-c05d2c929ad8 service nova] Creating event network-vif-deleted:11be2be6-0bbd-428c-a3b0-1637accf1cfc for instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 on n-h2-zed-1 Oct 28 10:24:28.220568 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6e3ba38c-167b-4e9b-8843-5e871876e554 req-ebd6b3db-cc6a-4096-8774-c05d2c929ad8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098758 Oct 28 10:24:28.226225 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3122/6262] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:24:28.451781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:28.452747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:28.469161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:28.470659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:28.473147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:28.474225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:28.475671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:28.477443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:28.611559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:28.612274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:28.617121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:28.617608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lazy-loading 'fault' on Instance uuid a8cbfe95-1b03-45d9-bdf8-0865b985bd35 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:24:28.719841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:28.734472 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93ab9f4e-e7cd-4788-ad40-f12856aacfb5 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 200 len: 1305 microversion: 2.1 time: 0.286534 Oct 28 10:24:28.750931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3141/6263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:28 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 1305 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:29.762538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:29.763228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: a8cbfe95-1b03-45d9-bdf8-0865b985bd35] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:29.786930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:29.792301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:29.793020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:29.797899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:29.798656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:29.799281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:29.857151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] HTTP exception thrown: Instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 could not be found. Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Request method failure captured: Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 HTTP/1.1 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6vlrJYCf_Dg7Kfb44N26_ij3WM0ja6IaeUGKBN3__kljfDcVQmcw97kaDW38Vjj5LjXpwjDQflsstZSp-FK8iLAVZ1mo3C6Hs3HzVTtHETUYWVN-sG5pClX7ZYYJC3q4AB5mGZ-MZbnfL6XtWp8X-Yf8p_DQHzn9nCYeqVmtE3FXrE Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_647a75e417314ddbb20364530ad36c54", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/647a75e417314ddbb20364530ad36c54"}]}] Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1b327af221c94695bc5b82fa49e3c448 Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 could not be found. Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a8cbfe95-1b03-45d9-bdf8-0865b985bd35'} Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 could not be found. Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 could not be found. Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:29.858855 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 could not be found. Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Returning 404 to user: Instance a8cbfe95-1b03-45d9-bdf8-0865b985bd35 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52660908-c16d-4de4-9c50-82a6b09cf341 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35" status: 404 len: 111 microversion: 2.1 time: 0.102524 Oct 28 10:24:29.865013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3123/6264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:29 2022] GET /compute/v2.1/servers/a8cbfe95-1b03-45d9-bdf8-0865b985bd35 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:29.872173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:29.873249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:29.883590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:29.896453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:29.900588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:29.904152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:29.905561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:29.908392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:29.980317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:24:30.140035 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ca2f58b-6521-4ffe-ac52-a4acea80387c tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 204 len: 0 microversion: 2.1 time: 0.272563 Oct 28 10:24:30.140632 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3142/6265] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:24:29 2022] DELETE /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:24:30.158552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:30.160890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:30.173198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:30.178840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:30.179635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:30.185604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:30.186445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:30.187129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:30.388457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:30.405347 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d670b7c-a829-4b55-ab83-ed7436cfd987 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1494 microversion: 2.1 time: 0.254446 Oct 28 10:24:30.420438 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3124/6266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:30 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1494 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:31.446044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:31.446777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:31.467016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:31.468797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:31.474757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:31.476835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:31.485244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:31.485702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:32.278846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:32.287362 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-854e9319-cc05-4a56-8dad-745e150557ab tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1494 microversion: 2.1 time: 0.850513 Oct 28 10:24:32.293067 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3143/6267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:31 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1494 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:33.267912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-78cfc9fe-b20a-4256-884b-05f0e199314f req-6eb3a759-b692-4926-98d8-7cf37d8ac9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79bd6411-af08-4081-a862-c2243d0eb04c", "name": "network-vif-deleted", "tag": "ef12a598-b1fe-40f1-9ea5-465d01c5f771"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:33.284948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-78cfc9fe-b20a-4256-884b-05f0e199314f req-6eb3a759-b692-4926-98d8-7cf37d8ac9ff service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:33.289945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-78cfc9fe-b20a-4256-884b-05f0e199314f req-6eb3a759-b692-4926-98d8-7cf37d8ac9ff service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:33.294869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-78cfc9fe-b20a-4256-884b-05f0e199314f req-6eb3a759-b692-4926-98d8-7cf37d8ac9ff service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:33.319990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:33.321234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:33.339817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:33.351445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:33.352280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:33.354626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:33.355100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:33.356611 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-78cfc9fe-b20a-4256-884b-05f0e199314f req-6eb3a759-b692-4926-98d8-7cf37d8ac9ff service nova] Creating event network-vif-deleted:ef12a598-b1fe-40f1-9ea5-465d01c5f771 for instance 79bd6411-af08-4081-a862-c2243d0eb04c on n-h2-zed-1 Oct 28 10:24:33.361491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:33.376979 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-78cfc9fe-b20a-4256-884b-05f0e199314f req-6eb3a759-b692-4926-98d8-7cf37d8ac9ff service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110906 Oct 28 10:24:33.383079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3125/6268] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:24:33.712682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:33.726964 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfdf6ea3-84a3-4667-a4d5-97cb006db13e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 200 len: 1287 microversion: 2.1 time: 0.412314 Oct 28 10:24:33.727968 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3144/6269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:33 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 1287 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:24:34.754565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:34.756742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 79bd6411-af08-4081-a862-c2243d0eb04c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:34.780434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:34.781383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:34.781943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:34.787880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:34.789483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:34.791670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:34.841691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] HTTP exception thrown: Instance 79bd6411-af08-4081-a862-c2243d0eb04c could not be found. Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Request method failure captured: Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c HTTP/1.1 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6vlrJYCf_Dg7Kfb44N26_ij3WM0ja6IaeUGKBN3__kljfDcVQmcw97kaDW38Vjj5LjXpwjDQflsstZSp-FK8iLAVZ1mo3C6Hs3HzVTtHETUYWVN-sG5pClX7ZYYJC3q4AB5mGZ-MZbnfL6XtWp8X-Yf8p_DQHzn9nCYeqVmtE3FXrE Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_647a75e417314ddbb20364530ad36c54", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/647a75e417314ddbb20364530ad36c54"}]}] Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1b327af221c94695bc5b82fa49e3c448 Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 79bd6411-af08-4081-a862-c2243d0eb04c could not be found. Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '79bd6411-af08-4081-a862-c2243d0eb04c'} Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79bd6411-af08-4081-a862-c2243d0eb04c could not be found. Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79bd6411-af08-4081-a862-c2243d0eb04c could not be found. Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:34.848394 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:34.854607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:34.854607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:34.854607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:34.854607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:24:34.854607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:24:34.854607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79bd6411-af08-4081-a862-c2243d0eb04c could not be found. Oct 28 10:24:34.854607 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:34.859709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Returning 404 to user: Instance 79bd6411-af08-4081-a862-c2243d0eb04c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:24:34.865687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-db868d1d-d870-45ef-baa3-6306295437d2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c" status: 404 len: 111 microversion: 2.1 time: 0.116744 Oct 28 10:24:34.866511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3126/6270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:34 2022] GET /compute/v2.1/servers/79bd6411-af08-4081-a862-c2243d0eb04c => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:34.874792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:34.876117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:34.884415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:34.885130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:34.885747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:34.886657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:34.887337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:34.887989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:34.924077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:24:35.007030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:35.047675 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f6ebf54a-e0bb-4b88-ac6b-25fd32dbb6ad tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 204 len: 0 microversion: 2.1 time: 0.175867 Oct 28 10:24:35.048651 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3145/6271] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:24:34 2022] DELETE /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:24:35.058674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:35.059433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:35.067739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:35.068495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:35.069225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:35.070529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:35.071173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:35.072018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:35.257423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:35.266859 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e9bf89cf-3776-4894-972d-25f0f155f88e tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1673 microversion: 2.1 time: 0.213884 Oct 28 10:24:35.269234 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3127/6272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:35 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:24:35.527772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:35.528499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:35.542566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:35.543073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:35.548865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:35.551079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:35.551851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:35.552323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:35.881395 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e36f8cef-5dc8-4ad5-bedb-bda5b0d974fa tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1827 microversion: 2.1 time: 0.358901 Oct 28 10:24:35.882074 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3146/6273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:35 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1827 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:35.904800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:35.905456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:35.920214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:35.921047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:35.933674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:35.934463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:35.934955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:35.935392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:36.271478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:36.281210 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1357b69-1352-44eb-ad94-b97ed1b1c8c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1682 microversion: 2.1 time: 0.380322 Oct 28 10:24:36.281794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3128/6274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:35 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1682 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:36.301031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:36.301031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:36.314447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:36.315024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:36.316014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:36.321367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:36.321848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:36.322287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:36.748460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:36.759043 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e9e71ad5-84e3-40ba-a807-800c3b6a97bf tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1673 microversion: 2.1 time: 0.469113 Oct 28 10:24:36.759550 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3147/6275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:36 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1673 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:37.111810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:37.116701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:37.135420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:37.137730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:37.145565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:37.148598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:37.149901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:37.165355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:37.301299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15df9972-40b6-48f5-90ec-cf8b44e86275 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action" status: 200 len: 32643 microversion: 2.1 time: 0.197318 Oct 28 10:24:37.308485 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3129/6276] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:24:37 2022] POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action => generated 32643 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:24:37.459565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:37.460439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:37.470942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:37.471438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:37.472459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:37.476828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:37.479519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:37.480039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:37.788615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:37.789632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:37.814128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:37.814617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:37.815076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:37.824884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:37.839071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:37.842747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:37.902096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '9af7e368832b4ccfa10ac8539b8723ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b66ba8a4e3c8436aae7b71a9d9266255', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:37.902805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] flavor_id is None. Assuming migration. {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 28 10:24:37.903335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:24:38.335396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:38.348242 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d84974a4-0e4f-4456-9b98-4291727b2d21 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1673 microversion: 2.1 time: 0.565501 Oct 28 10:24:38.349411 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3130/6277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:37 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1673 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:38.392669 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [d1df3681-c805-43c0-98f8-5fe994109871] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 10:24:39.376321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:39.377861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:39.388134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:39.388880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:39.389613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:39.390657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:39.391305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:39.391896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:39.401968 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [d1df3681-c805-43c0-98f8-5fe994109871] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 41962. Oct 28 10:24:39.403395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:39.424928 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d366a7be-e0a6-4548-b083-14b46a88a275 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action" status: 202 len: 0 microversion: 2.1 time: 1.959463 Oct 28 10:24:39.424928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3148/6278] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:24:37 2022] POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action => generated 0 bytes in 1963 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:24:39.433248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:39.445107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:39.499532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:39.500031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:39.500479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:39.507294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:39.510463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:39.510967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:39.751012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:39.777536 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d96ce37-60e2-42d1-839d-3ae2222a751d tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1673 microversion: 2.1 time: 0.403348 Oct 28 10:24:39.779278 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3131/6279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:39 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1673 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:24:40.327012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:40.357400 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e59454c-8f65-432a-a1d4-d17f39ef95d1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1691 microversion: 2.1 time: 0.941014 Oct 28 10:24:40.369759 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3149/6280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:39 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1691 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:24:40.808126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:40.809620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:40.824828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=40 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:40.838461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:40.839383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:40.840098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:40.843924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:40.845653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:40.846340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:41.210162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:41.229144 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-66f646e2-63fb-4b3a-aaef-7e6557bcded2 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1606 microversion: 2.1 time: 0.423577 Oct 28 10:24:41.232755 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3132/6281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:40 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1606 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:41.386856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:41.387577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:41.412191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:41.412868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:41.413362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:41.414090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:41.414551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:41.414984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:42.001938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-2f565fbf-a1dc-434a-bda9-600d8ed42bd7 req-838859cb-c497-4427-9be7-d4700bdc0b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcd0a6b-eda6-43de-b69e-7da5c7807c5a", "name": "network-vif-deleted", "tag": "247bca4a-5967-4d12-937e-61e43ddd86e4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:24:42.044942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2f565fbf-a1dc-434a-bda9-600d8ed42bd7 req-838859cb-c497-4427-9be7-d4700bdc0b73 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:42.045440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2f565fbf-a1dc-434a-bda9-600d8ed42bd7 req-838859cb-c497-4427-9be7-d4700bdc0b73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:42.045888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2f565fbf-a1dc-434a-bda9-600d8ed42bd7 req-838859cb-c497-4427-9be7-d4700bdc0b73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:42.091722 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-2f565fbf-a1dc-434a-bda9-600d8ed42bd7 req-838859cb-c497-4427-9be7-d4700bdc0b73 service nova] Creating event network-vif-deleted:247bca4a-5967-4d12-937e-61e43ddd86e4 for instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a on n-h1-zed-1 Oct 28 10:24:42.100953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-2f565fbf-a1dc-434a-bda9-600d8ed42bd7 req-838859cb-c497-4427-9be7-d4700bdc0b73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102785 Oct 28 10:24:42.105158 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3133/6282] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:24:42.258296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:42.266077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:42.266884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:42.271224 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d5df5492-26fa-4b40-9369-e3c6365ce8f5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1691 microversion: 2.1 time: 0.888952 Oct 28 10:24:42.284260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:42.286337 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3150/6283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:41 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1691 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:42.293559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:42.299803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:42.304279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:42.313997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:42.317556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:42.419523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:42.422989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:42.426483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:42.427214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lazy-loading 'fault' on Instance uuid 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:24:42.777047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b327af221c94695bc5b82fa49e3c448', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647a75e417314ddbb20364530ad36c54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:42.808578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eaa41143-7108-46fe-b04e-5a1c217ebf45 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 200 len: 1328 microversion: 2.1 time: 0.548961 Oct 28 10:24:42.815225 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3134/6284] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:42 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 1328 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:43.299647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:43.300516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:43.313458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:43.314128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:43.314386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:43.323297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:43.324027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:43.324648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:43.853239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:43.853892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] [instance: 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:43.874887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:43.874887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:43.875341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:43.875995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:43.897002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:43.901745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:43.990661 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] HTTP exception thrown: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a could not be found. Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Request method failure captured: Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a HTTP/1.1 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6vlrJYCf_Dg7Kfb44N26_ij3WM0ja6IaeUGKBN3__kljfDcVQmcw97kaDW38Vjj5LjXpwjDQflsstZSp-FK8iLAVZ1mo3C6Hs3HzVTtHETUYWVN-sG5pClX7ZYYJC3q4AB5mGZ-MZbnfL6XtWp8X-Yf8p_DQHzn9nCYeqVmtE3FXrE Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/647a75e417314ddbb20364530ad36c54"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_647a75e417314ddbb20364530ad36c54", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/647a75e417314ddbb20364530ad36c54"}]}] Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 647a75e417314ddbb20364530ad36c54 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-1074299661 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1b327af221c94695bc5b82fa49e3c448 Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-1074299661-project Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a could not be found. Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7dcd0a6b-eda6-43de-b69e-7da5c7807c5a'} Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a could not be found. Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a could not be found. Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:24:44.012171 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:44.022893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:24:44.022893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:24:44.022893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:24:44.022893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:24:44.022893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:24:44.022893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a could not be found. Oct 28 10:24:44.022893 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:24:44.028337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Returning 404 to user: Instance 7dcd0a6b-eda6-43de-b69e-7da5c7807c5a could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:24:44.031132 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fb3a9d4-37a2-48d6-8579-2ef1c25cbaa9 tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a" status: 404 len: 111 microversion: 2.1 time: 0.189477 Oct 28 10:24:44.036762 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3135/6285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:43 2022] GET /compute/v2.1/servers/7dcd0a6b-eda6-43de-b69e-7da5c7807c5a => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:24:44.053442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ffd773e-a7c2-4815-ba9b-240745d2861a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] Calling method '.version_select at 0x7fca3301bc10>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:44.109132 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ffd773e-a7c2-4815-ba9b-240745d2861a tempest-ServerActionsTestJSON-1074299661 tempest-ServerActionsTestJSON-1074299661-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208482007" status: 202 len: 0 microversion: 2.1 time: 0.065161 Oct 28 10:24:44.119288 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3136/6286] 10.222.0.16 () {58 vars in 1218 bytes} [Fri Oct 28 10:24:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208482007 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:24:44.380476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:44.412500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-507d456b-7744-421b-a9ce-70fbd963c59c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1691 microversion: 2.1 time: 1.112118 Oct 28 10:24:44.427339 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3151/6287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:43 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1691 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:45.442182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:45.444118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:45.468249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:45.469246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:45.476257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:45.477549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:45.486642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:45.487414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:47.024271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:47.060475 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee3ce50c-67ba-414e-94d5-89c1c664a875 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1691 microversion: 2.1 time: 1.612000 Oct 28 10:24:47.060475 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3137/6288] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:45 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1691 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:48.082833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:48.084163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:48.097314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=5 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:24:48.137222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:48.138552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:48.139001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:48.140180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:48.140180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:48.143685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:49.150122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:49.171800 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3e903aad-0451-4229-a21f-e1f51423cee5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1696 microversion: 2.1 time: 1.089299 Oct 28 10:24:49.183157 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3152/6289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:48 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1696 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:50.208811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:50.216326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:50.259552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:50.263598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:50.266135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:50.287739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:50.288380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:50.288976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:50.967666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:50.983925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-59080079-c9d5-4402-88dd-267391f4e3e0 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1696 microversion: 2.1 time: 0.785921 Oct 28 10:24:50.991815 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3138/6290] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:50 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1696 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:52.022183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:52.022803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:52.048086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:52.048596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:52.049078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:52.049861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:52.050325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:52.050760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:52.821714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:52.830096 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd0105fb-517d-470f-a430-b366a0021877 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1696 microversion: 2.1 time: 0.812570 Oct 28 10:24:52.831487 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3153/6291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:52 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1696 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:53.855932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:53.856547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:53.879918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:53.880043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:53.880623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:53.881270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:53.881729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:53.882164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:54.833646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:54.848869 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-804a868e-8248-4c69-b808-78194c127933 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1696 microversion: 2.1 time: 0.994092 Oct 28 10:24:54.850085 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3139/6292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:53 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1696 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:55.875122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:55.875801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:55.912403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:55.917168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:55.917662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:55.923639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:55.924142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:55.929963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:57.016319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:57.027544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dabc011f-677c-4e1e-8971-fabf330938dd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1696 microversion: 2.1 time: 1.157429 Oct 28 10:24:57.030392 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3154/6293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:55 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1696 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:58.075452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:58.079437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:58.129978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:58.129978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:58.138873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:58.150390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:58.152499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:58.153220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:58.844352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:24:58.866306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b5f367de-6084-4c10-9b24-dd2183c60e7b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1696 microversion: 2.1 time: 0.813021 Oct 28 10:24:58.889462 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3140/6294] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:58 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1696 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:24:59.894336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:24:59.895236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:24:59.912050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:59.914182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:59.915737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:24:59.919021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:24:59.920248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:24:59.923123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:00.295530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c3bc9d09-7358-4489-8551-58a571465e8d req-9eec5b1b-a424-4ef5-ae49-ae14d71367cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "name": "network-vif-unplugged", "status": "completed", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:00.332963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c3bc9d09-7358-4489-8551-58a571465e8d req-9eec5b1b-a424-4ef5-ae49-ae14d71367cb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:00.333564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c3bc9d09-7358-4489-8551-58a571465e8d req-9eec5b1b-a424-4ef5-ae49-ae14d71367cb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:00.334016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c3bc9d09-7358-4489-8551-58a571465e8d req-9eec5b1b-a424-4ef5-ae49-ae14d71367cb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:00.396516 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c3bc9d09-7358-4489-8551-58a571465e8d req-9eec5b1b-a424-4ef5-ae49-ae14d71367cb service nova] Creating event network-vif-unplugged:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h2-zed-1 Oct 28 10:25:00.425553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-c3bc9d09-7358-4489-8551-58a571465e8d req-9eec5b1b-a424-4ef5-ae49-ae14d71367cb service nova] Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:25:00.497127 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c3bc9d09-7358-4489-8551-58a571465e8d req-9eec5b1b-a424-4ef5-ae49-ae14d71367cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.204809 Oct 28 10:25:00.500545 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3141/6295] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:25:02.200326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:02.219863 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ff6a8425-042c-431c-bd6e-b17720c213ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1695 microversion: 2.1 time: 2.330369 Oct 28 10:25:02.233546 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3155/6296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:24:59 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1695 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:03.193311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1375953362", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": "none"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:03.248311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:03.249650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:03.266349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:03.269020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:03.270920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:03.272629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:03.277386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:03.278160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:03.301648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:25:03.302831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:25:03.303562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:25:03.304221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:25:03.308758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:25:03.338862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:03.347009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:03.353634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:03.354998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:03.356931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:03.361108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:03.425189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Getting quotas for project fafa0e8262b54463a9ce5d3d58519852. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:25:03.438632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Getting quotas for user 735cb543df9a480cb60de622526aad52 and project fafa0e8262b54463a9ce5d3d58519852. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:25:03.470089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:25:03.478141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:25:03.556481 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c7620b0b-319b-45ad-bd9e-7c277dbbc4d3 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.639470 Oct 28 10:25:03.566105 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3142/6297] 10.222.0.16 () {62 vars in 1188 bytes} [Fri Oct 28 10:25:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 28 10:25:03.578428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d9a72bf-7124-459b-9c11-667626a39729 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:03.579131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d9a72bf-7124-459b-9c11-667626a39729 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:04.263354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:04.273192 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29552de1-f296-46db-9141-22d46ab64039 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1695 microversion: 2.1 time: 1.029383 Oct 28 10:25:04.285926 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3156/6298] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:03 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1695 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:25:04.290574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e701ceeb-2287-4554-b9d3-a8cd4769aebf req-dc51e1a6-3662-4cd9-bb7f-9241ae303ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:04.310667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e701ceeb-2287-4554-b9d3-a8cd4769aebf req-dc51e1a6-3662-4cd9-bb7f-9241ae303ae0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:04.311204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e701ceeb-2287-4554-b9d3-a8cd4769aebf req-dc51e1a6-3662-4cd9-bb7f-9241ae303ae0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:04.311647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e701ceeb-2287-4554-b9d3-a8cd4769aebf req-dc51e1a6-3662-4cd9-bb7f-9241ae303ae0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:04.335979 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e701ceeb-2287-4554-b9d3-a8cd4769aebf req-dc51e1a6-3662-4cd9-bb7f-9241ae303ae0 service nova] Creating event network-changed:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h2-zed-1 Oct 28 10:25:04.337410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d9a72bf-7124-459b-9c11-667626a39729 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:04.353908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-e701ceeb-2287-4554-b9d3-a8cd4769aebf req-dc51e1a6-3662-4cd9-bb7f-9241ae303ae0 service nova] Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:25:04.357346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d9a72bf-7124-459b-9c11-667626a39729 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:04.363905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d9a72bf-7124-459b-9c11-667626a39729 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:04.365703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d9a72bf-7124-459b-9c11-667626a39729 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1278 microversion: 2.57 time: 0.798456 Oct 28 10:25:04.371447 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3143/6299] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:03 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1278 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:04.382840 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e701ceeb-2287-4554-b9d3-a8cd4769aebf req-dc51e1a6-3662-4cd9-bb7f-9241ae303ae0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095706 Oct 28 10:25:04.397044 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3157/6300] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:25:05.312126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:05.312983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:05.354683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:05.359992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:05.360548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:05.367499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:05.368352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:05.368817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:05.402370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:05.403083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:05.426467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:05.426992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:05.427446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:05.428182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:05.433580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:05.434037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:05.855653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:05.864389 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-062c6d13-b540-4222-9d97-f1dece389d7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1695 microversion: 2.1 time: 0.556647 Oct 28 10:25:05.865019 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3144/6301] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:05 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1695 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:06.029438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:06.033095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=83,nova_cell1:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:06.047511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:06.052689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:06.055429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-26a56d77-7f93-49f6-9bcd-bdbab7243231 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1338 microversion: 2.57 time: 0.655982 Oct 28 10:25:06.058093 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3158/6302] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:05 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1338 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:25:06.892955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:06.894153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:06.905463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:06.905972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:06.906423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:06.915165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:06.915672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:06.916129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:07.088757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:07.089662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:07.107471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:07.109432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:07.109994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:07.111790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:07.117154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:07.117711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:07.338590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:07.348425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:07.357347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:07.365015 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f244562c-3e2c-4440-98a0-c79ccf94f3f5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1336 microversion: 2.57 time: 0.280591 Oct 28 10:25:07.365988 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3159/6303] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:07 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1336 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:25:07.775909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:07.787975 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b75f69d4-e40e-4392-b921-211e04389c71 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1695 microversion: 2.1 time: 0.898539 Oct 28 10:25:07.789627 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3145/6304] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:06 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1695 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:08.399094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:08.402189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:08.418570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:08.421728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:08.422179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:08.423513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:08.424150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:08.424621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:08.583987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:08.595800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:08.599434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:08.603843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8f63a35-6dab-489c-ac83-1bfc9ef3dfdc tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1336 microversion: 2.57 time: 0.209157 Oct 28 10:25:08.606360 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3160/6305] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:08 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1336 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:08.817491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:08.818688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:08.838221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:08.842249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:08.843073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:08.846158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:08.847568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:08.848491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:09.246080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:09.266900 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e78ecb9b-6d9c-48d2-99b9-a8f984ece6c3 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1695 microversion: 2.1 time: 0.454930 Oct 28 10:25:09.267618 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3146/6306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:08 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1695 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:09.632268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:09.633074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:09.651142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:09.651761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:09.652213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:09.653222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:09.665346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:09.670041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:10.077996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:10.104850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:10.115321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:10.119481 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b61be279-aa9f-4d0b-a895-e1b6d034f262 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1336 microversion: 2.57 time: 0.491585 Oct 28 10:25:10.120078 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3161/6307] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:09 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1336 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:10.809977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:10.811350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:10.821745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:10.825990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:10.826835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:10.827872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:10.828602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:10.829344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:10.882628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=72 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:11.138865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:11.160732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:11.164212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:11.189605 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-00217be3-08aa-4170-8f89-68ea5f18f98d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1693 microversion: 2.1 time: 0.902454 Oct 28 10:25:11.209374 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3147/6308] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:10 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1693 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:11.210434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.211309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.212278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:11.213311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.214690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.215462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:11.429337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:11.442668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:11.449285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:11.450692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0fc7375e-f37a-4123-99a6-1c769e8b7ec1 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1357 microversion: 2.57 time: 0.296489 Oct 28 10:25:11.453066 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3162/6309] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:11 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1357 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:11.479477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:11.482658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:11.488700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:11.525282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.527124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.527751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:11.534278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.535821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.536278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:11.689513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:25:11.689912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:25:11.693090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:25:11.693524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:25:11.693951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:25:11.823945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:11.834652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.835531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.836713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:11.839146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.840359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.841496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:11.899067 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ccf2b29-0677-4919-85e0-c7f41654cc71 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "POST /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9/action" status: 202 len: 1138 microversion: 2.57 time: 0.424348 Oct 28 10:25:11.900612 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3148/6310] 10.222.0.16 () {62 vars in 1320 bytes} [Fri Oct 28 10:25:11 2022] POST /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9/action => generated 1138 bytes in 427 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 28 10:25:11.926185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:11.926896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:11.939025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.939609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.946133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:11.952016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:11.952728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:11.953611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:12.146118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:12.154662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:12.156122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:12.170035 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e8a4bb51-3929-4e9d-8fe2-35f5eec7e71c tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.239262 Oct 28 10:25:12.170747 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3163/6311] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:11 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:12.223276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:12.224354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:12.246396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:12.246895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:12.247333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:12.250784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:12.253696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:12.255875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:12.736024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:12.751641 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fa15b194-63bb-43b0-b779-ab30702b5442 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1693 microversion: 2.1 time: 0.532696 Oct 28 10:25:12.771026 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3149/6312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:12 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1693 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:13.204274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:13.206367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:13.214312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:13.215137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:13.215768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:13.216684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:13.217360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:13.218809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:13.393771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:13.404639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:13.423979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:13.432414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:13.440719 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc15ec18-0ed1-4922-b8bd-32588ec3a4b4 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.235432 Oct 28 10:25:13.441730 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3150/6313] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:13 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:13.567006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25f5c73c-833b-49e5-a716-44d89eaf2f33 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Action: 'create', calling method: .version_select at 0x7fca33b11b80>, body: {"keypair": {"name": "tempest-TestServerBasicOps-915663298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK7Q/XhJHbn+cBnLAaFnhycKwMAGuT4N0taYvZwDZ8IFaliHNQryLtIzhKcJODZK7v8T0lXCp79FHXkfF1Q0Oi0qrodGV+/PdMI5oD9ewSKq5l82pZtH/YAUiHNCdwbaUg=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:13.625930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-25f5c73c-833b-49e5-a716-44d89eaf2f33 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Getting quotas for project c2e7594ffba04a4bb687919ae7227733. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:25:13.642881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-25f5c73c-833b-49e5-a716-44d89eaf2f33 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Getting quotas for user ea05b9cbccbe4fa298503a412b287e1b and project c2e7594ffba04a4bb687919ae7227733. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:25:13.697460 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25f5c73c-833b-49e5-a716-44d89eaf2f33 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.708060 Oct 28 10:25:13.698763 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3164/6314] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:25:12 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:25:13.775786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:13.776759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:13.787063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:13.787845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:13.788614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:13.789823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:13.790659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:13.791294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:14.144616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:14.157920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-67a5d3f0-2cbd-4739-b421-9460ce070fc7 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1690 microversion: 2.1 time: 0.386168 Oct 28 10:25:14.159716 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3151/6315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:13 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1690 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:14.183162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:14.183712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:14.200228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:14.204098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:14.204862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:14.208190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:14.208957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:14.209592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:14.399031 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7763a03d-e9a9-4767-87eb-03d87c95c247 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action" status: 202 len: 0 microversion: 2.1 time: 0.218845 Oct 28 10:25:14.405994 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3165/6316] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:25:14 2022] POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:25:14.407999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:14.418054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:14.419216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:14.454836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:14.457426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:14.458594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:14.461579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:14.462255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:14.472366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:14.488758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:14.492266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:14.518961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:14.521521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:14.523407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:14.525578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:14.527971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:14.529835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:14.772070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:14.780714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:14.785553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:14.786688 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf6b8a75-3df8-4e88-9035-8540f61d0b9e tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.312804 Oct 28 10:25:14.790044 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3166/6317] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:14 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:15.558920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:15.574943 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10d1ab69-d0f2-4b55-932b-498a68ce0c48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 1.162868 Oct 28 10:25:15.589279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3152/6318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:14 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:15.816796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:15.817594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:15.827607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:15.833091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:15.833687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:15.834520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:15.837111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:15.838865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:16.113948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:16.124873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:16.126955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:16.129085 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-274b0206-fdb7-4ac9-998c-6e35a1f2c7b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.318888 Oct 28 10:25:16.129936 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3167/6319] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:15 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:25:16.281822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-47e87a2d-79e1-4b10-bd01-a1e1ac4c7303 req-d4747511-6169-423e-bc8f-cdf14ba31bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "name": "network-vif-plugged", "status": "completed", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:16.319020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-47e87a2d-79e1-4b10-bd01-a1e1ac4c7303 req-d4747511-6169-423e-bc8f-cdf14ba31bd3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:16.321357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-47e87a2d-79e1-4b10-bd01-a1e1ac4c7303 req-d4747511-6169-423e-bc8f-cdf14ba31bd3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:16.321837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-47e87a2d-79e1-4b10-bd01-a1e1ac4c7303 req-d4747511-6169-423e-bc8f-cdf14ba31bd3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:16.373756 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-47e87a2d-79e1-4b10-bd01-a1e1ac4c7303 req-d4747511-6169-423e-bc8f-cdf14ba31bd3 service nova] Creating event network-vif-plugged:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h2-zed-1 Oct 28 10:25:16.397227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-47e87a2d-79e1-4b10-bd01-a1e1ac4c7303 req-d4747511-6169-423e-bc8f-cdf14ba31bd3 service nova] Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:25:16.428878 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-47e87a2d-79e1-4b10-bd01-a1e1ac4c7303 req-d4747511-6169-423e-bc8f-cdf14ba31bd3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153944 Oct 28 10:25:16.431762 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3153/6320] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:25:16.603294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:16.603919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:16.618002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:16.620181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:16.621759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:16.623027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:16.624818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:16.625300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:17.167926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:17.168684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:17.179908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:17.180678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:17.182723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:17.184038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:17.185003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:17.185692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:17.407321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:17.423442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-efe42479-722c-4808-92bd-bb4c91151625 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 0.824170 Oct 28 10:25:17.424292 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3168/6321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:16 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:17.460057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:17.495747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:17.511844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:17.513586 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b6fdb0d-100d-4d05-bb64-ef3d050fa7e6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.350911 Oct 28 10:25:17.514757 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3154/6322] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:17 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:25:18.380287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1298882759", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-915663298", "security_groups": [{"name": "tempest-secgroup-smoke-532229298"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "4c37561b-3d88-4ffa-ab81-ac329a46f1db"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:18.430644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:18.448310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:18.449681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:18.458785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:18.464489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:18.472759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:18.475739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:18.480849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:18.481991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:18.664653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] validate_networks() for [('4c37561b-3d88-4ffa-ab81-ac329a46f1db', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:25:18.887563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:18.906730 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1f46544c-6acf-485c-9317-95893a4d4ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 0.463171 Oct 28 10:25:18.911709 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3155/6323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:18 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:18.917773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:18.923679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:18.957190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:18.958061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:18.958846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:18.964465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:18.965290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:18.965956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:19.104002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:19.124866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:19.126932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:19.133066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-86825153-c9b6-409a-9770-43447950efd6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.218382 Oct 28 10:25:19.135589 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3156/6324] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:18 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:19.937033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:19.938792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:19.950159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:19.952264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:19.952939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:19.954778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:19.957067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:19.959681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:20.172363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Getting quotas for project c2e7594ffba04a4bb687919ae7227733. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:25:20.181402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:20.185618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Getting quotas for user ea05b9cbccbe4fa298503a412b287e1b and project c2e7594ffba04a4bb687919ae7227733. Resources: dict_keys(['metadata_items']) {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:25:20.189853 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45f1f5ff-d213-4b10-99de-0297c57dff64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 0.258713 Oct 28 10:25:20.194538 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3157/6325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:19 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:25:20.209600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:20.210526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:20.218501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:25:20.219340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:25:20.220067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:25:20.222742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:25:20.223580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:25:20.233468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:20.246648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:20.247525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:20.250058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:20.252773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:20.253491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:20.255991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:20.257911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:20.258610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:20.261967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:20.267577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:20.269137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:20.336524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Getting quotas for project c2e7594ffba04a4bb687919ae7227733. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:25:20.352508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Getting quotas for user ea05b9cbccbe4fa298503a412b287e1b and project c2e7594ffba04a4bb687919ae7227733. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:25:20.387649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:25:20.390723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:25:20.497737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:20.506442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:20.507985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:20.516508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f0b06508-e33f-4b98-ad0e-1a22928186d5 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.320835 Oct 28 10:25:20.517374 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3158/6326] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:20 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:20.540146 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9bc0f0a7-023b-4f33-b799-3cc7fe4e3e95 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.165378 Oct 28 10:25:20.547423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3169/6327] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:25:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:25:20.552310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f293ceb4-be75-40a0-bffa-ac9d14495815 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:20.552955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f293ceb4-be75-40a0-bffa-ac9d14495815 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:20.704406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f293ceb4-be75-40a0-bffa-ac9d14495815 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:20.714000 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f293ceb4-be75-40a0-bffa-ac9d14495815 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1302 microversion: 2.1 time: 0.165543 Oct 28 10:25:20.720498 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3159/6328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:20 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1302 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:21.242584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:21.250626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:21.293789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:21.294454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:21.295982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:21.296830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:21.297696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:21.298371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:21.544132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:21.545493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:21.572638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:21.574620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:21.577208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:21.579858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:21.580623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:21.581762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:21.801637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:21.813620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:21.816325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:21.817946 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b5a53fe-8bf6-4d4d-b21c-7aedf01d4878 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.278065 Oct 28 10:25:21.819267 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3160/6329] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:21 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:21.832705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:21.837012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:21.853675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:21.854740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:21.856984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:21.858280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:21.863396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:21.864405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:22.034956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:22.047907 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cbf6163b-1651-425e-85bc-58e801237354 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1354 microversion: 2.1 time: 0.224174 Oct 28 10:25:22.048879 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3161/6330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:21 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1354 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:22.113161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:22.121312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8fb32e27-bd89-4078-8bff-b1774cf9a84b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 0.903884 Oct 28 10:25:22.128726 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3170/6331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:21 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:22.419066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-dc4ae5a1-e21a-4e46-8421-de6d3b32fbf9 req-9cd3d437-a92b-488d-b5a0-7f9547601c8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "name": "network-vif-unplugged", "status": "completed", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:22.451984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dc4ae5a1-e21a-4e46-8421-de6d3b32fbf9 req-9cd3d437-a92b-488d-b5a0-7f9547601c8e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:22.453427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dc4ae5a1-e21a-4e46-8421-de6d3b32fbf9 req-9cd3d437-a92b-488d-b5a0-7f9547601c8e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:22.457037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dc4ae5a1-e21a-4e46-8421-de6d3b32fbf9 req-9cd3d437-a92b-488d-b5a0-7f9547601c8e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:22.492585 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-dc4ae5a1-e21a-4e46-8421-de6d3b32fbf9 req-9cd3d437-a92b-488d-b5a0-7f9547601c8e service nova] Creating event network-vif-unplugged:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:25:22.508805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-dc4ae5a1-e21a-4e46-8421-de6d3b32fbf9 req-9cd3d437-a92b-488d-b5a0-7f9547601c8e service nova] Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:25:22.544578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-dc4ae5a1-e21a-4e46-8421-de6d3b32fbf9 req-9cd3d437-a92b-488d-b5a0-7f9547601c8e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132826 Oct 28 10:25:22.548122 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3162/6332] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:25:22.850335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:22.851570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:22.873812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:22.874319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:22.874761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:22.875540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:22.891949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:22.892429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:23.077646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:23.078650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:23.087355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:23.088095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:23.088718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:23.089656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:23.090298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:23.090908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:23.149339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:23.152541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:23.171549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:23.173038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:23.174273 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4cc7b7ef-e45d-493b-913d-1c6946e09268 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.329564 Oct 28 10:25:23.174841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3171/6333] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:22 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:23.185230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:23.189730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:23.204583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:23.206011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:23.206724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:23.207703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:23.208394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:23.209707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:23.459846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:23.472871 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5aaf486f-dfaf-45d1-87da-9d7d7035bee7 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1360 microversion: 2.1 time: 0.403796 Oct 28 10:25:23.495028 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3163/6334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:23 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1360 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:25:23.812319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:23.825743 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aa4b820c-b385-46f3-9d0c-574b4b10f7ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 0.644199 Oct 28 10:25:23.827716 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3172/6335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:23 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:24.204496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:24.210781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:24.227450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:24.258404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:24.268983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:24.270080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:24.270728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:24.273895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:24.505277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:24.506197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:24.552629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:24.557941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:24.562800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:24.567165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:24.573700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:24.574452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:24.592701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:24.619256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:24.621077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:24.630831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e199641b-f8ac-4ccd-8094-511985b9d18f tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.422607 Oct 28 10:25:24.632796 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3164/6336] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:24 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:24.652747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-03bca1d1-c95c-4a1e-abed-97daae4f2e69 req-4a87b729-9581-4e64-a43d-b54eb11cdc7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:24.687076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-03bca1d1-c95c-4a1e-abed-97daae4f2e69 req-4a87b729-9581-4e64-a43d-b54eb11cdc7f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:24.690668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-03bca1d1-c95c-4a1e-abed-97daae4f2e69 req-4a87b729-9581-4e64-a43d-b54eb11cdc7f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:24.695807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-03bca1d1-c95c-4a1e-abed-97daae4f2e69 req-4a87b729-9581-4e64-a43d-b54eb11cdc7f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:24.754728 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-03bca1d1-c95c-4a1e-abed-97daae4f2e69 req-4a87b729-9581-4e64-a43d-b54eb11cdc7f service nova] Creating event network-changed:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:25:24.772765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-03bca1d1-c95c-4a1e-abed-97daae4f2e69 req-4a87b729-9581-4e64-a43d-b54eb11cdc7f service nova] Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:25:24.797369 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-03bca1d1-c95c-4a1e-abed-97daae4f2e69 req-4a87b729-9581-4e64-a43d-b54eb11cdc7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149086 Oct 28 10:25:24.810404 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3165/6337] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:25:24.867080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:24.870180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:24.890955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:24.893747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:24.894332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:24.895167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:24.897285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:24.897807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:25.087629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:25.097758 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-40ca7481-e3df-4631-839c-477e4c1c995e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1360 microversion: 2.1 time: 0.598034 Oct 28 10:25:25.114079 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3173/6338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:24 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1360 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:25.664878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:25.665681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:25.686162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:25.689235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:25.690342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:25.694675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:25.699350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:25.704272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:25.975871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:25.992677 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eec85a01-da7b-4846-995d-48960f5f267d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 1.132971 Oct 28 10:25:25.993541 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3166/6339] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:24 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:26.126116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:26.127059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:26.143691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:26.144405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:26.145067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:26.145990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:26.146640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:26.147290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:26.328306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:26.339358 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b327f560-747f-48dd-8aff-08ce360f3f76 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1360 microversion: 2.1 time: 0.217098 Oct 28 10:25:26.344564 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3167/6340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:26 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1360 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:25:26.578470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:26.627211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:26.632879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:26.639754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-60302b29-7138-4f44-8358-c90e656fbf3d tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.980038 Oct 28 10:25:26.647332 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3174/6341] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:25 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:25:27.022054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:27.022757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:27.051782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:27.054047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:27.054715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:27.055761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:27.059802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:27.060459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:27.373419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:27.374564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:27.393910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:27.398342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:27.398875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:27.399644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:27.400898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:27.401881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:27.409326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:27.484444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:27.501203 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8aa01b85-2b03-4ad5-bb27-8dfe51f57c91 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 0.483729 Oct 28 10:25:27.506522 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3168/6342] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:27 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:27.679716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:27.680416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:27.699673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:27.702331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:27.705933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:27.707950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:27.710959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:27.712417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:27.979015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:28.008789 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-163daa37-1beb-4cf0-aab2-b8fafbf6378d tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.640919 Oct 28 10:25:28.021831 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3175/6343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:27 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:28.099670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:28.113631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:28.115090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:28.121773 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6cab7050-45cc-46ec-b26c-612d6dde7bcd tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.446011 Oct 28 10:25:28.125210 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3169/6344] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:27 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:25:28.528222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:28.529663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:28.550110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:28.551187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:28.551887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:28.553805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:28.556097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:28.557061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:29.035231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:29.036169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:29.076228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:29.078185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:29.079106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:29.081583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:29.082228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:29.083320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:29.340030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:29.353799 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-443e4d90-db34-4d29-955f-d3e3421d0878 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1689 microversion: 2.1 time: 0.830191 Oct 28 10:25:29.354979 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3176/6345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:28 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1689 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:29.361134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:29.362943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:29.370684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:29.372782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:29.373552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:29.374537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:29.375892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:29.376588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:29.574185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:29.610990 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ba953d8-caab-4210-895c-3bd3bf8586da tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.580776 Oct 28 10:25:29.614671 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3170/6346] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:29 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:29.686234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:29.730400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:29.734182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:29.737213 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-985defd8-a8c2-4938-aad9-de433d0c6d88 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.379605 Oct 28 10:25:29.750963 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3177/6347] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:29 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:30.379046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:30.380948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:30.393724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:30.397485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:30.398140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:30.399509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:30.401201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:30.402256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:30.639217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:30.641154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:30.651158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:30.653168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=14 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:30.656005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:30.657290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:30.658001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:30.660468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:30.661306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:30.661986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:30.709563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:30.837356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:30.851863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d54f7bc-5224-48c4-82be-9422301d7306 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1682 microversion: 2.1 time: 0.476850 Oct 28 10:25:30.852820 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3171/6348] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:30 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1682 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:30.857641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:30.862464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:30.875920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:30.876431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:30.876872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:30.881782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:30.886591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:30.887203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:31.122445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:31.135815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:31.142807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:31.144301 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d887882-f101-4d6b-9949-415ed2f5b643 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.290462 Oct 28 10:25:31.166030 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3172/6349] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:30 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:31.462616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:31.482010 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a9d2abb7-3d94-4bac-9556-15c0666eb736 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.844489 Oct 28 10:25:31.482010 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3178/6350] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:30 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:31.538608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ff2bbfe9-1120-4020-81a2-f8db4572b208 req-918bd773-2c74-41f1-9040-60a3695cb71c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d902ccb-2210-427f-aca0-19b8663395d9", "tag": "0394977a-6716-4674-b91d-f5cde0d5f33a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:31.557900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ff2bbfe9-1120-4020-81a2-f8db4572b208 req-918bd773-2c74-41f1-9040-60a3695cb71c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:31.558680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ff2bbfe9-1120-4020-81a2-f8db4572b208 req-918bd773-2c74-41f1-9040-60a3695cb71c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:31.560562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ff2bbfe9-1120-4020-81a2-f8db4572b208 req-918bd773-2c74-41f1-9040-60a3695cb71c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:31.595906 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ff2bbfe9-1120-4020-81a2-f8db4572b208 req-918bd773-2c74-41f1-9040-60a3695cb71c service nova] Creating event network-changed:0394977a-6716-4674-b91d-f5cde0d5f33a for instance 7d902ccb-2210-427f-aca0-19b8663395d9 on n-h1-zed-1 Oct 28 10:25:31.610117 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ff2bbfe9-1120-4020-81a2-f8db4572b208 req-918bd773-2c74-41f1-9040-60a3695cb71c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075300 Oct 28 10:25:31.611333 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3173/6351] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:25:32.201023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:32.201653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:32.222067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:32.227114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:32.233286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:32.241574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:32.241726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:32.246472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:32.468846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:32.483248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:32.508322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:32.509057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:32.519791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:32.521110 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e2583ec-e70c-4e4b-b396-b8e0bfc2bb62 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.324989 Oct 28 10:25:32.553422 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3179/6352] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:32 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:32.554625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:32.555368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:32.556053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:32.556984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:32.559346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:32.559988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:33.059618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:33.069793 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc67bce2-ede6-4e82-9b20-d302642113f8 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.572904 Oct 28 10:25:33.092431 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3174/6353] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:32 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:25:33.551013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:33.551565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:33.561772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:33.563419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:33.564310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:33.569116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:33.570079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:33.571655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:34.102529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:34.103150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:34.131154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:34.136018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:34.139752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:34.140618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:34.141431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:34.143899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:34.559411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:34.578224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d2eedb44-6b9f-430a-a923-514a70d4131f tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.477248 Oct 28 10:25:34.593866 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3175/6354] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:34 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:34.648067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:34.676580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:34.681168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:34.686749 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d80df8ec-ff44-4784-8171-683bc0db69c2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 1.136525 Oct 28 10:25:34.688022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3180/6355] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:33 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:34.897304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5f731587-2945-4f62-b410-c14e977dadb9 req-1b4d38b7-79f5-437a-8b8d-1257adcfe159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "name": "network-vif-plugged", "status": "completed", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:34.916066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f731587-2945-4f62-b410-c14e977dadb9 req-1b4d38b7-79f5-437a-8b8d-1257adcfe159 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:34.916827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f731587-2945-4f62-b410-c14e977dadb9 req-1b4d38b7-79f5-437a-8b8d-1257adcfe159 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:34.917471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5f731587-2945-4f62-b410-c14e977dadb9 req-1b4d38b7-79f5-437a-8b8d-1257adcfe159 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:34.967337 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5f731587-2945-4f62-b410-c14e977dadb9 req-1b4d38b7-79f5-437a-8b8d-1257adcfe159 service nova] Creating event network-vif-plugged:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:25:34.976481 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5f731587-2945-4f62-b410-c14e977dadb9 req-1b4d38b7-79f5-437a-8b8d-1257adcfe159 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085488 Oct 28 10:25:34.984460 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3176/6356] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:25:35.607193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:35.609781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:35.623755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:35.626491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:35.630599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:35.631580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:35.633458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:35.635453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:35.727151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:35.727862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:35.742842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:35.743327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:35.743970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:35.747635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:35.748373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:35.749042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:35.935172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:35.944289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:35.947542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:35.949075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c74cb5d0-ce2c-4013-b773-179771a4e8b6 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.227710 Oct 28 10:25:35.950193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3177/6357] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:35 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:36.314715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:36.323382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-663b7c86-e476-4222-93eb-aabcf65e56be tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.721572 Oct 28 10:25:36.327382 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3181/6358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:35 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:36.978268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:36.979589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:36.989830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:36.991603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:36.992233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:36.993199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:36.993905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:37.010396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:37.182856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:37.222992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:37.226003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:37.227798 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce1dadc7-20d2-4a70-a402-d943c37cff05 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.253518 Oct 28 10:25:37.228999 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3178/6359] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:36 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:37.347745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:37.348611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:37.367750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:37.368330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:37.369277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:37.370254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:37.379922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:37.380476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:38.262491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:38.263331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:38.274247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:38.274920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:38.275552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:38.276835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:38.278606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:38.279438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:38.312447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:38.329581 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6fc3d11d-d2fd-4050-99c7-4c38072f9b34 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.983659 Oct 28 10:25:38.332655 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3182/6360] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:37 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:38.411481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:38.430477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:38.432860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:38.434612 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c7a6dff-0e65-40c8-aab5-d425cbbaa9f2 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1366 microversion: 2.57 time: 0.178187 Oct 28 10:25:38.435311 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3179/6361] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:38 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:39.358950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:39.364990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:39.389324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:39.390079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:39.390746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:39.391667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:39.393790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:39.394503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:39.464427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:39.465717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:39.479977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:39.484184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:39.484890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:39.493471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:39.494706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:39.495176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:39.817230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:39.832559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:39.838288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:39.840404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3188b90-7c97-4f5f-aaf2-daf6f52176d8 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1384 microversion: 2.57 time: 0.380579 Oct 28 10:25:39.842469 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3180/6362] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:39 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1384 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:39.931777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7f7edd32-431e-45cf-9d5f-9d20fe76fac8 req-824ebd8d-d0bc-4f19-9747-8cf6a3cdd197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d902ccb-2210-427f-aca0-19b8663395d9", "name": "network-vif-plugged", "status": "completed", "tag": "0394977a-6716-4674-b91d-f5cde0d5f33a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:39.947320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f7edd32-431e-45cf-9d5f-9d20fe76fac8 req-824ebd8d-d0bc-4f19-9747-8cf6a3cdd197 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:39.950941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f7edd32-431e-45cf-9d5f-9d20fe76fac8 req-824ebd8d-d0bc-4f19-9747-8cf6a3cdd197 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:39.953562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7f7edd32-431e-45cf-9d5f-9d20fe76fac8 req-824ebd8d-d0bc-4f19-9747-8cf6a3cdd197 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:40.003181 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7f7edd32-431e-45cf-9d5f-9d20fe76fac8 req-824ebd8d-d0bc-4f19-9747-8cf6a3cdd197 service nova] Creating event network-vif-plugged:0394977a-6716-4674-b91d-f5cde0d5f33a for instance 7d902ccb-2210-427f-aca0-19b8663395d9 on n-h1-zed-1 Oct 28 10:25:40.015761 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7f7edd32-431e-45cf-9d5f-9d20fe76fac8 req-824ebd8d-d0bc-4f19-9747-8cf6a3cdd197 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088089 Oct 28 10:25:40.021320 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3181/6363] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:25:40.307515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:40.332124 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f3faef80-ab53-42ca-bf0d-1f87c3fac326 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.977607 Oct 28 10:25:40.347774 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3183/6364] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:39 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:40.873893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:40.875370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:40.896106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:40.898857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:40.899348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:40.900114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:40.908749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:40.909413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:40.954815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:41.107431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:41.120035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:41.123390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:41.125134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57e6a437-3a29-46e2-8dc2-34242bb20148 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1372 microversion: 2.57 time: 0.257091 Oct 28 10:25:41.136947 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3182/6365] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:40 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1372 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:41.355344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:41.355958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:41.368608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:41.368608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:41.368608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:41.368608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:41.368608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:41.368608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:41.841254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:41.849525 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7f05aa7-96b4-4bbf-83fc-df6eb40ec4ed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1427 microversion: 2.1 time: 0.498455 Oct 28 10:25:41.850090 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3184/6366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:41 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1427 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:42.154434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:42.155224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:42.162539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=76 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:42.164690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:42.171431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:42.173862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:42.175572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:42.184325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:42.186433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:42.582347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:42.594978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:42.596639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:42.606488 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd8da7cd-d00a-49e0-9ce1-636f1b746573 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1372 microversion: 2.57 time: 0.456025 Oct 28 10:25:42.617778 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3183/6367] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:42 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1372 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:42.875586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:42.876283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:42.888715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:42.894310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:42.894913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:42.895946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:42.896535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:42.897258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:43.102171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:43.114487 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c1874a0a-3f16-4f17-9e52-66040e96cb6e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1607 microversion: 2.1 time: 0.243126 Oct 28 10:25:43.118112 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3185/6368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:42 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1607 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:43.141133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:43.142374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:43.153920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:43.155271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:43.156506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:43.157543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:43.158523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:43.159260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:43.590551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:43.599778 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f7f7c1c0-dc66-4da1-aede-d536bb055f18 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1607 microversion: 2.1 time: 0.462747 Oct 28 10:25:43.600385 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3184/6369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:43 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1607 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:43.626315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:43.627486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:43.641928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:43.642434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:43.644086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:43.645789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:43.652608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:43.653478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:43.653640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:43.658765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:43.662067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:43.662818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:43.663440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:43.664355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:43.665029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:43.665635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:43.884703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:43.905259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:43.912225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:43.913731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-98fcf642-caa2-482d-b57b-40f4155631bb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1372 microversion: 2.57 time: 0.269307 Oct 28 10:25:43.915202 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3185/6370] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:43 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1372 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 28 10:25:44.040936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:44.052721 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7191c445-b27f-4088-993b-1ef6b08fd5d0 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1607 microversion: 2.1 time: 0.430472 Oct 28 10:25:44.066504 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3186/6371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:25:43 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1607 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:25:44.944645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:44.945301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:44.957541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:44.971156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:44.971633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:44.972400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:44.972875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:45.009766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:45.646590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:45.666411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:45.675206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:45.681629 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-130af70b-0416-492c-9f10-7cf7615792eb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1357 microversion: 2.57 time: 0.740134 Oct 28 10:25:45.685547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3186/6372] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:44 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1357 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:45.724404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:45.725086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:45.737180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:45.739338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:45.739864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:45.741418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:45.742583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:45.744582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:45.794842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:25:45.996830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-757d246e-90fa-4ebb-b5e4-cef71765b6f7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 204 len: 0 microversion: 2.57 time: 0.277785 Oct 28 10:25:46.005441 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3187/6373] 10.222.0.16 () {60 vars in 1280 bytes} [Fri Oct 28 10:25:45 2022] DELETE /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 28 10:25:46.013922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:46.014377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:46.038115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:46.042905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:46.046081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:46.050439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:46.072495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:46.073682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:46.268468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:46.284147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:46.286602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:46.287827 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d7664c8-d152-4876-94a2-8f1be28bddc7 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1363 microversion: 2.57 time: 0.278298 Oct 28 10:25:46.288401 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3187/6374] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:46 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1363 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:47.323070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:47.324581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:47.344006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:47.349436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:47.353154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:47.359353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:47.360802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:47.361526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:47.537496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:47.553413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:47.554801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:47.563824 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a9e3ebbf-dd6b-45d1-a148-9e3129dbc485 tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1363 microversion: 2.57 time: 0.246751 Oct 28 10:25:47.568631 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3188/6375] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:47 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1363 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:48.393330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e6eca8a0-4583-472b-b0c3-f9430fbd0ea1 req-8ec97a10-e267-4901-8b40-62aaef659409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d902ccb-2210-427f-aca0-19b8663395d9", "tag": "0394977a-6716-4674-b91d-f5cde0d5f33a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:48.414077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e6eca8a0-4583-472b-b0c3-f9430fbd0ea1 req-8ec97a10-e267-4901-8b40-62aaef659409 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:48.416653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e6eca8a0-4583-472b-b0c3-f9430fbd0ea1 req-8ec97a10-e267-4901-8b40-62aaef659409 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:48.423464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e6eca8a0-4583-472b-b0c3-f9430fbd0ea1 req-8ec97a10-e267-4901-8b40-62aaef659409 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:48.446319 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e6eca8a0-4583-472b-b0c3-f9430fbd0ea1 req-8ec97a10-e267-4901-8b40-62aaef659409 service nova] Creating event network-changed:0394977a-6716-4674-b91d-f5cde0d5f33a for instance 7d902ccb-2210-427f-aca0-19b8663395d9 on n-h1-zed-1 Oct 28 10:25:48.458882 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e6eca8a0-4583-472b-b0c3-f9430fbd0ea1 req-8ec97a10-e267-4901-8b40-62aaef659409 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069844 Oct 28 10:25:48.465560 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3188/6376] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:25:48.616869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:48.618105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:48.625175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:48.629218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:48.629933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:48.630571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:48.631789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:48.632435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:48.633124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:48.763559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:48.764155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:48.764615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:48.765125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lazy-loading 'fault' on Instance uuid a30f4141-354d-4ff5-ae57-0fc6f80874c9 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:25:48.968083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:48.971691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:25:48.997513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:48.999268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '735cb543df9a480cb60de622526aad52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fafa0e8262b54463a9ce5d3d58519852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:25:49.000751 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f68b246-c3c7-4f70-90e5-a6862caab39b tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 200 len: 1368 microversion: 2.57 time: 0.397986 Oct 28 10:25:49.002937 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3189/6377] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:48 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 1368 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 28 10:25:50.042225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:25:50.042961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] [instance: a30f4141-354d-4ff5-ae57-0fc6f80874c9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:50.071972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:50.072350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:50.072804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:50.073587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:50.074179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:50.074807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:50.114709 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] HTTP exception thrown: Instance a30f4141-354d-4ff5-ae57-0fc6f80874c9 could not be found. Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Request method failure captured: Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 HTTP/1.1 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW63--gF1dElCj4Gx7nrN0hFNLkrXPzqs3-Hw-SNZSx0L1yh8lktpudFN3_UaETKLzqIvmIzyDZquhMDwgR3TR-JR_-tMrjZKynZatXxAKJJGbTgENpege-KD74BdU3vVbZG6rdd2WqafQ_nNGz7dwKoFGfxuiLMpSDDryYHTq74kc7M Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Openstack-Nova-Api-Version: 2.57 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: fafa0e8262b54463a9ce5d3d58519852 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerShowV257Test-464030363 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fafa0e8262b54463a9ce5d3d58519852"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fafa0e8262b54463a9ce5d3d58519852"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fafa0e8262b54463a9ce5d3d58519852", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fafa0e8262b54463a9ce5d3d58519852"}]}] Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerShowV257Test-464030363 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: fafa0e8262b54463a9ce5d3d58519852 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerShowV257Test-464030363 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerShowV257Test-464030363-project Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 735cb543df9a480cb60de622526aad52 Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerShowV257Test-464030363-project Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a30f4141-354d-4ff5-ae57-0fc6f80874c9 could not be found. Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a30f4141-354d-4ff5-ae57-0fc6f80874c9'} Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a30f4141-354d-4ff5-ae57-0fc6f80874c9 could not be found. Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a30f4141-354d-4ff5-ae57-0fc6f80874c9 could not be found. Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:25:50.116520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a30f4141-354d-4ff5-ae57-0fc6f80874c9 could not be found. Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] Returning 404 to user: Instance a30f4141-354d-4ff5-ae57-0fc6f80874c9 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8815b1a5-95d3-4d23-8ff4-37021ac7b3fb tempest-ServerShowV257Test-464030363 tempest-ServerShowV257Test-464030363-project] 10.222.0.16 "GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9" status: 404 len: 111 microversion: 2.57 time: 0.093484 Oct 28 10:25:50.124260 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3189/6378] 10.222.0.16 () {60 vars in 1277 bytes} [Fri Oct 28 10:25:50 2022] GET /compute/v2.1/servers/a30f4141-354d-4ff5-ae57-0fc6f80874c9 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:25:55.458280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:25:55.460587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:25:55.478298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:55.479015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:55.479652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:55.480562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:25:55.493900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:25:55.494636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:25:55.592672 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e4b7381-23c3-43ae-9270-5a113690b77e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action" status: 200 len: 63199 microversion: 2.1 time: 0.138331 Oct 28 10:25:55.594157 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3190/6379] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:25:55 2022] POST /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3/action => generated 63199 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:26:01.784377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=13 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:01.785276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=37 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:02.482615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:02.483506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:02.499250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:02.520356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:02.520879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:02.521690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:02.522177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:02.523501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:03.080434 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d176a301-0417-4e11-8d6f-14b42e9dfdf4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1827 microversion: 2.1 time: 1.303412 Oct 28 10:26:03.081906 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3190/6380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:01 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1827 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:03.461238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-534233f1-8400-4ae8-8634-6ce96e8f9eae tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'create', calling method: .version_select at 0x7fca328ceb80>, body: {"keypair": {"name": "tempest-keypair-1721082951", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKatB8VAmwsyIUA1PdlaykvxaF1OToXih5ikFSgupjWE1Cizcbj4qigGmM2ZgT2jhMSTjCTv57ocHTgzZ3zutYy+tDBzuxYkMMi68/wkzNWqMUDv5O6ikiMxqGOzLNOCGw=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:03.533805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-534233f1-8400-4ae8-8634-6ce96e8f9eae tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for project d1abb2b7300b44b4af7b177c76b74216. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:26:03.587321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-534233f1-8400-4ae8-8634-6ce96e8f9eae tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for user c3a28b4dcd9f4cdfb724f5b29ce26b16 and project d1abb2b7300b44b4af7b177c76b74216. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:26:03.657964 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-534233f1-8400-4ae8-8634-6ce96e8f9eae tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.367941 Oct 28 10:26:03.662064 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3191/6381] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:26:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:05.535700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:05.536836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:05.548112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7bffe7aa-a9e7-499a-87e6-476031b7ce11 req-a91beff3-8c2c-4409-8a71-9933f26f8dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:05.567092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:05.576964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:05.579442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:05.579993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:05.582460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:05.583309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7bffe7aa-a9e7-499a-87e6-476031b7ce11 req-a91beff3-8c2c-4409-8a71-9933f26f8dec service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:05.584009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7bffe7aa-a9e7-499a-87e6-476031b7ce11 req-a91beff3-8c2c-4409-8a71-9933f26f8dec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:05.584627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7bffe7aa-a9e7-499a-87e6-476031b7ce11 req-a91beff3-8c2c-4409-8a71-9933f26f8dec service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:05.585186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:05.587652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:05.635932 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7bffe7aa-a9e7-499a-87e6-476031b7ce11 req-a91beff3-8c2c-4409-8a71-9933f26f8dec service nova] Creating event network-changed:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:26:05.661830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7bffe7aa-a9e7-499a-87e6-476031b7ce11 req-a91beff3-8c2c-4409-8a71-9933f26f8dec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117359 Oct 28 10:26:05.664369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:26:05.668529 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3192/6382] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:05.875213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7c4d17ab-10c7-4a63-95fb-ef262856664f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 204 len: 0 microversion: 2.1 time: 0.344298 Oct 28 10:26:05.876357 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3191/6383] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:26:05 2022] DELETE /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:26:05.885838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:05.886741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:05.898522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:05.899351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:05.900020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:05.901272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:05.904518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:05.905370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:06.164353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:06.172606 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a72bab96-be71-4dd2-8c50-6c7a7f64b397 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1688 microversion: 2.1 time: 0.290940 Oct 28 10:26:06.176288 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3193/6384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:05 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1688 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:07.202400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:07.203113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:07.219209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:07.219733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:07.220190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:07.220988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:07.223955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:07.224500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:08.246658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:08.263850 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1b42fc6a-03d5-4ddb-af96-2e765a927ca2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1688 microversion: 2.1 time: 1.058461 Oct 28 10:26:08.264720 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3192/6385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:07 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1688 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:09.275542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-bae15383-5e66-43a9-991a-8a22891bafc1 req-9a642a8e-dd7e-4c99-a65a-7aa8aefa45a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3", "name": "network-vif-deleted", "tag": "0870ad5a-e531-4fad-9f3c-09151c7d01ce"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:09.294571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:09.296149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:09.311574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:09.314104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bae15383-5e66-43a9-991a-8a22891bafc1 req-9a642a8e-dd7e-4c99-a65a-7aa8aefa45a2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:09.316670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:09.317514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bae15383-5e66-43a9-991a-8a22891bafc1 req-9a642a8e-dd7e-4c99-a65a-7aa8aefa45a2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:09.318161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:09.318906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bae15383-5e66-43a9-991a-8a22891bafc1 req-9a642a8e-dd7e-4c99-a65a-7aa8aefa45a2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:09.319951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:09.323249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:09.326480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:09.383696 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-bae15383-5e66-43a9-991a-8a22891bafc1 req-9a642a8e-dd7e-4c99-a65a-7aa8aefa45a2 service nova] Creating event network-vif-deleted:0870ad5a-e531-4fad-9f3c-09151c7d01ce for instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 on n-h1-zed-1 Oct 28 10:26:09.399125 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-bae15383-5e66-43a9-991a-8a22891bafc1 req-9a642a8e-dd7e-4c99-a65a-7aa8aefa45a2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128392 Oct 28 10:26:09.399839 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3194/6386] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:26:09.691214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:09.707057 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9bd0fe48-1b62-4d8c-956b-da21256ec185 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 200 len: 1351 microversion: 2.1 time: 0.417751 Oct 28 10:26:09.708206 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3193/6387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:09 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 1351 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:26:10.408733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1105262751", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbf4ea4f-632f-4cb8-8fcc-b8fdc886c281"}], "security_groups": [{"name": "tempest-securitygroup--1941097248"}], "key_name": "tempest-keypair-1721082951", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:10.657313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] validate_networks() for [('bbf4ea4f-632f-4cb8-8fcc-b8fdc886c281', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:26:10.735583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:10.736777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:10.751948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:10.752459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:10.757225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:10.757882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:10.758823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:10.759692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:10.783222 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] HTTP exception thrown: Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 could not be found. Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Request method failure captured: Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 HTTP/1.1 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6zXHm2C0MBZyh1v9W7qaCMezuCetEchcqsk_b8RAoux6fJEz9I9HuMCo8PBbtHPGu0VR2DyPC7nyw8kroAbJeUqYDYl7PHuIuZvlES9rmLvMQK9_o0rbBvOeJu953NpDPOD8Hi-3tTGWLZcp5HaeSQhjwgaPVolC0PCrS_HHPl8_Bc Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43f3d1244dc147c398fc24ddcfc6da34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43f3d1244dc147c398fc24ddcfc6da34"}]}] Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 608b9dc1a00d489a94524f99820022f6 Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 could not be found. Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3'} Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 could not be found. Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 could not be found. Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:26:10.786541 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 could not be found. Oct 28 10:26:10.790598 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:26:10.793750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Returning 404 to user: Instance 86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:26:10.795507 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-34d51f39-21f3-408b-9969-4be1eb088b41 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3" status: 404 len: 111 microversion: 2.1 time: 0.063807 Oct 28 10:26:10.799467 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3194/6388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:10 2022] GET /compute/v2.1/servers/86fc6a3f-2b8c-4ef4-a55a-5e0e653976d3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:26:11.915162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:26:11.915692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:26:11.916276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:26:11.916791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:26:11.917391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:26:11.937700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:11.939544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:11.942994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:11.943952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:11.944564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:11.945196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:12.012465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for project d1abb2b7300b44b4af7b177c76b74216. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:26:12.033510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for user c3a28b4dcd9f4cdfb724f5b29ce26b16 and project d1abb2b7300b44b4af7b177c76b74216. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:26:12.108944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:26:12.117311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:26:12.266930 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e03a2cd-869e-4cf9-92e4-16a3f4920ed8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.866083 Oct 28 10:26:12.274930 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3195/6389] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:26:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:26:12.286444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3bc742b6-7131-4254-8d27-3cadd2508d5f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:12.289337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3bc742b6-7131-4254-8d27-3cadd2508d5f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:12.598257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3bc742b6-7131-4254-8d27-3cadd2508d5f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:12.610121 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3bc742b6-7131-4254-8d27-3cadd2508d5f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1238 microversion: 2.1 time: 0.332241 Oct 28 10:26:12.610726 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3195/6390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:12 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1238 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:13.638251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:13.641712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:13.653737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:13.655431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:13.656098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:13.657086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:13.660551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:13.665555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:13.888829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:13.905232 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0075d9d0-8615-4964-a0cd-987155538380 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1234 microversion: 2.1 time: 0.270434 Oct 28 10:26:13.906235 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3196/6391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:13 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1234 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:14.935886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:14.936536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:14.971932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:14.972446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:14.978418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:14.979298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:14.981859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:14.994200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:15.233350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:15.243512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb02346c-5c1e-494c-9623-302544160fb9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1296 microversion: 2.1 time: 0.312573 Oct 28 10:26:15.244676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3196/6392] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:14 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1296 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:16.268886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:16.269609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:16.279903 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:16.284850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:16.285345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:16.286106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:16.289489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:16.289968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:16.455681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:16.464119 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f812609a-871d-4dec-a658-51b56f9e5987 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1296 microversion: 2.1 time: 0.199601 Oct 28 10:26:16.468513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3197/6393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:16 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1296 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:17.497126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:17.498045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:17.526756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:17.528494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:17.531146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:17.532106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:17.532704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:17.536713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:18.410249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:18.425660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad0af1af-975d-4082-a79d-b3757317ab92 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.935461 Oct 28 10:26:18.431193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3197/6394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:17 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:19.205918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7d29dca3-80fa-41a4-a0ef-e7a58bc1c30e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '.version_select at 0x7fca328ce310>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:19.218454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:19.265363 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7d29dca3-80fa-41a4-a0ef-e7a58bc1c30e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-202653064" status: 202 len: 0 microversion: 2.1 time: 0.053202 Oct 28 10:26:19.268433 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3198/6395] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 10:26:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-202653064 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:26:19.311051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-512df562-5ab8-45df-a2c1-46a8491cc70b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: .version_select at 0x7fca3b8daf70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1944621717", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdMC2VEcOVtC2Le1fAnQuSSWAdEW7K9aqlM+8lZ+RObbtv8OQ2relIdMBG+GQBsp/v3lbJI9QiWfNrCY/NxfwEr7pmmZ9Ks6WHt8Ydr4V6YdxcY7Dlnm3A58HB6wi6TAg=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:19.345724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-512df562-5ab8-45df-a2c1-46a8491cc70b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:26:19.362330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-512df562-5ab8-45df-a2c1-46a8491cc70b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:26:19.420108 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-512df562-5ab8-45df-a2c1-46a8491cc70b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.111174 Oct 28 10:26:19.423484 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3198/6396] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:26:19 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:19.457187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:19.458055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:19.477543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:19.478053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:19.497160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:19.502966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:19.505287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:19.506727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:19.980197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:19.993010 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-971aff8c-2f5b-4aa9-a0b8-b321cd9037bf tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.542037 Oct 28 10:26:19.998567 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3199/6397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:19 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:20.144874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:20.145411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:20.156377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:20.156944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:20.157402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:20.163387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:20.164246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:20.164703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:20.202828 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f28ac953-b665-4d68-b942-d6883c90f262 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.062358 Oct 28 10:26:20.205242 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3199/6398] 10.222.0.16 () {58 vars in 1293 bytes} [Fri Oct 28 10:26:20 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9/os-server-password => generated 116 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:20.977941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-59c390d2-0c2d-4a80-8a27-61065c3338e0 req-8139c2b6-8d67-4b80-b9a7-9c87e66bfeea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf469daa-59f1-4892-bd8c-76e8f947722b", "tag": "f7d5be91-1a22-48a9-997e-dc50db3afbaf"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:21.007656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59c390d2-0c2d-4a80-8a27-61065c3338e0 req-8139c2b6-8d67-4b80-b9a7-9c87e66bfeea service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:21.010179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59c390d2-0c2d-4a80-8a27-61065c3338e0 req-8139c2b6-8d67-4b80-b9a7-9c87e66bfeea service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:21.013732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59c390d2-0c2d-4a80-8a27-61065c3338e0 req-8139c2b6-8d67-4b80-b9a7-9c87e66bfeea service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:21.026603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:21.027918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:21.038776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:21.045228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:21.047734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:21.053995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:21.058067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:21.058867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:21.070647 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-59c390d2-0c2d-4a80-8a27-61065c3338e0 req-8139c2b6-8d67-4b80-b9a7-9c87e66bfeea service nova] Creating event network-changed:f7d5be91-1a22-48a9-997e-dc50db3afbaf for instance bf469daa-59f1-4892-bd8c-76e8f947722b on n-h2-zed-1 Oct 28 10:26:21.086851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-59c390d2-0c2d-4a80-8a27-61065c3338e0 req-8139c2b6-8d67-4b80-b9a7-9c87e66bfeea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110899 Oct 28 10:26:21.091229 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3200/6399] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:21.375711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:21.397601 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-da264f86-ff35-4a38-ab64-3a05079afbe4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.374518 Oct 28 10:26:21.398479 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3200/6400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:21 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:22.424628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:22.425444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:22.427427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:22.431716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:22.445894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:22.449159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:22.449812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:22.451878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:22.453292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:22.453927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:22.943310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:22.953652 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-facdbbe9-b67a-4948-a2d4-14baa4f0e12e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.533461 Oct 28 10:26:22.954179 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3201/6401] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:22 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:23.980846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:23.982288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:23.991190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:23.993557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:23.994421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:23.996055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:23.997684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:23.999800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:24.279369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:24.289997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c141cea9-fd01-4bd3-9ba9-4ee9ae2be558 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.313213 Oct 28 10:26:24.296853 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3201/6402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:23 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:25.330357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:25.331676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:25.345869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:25.346373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:25.349604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:25.351314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:25.352064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:25.352743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:26.144443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:26.165480 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b04b27d-4abc-4f8e-81eb-10dd85349761 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.840127 Oct 28 10:26:26.168718 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3202/6403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:25 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:27.195567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:27.197008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:27.218703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:27.221841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:27.223089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:27.224428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:27.227787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:27.229044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:27.810378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:27.826338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a8a28a2-47f5-41f0-b1a3-81f8c41ee3b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.635648 Oct 28 10:26:27.828693 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3202/6404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:27 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:28.857462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:28.859579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:28.881053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:28.881850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:28.882710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:28.883793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:28.885396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:28.886019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:29.042558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8a376dd7-ff39-40f6-866c-e48d5688bc29 req-6d34e321-5894-48c2-b6ff-6537b42d5908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf469daa-59f1-4892-bd8c-76e8f947722b", "name": "network-vif-plugged", "status": "completed", "tag": "f7d5be91-1a22-48a9-997e-dc50db3afbaf"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:29.060645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a376dd7-ff39-40f6-866c-e48d5688bc29 req-6d34e321-5894-48c2-b6ff-6537b42d5908 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:29.061338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a376dd7-ff39-40f6-866c-e48d5688bc29 req-6d34e321-5894-48c2-b6ff-6537b42d5908 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:29.068499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a376dd7-ff39-40f6-866c-e48d5688bc29 req-6d34e321-5894-48c2-b6ff-6537b42d5908 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:29.087399 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8a376dd7-ff39-40f6-866c-e48d5688bc29 req-6d34e321-5894-48c2-b6ff-6537b42d5908 service nova] Creating event network-vif-plugged:f7d5be91-1a22-48a9-997e-dc50db3afbaf for instance bf469daa-59f1-4892-bd8c-76e8f947722b on n-h2-zed-1 Oct 28 10:26:29.103514 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8a376dd7-ff39-40f6-866c-e48d5688bc29 req-6d34e321-5894-48c2-b6ff-6537b42d5908 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375091 Oct 28 10:26:29.104401 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3203/6405] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:29.377204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:29.391825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:29.401695 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6937b04-6e38-4d92-a4bb-c016695e40f6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.549853 Oct 28 10:26:29.405143 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3203/6406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:28 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:30.431400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:30.432096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:30.452533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:30.461650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:30.462346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:30.463292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:30.463909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:30.464495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:31.007355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:31.020119 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4ca87bc-ce4f-43e3-a79d-9871dc6ffce5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1364 microversion: 2.1 time: 0.593472 Oct 28 10:26:31.022530 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3204/6407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:30 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1364 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:32.045466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:32.046196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:32.058834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:32.063431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:32.065107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:32.068453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:32.069505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:32.070173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:32.080104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:32.085546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:32.815217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:32.827902 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-51e5f23f-4138-4968-8c51-0f2f1e3b782c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1549 microversion: 2.1 time: 0.786438 Oct 28 10:26:32.834688 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3204/6408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:32 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1549 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:32.856618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:32.857327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:32.886140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:32.886644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:32.891287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:32.893006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:32.893918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:32.896318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:33.138064 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-57040c8f-5f58-4e1e-818a-3cb5b57a473f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.285552 Oct 28 10:26:33.147756 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3205/6409] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:26:32 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-interface => generated 284 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:36.595898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1040990431", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "0e820c73-ba40-4b9c-9f0e-591f561549f6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1944621717", "security_groups": [{"name": "tempest-secgroup-smoke-2119324194"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:36.835808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] validate_networks() for [('0e820c73-ba40-4b9c-9f0e-591f561549f6', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:26:37.250706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d699fedb-b381-433b-90c0-78bfeb27733e req-b9f8025a-44f7-4bba-8cdb-50613efa8625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf469daa-59f1-4892-bd8c-76e8f947722b", "tag": "f7d5be91-1a22-48a9-997e-dc50db3afbaf"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:37.270706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d699fedb-b381-433b-90c0-78bfeb27733e req-b9f8025a-44f7-4bba-8cdb-50613efa8625 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:37.283763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d699fedb-b381-433b-90c0-78bfeb27733e req-b9f8025a-44f7-4bba-8cdb-50613efa8625 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:37.284227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d699fedb-b381-433b-90c0-78bfeb27733e req-b9f8025a-44f7-4bba-8cdb-50613efa8625 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:37.323000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=57 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:37.337146 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d699fedb-b381-433b-90c0-78bfeb27733e req-b9f8025a-44f7-4bba-8cdb-50613efa8625 service nova] Creating event network-changed:f7d5be91-1a22-48a9-997e-dc50db3afbaf for instance bf469daa-59f1-4892-bd8c-76e8f947722b on n-h2-zed-1 Oct 28 10:26:37.354836 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d699fedb-b381-433b-90c0-78bfeb27733e req-b9f8025a-44f7-4bba-8cdb-50613efa8625 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.324198 Oct 28 10:26:37.356225 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3206/6410] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:26:37.815244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:26:37.817204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:26:37.818039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:26:37.818650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:26:37.820048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:26:37.838169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:37.838673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:37.839125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:37.839894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:37.840940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:37.842899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:37.898750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:26:37.908649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:26:37.946834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:26:37.954936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:26:38.096660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-83401e4b-9e78-4152-a58c-87f741515c4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.505226 Oct 28 10:26:38.101935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3205/6411] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:26:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:26:38.115788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b103ac0-dcf0-4174-8ca4-3db0ab730a18 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:38.127874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b103ac0-dcf0-4174-8ca4-3db0ab730a18 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:38.340516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4b103ac0-dcf0-4174-8ca4-3db0ab730a18 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:38.349066 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b103ac0-dcf0-4174-8ca4-3db0ab730a18 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1267 microversion: 2.1 time: 0.239018 Oct 28 10:26:38.354158 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3207/6412] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:38 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:39.379392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:39.382884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:39.406058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:39.406058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:39.406058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:39.406058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:39.406058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:39.406959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:39.573012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:39.598829 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-90ff20e7-9222-4f8e-936a-bc9cc1d2ba07 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1263 microversion: 2.1 time: 0.225183 Oct 28 10:26:39.600615 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3206/6413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:39 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1263 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:40.628502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:40.631756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:40.662831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:40.670089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:40.670748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:40.671933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:40.672426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:40.673451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:40.968151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:40.990686 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0bde76a0-6198-4dcd-9a97-9af7c80a788f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1325 microversion: 2.1 time: 0.361569 Oct 28 10:26:40.992085 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3208/6414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:40 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1325 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:42.019057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:42.020109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:42.038258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:42.038798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:42.039218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:42.058246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:42.059679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:42.061135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:42.529151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:42.539383 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6122fee1-e7c7-4fab-88f0-d93ab83acb00 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1325 microversion: 2.1 time: 0.524250 Oct 28 10:26:42.556395 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3207/6415] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:42 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1325 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:43.568850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:43.570290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:43.620068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:43.624771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:43.634534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:43.636712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:43.639391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:43.644425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:44.177685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:44.189827 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dab519b9-0ae5-4a96-a749-74e38105f43f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1393 microversion: 2.1 time: 0.626175 Oct 28 10:26:44.193274 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3209/6416] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:43 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1393 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:45.223488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:45.224213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:45.235904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:45.240823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:45.243225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:45.246943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:45.252584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:45.253467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:45.630237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-bd1adc3a-3937-49c1-8019-0565a5c26e72 req-9336d579-7a20-4c44-bff4-5d6a109255db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17671e31-4a1b-4f88-8f5d-94aa2a3a2117", "tag": "9138dcda-97a8-4276-85a1-00af22c0979f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:45.681060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bd1adc3a-3937-49c1-8019-0565a5c26e72 req-9336d579-7a20-4c44-bff4-5d6a109255db service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:45.681557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bd1adc3a-3937-49c1-8019-0565a5c26e72 req-9336d579-7a20-4c44-bff4-5d6a109255db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:45.682177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bd1adc3a-3937-49c1-8019-0565a5c26e72 req-9336d579-7a20-4c44-bff4-5d6a109255db service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:45.736414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-bd1adc3a-3937-49c1-8019-0565a5c26e72 req-9336d579-7a20-4c44-bff4-5d6a109255db service nova] Creating event network-changed:9138dcda-97a8-4276-85a1-00af22c0979f for instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 on n-h1-zed-1 Oct 28 10:26:45.757428 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-bd1adc3a-3937-49c1-8019-0565a5c26e72 req-9336d579-7a20-4c44-bff4-5d6a109255db service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130957 Oct 28 10:26:45.766275 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3210/6417] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:46.739516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:46.768397 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-38f74e12-1da1-483e-b5e6-d2d13027e243 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1393 microversion: 2.1 time: 1.545781 Oct 28 10:26:46.785621 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3208/6418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:45 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1393 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:47.805539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:47.806258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:47.859250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:47.861367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:47.861832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:47.862578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:47.863049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:47.863486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:48.345933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:48.455529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:48.471688 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b720e35-a85e-4ec8-ab89-605182b7561a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1393 microversion: 2.1 time: 0.671427 Oct 28 10:26:48.480879 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3211/6419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:47 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1393 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:49.517475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:49.519273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:49.525658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:49.529134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:49.548976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:49.551005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:49.553796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:49.555515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:49.556007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:49.556455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:49.986075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:49.997892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74858470-5871-4efe-a79a-227a5db91608 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1393 microversion: 2.1 time: 0.491188 Oct 28 10:26:50.001236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3209/6420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:49 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1393 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:51.026194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:51.026867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:51.039409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:26:51.043883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:51.045428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:51.047589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:51.049603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:51.051493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:51.057025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:51.389946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:51.400882 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99051299-70f8-4f98-afc5-70b9dd960bad tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1393 microversion: 2.1 time: 0.380261 Oct 28 10:26:51.414098 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3212/6421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:51 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1393 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:52.436679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:52.438074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:52.454679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:52.455261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:52.455785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:52.456488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:52.456984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:52.469317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:53.342311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:53.356393 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-66d2b222-6de7-4344-850a-3c2ffe362580 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1393 microversion: 2.1 time: 0.923196 Oct 28 10:26:53.373191 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3210/6422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:52 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1393 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:53.995295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ecfa984e-cbbb-4e42-ad4d-1c19b1fc6554 req-14f66fa8-ede1-4063-9443-6adb3217ed82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17671e31-4a1b-4f88-8f5d-94aa2a3a2117", "name": "network-vif-plugged", "status": "completed", "tag": "9138dcda-97a8-4276-85a1-00af22c0979f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:54.009946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ecfa984e-cbbb-4e42-ad4d-1c19b1fc6554 req-14f66fa8-ede1-4063-9443-6adb3217ed82 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:54.010559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ecfa984e-cbbb-4e42-ad4d-1c19b1fc6554 req-14f66fa8-ede1-4063-9443-6adb3217ed82 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:54.015536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ecfa984e-cbbb-4e42-ad4d-1c19b1fc6554 req-14f66fa8-ede1-4063-9443-6adb3217ed82 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:54.042336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ecfa984e-cbbb-4e42-ad4d-1c19b1fc6554 req-14f66fa8-ede1-4063-9443-6adb3217ed82 service nova] Creating event network-vif-plugged:9138dcda-97a8-4276-85a1-00af22c0979f for instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 on n-h1-zed-1 Oct 28 10:26:54.057628 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ecfa984e-cbbb-4e42-ad4d-1c19b1fc6554 req-14f66fa8-ede1-4063-9443-6adb3217ed82 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065927 Oct 28 10:26:54.058773 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3213/6423] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:26:54.413335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:54.414869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:54.428026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:54.428785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:54.430089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:54.431747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:54.432512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:54.433340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:54.777824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:54.789220 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b34eec6-66b2-4910-867f-faccd484ce09 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1393 microversion: 2.1 time: 0.381752 Oct 28 10:26:54.789815 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3211/6424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:54 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1393 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:55.815512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:55.816377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:55.838913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:55.843846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:55.845209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:55.846124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:55.849011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:55.849664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:56.146562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:56.161188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b3e3baeb-9b63-46a4-ab4b-16d6690e9a48 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1564 microversion: 2.1 time: 0.350870 Oct 28 10:26:56.162903 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3214/6425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:55 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1564 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:56.191241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:56.192709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:56.204897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:56.207671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:56.208816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:56.210738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:56.214398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:56.215130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:56.502356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:26:56.521254 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-399bb680-758c-41b8-b8d3-a983dbc59416 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1564 microversion: 2.1 time: 0.335243 Oct 28 10:26:56.522177 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3212/6426] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:56 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1564 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:26:59.661063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:26:59.662699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:26:59.681169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1638673e-157d-430b-b289-21d728b797c9 req-1d7f3635-6134-4889-a806-24201f9df2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17671e31-4a1b-4f88-8f5d-94aa2a3a2117", "tag": "9138dcda-97a8-4276-85a1-00af22c0979f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:26:59.701726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:59.702335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:59.702793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:59.706715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:59.707225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:59.711548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:59.718964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1638673e-157d-430b-b289-21d728b797c9 req-1d7f3635-6134-4889-a806-24201f9df2e6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:26:59.724640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1638673e-157d-430b-b289-21d728b797c9 req-1d7f3635-6134-4889-a806-24201f9df2e6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:26:59.728853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1638673e-157d-430b-b289-21d728b797c9 req-1d7f3635-6134-4889-a806-24201f9df2e6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:26:59.763798 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1638673e-157d-430b-b289-21d728b797c9 req-1d7f3635-6134-4889-a806-24201f9df2e6 service nova] Creating event network-changed:9138dcda-97a8-4276-85a1-00af22c0979f for instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 on n-h1-zed-1 Oct 28 10:26:59.774669 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1638673e-157d-430b-b289-21d728b797c9 req-1d7f3635-6134-4889-a806-24201f9df2e6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098659 Oct 28 10:26:59.785159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3213/6427] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:27:00.043672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:00.061253 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4cc91d74-3365-419e-9be0-84a86903407f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1564 microversion: 2.1 time: 0.405382 Oct 28 10:27:00.062534 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3215/6428] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:26:59 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1564 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:27:20.788142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:20.788624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:20.791476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:20.792176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=51 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:20.799321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:20.800055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:20.800676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:20.801589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:20.802212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:20.802811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:20.883915 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4c7aa9b-ab2e-46b1-bda1-9ce611009d64 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action" status: 200 len: 24566 microversion: 2.1 time: 0.102750 Oct 28 10:27:20.892590 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3214/6429] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:27:20 2022] POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action => generated 24566 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:27:27.219471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:27.219980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:27.223141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=7 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:27.223822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=41 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:27.237583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:27.237583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:27.237583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:27.237583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:27.239273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:27.239715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:27.510370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:27.522693 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bcf32044-c98b-45cf-a58f-8af8331bed49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1682 microversion: 2.1 time: 0.307283 Oct 28 10:27:27.523982 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3216/6430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:27 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1682 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:27.640299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:27.643917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:27.656430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:27.659227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:27.660551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:27.661318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:27.662176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:27.668420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:27.774936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-091eb970-1a2b-4d86-b9c7-fb8b8fa6fd14 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action" status: 200 len: 32636 microversion: 2.1 time: 0.140336 Oct 28 10:27:27.776199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3215/6431] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:27:27 2022] POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action => generated 32636 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:27:28.034791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:28.035647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:28.045569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:28.048096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:28.048538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:28.049977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:28.051319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:28.051913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:28.291651 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d76d0cca-6f38-4ff6-81b2-8aadfd65f0c4 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1827 microversion: 2.1 time: 0.261262 Oct 28 10:27:28.292233 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3217/6432] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:28 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1827 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:28.328068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:28.331130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:28.345123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:28.345994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:28.346666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:28.350226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:28.350776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:28.351432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:28.449064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lazy-loading 'flavor' on Instance uuid 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:27:28.494980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Going to try to live migrate instance to another host {{(pid=128747) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 28 10:27:31.960395 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95b298a1-f63f-43f1-bcae-123bb43eed07 tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action" status: 202 len: 0 microversion: 2.1 time: 3.636290 Oct 28 10:27:31.962576 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3216/6433] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:27:28 2022] POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action => generated 0 bytes in 3638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:27:31.980484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:31.983531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:31.997644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:31.998651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:31.999338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:32.003792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:32.004938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:32.005652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:32.208476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:32.219668 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-399484c9-355c-4033-8fdb-6c2503545a52 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.251763 Oct 28 10:27:32.220644 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3218/6434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:31 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:33.251520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:33.252790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:33.272170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:33.277746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:33.278487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:33.281358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:33.285424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:33.286159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:33.709753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:33.726282 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64d4b06e-7ce3-43a8-b8ff-5cf125332cc5 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.479191 Oct 28 10:27:33.731385 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3217/6435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:33 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:34.157367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0ef10eeb-67c9-4f80-b06e-eb80906b3fb5 req-b74c97b7-a1fa-4a54-8dcd-18f61215952f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17671e31-4a1b-4f88-8f5d-94aa2a3a2117", "name": "network-vif-unplugged", "status": "completed", "tag": "9138dcda-97a8-4276-85a1-00af22c0979f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:34.175457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ef10eeb-67c9-4f80-b06e-eb80906b3fb5 req-b74c97b7-a1fa-4a54-8dcd-18f61215952f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:34.178617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ef10eeb-67c9-4f80-b06e-eb80906b3fb5 req-b74c97b7-a1fa-4a54-8dcd-18f61215952f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:34.179250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0ef10eeb-67c9-4f80-b06e-eb80906b3fb5 req-b74c97b7-a1fa-4a54-8dcd-18f61215952f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:34.201641 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0ef10eeb-67c9-4f80-b06e-eb80906b3fb5 req-b74c97b7-a1fa-4a54-8dcd-18f61215952f service nova] Creating event network-vif-unplugged:9138dcda-97a8-4276-85a1-00af22c0979f for instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 on n-h1-zed-1 Oct 28 10:27:34.219678 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0ef10eeb-67c9-4f80-b06e-eb80906b3fb5 req-b74c97b7-a1fa-4a54-8dcd-18f61215952f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065884 Oct 28 10:27:34.220945 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3219/6436] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:27:34.779561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:34.781403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:34.798539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:34.802071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:34.802983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:34.804129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:34.809619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:34.810685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:35.179671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:35.191075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-750b831a-e197-4358-a318-9fec2f300d6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.417807 Oct 28 10:27:35.206948 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3218/6437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:34 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:36.216792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:36.219927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:36.237760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5ff32922-a01d-4b4d-9989-56bca9ea81f6 req-7e7d8f91-7914-4476-a8a8-b2e61a8b3bed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17671e31-4a1b-4f88-8f5d-94aa2a3a2117", "tag": "9138dcda-97a8-4276-85a1-00af22c0979f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:36.239991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:36.240582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:36.256072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:36.259939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:36.262025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:36.262641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:36.270461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5ff32922-a01d-4b4d-9989-56bca9ea81f6 req-7e7d8f91-7914-4476-a8a8-b2e61a8b3bed service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:36.271150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5ff32922-a01d-4b4d-9989-56bca9ea81f6 req-7e7d8f91-7914-4476-a8a8-b2e61a8b3bed service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:36.271822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5ff32922-a01d-4b4d-9989-56bca9ea81f6 req-7e7d8f91-7914-4476-a8a8-b2e61a8b3bed service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:36.305157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5ff32922-a01d-4b4d-9989-56bca9ea81f6 req-7e7d8f91-7914-4476-a8a8-b2e61a8b3bed service nova] Creating event network-changed:9138dcda-97a8-4276-85a1-00af22c0979f for instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 on n-h1-zed-1 Oct 28 10:27:36.313343 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5ff32922-a01d-4b4d-9989-56bca9ea81f6 req-7e7d8f91-7914-4476-a8a8-b2e61a8b3bed service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078619 Oct 28 10:27:36.315200 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3219/6438] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:27:36.517349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:36.528724 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f823794-f67e-444a-9527-e4562e938ca9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.315931 Oct 28 10:27:36.530810 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3220/6439] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:36 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:27:37.561918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:37.563319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:37.594919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:37.596736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:37.597410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:37.601617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:37.602329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:37.603039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:37.865395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:37.885173 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d46a9dea-4d4d-4638-b6b9-35bce533f7bb tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.332862 Oct 28 10:27:37.885900 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3220/6440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:37 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:38.508624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:38.510211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:38.522207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:38.522912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:38.524358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:38.535073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:38.536219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:38.537097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:38.580793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9218030a-f716-45da-a07e-169a05b7d528 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/ips" status: 200 len: 145 microversion: 2.1 time: 0.076786 Oct 28 10:27:38.581860 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3221/6441] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:27:38 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/ips => generated 145 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:27:38.909454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:38.910755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:38.919132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:38.919929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:38.920600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:38.921550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:38.923088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:38.923729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:39.203058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:39.212627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6aaf14b-59aa-4c9a-9df3-db46ea916b4d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.307974 Oct 28 10:27:39.226007 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3221/6442] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:38 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:40.239158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:40.240743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:40.253971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:40.257527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:40.258199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:40.260485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:40.261989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:40.263082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:40.574937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:40.655591 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7ad10124-e852-4bd3-af49-0c75c1f12d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.419683 Oct 28 10:27:40.658012 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3222/6443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:40 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:41.684803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:41.686081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:41.710486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:41.710986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:41.720827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:41.725581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:41.727519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:41.730012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:42.234989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:42.258876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-89c1ec1d-846a-44ad-b899-61c1000c8585 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.578508 Oct 28 10:27:42.260080 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3222/6444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:41 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:27:43.338875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:43.342063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:43.356057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:43.358322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:43.358950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:43.360505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:43.361218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:43.361837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:43.766895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26aa4344-18cd-45c9-a535-f76628369cec"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:43.769369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:43.787629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:43.788390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:43.798099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:43.806018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:43.806947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:43.807589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:44.458530 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eba7c776-9ab0-4c54-8331-fafb06a429e4 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.695444 Oct 28 10:27:44.459894 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3223/6445] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:27:43 2022] POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-volume_attachments => generated 194 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:27:44.907285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:44.916238 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97c5428d-9228-4277-8036-d1840c52d0a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 1.616690 Oct 28 10:27:44.922320 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3223/6446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:43 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 1627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:45.948460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:45.963203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:45.999388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:46.011209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:46.012188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:46.027979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:46.028477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:46.029144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:46.433328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:46.456209 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-32c0beaf-c4ac-4f82-abe1-85229022098e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.502562 Oct 28 10:27:46.456893 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3224/6447] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:45 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:27:47.483974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:47.485397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:47.507741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:47.515241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:47.516003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:47.519343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:47.520819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:47.521499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:48.159134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:48.167574 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-526a3e48-d708-475f-a071-96253ce2fc47 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1692 microversion: 2.1 time: 0.687802 Oct 28 10:27:48.168158 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3224/6448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:47 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1692 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:49.191703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:49.192936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:49.206836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:49.208706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:49.209423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:49.212304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:49.212972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:49.215108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:49.547086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:49.555846 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e053f606-aa5e-42bc-b367-9eeeb8b50a7f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1682 microversion: 2.1 time: 0.368748 Oct 28 10:27:49.560946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3225/6449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:49 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1682 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:49.588362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:49.589565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:49.604680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:49.606916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:49.608041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:49.626503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:49.626964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:49.627405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:49.981140 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1700c33b-eeae-4f2e-be64-11006107480b tempest-TestNetworkAdvancedServerOps-1716312377 tempest-TestNetworkAdvancedServerOps-1716312377-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1827 microversion: 2.1 time: 0.395335 Oct 28 10:27:50.005463 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3225/6450] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:49 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1827 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:50.011500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:50.012655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:50.030502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:50.031008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:50.034505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:50.035521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:50.037649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:50.038275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:50.369467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:50.377232 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c8477a28-0649-4e51-98f5-22988cea08c2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1682 microversion: 2.1 time: 0.370404 Oct 28 10:27:50.377831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3226/6451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:50 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1682 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:50.591956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:50.595878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:50.641336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:50.641933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:50.642396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:50.643153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:50.649670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:50.650212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:50.791791 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2af4f098-487a-4dca-87ce-905a49b574f2 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action" status: 200 len: 38632 microversion: 2.1 time: 0.203498 Oct 28 10:27:50.792467 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3226/6452] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:27:50 2022] POST /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117/action => generated 38632 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:27:53.106705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:53.107197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:53.121069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=29 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:53.130524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:53.131032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:53.134796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:53.135983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:53.145271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:53.145961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:53.157719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:27:53.217398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:27:53.440640 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-39873425-ee6d-4393-a189-c830a9903b94 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 204 len: 0 microversion: 2.1 time: 0.333246 Oct 28 10:27:53.443587 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3227/6453] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:27:53 2022] DELETE /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:27:53.465389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f916fcc4-5ac7-4b12-8715-6d55bf6186d5 req-1209f994-c2ed-4455-a5d8-e46f2c3c4549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17671e31-4a1b-4f88-8f5d-94aa2a3a2117", "tag": "9138dcda-97a8-4276-85a1-00af22c0979f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:53.477300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:53.477300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:53.480628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f916fcc4-5ac7-4b12-8715-6d55bf6186d5 req-1209f994-c2ed-4455-a5d8-e46f2c3c4549 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:53.481161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f916fcc4-5ac7-4b12-8715-6d55bf6186d5 req-1209f994-c2ed-4455-a5d8-e46f2c3c4549 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:53.481647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f916fcc4-5ac7-4b12-8715-6d55bf6186d5 req-1209f994-c2ed-4455-a5d8-e46f2c3c4549 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:53.488558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:53.489095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:53.489543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:53.490267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:53.490714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:53.493216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:53.494634 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f916fcc4-5ac7-4b12-8715-6d55bf6186d5 req-1209f994-c2ed-4455-a5d8-e46f2c3c4549 service nova] Creating event network-changed:9138dcda-97a8-4276-85a1-00af22c0979f for instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 on n-h2-zed-1 Oct 28 10:27:53.500690 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f916fcc4-5ac7-4b12-8715-6d55bf6186d5 req-1209f994-c2ed-4455-a5d8-e46f2c3c4549 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.388027 Oct 28 10:27:53.501648 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3227/6454] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:27:53.775817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:53.791166 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0f9ded4-b02e-4389-ad9b-ffb48467be6d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1688 microversion: 2.1 time: 0.346266 Oct 28 10:27:53.793310 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3228/6455] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:53 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1688 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:54.818990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:54.819852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:54.835549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:54.836976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:54.847617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:54.848541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:54.849301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:54.857637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:55.397844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:27:55.414219 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49acde29-ea6e-4d02-bc62-590a1c0e32f4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 200 len: 1688 microversion: 2.1 time: 0.599433 Oct 28 10:27:55.418940 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3228/6456] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:54 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 1688 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:27:55.620426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-2859059c-7ea2-418c-b001-ab4c15d1c8cc req-61b6fca2-49ae-47e0-b11e-af4e34e4016f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17671e31-4a1b-4f88-8f5d-94aa2a3a2117", "name": "network-vif-deleted", "tag": "9138dcda-97a8-4276-85a1-00af22c0979f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:27:55.647813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2859059c-7ea2-418c-b001-ab4c15d1c8cc req-61b6fca2-49ae-47e0-b11e-af4e34e4016f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:55.662762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2859059c-7ea2-418c-b001-ab4c15d1c8cc req-61b6fca2-49ae-47e0-b11e-af4e34e4016f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:55.663539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2859059c-7ea2-418c-b001-ab4c15d1c8cc req-61b6fca2-49ae-47e0-b11e-af4e34e4016f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:55.694220 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-2859059c-7ea2-418c-b001-ab4c15d1c8cc req-61b6fca2-49ae-47e0-b11e-af4e34e4016f service nova] Creating event network-vif-deleted:9138dcda-97a8-4276-85a1-00af22c0979f for instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 on n-h2-zed-1 Oct 28 10:27:55.704804 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-2859059c-7ea2-418c-b001-ab4c15d1c8cc req-61b6fca2-49ae-47e0-b11e-af4e34e4016f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095280 Oct 28 10:27:55.709511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3229/6457] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:27:56.445665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:27:56.446334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 17671e31-4a1b-4f88-8f5d-94aa2a3a2117] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:27:56.460299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:56.460804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:56.461481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:56.463177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:27:56.465291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:27:56.465937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:27:56.506779 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] HTTP exception thrown: Instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 could not be found. Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Request method failure captured: Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 HTTP/1.1 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW6zXHm2C0MBZyh1v9W7qaCMezuCetEchcqsk_b8RAoux6fJEz9I9HuMCo8PBbtHPGu0VR2DyPC7nyw8kroAbJeUqYDYl7PHuIuZvlES9rmLvMQK9_o0rbBvOeJu953NpDPOD8Hi-3tTGWLZcp5HaeSQhjwgaPVolC0PCrS_HHPl8_Bc Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43f3d1244dc147c398fc24ddcfc6da34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43f3d1244dc147c398fc24ddcfc6da34"}]}] Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 608b9dc1a00d489a94524f99820022f6 Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 could not be found. Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '17671e31-4a1b-4f88-8f5d-94aa2a3a2117'} Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 could not be found. Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 could not be found. Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:27:56.508642 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 could not be found. Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Returning 404 to user: Instance 17671e31-4a1b-4f88-8f5d-94aa2a3a2117 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b295c3d-7a23-4b36-99cb-9f8f80784122 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117" status: 404 len: 111 microversion: 2.1 time: 0.069967 Oct 28 10:27:56.513279 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3229/6458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:27:56 2022] GET /compute/v2.1/servers/17671e31-4a1b-4f88-8f5d-94aa2a3a2117 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:28:02.730899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-921e159c-4e4e-4281-9be1-fa540c5979c9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:02.754694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e159c-4e4e-4281-9be1-fa540c5979c9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:02.760686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e159c-4e4e-4281-9be1-fa540c5979c9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:02.761856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e159c-4e4e-4281-9be1-fa540c5979c9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:02.816542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-921e159c-4e4e-4281-9be1-fa540c5979c9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Going to try to stop instance {{(pid=128747) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:28:02.907932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-921e159c-4e4e-4281-9be1-fa540c5979c9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action" status: 202 len: 0 microversion: 2.1 time: 0.190413 Oct 28 10:28:02.910141 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3230/6459] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:28:02 2022] POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:28:02.918008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:02.921264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:02.944960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=29 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:02.949406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:02.949920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:02.952582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:02.953427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:02.953913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:02.954646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:02.964420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=69 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:03.552299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:03.564139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-098f919e-d2bf-468d-ad0d-4dfbaea034fe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.649986 Oct 28 10:28:03.566367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3230/6460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:02 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:04.351481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fec5dd9c-507f-44ae-9b4b-2561a646085c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '.version_select at 0x7fca330dc280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:04.457157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fec5dd9c-507f-44ae-9b4b-2561a646085c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1944621717" status: 202 len: 0 microversion: 2.1 time: 0.113122 Oct 28 10:28:04.465637 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3231/6461] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 10:28:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1944621717 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:28:04.497770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78bc962b-ebc5-425d-b775-0ab0990c1a63 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: .version_select at 0x7fca3349b550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-476255662", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXfhHgMR9TuKGhZGDPv+fuPEM+fZaHe746ASYPqVuNc3rn2ehKKEd+jM0g9p6sPu5M2kX/wzqHki3giq45jc9lhLSx/ZrOhuTqGhObgCZWCtMM3qRV/QtUsRaDq2yxAYQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:04.533657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-78bc962b-ebc5-425d-b775-0ab0990c1a63 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:28:04.554489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-78bc962b-ebc5-425d-b775-0ab0990c1a63 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:28:04.597683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:04.598436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:04.612954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:04.613462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:04.614007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:04.617223 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-78bc962b-ebc5-425d-b775-0ab0990c1a63 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.125933 Oct 28 10:28:04.618211 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3231/6462] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:28:04 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:28:04.637927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:04.643054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:04.643524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:05.002345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:05.036649 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f711e794-6f10-4aca-b2cc-eb04a48aa17d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.445229 Oct 28 10:28:05.051437 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3232/6463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:04 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:06.084565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:06.085466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:06.099950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:06.100646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:06.101177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:06.101977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:06.102679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:06.105383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:06.418067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:06.430741 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a6bca04-eb77-42c0-a571-23b5f460040f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.350699 Oct 28 10:28:06.432493 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3232/6464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:06 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:07.462808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:07.464065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:07.478685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:07.481601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:07.482267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:07.483278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:07.490179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:07.490529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:07.802087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:07.811093 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-53fc958f-5e07-4904-8a89-1acf84725253 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.355410 Oct 28 10:28:07.831129 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3233/6465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:07 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:08.841132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:08.841132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:08.851449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:08.854782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:08.858868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:08.860482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:08.861664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:08.862330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:09.057656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:09.073750 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-64b74dcc-b76a-4881-a0a6-eb1fa09cab72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.239289 Oct 28 10:28:09.077506 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3233/6466] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:08 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:10.100530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:10.101179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:10.120407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:10.127898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:10.129606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:10.132844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:10.134853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:10.141724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:10.511600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:10.522450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-546b9e9b-0476-49da-953c-5bba3ef9606a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.425962 Oct 28 10:28:10.548781 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3234/6467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:10 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:11.549985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:11.552388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:11.568680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:11.581848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:11.582770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:11.590624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:11.597323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:11.599490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:11.979040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:11.997631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2373c55e-deec-433f-b68a-6ca2e13ea56d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.451823 Oct 28 10:28:12.002970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3234/6468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:11 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:13.036500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:13.037848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:13.069829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:13.070440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:13.071500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:13.075208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:13.076297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:13.081314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:13.627467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:13.646103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3fec3ad-4d3f-454f-8fc5-508738d62f2d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.618211 Oct 28 10:28:13.647501 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3235/6469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:13 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:14.678579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:14.679914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:14.687975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:14.689953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:14.691071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:14.691995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:14.692880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:14.693509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:14.694270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:15.227142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:15.242931 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-44ef2f78-a339-4b65-a5ec-31372f0f174a tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.572614 Oct 28 10:28:15.243916 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3235/6470] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:14 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:16.271588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:16.272222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:16.287166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:16.287695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:16.288153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:16.288886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:16.291878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:16.292592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:16.392418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-138083695", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "ec954c19-beb0-4f23-80ca-12c86595438d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-476255662", "security_groups": [{"name": "tempest-secgroup-smoke-107653981"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:16.703956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:16.717522 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5582ab0b-96d9-455f-a01f-d1df9bb38895 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.449660 Oct 28 10:28:16.722710 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3236/6471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:16 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:28:17.065293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] validate_networks() for [('ec954c19-beb0-4f23-80ca-12c86595438d', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:28:17.756460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:17.758041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:17.769613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:17.770481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:17.771156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:17.772299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:17.773139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:17.774002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:18.012320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:28:18.012868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:28:18.013857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:28:18.016517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:28:18.017054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:28:18.062747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:18.063864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:18.070434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:18.071289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:18.071776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:18.072221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:18.153760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:28:18.186303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Getting quotas for user 608b9dc1a00d489a94524f99820022f6 and project 43f3d1244dc147c398fc24ddcfc6da34. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:28:18.225232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:28:18.227904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:28:18.233462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:18.262704 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ba8d667-2d74-47a6-bcc0-ec84bc67c94f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1724 microversion: 2.1 time: 0.513054 Oct 28 10:28:18.284585 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3237/6472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:17 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1724 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:18.356563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dacaa3bc-f1c3-4ab3-9205-5a175edcbbd9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.952857 Oct 28 10:28:18.357980 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3236/6473] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:28:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:28:18.370500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddced717-e473-4f17-bc38-c5fdc36d6318 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:18.371300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddced717-e473-4f17-bc38-c5fdc36d6318 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:18.551310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddced717-e473-4f17-bc38-c5fdc36d6318 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:18.562189 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddced717-e473-4f17-bc38-c5fdc36d6318 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1265 microversion: 2.1 time: 0.193842 Oct 28 10:28:18.565463 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3238/6474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:18 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:19.293661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:19.294290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:19.313079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:19.313556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:19.314007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:19.314737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:19.315195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:19.315886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:19.590971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:19.592402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:19.603225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:19.604490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:19.605370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:19.606681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:19.608024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:19.608946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:19.804257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:19.819164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:19.827492 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fba11c40-cad0-45fd-bb4b-d29ab1db7d7d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1701 microversion: 2.1 time: 0.536865 Oct 28 10:28:19.828193 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3237/6475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:19 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1701 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:19.851407 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d475dce-df9e-44d8-9821-06c6ea33d46a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1261 microversion: 2.1 time: 0.261260 Oct 28 10:28:19.854159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba06cfdb-f744-4034-9edf-ac8e96a02273 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:19.867847 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3239/6476] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:19 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1261 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:19.879953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba06cfdb-f744-4034-9edf-ac8e96a02273 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:19.880466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba06cfdb-f744-4034-9edf-ac8e96a02273 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:19.881732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba06cfdb-f744-4034-9edf-ac8e96a02273 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:19.985373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba06cfdb-f744-4034-9edf-ac8e96a02273 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Going to try to start instance {{(pid=128748) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 10:28:20.086425 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba06cfdb-f744-4034-9edf-ac8e96a02273 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action" status: 202 len: 0 microversion: 2.1 time: 0.234347 Oct 28 10:28:20.087394 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3238/6477] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:28:19 2022] POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:28:20.111388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:20.114033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:20.130353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:20.137736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:20.138692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:20.143032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:20.143852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:20.145494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:20.628846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:20.652066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e8de42d-2d98-4c70-91d2-8410f3242b32 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1710 microversion: 2.1 time: 0.560136 Oct 28 10:28:20.656247 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3240/6478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:20 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1710 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:20.885309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:20.886037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:20.909061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:20.909573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:20.912766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:20.915427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:20.916393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:20.918509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:21.087466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:21.097384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-609795e7-1671-431c-a1c0-faad46b808fa tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1323 microversion: 2.1 time: 0.218004 Oct 28 10:28:21.097975 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3239/6479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:20 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1323 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:21.684233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:21.685611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:21.704220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:21.704730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:21.705209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:21.705934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:21.706406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:21.707280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:22.134194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:22.141856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:22.167457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:22.168175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:22.172227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:22.173483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:22.175546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:22.177135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:22.249548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:22.262140 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14470ed8-f62d-49dc-bef0-9db26cee7c4d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1710 microversion: 2.1 time: 0.581970 Oct 28 10:28:22.269411 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3241/6480] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:21 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1710 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:22.791786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:22.800388 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca6484d4-dc90-4e81-b6e3-cdf06ac8a684 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1390 microversion: 2.1 time: 0.678753 Oct 28 10:28:22.810575 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3240/6481] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:22 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1390 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:28:23.302101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:23.302721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:23.306436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:23.345693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:23.351966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:23.352526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:23.358425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:23.362159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:23.362693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:23.384687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:23.833418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-22f8b3ec-c760-46fd-8bca-e528d323656d req-c06886fe-f61d-425c-ab43-ff4ed7dcd9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261ddbf4-9f00-4749-bdef-38d2e9d16e7c", "tag": "a6af78cf-17bd-4674-9490-8bd13aeb317f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:23.861781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-22f8b3ec-c760-46fd-8bca-e528d323656d req-c06886fe-f61d-425c-ab43-ff4ed7dcd9a1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:23.864683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-22f8b3ec-c760-46fd-8bca-e528d323656d req-c06886fe-f61d-425c-ab43-ff4ed7dcd9a1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:23.865464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-22f8b3ec-c760-46fd-8bca-e528d323656d req-c06886fe-f61d-425c-ab43-ff4ed7dcd9a1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:23.924590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-22f8b3ec-c760-46fd-8bca-e528d323656d req-c06886fe-f61d-425c-ab43-ff4ed7dcd9a1 service nova] Creating event network-changed:a6af78cf-17bd-4674-9490-8bd13aeb317f for instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c on n-h1-zed-1 Oct 28 10:28:23.924767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:23.934110 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-22f8b3ec-c760-46fd-8bca-e528d323656d req-c06886fe-f61d-425c-ab43-ff4ed7dcd9a1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104341 Oct 28 10:28:23.934987 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3241/6482] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:28:23.940309 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b116d4f-794b-4f7f-9184-8260579d4286 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1710 microversion: 2.1 time: 0.642328 Oct 28 10:28:23.941198 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3242/6483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:23 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1710 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:23.960620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:23.961437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:23.980624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:23.981161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:23.983345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:23.984639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:23.985133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:23.992693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:24.968615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:24.969322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:24.983575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:24.984249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:24.984963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:24.985835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:24.986304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:24.987138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:25.005724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:25.022687 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc788501-9ec7-4312-adbc-7c9ee8b50254 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1390 microversion: 2.1 time: 1.084848 Oct 28 10:28:25.033928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3242/6484] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:23 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1390 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:25.239751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:25.249168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-924171fe-971f-442c-b58a-cef636f6f643 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1714 microversion: 2.1 time: 0.284526 Oct 28 10:28:25.262008 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3243/6485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:24 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1714 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:26.046284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:26.047537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:26.056288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:26.056791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:26.057464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:26.058501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:26.059232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:26.059831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:26.307790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:26.321209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-958793c5-1116-4bd9-aabe-3cf8e8f7d0ec tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1390 microversion: 2.1 time: 0.278898 Oct 28 10:28:26.333888 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3243/6486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:26 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1390 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:27.346276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:27.346885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:27.354108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:27.354597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:27.355068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:27.355758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:27.356213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:27.356640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:27.498347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:27.507191 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2bded02e-2b77-4302-abd1-c34accbb450c tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1390 microversion: 2.1 time: 0.164754 Oct 28 10:28:27.507789 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3244/6487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:27 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:28.529884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:28.530501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:28.534728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:28.535403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:28.543814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:28.544323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:28.544773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:28.545543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:28.546648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:28.547092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:28.748104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:28.757912 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd28a00a-1762-4fe9-a842-454fe225fc78 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1390 microversion: 2.1 time: 0.231821 Oct 28 10:28:28.759645 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3244/6488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:28 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1390 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:29.783682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:29.784303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:29.788182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:29.792000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:29.792600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:29.801350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:29.802182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:29.802674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:29.803122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:30.023946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:30.037994 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-172d9803-0ec5-41e6-9f62-696887d24317 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1390 microversion: 2.1 time: 0.258677 Oct 28 10:28:30.044327 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3245/6489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:29 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1390 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:30.392573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c2c31ad4-c7e4-41a1-8d65-966ba7a4a234 req-44b0e7aa-87c0-4c1f-873e-c4cf2a264bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261ddbf4-9f00-4749-bdef-38d2e9d16e7c", "name": "network-vif-plugged", "status": "completed", "tag": "a6af78cf-17bd-4674-9490-8bd13aeb317f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:30.407433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c2c31ad4-c7e4-41a1-8d65-966ba7a4a234 req-44b0e7aa-87c0-4c1f-873e-c4cf2a264bb7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:30.408131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c2c31ad4-c7e4-41a1-8d65-966ba7a4a234 req-44b0e7aa-87c0-4c1f-873e-c4cf2a264bb7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:30.408712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c2c31ad4-c7e4-41a1-8d65-966ba7a4a234 req-44b0e7aa-87c0-4c1f-873e-c4cf2a264bb7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:30.420838 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c2c31ad4-c7e4-41a1-8d65-966ba7a4a234 req-44b0e7aa-87c0-4c1f-873e-c4cf2a264bb7 service nova] Creating event network-vif-plugged:a6af78cf-17bd-4674-9490-8bd13aeb317f for instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c on n-h1-zed-1 Oct 28 10:28:30.431843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c2c31ad4-c7e4-41a1-8d65-966ba7a4a234 req-44b0e7aa-87c0-4c1f-873e-c4cf2a264bb7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040008 Oct 28 10:28:30.436336 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3245/6490] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:28:31.071691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:31.073019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:31.081133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:31.081667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:31.082125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:31.082841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:31.083368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:31.083884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:31.276536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:31.288655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-801bf1e8-3f18-444c-9a40-f33e6db39d89 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1390 microversion: 2.1 time: 0.221972 Oct 28 10:28:31.303903 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3246/6491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:31 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1390 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:32.315294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:32.317402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:32.322741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:32.323438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:32.324108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:32.324768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:32.325274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:32.325841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:32.486689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:32.494888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-beeff95d-a52e-4235-af60-9128ffca4efd tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1561 microversion: 2.1 time: 0.185380 Oct 28 10:28:32.495967 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3246/6492] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:32 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1561 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:32.523229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:32.523834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:32.532642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:32.533457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:32.534068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:32.535055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:32.535570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:32.536169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:32.709621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:32.719054 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-979c7bc2-154c-4817-ac16-cb22e77aae21 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1561 microversion: 2.1 time: 0.199854 Oct 28 10:28:32.719643 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3247/6493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:32 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:33.985044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-963155634", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:34.005267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:34.073207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:28:34.511766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:28:34.512487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:28:34.513168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:28:34.513806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:28:34.514377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:28:34.524196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:34.524690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:34.525255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:34.526050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:34.526525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:34.526989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:34.537910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:34.557738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Getting quotas for project 3b0dea03ca9d4c5b99c4c26b31b6fb27. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:28:34.566576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Getting quotas for user eb2442f7f47e4bff8e1ab9d3547550fe and project 3b0dea03ca9d4c5b99c4c26b31b6fb27. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:28:34.591422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:28:34.594015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:28:34.643316 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b932cf2-68d2-42ba-a621-2a6883719222 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661991 Oct 28 10:28:34.644295 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3247/6494] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:28:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:28:34.657165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f54340fc-6edf-494f-b27c-e402cccbb4e4 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:34.658432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f54340fc-6edf-494f-b27c-e402cccbb4e4 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:34.727348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f54340fc-6edf-494f-b27c-e402cccbb4e4 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:34.735650 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f54340fc-6edf-494f-b27c-e402cccbb4e4 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1213 microversion: 2.1 time: 0.083604 Oct 28 10:28:34.750029 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3248/6495] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:34 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1213 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:28:35.046032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:35.047228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:35.054907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3f516100-b35f-4c46-92ce-8ec9242fe97a req-b2e37f4d-ab04-4761-bdc7-1b92aa8152e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261ddbf4-9f00-4749-bdef-38d2e9d16e7c", "tag": "a6af78cf-17bd-4674-9490-8bd13aeb317f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:35.071079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3f516100-b35f-4c46-92ce-8ec9242fe97a req-b2e37f4d-ab04-4761-bdc7-1b92aa8152e4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:35.071783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3f516100-b35f-4c46-92ce-8ec9242fe97a req-b2e37f4d-ab04-4761-bdc7-1b92aa8152e4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:35.072388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3f516100-b35f-4c46-92ce-8ec9242fe97a req-b2e37f4d-ab04-4761-bdc7-1b92aa8152e4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:35.074626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:35.078321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:35.081178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:35.084712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:35.085383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:35.085990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:35.094879 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3f516100-b35f-4c46-92ce-8ec9242fe97a req-b2e37f4d-ab04-4761-bdc7-1b92aa8152e4 service nova] Creating event network-changed:a6af78cf-17bd-4674-9490-8bd13aeb317f for instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c on n-h1-zed-1 Oct 28 10:28:35.101698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3f516100-b35f-4c46-92ce-8ec9242fe97a req-b2e37f4d-ab04-4761-bdc7-1b92aa8152e4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059221 Oct 28 10:28:35.111884 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3249/6496] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:28:35.408435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:35.419304 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6abf49b4-674c-4d78-811c-53ab3483afaf tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1561 microversion: 2.1 time: 0.380224 Oct 28 10:28:35.419986 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3248/6497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:35 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1561 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:35.760639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:35.762015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:35.774028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:35.775000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:35.775619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:35.776549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:35.777235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:35.777671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:35.865869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:35.874934 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e24d605-88b8-44e9-9db7-a01f8d8d61dd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1265 microversion: 2.1 time: 0.118343 Oct 28 10:28:35.875626 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3250/6498] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:35 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1265 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:36.903603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:36.904219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:36.911103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:36.911599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:36.912041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:36.912744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:36.913228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:36.913662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:36.978017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:36.985783 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9596fd5d-02ae-4ae2-9a14-b1b988b9390f tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1271 microversion: 2.1 time: 0.086045 Oct 28 10:28:36.986368 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3249/6499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:36 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:37.925224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-17ed4482-bcee-44bb-ad84-bb189367e286 req-f37bb388-ded9-4bb6-a293-8011df05bc95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18c1721b-b614-41dc-a369-b75b892d9d0d", "tag": "878940fd-6955-4a4c-b004-22ed29bdc474"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:37.938445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-17ed4482-bcee-44bb-ad84-bb189367e286 req-f37bb388-ded9-4bb6-a293-8011df05bc95 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:37.939264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-17ed4482-bcee-44bb-ad84-bb189367e286 req-f37bb388-ded9-4bb6-a293-8011df05bc95 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:37.940104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-17ed4482-bcee-44bb-ad84-bb189367e286 req-f37bb388-ded9-4bb6-a293-8011df05bc95 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:37.953336 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-17ed4482-bcee-44bb-ad84-bb189367e286 req-f37bb388-ded9-4bb6-a293-8011df05bc95 service nova] Creating event network-changed:878940fd-6955-4a4c-b004-22ed29bdc474 for instance 18c1721b-b614-41dc-a369-b75b892d9d0d on n-h2-zed-1 Oct 28 10:28:37.958300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-17ed4482-bcee-44bb-ad84-bb189367e286 req-f37bb388-ded9-4bb6-a293-8011df05bc95 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037345 Oct 28 10:28:37.969852 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3251/6500] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:28:38.009803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:38.010706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:38.019236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:38.019811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:38.020285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:38.021284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:38.021961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:38.022392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:38.167980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:38.177790 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b67b1288-1ce1-4865-bf9a-d8ea260d4f2b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.171793 Oct 28 10:28:38.178828 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3250/6501] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:38 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:39.204781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:39.205634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:39.212216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:39.212709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:39.213184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:39.213892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:39.214351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:39.214844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:39.348959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:39.356677 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b7868d8e-37dc-441e-a204-59582e4ea0e9 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.157322 Oct 28 10:28:39.357278 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3252/6502] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:39 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:40.379719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:40.380282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:40.387214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:40.387701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:40.388132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:40.388819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:40.389287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:40.389707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:40.521830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:40.529548 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4ba3ccc3-e34f-42da-b987-abd485d06ebd tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.153878 Oct 28 10:28:40.530128 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3251/6503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:40 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:41.553642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:41.554339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:41.561671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:41.562309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:41.562820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:41.563637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:41.564181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:41.564683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:41.716696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:41.725839 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14c570cd-87e5-4003-a844-89c256cc72b0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.176085 Oct 28 10:28:41.726422 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3253/6504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:41 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:42.748988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:42.750899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:42.758632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:42.759332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:42.759777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:42.760486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:42.761134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:42.761715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:42.915713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:42.924575 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-880bc4c3-c195-4568-84c7-0eac601ec56c tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.179609 Oct 28 10:28:42.925345 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3252/6505] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:42 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:28:43.949245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:43.949972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:43.959229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:43.959807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:43.960334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:43.961405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:43.961761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:43.962581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:44.110899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:44.119091 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f6d7ee4-d929-4558-9043-373b282dff8d tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.173795 Oct 28 10:28:44.120332 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3254/6506] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:43 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:44.793131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-49df4e90-1611-438e-ac97-e4e77596338e req-6b71d816-2b3f-46a6-b926-d38be777f40b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c1721b-b614-41dc-a369-b75b892d9d0d", "name": "network-vif-plugged", "status": "completed", "tag": "878940fd-6955-4a4c-b004-22ed29bdc474"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:44.803488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:44.804593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:44.807894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-49df4e90-1611-438e-ac97-e4e77596338e req-6b71d816-2b3f-46a6-b926-d38be777f40b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:44.808695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-49df4e90-1611-438e-ac97-e4e77596338e req-6b71d816-2b3f-46a6-b926-d38be777f40b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:44.809314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-49df4e90-1611-438e-ac97-e4e77596338e req-6b71d816-2b3f-46a6-b926-d38be777f40b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:44.824398 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-49df4e90-1611-438e-ac97-e4e77596338e req-6b71d816-2b3f-46a6-b926-d38be777f40b service nova] Creating event network-vif-plugged:878940fd-6955-4a4c-b004-22ed29bdc474 for instance 18c1721b-b614-41dc-a369-b75b892d9d0d on n-h2-zed-1 Oct 28 10:28:44.830117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-49df4e90-1611-438e-ac97-e4e77596338e req-6b71d816-2b3f-46a6-b926-d38be777f40b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040759 Oct 28 10:28:44.830751 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3253/6507] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:28:45.142603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:45.143223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:45.146326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:45.153940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:45.154441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:45.154884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:45.156099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:45.156558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:45.157016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:45.297131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:45.305075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-419a797a-e83e-4818-a1fb-a5fff4857613 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.166335 Oct 28 10:28:45.305650 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3255/6508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:45 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:46.329618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:46.330615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:46.337186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:46.337667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:46.338098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:46.338783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:46.339274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:46.339698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:46.475890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:46.486060 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0ba93ae-4110-426e-a042-17e9c7bf8751 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1313 microversion: 2.1 time: 0.160906 Oct 28 10:28:46.486662 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3254/6509] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:46 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:47.510141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:28:47.510932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:47.518037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:47.518820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:47.519306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:47.520020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:47.520489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:47.520986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:47.663131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:28:47.672046 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-31889fe1-54e7-45df-b294-b0f9dd81e6a3 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1462 microversion: 2.1 time: 0.165835 Oct 28 10:28:47.672677 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3256/6510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:28:47 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1462 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:28:47.695670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b5656ab-ee93-4426-93d6-f8dcd23cdf62", "device": "/dev/sdb"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:47.698435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:47.705892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:47.706378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:47.706817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:47.707515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:47.707969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:47.708393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:47.973859 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f14b75c3-49c8-4edc-86b1-0fe5bf39fecb tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "POST /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282235 Oct 28 10:28:47.974481 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3255/6511] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:28:47 2022] POST /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:28:56.714558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:28:56.716763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:28:56.719536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=32 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:56.725295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:56.725786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:56.726229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:56.726955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:28:56.727418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:28:56.727850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:28:56.730451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=76 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:28:56.799309 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1153bcc9-96bf-423e-9f2a-259cf620e720 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c/action" status: 200 len: 24571 microversion: 2.1 time: 0.088494 Oct 28 10:28:56.806402 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3257/6512] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:28:56 2022] POST /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c/action => generated 24571 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:29:07.741836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:07.743149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:07.750387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:07.753780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:07.763962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:07.765083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:07.765530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:07.766657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:07.767293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:07.768193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:07.865066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:29:07.865731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:29:07.866403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:29:07.867046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:29:07.867628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:29:07.949283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:07.961625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:07.962035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:07.962489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:07.963215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:07.966656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:07.967165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:08.017272 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb493285-b488-4ea9-a102-8e2b7ef9cc50 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c/action" status: 202 len: 1136 microversion: 2.1 time: 0.277778 Oct 28 10:29:08.036586 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3256/6513] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:29:07 2022] POST /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c/action => generated 1136 bytes in 298 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 28 10:29:08.042900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:08.043605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:08.047586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:08.048238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:08.070075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:08.070577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:08.071024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:08.071740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:08.072206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:08.072639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:08.258852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:08.268536 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5a2da659-6fbc-4d3b-ad82-151f760d2328 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.229810 Oct 28 10:29:08.273610 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3258/6514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:08 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:09.296324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:09.297038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:09.304745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:09.306007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:09.306481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:09.307203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:09.307669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:09.308103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:09.453454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:09.464804 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ebb9a09-452d-44c5-bc2a-841564624921 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.175915 Oct 28 10:29:09.465433 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3257/6515] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:09 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:10.168385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d870615d-ac6b-470e-b72c-1067befbeb34 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Action: 'create', calling method: .version_select at 0x7fca3301b0d0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-1110613118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp9wGX342Rt39rOiV1msxpQnSutRpx1A5i1BTTzpcmwhIdRfzsBT6MKeLCOvJ06SJuHSF/jckychMu3Gf0ZTTz7MiM2mMsi4QS53NQqnXblPmZvDaPwTqcf5lphOPCuZA=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:10.185490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-d870615d-ac6b-470e-b72c-1067befbeb34 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Getting quotas for project 2807e06b2fea49d0b35bd4f227bb8b79. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:29:10.191660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-d870615d-ac6b-470e-b72c-1067befbeb34 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Getting quotas for user f777312225d24ba7b8c686e49d0cd4f7 and project 2807e06b2fea49d0b35bd4f227bb8b79. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:29:10.215891 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d870615d-ac6b-470e-b72c-1067befbeb34 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.220275 Oct 28 10:29:10.216619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3259/6516] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:29:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:29:10.490850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:10.491649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:10.500183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:10.500792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:10.501408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:10.502180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:10.502734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:10.503261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:10.665321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:10.675518 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1642fc3b-b1f8-4214-9ed1-527f64191616 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.188941 Oct 28 10:29:10.676337 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3258/6517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:10 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:11.700565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:11.701427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:11.708474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:11.709062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:11.709633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:11.710405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:11.710937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:11.711452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:11.944348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:11.953671 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2d953b7-1e0f-4e0a-af4c-f73850a3ff2d tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.257826 Oct 28 10:29:11.954254 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3260/6518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:11 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:12.976210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:12.976875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:12.992495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:13.002364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:13.003269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:13.005706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:13.006195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:13.006633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:13.399075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:13.407384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1c203a8d-1736-4000-a842-89a951589e49 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.435086 Oct 28 10:29:13.409200 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3259/6519] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:12 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:14.433650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:14.434269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:14.443168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:14.443694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:14.444306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:14.445361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:14.445940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:14.446644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:14.668526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:14.677632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-57900c43-2d4e-4f9f-ad2b-83124d66660f tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.247815 Oct 28 10:29:14.679798 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3261/6520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:14 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:15.711152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:15.713308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:15.723461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:15.724345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:15.725618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:15.726797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:15.727423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:15.728107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:15.984784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:15.993326 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e4d27f9-7ba2-49c4-bd29-732d27449d97 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.288739 Oct 28 10:29:16.001649 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3260/6521] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:15 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:16.086489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-937552413-access_point-2079495425", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "f5b20754-e1de-4918-92dd-69d7bd7461f9"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1110613118", "security_groups": [{"name": "tempest-secgroup_access--743955111"}, {"name": "tempest-secgroup_general--1677792039"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:16.254518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] validate_networks() for [('f5b20754-e1de-4918-92dd-69d7bd7461f9', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:29:16.738222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:29:16.738827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:29:16.739398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:29:16.740053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:29:16.740543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:29:16.750476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:16.751068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:16.751590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:16.752612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:16.753087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:16.753517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:16.771101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Getting quotas for project 2807e06b2fea49d0b35bd4f227bb8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:29:16.777672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Getting quotas for user f777312225d24ba7b8c686e49d0cd4f7 and project 2807e06b2fea49d0b35bd4f227bb8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:29:16.791710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:29:16.793759 n-d-zed-1 devstack@n-api.service[128747]: WARNING nova.utils [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-937552413-access_point-2079495425 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-937552413-acc Oct 28 10:29:16.794696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:29:16.850038 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c7d06b8-195b-46ba-b3f5-0f1625f89fc7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.765140 Oct 28 10:29:16.850038 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3262/6522] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:29:16 2022] POST /compute/v2.1/servers => generated 457 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:29:16.861745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b28b15e6-d016-4cfc-b648-080806e3c59d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:16.862288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b28b15e6-d016-4cfc-b648-080806e3c59d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:16.937239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b28b15e6-d016-4cfc-b648-080806e3c59d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:16.944574 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b28b15e6-d016-4cfc-b648-080806e3c59d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1294 microversion: 2.1 time: 0.088978 Oct 28 10:29:16.945540 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3261/6523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:16 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:17.026679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:17.027502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:17.035078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:17.035564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:17.036760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:17.037696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:17.038519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:17.039084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:17.208821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:17.222937 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07f98c91-cf6f-4c27-bd15-e02c340ba11e tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.201295 Oct 28 10:29:17.225704 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3263/6524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:17 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:17.968224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:17.968826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:17.977067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:17.977788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:17.978254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:17.979135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:17.979742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:17.980174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:18.049447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:18.058066 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8721b786-6a1c-4c2d-b350-8dd98127758b tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1346 microversion: 2.1 time: 0.094272 Oct 28 10:29:18.058746 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3262/6525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:17 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:18.250792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:18.252081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:18.259689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:18.260196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:18.261319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:18.262051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:18.262520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:18.262966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:18.492466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:18.501958 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3d5cc07-1585-41d1-b863-0b67524c492b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.255553 Oct 28 10:29:18.502653 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3264/6526] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:18 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:19.082483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:19.083715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:19.090430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:19.090910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:19.091345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:19.092040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:19.092553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:19.093000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:19.278431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:19.288621 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62ac7571-dc02-438f-85e1-537aa9f2be40 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.209131 Oct 28 10:29:19.289439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3263/6527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:19 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:19.535083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:19.536499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:19.547834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:19.548648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:19.549396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:19.551250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:19.552541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:19.553217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:20.110566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:20.120085 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a93e69cc-cba1-4da0-8867-23087e7d27ed tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.597234 Oct 28 10:29:20.121038 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3265/6528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:19 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:20.317946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:20.318572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:20.325572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:20.326288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:20.326735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:20.327632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:20.328956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:20.329575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:20.483813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f37a1896-2c61-4974-a364-5db8b8277200 req-e783c3f0-a1eb-4964-ac62-0bdce3996ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20", "tag": "d8d60f50-d10c-487f-8f0f-040964827929"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:20.490616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:20.498188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f37a1896-2c61-4974-a364-5db8b8277200 req-e783c3f0-a1eb-4964-ac62-0bdce3996ce5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:20.499017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f37a1896-2c61-4974-a364-5db8b8277200 req-e783c3f0-a1eb-4964-ac62-0bdce3996ce5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:20.499712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f37a1896-2c61-4974-a364-5db8b8277200 req-e783c3f0-a1eb-4964-ac62-0bdce3996ce5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:20.501669 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ec479f4-cfd5-403b-823c-d231e9296e74 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.187827 Oct 28 10:29:20.516934 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3264/6529] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:20 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:20.517140 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f37a1896-2c61-4974-a364-5db8b8277200 req-e783c3f0-a1eb-4964-ac62-0bdce3996ce5 service nova] Creating event network-changed:d8d60f50-d10c-487f-8f0f-040964827929 for instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 on n-h2-zed-1 Oct 28 10:29:20.518086 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f37a1896-2c61-4974-a364-5db8b8277200 req-e783c3f0-a1eb-4964-ac62-0bdce3996ce5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039099 Oct 28 10:29:20.518795 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3266/6530] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:29:20.575539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:20.576036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:20.582301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:20.582795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:20.583232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:20.583927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:20.584382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:20.584805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:20.693288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lazy-loading 'services' on Instance uuid bf469daa-59f1-4892-bd8c-76e8f947722b {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:29:20.772602 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4add0f40-865c-40bd-961a-22424c151fe2 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-volume_attachments/26aa4344-18cd-45c9-a535-f76628369cec" status: 202 len: 0 microversion: 2.1 time: 0.200820 Oct 28 10:29:20.780850 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3265/6531] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:29:20 2022] DELETE /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-volume_attachments/26aa4344-18cd-45c9-a535-f76628369cec => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:29:21.145591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:21.147754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:21.154712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:21.155291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:21.155739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:21.156450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:21.156930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:21.157367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:21.319246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:21.329636 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a8c3742c-4da1-4b7d-9446-60f6a670e49a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.189072 Oct 28 10:29:21.331339 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3267/6532] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:21 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:21.527236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:21.528171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:21.534543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:21.535033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:21.535477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:21.536178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:21.536636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:21.537118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:21.686814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:21.695209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-80492cdc-44ee-4c0f-8ba3-d04ae9e04889 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.173057 Oct 28 10:29:21.695791 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3266/6533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:21 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:22.354461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:22.355083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:22.362628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:22.363502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:22.364109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:22.364829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:22.365321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:22.365761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:22.505459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:22.514083 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0de0f31a-8d84-4f4f-bf88-0807be91beb9 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.163446 Oct 28 10:29:22.515494 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3268/6534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:22 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:22.718265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:22.718885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:22.726250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:22.726841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:22.727350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:22.728149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:22.728777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:22.729298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:22.878341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:22.886843 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41c6360e-9b69-4967-a2de-70d0fcfc0791 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.172510 Oct 28 10:29:22.887421 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3267/6535] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:22 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:23.538248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:23.539741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:23.548614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:23.550253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:23.551051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:23.551999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:23.552688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:23.553628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:23.871338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:23.887876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf452e7d-4387-45bc-98d3-cb5c3a063bb4 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1689 microversion: 2.1 time: 0.353161 Oct 28 10:29:23.905133 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3269/6536] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:23 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1689 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:23.909851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:23.911297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:23.919402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:23.920179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:23.921405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:23.922294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:23.924885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:23.925753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:24.182628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:24.191747 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f829361b-e93a-4c37-9b10-4ccbde3f6372 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.285620 Oct 28 10:29:24.193749 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3268/6537] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:23 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:29:24.915631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:24.917068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:24.930703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:24.933188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:24.935162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:24.938908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:24.939764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:24.940650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:25.167274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:25.179217 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d3dd42c-8e63-4a4e-8e9b-b4236bcd02a8 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1707 microversion: 2.1 time: 0.268190 Oct 28 10:29:25.180317 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3270/6538] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:24 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1707 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:25.225872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:25.228345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:25.238354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:25.239576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:25.240231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:25.241815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:25.242623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:25.243318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:25.424295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:25.433323 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01199d91-cfa3-4c0d-b228-bf539ce714b3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.212366 Oct 28 10:29:25.433911 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3269/6539] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:25 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:26.213847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:26.214576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:26.234357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:26.234871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:26.235321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:26.236043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:26.236692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:26.237325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:26.457973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:26.458638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:26.465626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:26.466113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:26.466568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:26.467282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:26.468398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:26.469036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:26.474813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:26.489534 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ca6f7a3-595c-4924-96d7-7fe2e37cdabe tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1695 microversion: 2.1 time: 0.285150 Oct 28 10:29:26.508651 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3271/6540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:26 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1695 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:26.709111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:26.718290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:26.721741 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-78efca42-85be-4fac-92fc-c3518a4e7083 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.267528 Oct 28 10:29:26.722766 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3270/6541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:26 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:29:26.974988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8d55e721-5911-4b8b-a533-741be0053252 req-ae619bb4-129d-44cc-8c90-5812f56f417b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20", "name": "network-vif-plugged", "status": "completed", "tag": "d8d60f50-d10c-487f-8f0f-040964827929"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:26.987400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:26.991177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=10 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:27.000042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8d55e721-5911-4b8b-a533-741be0053252 req-ae619bb4-129d-44cc-8c90-5812f56f417b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:27.001076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8d55e721-5911-4b8b-a533-741be0053252 req-ae619bb4-129d-44cc-8c90-5812f56f417b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:27.001754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8d55e721-5911-4b8b-a533-741be0053252 req-ae619bb4-129d-44cc-8c90-5812f56f417b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:27.016493 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8d55e721-5911-4b8b-a533-741be0053252 req-ae619bb4-129d-44cc-8c90-5812f56f417b service nova] Creating event network-vif-plugged:d8d60f50-d10c-487f-8f0f-040964827929 for instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 on n-h2-zed-1 Oct 28 10:29:27.023037 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8d55e721-5911-4b8b-a533-741be0053252 req-ae619bb4-129d-44cc-8c90-5812f56f417b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053960 Oct 28 10:29:27.024168 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3272/6542] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:29:27.516838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:27.518544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:27.520772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:27.530973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:27.532398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:27.532883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:27.533641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:27.534103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:27.534526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:27.691092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:27.699899 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-234fe4f1-544a-4754-a391-1c56485b3761 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1680 microversion: 2.1 time: 0.189609 Oct 28 10:29:27.700598 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3271/6543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:27 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1680 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:27.754790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:27.756100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:27.763614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:27.764841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:27.765505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:27.766384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:27.767004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:27.767593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:27.939461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:27.948679 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c449e9a2-3951-40d8-b98d-0dbfaadd2329 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1471 microversion: 2.1 time: 0.203504 Oct 28 10:29:27.949990 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3273/6544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:27 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:28.368442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17d2b83f-10d4-417f-a5b5-9dad27716ae7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:28.375760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d2b83f-10d4-417f-a5b5-9dad27716ae7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:28.376395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d2b83f-10d4-417f-a5b5-9dad27716ae7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:28.376858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d2b83f-10d4-417f-a5b5-9dad27716ae7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:28.400265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17d2b83f-10d4-417f-a5b5-9dad27716ae7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Going to try to stop instance {{(pid=128748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:29:28.449737 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17d2b83f-10d4-417f-a5b5-9dad27716ae7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action" status: 202 len: 0 microversion: 2.1 time: 0.084914 Oct 28 10:29:28.459889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:28.460659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:28.463692 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3272/6545] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:29:28 2022] POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:29:28.467521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:28.477049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:28.477534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:28.478439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:28.479093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:28.479967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:28.633047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:28.642742 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64e478fc-ee28-447f-904e-9ecf15c3d3bc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.187422 Oct 28 10:29:28.652951 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3274/6546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:28 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:28.973867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:28.974488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:28.980996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:28.981533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:28.981980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:28.982683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:28.983363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:28.983801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:29.152738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:29.161338 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-991c4915-9b9e-45b7-9333-e5e96749f396 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1643 microversion: 2.1 time: 0.192768 Oct 28 10:29:29.161942 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3273/6547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:28 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1643 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:29.183852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:29.184470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:29.191471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:29.192220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:29.192674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:29.193415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:29.193875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:29.194308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:29.350624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:29.358990 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6c50827d-9aad-4dc3-9986-8866203df7f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1643 microversion: 2.1 time: 0.179085 Oct 28 10:29:29.359615 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3275/6548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:29 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1643 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:29:29.381465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:29.382245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:29.388446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:29.389077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:29.390100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:29.390904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:29.391426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:29.391921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:29.643652 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94bdd604-0238-4261-994c-1281e2ff3811 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1788 microversion: 2.1 time: 0.265932 Oct 28 10:29:29.644434 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3274/6549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:29 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1788 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:29.666512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:29.667226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:29.673687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:29.674181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:29.674630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:29.675341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:29.675809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:29.676237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:29.898251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:29.909509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e058dd30-25d6-440d-9e46-d6414d3558b1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.246792 Oct 28 10:29:29.910118 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3276/6550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:29 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:30.562160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-098ec280-d079-45ec-848a-78679e8659f8 req-6d021764-aff9-4076-9866-81fa1e8d2e64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261ddbf4-9f00-4749-bdef-38d2e9d16e7c", "name": "network-vif-plugged", "status": "completed", "tag": "a6af78cf-17bd-4674-9490-8bd13aeb317f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:30.574690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-098ec280-d079-45ec-848a-78679e8659f8 req-6d021764-aff9-4076-9866-81fa1e8d2e64 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:30.575779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-098ec280-d079-45ec-848a-78679e8659f8 req-6d021764-aff9-4076-9866-81fa1e8d2e64 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:30.577732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-098ec280-d079-45ec-848a-78679e8659f8 req-6d021764-aff9-4076-9866-81fa1e8d2e64 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:30.606632 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-098ec280-d079-45ec-848a-78679e8659f8 req-6d021764-aff9-4076-9866-81fa1e8d2e64 service nova] Creating event network-vif-plugged:a6af78cf-17bd-4674-9490-8bd13aeb317f for instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c on n-h1-zed-1 Oct 28 10:29:30.614008 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-098ec280-d079-45ec-848a-78679e8659f8 req-6d021764-aff9-4076-9866-81fa1e8d2e64 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055447 Oct 28 10:29:30.615648 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3275/6551] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:29:30.934587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:30.936629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:30.954830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:30.955513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:30.956066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:30.957107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:30.957685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:30.958230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:30.981843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:31.216992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:31.226769 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3567eefd-1181-46a1-ba8b-943486c8852b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.296961 Oct 28 10:29:31.227567 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3277/6552] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:30 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:31.506817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c82244ef-d206-45fc-af80-257079df3135 req-eacd79b0-db86-43f6-8fc4-ba883fea5059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20", "tag": "d8d60f50-d10c-487f-8f0f-040964827929"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:31.517144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c82244ef-d206-45fc-af80-257079df3135 req-eacd79b0-db86-43f6-8fc4-ba883fea5059 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:31.517911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c82244ef-d206-45fc-af80-257079df3135 req-eacd79b0-db86-43f6-8fc4-ba883fea5059 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:31.518558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c82244ef-d206-45fc-af80-257079df3135 req-eacd79b0-db86-43f6-8fc4-ba883fea5059 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:31.530736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c82244ef-d206-45fc-af80-257079df3135 req-eacd79b0-db86-43f6-8fc4-ba883fea5059 service nova] Creating event network-changed:d8d60f50-d10c-487f-8f0f-040964827929 for instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 on n-h2-zed-1 Oct 28 10:29:31.537443 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c82244ef-d206-45fc-af80-257079df3135 req-eacd79b0-db86-43f6-8fc4-ba883fea5059 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033946 Oct 28 10:29:31.538886 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3276/6553] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:29:32.255140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:32.256355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:32.265537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:32.266359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:32.267009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:32.268094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:32.268761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:32.269968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:32.430578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:32.439581 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c471a64a-b5fe-42d0-b066-3951bfa08e82 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.191677 Oct 28 10:29:32.453370 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3278/6554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:32 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:33.464502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:33.465241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:33.473387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:33.473900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:33.474338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:33.475032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:33.475487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:33.475907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:33.614266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:33.622401 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-75ac9150-3f31-4029-8bfd-1270d211fa87 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.162426 Oct 28 10:29:33.622980 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3277/6555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:33 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:34.645870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:34.646519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:34.653472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:34.653969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:34.654418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:34.655631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:34.656098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:34.656535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:34.804112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:34.812076 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4b4ae69-42ca-43c0-80e7-d7f3369375f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.170218 Oct 28 10:29:34.812887 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3279/6556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:34 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:35.835751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:35.836344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:35.843835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:35.844334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:35.844772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:35.845557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:35.846015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:35.846474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:35.984882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:35.993111 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46e91a60-4c6d-4206-a8fb-71b86cbf3ce7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.161159 Oct 28 10:29:35.993780 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3278/6557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:35 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:37.018018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:37.018640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:37.026196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:37.026694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:37.027136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:37.027868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:37.028310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:37.028743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:37.160969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:37.169997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a62d8626-1974-4822-9e5d-b0860d642e2b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.156302 Oct 28 10:29:37.170795 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3280/6558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:37 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:38.195126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:38.195748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:38.198825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=53 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:38.204279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:38.204796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:38.205273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:38.205978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:38.206438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:38.206899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:38.336768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:38.346025 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3726668a-094c-41ca-a7b8-487bb72d88b6 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1678 microversion: 2.1 time: 0.154588 Oct 28 10:29:38.346251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3279/6559] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:38 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:39.368836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:39.369806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:39.372243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:39.380551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:39.381328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:39.381786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:39.382503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:39.382969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:39.383406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:39.520372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:39.528335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f65d9bd0-cde9-4e16-bd20-d35334248ab0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1655 microversion: 2.1 time: 0.163550 Oct 28 10:29:39.528930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3281/6560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:39 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1655 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:39.551499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-65d672aa-ce38-4c72-9c65-a737ec3956b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:39.558937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65d672aa-ce38-4c72-9c65-a737ec3956b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:39.559532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65d672aa-ce38-4c72-9c65-a737ec3956b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:39.560045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65d672aa-ce38-4c72-9c65-a737ec3956b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:39.582964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-65d672aa-ce38-4c72-9c65-a737ec3956b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Going to try to start instance {{(pid=128748) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 10:29:39.627331 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-65d672aa-ce38-4c72-9c65-a737ec3956b8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action" status: 202 len: 0 microversion: 2.1 time: 0.079463 Oct 28 10:29:39.627941 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3280/6561] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:29:39 2022] POST /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:29:39.636706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:39.641721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:39.648550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:39.649189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:39.649635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:39.650342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:39.650797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:39.651224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:39.835098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:39.843978 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5253e075-6076-447a-a651-fe63b8b329b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1664 microversion: 2.1 time: 0.211553 Oct 28 10:29:39.844808 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3282/6562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:39 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1664 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:40.869092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:40.869792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:40.876352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:40.876868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:40.877325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:40.878045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:40.878493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:40.878941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:41.045355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:41.053471 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2b9f030-9585-4f19-81dd-28bbebd1d373 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1664 microversion: 2.1 time: 0.189626 Oct 28 10:29:41.054093 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3281/6563] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:40 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1664 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:42.078028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:42.078901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:42.086538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:42.087035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:42.087478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:42.088184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:42.089101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:42.090004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:42.227725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:42.236846 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fdba871f-f7ec-4276-af44-2ef5f8211807 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1668 microversion: 2.1 time: 0.163615 Oct 28 10:29:42.237649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3283/6564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:42 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:51.923340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:51.925662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:51.936689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=5 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:51.937314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:51.939058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:51.939571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:51.940446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:51.942214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:51.943153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:51.944132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:52.022347 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-272fd6a6-65e5-40c6-aace-3adbf3341d85 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "POST /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c/action" status: 200 len: 24571 microversion: 2.1 time: 0.103451 Oct 28 10:29:52.025553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3282/6565] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:29:51 2022] POST /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c/action => generated 24571 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:29:53.800955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:53.801715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:53.804604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=5 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:53.805322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=38 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:29:53.811906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:53.812390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:53.812829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:53.813545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:53.813998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:53.814422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:53.894704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lazy-loading 'services' on Instance uuid 18c1721b-b614-41dc-a369-b75b892d9d0d {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:29:53.964632 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-566b7dd7-95b3-460a-9ef9-3a94f3f95f93 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d/os-volume_attachments/1b5656ab-ee93-4426-93d6-f8dcd23cdf62" status: 202 len: 0 microversion: 2.1 time: 0.167703 Oct 28 10:29:53.965292 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3284/6566] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:29:53 2022] DELETE /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d/os-volume_attachments/1b5656ab-ee93-4426-93d6-f8dcd23cdf62 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:29:59.284801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:59.285421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:59.288527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b803b37c-e479-43d7-b753-9d2d6a73272f req-9da864d3-c1ae-4fe5-bd8d-7f73bd5b1fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "261ddbf4-9f00-4749-bdef-38d2e9d16e7c", "tag": "a6af78cf-17bd-4674-9490-8bd13aeb317f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:29:59.299167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b803b37c-e479-43d7-b753-9d2d6a73272f req-9da864d3-c1ae-4fe5-bd8d-7f73bd5b1fb4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.299780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b803b37c-e479-43d7-b753-9d2d6a73272f req-9da864d3-c1ae-4fe5-bd8d-7f73bd5b1fb4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.300363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b803b37c-e479-43d7-b753-9d2d6a73272f req-9da864d3-c1ae-4fe5-bd8d-7f73bd5b1fb4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.302654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.303345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.303798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.305027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.305488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.306421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.316562 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b803b37c-e479-43d7-b753-9d2d6a73272f req-9da864d3-c1ae-4fe5-bd8d-7f73bd5b1fb4 service nova] Creating event network-changed:a6af78cf-17bd-4674-9490-8bd13aeb317f for instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c on n-h1-zed-1 Oct 28 10:29:59.323194 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b803b37c-e479-43d7-b753-9d2d6a73272f req-9da864d3-c1ae-4fe5-bd8d-7f73bd5b1fb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040068 Oct 28 10:29:59.324335 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3285/6567] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:29:59.338924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:29:59.342660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:59.343255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:59.350053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.350247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.350625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.351331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.351794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.352746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.382008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:29:59.430923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31e81d55-7800-4495-a90e-c94129f7bd8a tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 204 len: 0 microversion: 2.1 time: 0.150269 Oct 28 10:29:59.436300 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3283/6568] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:29:59 2022] DELETE /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:29:59.451816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:59.453045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:59.470509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.471136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.471697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.472548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.473132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.473818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.513682 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b95bcb5-1374-4f32-a95d-c0025d136627 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "DELETE /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 204 len: 0 microversion: 2.1 time: 0.173655 Oct 28 10:29:59.515533 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3286/6569] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:29:59 2022] DELETE /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:29:59.524181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:29:59.524980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:29:59.531601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.532101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.532544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.533280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:29:59.533745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:29:59.534178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:29:59.631325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:59.639721 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b35fe86-9dcf-4e94-863b-92b058a7d63b tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1686 microversion: 2.1 time: 0.200584 Oct 28 10:29:59.640561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3284/6570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:59 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1686 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:29:59.686933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:29:59.695134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-091fdc7d-db58-4a15-a2eb-d46632781cd7 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1468 microversion: 2.1 time: 0.175116 Oct 28 10:29:59.695719 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3287/6571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:29:59 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:30:00.663785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:00.664401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:00.671521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:00.672007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:00.672449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:00.673171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:00.673630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:00.674057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:00.719248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:00.719869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:00.726497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:00.726986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:00.727431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:00.728127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:00.728586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:00.729045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:00.839652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:00.848537 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-821f7b0e-5d18-427e-a73f-556a3ce591ba tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1686 microversion: 2.1 time: 0.188644 Oct 28 10:30:00.860791 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3285/6572] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:00 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1686 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:00.863297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:00.871416 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a62ce841-8ddc-4fce-a4e3-cbaa5275c70b tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1468 microversion: 2.1 time: 0.156041 Oct 28 10:30:00.871997 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3288/6573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:00 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1468 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:30:01.603962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ae1e41d3-29bd-47bd-b03c-fe05a57f2c39 req-f68c4654-ffb0-4db5-b1d8-2fc1ef5cbbc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "261ddbf4-9f00-4749-bdef-38d2e9d16e7c", "name": "network-vif-deleted", "tag": "a6af78cf-17bd-4674-9490-8bd13aeb317f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:01.615498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae1e41d3-29bd-47bd-b03c-fe05a57f2c39 req-f68c4654-ffb0-4db5-b1d8-2fc1ef5cbbc6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:01.615949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae1e41d3-29bd-47bd-b03c-fe05a57f2c39 req-f68c4654-ffb0-4db5-b1d8-2fc1ef5cbbc6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:01.616386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ae1e41d3-29bd-47bd-b03c-fe05a57f2c39 req-f68c4654-ffb0-4db5-b1d8-2fc1ef5cbbc6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:01.628936 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ae1e41d3-29bd-47bd-b03c-fe05a57f2c39 req-f68c4654-ffb0-4db5-b1d8-2fc1ef5cbbc6 service nova] Creating event network-vif-deleted:a6af78cf-17bd-4674-9490-8bd13aeb317f for instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c on n-h1-zed-1 Oct 28 10:30:01.634314 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ae1e41d3-29bd-47bd-b03c-fe05a57f2c39 req-f68c4654-ffb0-4db5-b1d8-2fc1ef5cbbc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037597 Oct 28 10:30:01.634948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3286/6574] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:30:01.872463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:01.879892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0783e962-ea5e-4570-8298-1de414baa122 req-b75c0d49-6e10-4ca6-b5d5-4a21651ea3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18c1721b-b614-41dc-a369-b75b892d9d0d", "name": "network-vif-deleted", "tag": "878940fd-6955-4a4c-b004-22ed29bdc474"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:01.887844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:01.891289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0783e962-ea5e-4570-8298-1de414baa122 req-b75c0d49-6e10-4ca6-b5d5-4a21651ea3c4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:01.891771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0783e962-ea5e-4570-8298-1de414baa122 req-b75c0d49-6e10-4ca6-b5d5-4a21651ea3c4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:01.892232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0783e962-ea5e-4570-8298-1de414baa122 req-b75c0d49-6e10-4ca6-b5d5-4a21651ea3c4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:01.895197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:01.895695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:01.896143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:01.896865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:01.897362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:01.897798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:01.906234 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0783e962-ea5e-4570-8298-1de414baa122 req-b75c0d49-6e10-4ca6-b5d5-4a21651ea3c4 service nova] Creating event network-vif-deleted:878940fd-6955-4a4c-b004-22ed29bdc474 for instance 18c1721b-b614-41dc-a369-b75b892d9d0d on n-h2-zed-1 Oct 28 10:30:01.912942 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0783e962-ea5e-4570-8298-1de414baa122 req-b75c0d49-6e10-4ca6-b5d5-4a21651ea3c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037609 Oct 28 10:30:01.914605 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3287/6575] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:30:01.920051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:01.920753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:01.927210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:01.927700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:01.928282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:01.929037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:01.929494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:01.929917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:01.959373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:01.960250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:01.960938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:01.961652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lazy-loading 'fault' on Instance uuid 261ddbf4-9f00-4749-bdef-38d2e9d16e7c {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:30:02.008214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '608b9dc1a00d489a94524f99820022f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43f3d1244dc147c398fc24ddcfc6da34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:02.009256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eb2442f7f47e4bff8e1ab9d3547550fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b0dea03ca9d4c5b99c4c26b31b6fb27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:02.018019 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3fed1852-9a22-4718-a82b-20a1c8ec32e1 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 200 len: 1355 microversion: 2.1 time: 0.149576 Oct 28 10:30:02.019099 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3289/6576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:01 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 1355 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:02.025783 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f9a0048-a620-4864-ae1b-0a46c89799ed tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 200 len: 1298 microversion: 2.1 time: 0.109631 Oct 28 10:30:02.026428 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3288/6577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:01 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:03.041222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:03.041849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] [instance: 261ddbf4-9f00-4749-bdef-38d2e9d16e7c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:03.048698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:03.049228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:03.049341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] [instance: 18c1721b-b614-41dc-a369-b75b892d9d0d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:03.049440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:03.049798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:03.050505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:03.050975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:03.051410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:03.056010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:03.056492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:03.056950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:03.057668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:03.058121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:03.058539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:03.064953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] HTTP exception thrown: Instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c could not be found. Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Request method failure captured: Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c HTTP/1.1 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW6zXHm2C0MBZyh1v9W7qaCMezuCetEchcqsk_b8RAoux6fJEz9I9HuMCo8PBbtHPGu0VR2DyPC7nyw8kroAbJeUqYDYl7PHuIuZvlES9rmLvMQK9_o0rbBvOeJu953NpDPOD8Hi-3tTGWLZcp5HaeSQhjwgaPVolC0PCrS_HHPl8_Bc Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/43f3d1244dc147c398fc24ddcfc6da34"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_43f3d1244dc147c398fc24ddcfc6da34", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/43f3d1244dc147c398fc24ddcfc6da34"}]}] Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 43f3d1244dc147c398fc24ddcfc6da34 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2068054591 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 608b9dc1a00d489a94524f99820022f6 Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2068054591-project Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c could not be found. Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '261ddbf4-9f00-4749-bdef-38d2e9d16e7c'} Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c could not be found. Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c could not be found. Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.066693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c could not be found. Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Returning 404 to user: Instance 261ddbf4-9f00-4749-bdef-38d2e9d16e7c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b61b603e-4e26-42f0-ab89-d82250140e84 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c" status: 404 len: 111 microversion: 2.1 time: 0.031115 Oct 28 10:30:03.071776 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3290/6578] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:03 2022] GET /compute/v2.1/servers/261ddbf4-9f00-4749-bdef-38d2e9d16e7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:30:03.075505 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] HTTP exception thrown: Instance 18c1721b-b614-41dc-a369-b75b892d9d0d could not be found. Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Request method failure captured: Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d HTTP/1.1 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW67Qg3w2OOMzPR_Yn7_WPEdbXFUdwQRSEfhUJGsOSp9_1V3oaVeQQecCz9D1IO9kmTrGGlVSFkaV0QyoH5fAeuH0sMu1vX_W8g-BgfQWFRwxPd0LIEd_rVS1rrlVWESoZJYbN9R3n8Nbi2T14phiU1HwqHVg8IthRhmnZELnCk6Cmpw Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3b0dea03ca9d4c5b99c4c26b31b6fb27 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesBackupsTest-156644103 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b0dea03ca9d4c5b99c4c26b31b6fb27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3b0dea03ca9d4c5b99c4c26b31b6fb27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3b0dea03ca9d4c5b99c4c26b31b6fb27", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3b0dea03ca9d4c5b99c4c26b31b6fb27"}]}] Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesBackupsTest-156644103 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3b0dea03ca9d4c5b99c4c26b31b6fb27 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesBackupsTest-156644103 Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesBackupsTest-156644103-project Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: eb2442f7f47e4bff8e1ab9d3547550fe Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesBackupsTest-156644103-project Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 18c1721b-b614-41dc-a369-b75b892d9d0d could not be found. Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '18c1721b-b614-41dc-a369-b75b892d9d0d'} Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18c1721b-b614-41dc-a369-b75b892d9d0d could not be found. Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18c1721b-b614-41dc-a369-b75b892d9d0d could not be found. Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:03.077670 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18c1721b-b614-41dc-a369-b75b892d9d0d could not be found. Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] Returning 404 to user: Instance 18c1721b-b614-41dc-a369-b75b892d9d0d could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-487e10be-ff02-4bd9-999a-adbac213aee0 tempest-VolumesBackupsTest-156644103 tempest-VolumesBackupsTest-156644103-project] 10.222.0.16 "GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d" status: 404 len: 111 microversion: 2.1 time: 0.034237 Oct 28 10:30:03.082059 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3289/6579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:03 2022] GET /compute/v2.1/servers/18c1721b-b614-41dc-a369-b75b892d9d0d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:30:06.748368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e0de094-9ab6-4749-9f33-adabd4165105 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] Calling method '.version_select at 0x7fca33072ca0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:06.800570 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e0de094-9ab6-4749-9f33-adabd4165105 tempest-TestNetworkAdvancedServerOps-2068054591 tempest-TestNetworkAdvancedServerOps-2068054591-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-476255662" status: 202 len: 0 microversion: 2.1 time: 0.056208 Oct 28 10:30:06.801251 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3291/6580] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 10:30:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-476255662 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:30:21.581295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1875140358", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "84ef6560-44ab-49bf-91a8-fce4b4ea9b64", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:21.593845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:21.594517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:21.596436 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:30:21.596829 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 10:30:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 10:30:21.655570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:30:22.288709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:30:22.289191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:30:22.289667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:30:22.290100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:30:22.290614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:30:22.302069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:22.302807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:22.303440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:22.304249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:22.304984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:22.305489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:22.325792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:30:22.333203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:30:22.392307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:30:22.394380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='84ef6560-44ab-49bf-91a8-fce4b4ea9b64',volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:30:22.556074 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0dff3f9f-c394-4618-876a-71f50c13aef5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.978909 Oct 28 10:30:22.568195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:22.570187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:22.577233 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3290/6581] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:30:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:30:22.577409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef6c9a12-0a9a-4392-b91a-e68430f54ed3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:22.578039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef6c9a12-0a9a-4392-b91a-e68430f54ed3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:22.848031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ef6c9a12-0a9a-4392-b91a-e68430f54ed3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:22.858130 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef6c9a12-0a9a-4392-b91a-e68430f54ed3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1057 microversion: 2.1 time: 0.293024 Oct 28 10:30:22.858914 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3292/6582] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:22 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1057 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:23.889005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:23.893082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:23.930118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:23.932955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:23.934475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:23.938332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:23.940487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:23.941210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:24.140545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:24.141203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:24.151021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:24.151635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:24.152081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:24.153317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:24.154066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:24.154699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:24.200107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:30:24.218002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:24.228737 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0bf9ee4-e4b7-4144-b78e-6746b4ef315d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1163 microversion: 2.1 time: 0.346632 Oct 28 10:30:24.231649 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3291/6583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:23 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1163 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:24.378286 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-82f6b6cb-b6d7-4df5-9086-09918c3ffd29 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 204 len: 0 microversion: 2.1 time: 0.472927 Oct 28 10:30:24.378906 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3293/6584] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:30:23 2022] DELETE /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:30:24.387620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:24.388243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:24.394481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:24.395112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:24.395556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:24.396257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:24.397009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:24.397444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:24.596220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:24.611141 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56b59550-ad58-4980-8d0c-9ef9d650feec tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1732 microversion: 2.1 time: 0.227770 Oct 28 10:30:24.613026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3292/6585] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:24 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1732 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:25.256235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:25.257689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:25.270880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:25.273546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:25.274060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:25.274818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:25.275369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:25.275935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:25.614231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:25.625757 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb9474fa-2b47-40e6-9e33-88a17f36273e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1215 microversion: 2.1 time: 0.373946 Oct 28 10:30:25.642074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:25.642074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:25.644820 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3294/6586] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:25 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1215 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:25.662233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:25.663472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:25.665878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:25.668961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:25.674637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:25.676196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:26.061190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:26.072491 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56e420be-6b08-450c-b19b-3a1b1d9bd0f9 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1732 microversion: 2.1 time: 0.435999 Oct 28 10:30:26.078897 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3293/6587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:25 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1732 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:26.654368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:26.655898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:26.668474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:26.671610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:26.672378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:26.677705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:26.678188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:26.678900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:26.875665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:26.892154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-053b4b5f-178e-45b2-a7b4-e85095b2e191 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1215 microversion: 2.1 time: 0.244154 Oct 28 10:30:26.893763 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3295/6588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:26 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:27.103139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:27.104514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:27.113549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:27.114595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:27.115059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:27.115763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:27.116875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:27.117342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:27.281326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fd00a037-e8ef-43fd-b126-8a26894c45ca req-ccffa6b2-a76f-4176-8eb5-e10cd929151c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "869c56e7-43dc-4890-b45a-80f3f94c818f", "tag": "c20a4f84-7712-4712-a676-885a5c17494a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:27.294133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fd00a037-e8ef-43fd-b126-8a26894c45ca req-ccffa6b2-a76f-4176-8eb5-e10cd929151c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:27.296089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fd00a037-e8ef-43fd-b126-8a26894c45ca req-ccffa6b2-a76f-4176-8eb5-e10cd929151c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:27.296780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fd00a037-e8ef-43fd-b126-8a26894c45ca req-ccffa6b2-a76f-4176-8eb5-e10cd929151c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:27.310332 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fd00a037-e8ef-43fd-b126-8a26894c45ca req-ccffa6b2-a76f-4176-8eb5-e10cd929151c service nova] Creating event network-changed:c20a4f84-7712-4712-a676-885a5c17494a for instance 869c56e7-43dc-4890-b45a-80f3f94c818f on n-h1-zed-1 Oct 28 10:30:27.327234 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fd00a037-e8ef-43fd-b126-8a26894c45ca req-ccffa6b2-a76f-4176-8eb5-e10cd929151c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050590 Oct 28 10:30:27.329761 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3296/6589] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:30:27.488845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:27.502806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c32f0abd-ecdd-43de-87b6-86e9a345db77 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1732 microversion: 2.1 time: 0.404058 Oct 28 10:30:27.504473 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3294/6590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:27 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1732 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:27.922469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:27.924317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:27.931604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:27.932429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:27.934857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:27.936310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:27.937720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:27.938254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:28.115221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:28.126532 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-06e80b4b-6081-4461-83dd-7a6f371f2ac9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1215 microversion: 2.1 time: 0.213915 Oct 28 10:30:28.143199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3297/6591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:27 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1215 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:28.528146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:28.531194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:28.542007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:28.542692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:28.543287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:28.544216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:28.545847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:28.546687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:28.595024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:28.595706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:28.596298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:28.597597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lazy-loading 'fault' on Instance uuid 7d902ccb-2210-427f-aca0-19b8663395d9 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:30:28.655826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea05b9cbccbe4fa298503a412b287e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e7594ffba04a4bb687919ae7227733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:28.672334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c3308e3-d2ab-4152-879a-69cbedf86b2e tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 200 len: 1388 microversion: 2.1 time: 0.150171 Oct 28 10:30:28.686922 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3295/6592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:28 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 1388 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:29.152396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:29.153065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:29.167777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:29.168512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:29.169186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:29.170444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:29.170902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:29.171330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:29.328673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:29.337120 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6b9430b-95f2-492a-b3ab-c33088891cb4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1215 microversion: 2.1 time: 0.188983 Oct 28 10:30:29.337478 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3298/6593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:29 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1215 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:29.348657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b774dd11-6073-4980-b55d-8748c4e10f9b req-6bff5cc1-e448-4cff-bb4c-eba1847364fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d902ccb-2210-427f-aca0-19b8663395d9", "name": "network-vif-deleted", "tag": "0394977a-6716-4674-b91d-f5cde0d5f33a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:29.358867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b774dd11-6073-4980-b55d-8748c4e10f9b req-6bff5cc1-e448-4cff-bb4c-eba1847364fa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:29.359344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b774dd11-6073-4980-b55d-8748c4e10f9b req-6bff5cc1-e448-4cff-bb4c-eba1847364fa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:29.359770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b774dd11-6073-4980-b55d-8748c4e10f9b req-6bff5cc1-e448-4cff-bb4c-eba1847364fa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:29.370825 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b774dd11-6073-4980-b55d-8748c4e10f9b req-6bff5cc1-e448-4cff-bb4c-eba1847364fa service nova] Creating event network-vif-deleted:0394977a-6716-4674-b91d-f5cde0d5f33a for instance 7d902ccb-2210-427f-aca0-19b8663395d9 on n-h1-zed-1 Oct 28 10:30:29.376371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b774dd11-6073-4980-b55d-8748c4e10f9b req-6bff5cc1-e448-4cff-bb4c-eba1847364fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031442 Oct 28 10:30:29.377177 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3296/6594] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:30:29.699025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:29.699777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:29.706413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:29.706905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:29.707347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:29.708039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:29.708495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:29.708945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:29.722483 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] HTTP exception thrown: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Request method failure captured: Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 HTTP/1.1 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW631T1sVIvlO0H7DGGy5sfAbz1U8DewOhqjvjrCqPbKTx6oUXFnjtbi_wy8ErrPtd3dTwnX50cWkpT7ZYziV2XMsepnxSFMAXQr4UJ6Pj4AP6bUw4MzhrCLKJRu6xcravVsXjgv4MeGxYOjBqo_NrsNTxzfvvwyKvAj9DzLEqK3YjUM Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: c2e7594ffba04a4bb687919ae7227733 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestServerBasicOps-725032182 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e7594ffba04a4bb687919ae7227733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e7594ffba04a4bb687919ae7227733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e7594ffba04a4bb687919ae7227733", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e7594ffba04a4bb687919ae7227733"}]}] Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestServerBasicOps-725032182 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: c2e7594ffba04a4bb687919ae7227733 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestServerBasicOps-725032182 Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestServerBasicOps-725032182-project Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: ea05b9cbccbe4fa298503a412b287e1b Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestServerBasicOps-725032182-project Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7d902ccb-2210-427f-aca0-19b8663395d9'} Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:29.724135 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Returning 404 to user: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2f1f5390-6095-4ce1-baa2-638f3f035df5 tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 404 len: 111 microversion: 2.1 time: 0.030517 Oct 28 10:30:29.729073 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3299/6595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:29 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:30:30.207880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:30.208450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:30.214867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:30.215347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:30.215779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:30.217016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:30.217475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:30.217905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:30.231317 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] HTTP exception thrown: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Request method failure captured: Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 HTTP/1.1 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW631T1sVIvlO0H7DGGy5sfAbz1U8DewOhqjvjrCqPbKTx6oUXFnjtbi_wy8ErrPtd3dTwnX50cWkpT7ZYziV2XMsepnxSFMAXQr4UJ6Pj4AP6bUw4MzhrCLKJRu6xcravVsXjgv4MeGxYOjBqo_NrsNTxzfvvwyKvAj9DzLEqK3YjUM Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: c2e7594ffba04a4bb687919ae7227733 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestServerBasicOps-725032182 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e7594ffba04a4bb687919ae7227733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e7594ffba04a4bb687919ae7227733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e7594ffba04a4bb687919ae7227733", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e7594ffba04a4bb687919ae7227733"}]}] Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestServerBasicOps-725032182 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: c2e7594ffba04a4bb687919ae7227733 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestServerBasicOps-725032182 Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestServerBasicOps-725032182-project Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: ea05b9cbccbe4fa298503a412b287e1b Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestServerBasicOps-725032182-project Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '7d902ccb-2210-427f-aca0-19b8663395d9'} Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:30:30.233582 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Returning 404 to user: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:30:30.238325 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a6450eb5-b89d-46f3-a0cd-0b1ad2c3edfb tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "DELETE /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 404 len: 111 microversion: 2.1 time: 0.032353 Oct 28 10:30:30.243918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:30.244534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] [instance: 7d902ccb-2210-427f-aca0-19b8663395d9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:30.248223 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3297/6596] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:30:30 2022] DELETE /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:30:30.251875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:30.252369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:30.252813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:30.253539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:30.254001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:30.254434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:30.268663 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] HTTP exception thrown: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Request method failure captured: Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 HTTP/1.1 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW631T1sVIvlO0H7DGGy5sfAbz1U8DewOhqjvjrCqPbKTx6oUXFnjtbi_wy8ErrPtd3dTwnX50cWkpT7ZYziV2XMsepnxSFMAXQr4UJ6Pj4AP6bUw4MzhrCLKJRu6xcravVsXjgv4MeGxYOjBqo_NrsNTxzfvvwyKvAj9DzLEqK3YjUM Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: c2e7594ffba04a4bb687919ae7227733 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestServerBasicOps-725032182 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e7594ffba04a4bb687919ae7227733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/c2e7594ffba04a4bb687919ae7227733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_c2e7594ffba04a4bb687919ae7227733", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/c2e7594ffba04a4bb687919ae7227733"}]}] Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestServerBasicOps-725032182 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: c2e7594ffba04a4bb687919ae7227733 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestServerBasicOps-725032182 Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestServerBasicOps-725032182-project Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: ea05b9cbccbe4fa298503a412b287e1b Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestServerBasicOps-725032182-project Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '7d902ccb-2210-427f-aca0-19b8663395d9'} Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:30.270230 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Returning 404 to user: Instance 7d902ccb-2210-427f-aca0-19b8663395d9 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-302d4233-fc80-43bc-8a0f-1ce7811dbdab tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9" status: 404 len: 111 microversion: 2.1 time: 0.031557 Oct 28 10:30:30.276626 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3300/6597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:30 2022] GET /compute/v2.1/servers/7d902ccb-2210-427f-aca0-19b8663395d9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:30:30.360452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:30.361364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:30.368641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:30.369253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:30.369902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:30.370675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:30.371203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:30.371874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:30.445739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4166fa0a-74f5-4163-a3da-45769002ffed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] Calling method '.version_select at 0x7fca335c6e50>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:30.471796 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4166fa0a-74f5-4163-a3da-45769002ffed tempest-TestServerBasicOps-725032182 tempest-TestServerBasicOps-725032182-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-915663298" status: 202 len: 0 microversion: 2.1 time: 0.026439 Oct 28 10:30:30.473350 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3301/6598] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 10:30:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-915663298 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:30:30.535927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:30.544116 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-219fd335-48ef-4911-bcb8-dc16f0b52c7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.187688 Oct 28 10:30:30.545378 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3298/6599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:30 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:31.568947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:31.570267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:31.579065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:31.579852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:31.581080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:31.582064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:31.582644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:31.583166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:32.164651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:32.172743 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d8dd530-ba2c-4612-ac13-5a3f854fd24b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.608870 Oct 28 10:30:32.173447 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3302/6600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:31 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:33.195944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:33.196815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:33.199743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:33.200731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:33.207675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:33.208386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:33.208836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:33.209598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:33.210061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:33.210502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:33.472620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:33.483559 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41fb6b24-6987-4626-bcef-cb0d6cb737c7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.291351 Oct 28 10:30:33.484933 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3299/6601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:33 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:34.507712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:34.508235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:34.511137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:34.517451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:34.517941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:34.518379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:34.519071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:34.519525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:34.519947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:34.768795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:34.778533 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e08fab20-0781-4e07-a5eb-d01d2e2a04ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.274705 Oct 28 10:30:34.779238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3303/6602] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:34 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:35.802251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:35.803481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:35.811207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:35.811974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:35.812576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:35.813490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:35.814103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:35.814696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:35.979116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:35.990761 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1601978b-0427-4c43-a1bd-3dea7d7ad2ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.191997 Oct 28 10:30:35.991171 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3300/6603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:35 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:30:37.017652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:37.018213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:37.025053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:37.025552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:37.025993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:37.026692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:37.027151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:37.027585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:37.283312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:37.292210 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-677d737c-8d9f-441f-b143-0fce3ef84ac7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.279143 Oct 28 10:30:37.293255 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3304/6604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:37 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:38.318634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:38.319442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:38.327892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:38.328475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:38.329016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:38.329814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:38.330341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:38.330838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:38.478363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:38.487244 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c12d7cf6-9616-46de-b334-1570034d70ad tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.172606 Oct 28 10:30:38.490142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3301/6605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:38 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:38.815624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-65d1b9d2-6692-4a12-ab24-44f250e990a4 req-be463334-061c-4342-bb6d-d15f3d2f5765 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869c56e7-43dc-4890-b45a-80f3f94c818f", "name": "network-vif-plugged", "status": "completed", "tag": "c20a4f84-7712-4712-a676-885a5c17494a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:38.830409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-65d1b9d2-6692-4a12-ab24-44f250e990a4 req-be463334-061c-4342-bb6d-d15f3d2f5765 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:38.830906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-65d1b9d2-6692-4a12-ab24-44f250e990a4 req-be463334-061c-4342-bb6d-d15f3d2f5765 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:38.831374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-65d1b9d2-6692-4a12-ab24-44f250e990a4 req-be463334-061c-4342-bb6d-d15f3d2f5765 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:38.845096 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-65d1b9d2-6692-4a12-ab24-44f250e990a4 req-be463334-061c-4342-bb6d-d15f3d2f5765 service nova] Creating event network-vif-plugged:c20a4f84-7712-4712-a676-885a5c17494a for instance 869c56e7-43dc-4890-b45a-80f3f94c818f on n-h1-zed-1 Oct 28 10:30:38.851142 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-65d1b9d2-6692-4a12-ab24-44f250e990a4 req-be463334-061c-4342-bb6d-d15f3d2f5765 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039943 Oct 28 10:30:38.852429 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3305/6606] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:30:39.511885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:39.512586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:39.520089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:39.520757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:39.521322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:39.522268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:39.522857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:39.523394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:39.675425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:39.683464 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4e37aa7-59a3-426b-bf09-0939e61d7f6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1203 microversion: 2.1 time: 0.175600 Oct 28 10:30:39.684395 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3302/6607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:39 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1203 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:40.708019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:40.709011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:40.717305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:40.717892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:40.718352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:40.719099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:40.719557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:40.719990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:40.854325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:40.862713 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b6c14b1-9c37-4367-8591-6f24d8ad82bd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1390 microversion: 2.1 time: 0.159040 Oct 28 10:30:40.863385 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3306/6608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:40 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:40.885458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:40.886068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:40.894441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:40.894970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:40.895425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:40.896130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:40.896623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:40.897196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:41.030349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:41.038575 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-66912d94-a7ef-4aa3-84aa-a3f0665554ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1390 microversion: 2.1 time: 0.156943 Oct 28 10:30:41.039161 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3303/6609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:40 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:30:41.061373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:41.061999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:41.068301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:41.068779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:41.069254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:41.069999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:41.070445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:41.070875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:41.205157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:41.212990 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b0c57ba-7725-4d81-8310-c79f754b7c00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1390 microversion: 2.1 time: 0.156060 Oct 28 10:30:41.213566 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3307/6610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:41 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:41.235523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:41.236024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:41.242377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:41.242868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:41.243312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:41.244010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:41.244472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:41.244931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:41.270698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:30:41.345723 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c919419a-9a0a-48da-9073-9f1d70eebb7e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 204 len: 0 microversion: 2.1 time: 0.114216 Oct 28 10:30:41.346561 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3304/6611] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:30:41 2022] DELETE /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:30:41.355873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:41.356575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:41.363285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:41.363847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:41.364741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:41.365801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:41.366525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:41.367123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:41.509956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:41.518720 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-62a64d1e-5866-4932-8c3e-6ed59e3b4895 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1396 microversion: 2.1 time: 0.166871 Oct 28 10:30:41.519323 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3308/6612] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:41 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1396 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:42.542573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:42.543326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:42.558671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:42.559290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:42.559804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:42.560516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:42.561001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:42.561435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:42.697182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:42.705547 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d84af7bc-a07b-4876-b594-f732a38919b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1396 microversion: 2.1 time: 0.167336 Oct 28 10:30:42.706121 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3305/6613] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:42 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1396 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:43.440883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1bad42e3-891e-4c0c-8eab-7ed93cc2bf45 req-f1526bb4-ba40-42fc-be0f-e24887f509b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "869c56e7-43dc-4890-b45a-80f3f94c818f", "name": "network-vif-deleted", "tag": "c20a4f84-7712-4712-a676-885a5c17494a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:43.452109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1bad42e3-891e-4c0c-8eab-7ed93cc2bf45 req-f1526bb4-ba40-42fc-be0f-e24887f509b7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:43.452594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1bad42e3-891e-4c0c-8eab-7ed93cc2bf45 req-f1526bb4-ba40-42fc-be0f-e24887f509b7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:43.458182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1bad42e3-891e-4c0c-8eab-7ed93cc2bf45 req-f1526bb4-ba40-42fc-be0f-e24887f509b7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:43.471415 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1bad42e3-891e-4c0c-8eab-7ed93cc2bf45 req-f1526bb4-ba40-42fc-be0f-e24887f509b7 service nova] Creating event network-vif-deleted:c20a4f84-7712-4712-a676-885a5c17494a for instance 869c56e7-43dc-4890-b45a-80f3f94c818f on n-h1-zed-1 Oct 28 10:30:43.480390 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1bad42e3-891e-4c0c-8eab-7ed93cc2bf45 req-f1526bb4-ba40-42fc-be0f-e24887f509b7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043298 Oct 28 10:30:43.481197 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3309/6614] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:30:43.729847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:43.731081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:43.738216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:43.738701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:43.739237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:43.739944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:43.740402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:43.740833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:43.760119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:43.813230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:43.821815 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-48a4bfdf-71f8-4035-b21f-7de8f2b0ea89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1188 microversion: 2.1 time: 0.095777 Oct 28 10:30:43.822396 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3306/6615] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:43 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1188 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:44.848250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:44.848871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:44.856231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:44.856729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:44.857199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:44.857897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:44.858529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:44.858968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:44.927833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:44.939419 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7ceca8c4-186c-4a19-8b1a-4c98028f99cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1188 microversion: 2.1 time: 0.096881 Oct 28 10:30:44.940017 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3310/6616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:44 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:45.640313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:45.643150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:45.650495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.651270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.651784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:45.652536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.653076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.653622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:45.686508 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f0479b0a-0b27-46bc-b65b-261f20280358 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049996 Oct 28 10:30:45.691019 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3307/6617] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:30:45 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:30:45.754466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:45.755141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:45.761422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.762018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.762557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:45.763391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.763942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.764470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:45.790787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:30:45.806159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:45.880954 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-810699c3-f274-4b38-8f16-1ab1c3a709fb tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 204 len: 0 microversion: 2.1 time: 0.129959 Oct 28 10:30:45.885005 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3311/6618] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:30:45 2022] DELETE /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:30:45.892168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:45.893143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:45.902117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.902949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.903457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:45.904845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.905394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.905888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:45.965712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:45.967452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:45.975403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.975888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.977192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:45.978154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:45.978888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:45.979520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:46.054131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:46.056271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:46.064547 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b562ee78-5204-4b82-bc71-f852d2a6d65d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1188 microversion: 2.1 time: 0.103628 Oct 28 10:30:46.066243 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-538a8345-eab2-4a51-9a60-75e04bc11830 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1674 microversion: 2.1 time: 0.179888 Oct 28 10:30:46.067182 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3312/6619] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:45 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1188 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:46.080690 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3308/6620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:45 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:47.090114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:47.090869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:47.092110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:47.092573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:47.099426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:47.100161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:47.100466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:47.100654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:47.101243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:47.101379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:47.102021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:47.102479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:47.102738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:47.102899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:47.103502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:47.104167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:47.182940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:47.193276 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aed28f4a-c783-4ab8-8dae-f371c676bc96 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1188 microversion: 2.1 time: 0.106960 Oct 28 10:30:47.196344 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3313/6621] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:47 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1188 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:47.253828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:47.261755 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-33b8855a-8711-40ae-b5ca-e58ac2d5a56c tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1674 microversion: 2.1 time: 0.174771 Oct 28 10:30:47.262617 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3309/6622] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:47 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1674 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:48.224417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:48.225401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:48.235327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:48.237075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:48.238099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:48.239076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:48.239644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:48.240310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:48.277518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:48.278434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:48.279040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:48.279618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lazy-loading 'fault' on Instance uuid 869c56e7-43dc-4890-b45a-80f3f94c818f {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:30:48.289055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:48.290350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:48.304989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:48.306846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:48.307297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:48.311639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:48.312145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:48.312585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:48.338970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:48.352072 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7178d2f1-a3d6-4616-b272-a40b555362ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 200 len: 1147 microversion: 2.1 time: 0.132487 Oct 28 10:30:48.352991 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3314/6623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:48 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 1147 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:48.690067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:48.701879 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bb550f93-ed21-4c28-98ba-29b0ced296cd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1674 microversion: 2.1 time: 0.417174 Oct 28 10:30:48.704768 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3310/6624] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:48 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1674 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:49.379627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:49.380384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 869c56e7-43dc-4890-b45a-80f3f94c818f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:49.390167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:49.390982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:49.391674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:49.393134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:49.393851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:49.394361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:49.409458 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance 869c56e7-43dc-4890-b45a-80f3f94c818f could not be found. Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f HTTP/1.1 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 869c56e7-43dc-4890-b45a-80f3f94c818f could not be found. Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '869c56e7-43dc-4890-b45a-80f3f94c818f'} Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 869c56e7-43dc-4890-b45a-80f3f94c818f could not be found. Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 869c56e7-43dc-4890-b45a-80f3f94c818f could not be found. Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:49.413209 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:49.417445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:49.417445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:49.417445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:49.417445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:30:49.417445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:30:49.417445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 869c56e7-43dc-4890-b45a-80f3f94c818f could not be found. Oct 28 10:30:49.417445 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:30:49.419011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance 869c56e7-43dc-4890-b45a-80f3f94c818f could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:30:49.419884 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df9ac8d2-09e4-4439-b965-344dbce890ae tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f" status: 404 len: 111 microversion: 2.1 time: 0.044362 Oct 28 10:30:49.420970 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3315/6625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:49 2022] GET /compute/v2.1/servers/869c56e7-43dc-4890-b45a-80f3f94c818f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:30:49.726983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:49.728218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:49.735857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:49.736763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:49.737385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:49.738304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:49.738943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:49.739531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:50.174416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:50.182500 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d643b7e2-40df-4cf1-ae8a-16ffa429ebbc tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 200 len: 1606 microversion: 2.1 time: 0.459631 Oct 28 10:30:50.199483 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3311/6626] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:49 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 1606 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:50.403481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3cc0fb58-9629-4689-bd7c-5479a34aa87a req-9b953ec3-4a3e-46cb-b8aa-a054c99925aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf469daa-59f1-4892-bd8c-76e8f947722b", "name": "network-vif-deleted", "tag": "f7d5be91-1a22-48a9-997e-dc50db3afbaf"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:50.424804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3cc0fb58-9629-4689-bd7c-5479a34aa87a req-9b953ec3-4a3e-46cb-b8aa-a054c99925aa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:50.425326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3cc0fb58-9629-4689-bd7c-5479a34aa87a req-9b953ec3-4a3e-46cb-b8aa-a054c99925aa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:50.425938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3cc0fb58-9629-4689-bd7c-5479a34aa87a req-9b953ec3-4a3e-46cb-b8aa-a054c99925aa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:50.453476 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3cc0fb58-9629-4689-bd7c-5479a34aa87a req-9b953ec3-4a3e-46cb-b8aa-a054c99925aa service nova] Creating event network-vif-deleted:f7d5be91-1a22-48a9-997e-dc50db3afbaf for instance bf469daa-59f1-4892-bd8c-76e8f947722b on n-h2-zed-1 Oct 28 10:30:50.462039 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3cc0fb58-9629-4689-bd7c-5479a34aa87a req-9b953ec3-4a3e-46cb-b8aa-a054c99925aa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062634 Oct 28 10:30:50.465458 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3316/6627] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:30:51.209291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:51.210652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:51.224252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:51.228392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:51.242426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:51.244285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:51.247240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:51.251137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:51.324738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] HTTP exception thrown: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Request method failure captured: Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b HTTP/1.1 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW647805cRrxMd9qedfzj9YFEhZMGrGUxITGSAA8uOYlHLH7k-RgPuHnp_S0CHpbWEmTnBW342BASFeturT8NcM_-rfJDcP6mIsxqdxr9MC3anY7_faNyOa0jegAn9AmUiWQ1gl5tcOSC67hnEd6TgRLJKULBXylxsK21xiAklRMWYzc Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1abb2b7300b44b4af7b177c76b74216", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1abb2b7300b44b4af7b177c76b74216"}]}] Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c3a28b4dcd9f4cdfb724f5b29ce26b16 Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'bf469daa-59f1-4892-bd8c-76e8f947722b'} Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:30:51.326765 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:51.330953 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:30:51.330953 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:30:51.330953 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:30:51.330953 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:30:51.330953 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:30:51.330953 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:30:51.330953 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:30:51.333069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Returning 404 to user: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:30:51.334269 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-935d3129-67ac-42ad-89eb-164a490aa9e3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 404 len: 111 microversion: 2.1 time: 0.130965 Oct 28 10:30:51.342871 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3312/6628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:51 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:30:51.349576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1edc5b4-c9b0-4bb4-8446-641ac1135806 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '.version_select at 0x7fca32f9f0d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:51.377281 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1edc5b4-c9b0-4bb4-8446-641ac1135806 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721082951" status: 202 len: 0 microversion: 2.1 time: 0.033610 Oct 28 10:30:51.379571 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3317/6629] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:30:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1721082951 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:30:53.026024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a9d1100-6654-4735-8883-49f4d5b371e8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'create', calling method: .version_select at 0x7fca3265c3a0>, body: {"keypair": {"name": "tempest-keypair-1437925132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcIL7F5HIhn56BLI3qVrPYxqXTs6LXShT70wVnjfizU7TVd918s7R3lUJNS3dtQWcb0u6K/y1ePaN04aDAcc/9IOYx98zpG4j8pKHDFAsd6w+iVUI6Snx/AcE2TON9Xgw=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:53.039228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:53.076644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6a9d1100-6654-4735-8883-49f4d5b371e8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for project d1abb2b7300b44b4af7b177c76b74216. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:30:53.084845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-6a9d1100-6654-4735-8883-49f4d5b371e8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for user c3a28b4dcd9f4cdfb724f5b29ce26b16 and project d1abb2b7300b44b4af7b177c76b74216. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:30:53.139622 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6a9d1100-6654-4735-8883-49f4d5b371e8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.117368 Oct 28 10:30:53.140871 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3313/6630] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:30:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:30:56.676813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-865291468", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbf4ea4f-632f-4cb8-8fcc-b8fdc886c281"}], "security_groups": [{"name": "tempest-securitygroup--865079541"}], "key_name": "tempest-keypair-1437925132", "user_data": "}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:56.703313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:30:56.882916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] validate_networks() for [('bbf4ea4f-632f-4cb8-8fcc-b8fdc886c281', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:30:56.928480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-618765388", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "c10b2ee5-2701-4d92-ac8c-835fa45d175d"}], "key_name": "tempest-TestSecurityGroupsBasicOps-1110613118", "security_groups": []}, "os:scheduler_hints": {"different_host": ["48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20"]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:57.024883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] validate_networks() for [('c10b2ee5-2701-4d92-ac8c-835fa45d175d', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:30:57.523944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:30:57.524857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:30:57.525805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:30:57.526413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:30:57.527034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:30:57.539313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:57.540040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:57.540773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:57.541861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:57.542547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:57.543329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:57.564808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for project d1abb2b7300b44b4af7b177c76b74216. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:30:57.572074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Getting quotas for user c3a28b4dcd9f4cdfb724f5b29ce26b16 and project d1abb2b7300b44b4af7b177c76b74216. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:30:57.591799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:30:57.595542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:30:57.671246 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b9f1dbf0-2b6b-4162-880d-00e0b477f790 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.000127 Oct 28 10:30:57.672930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3318/6631] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:30:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:30:57.683881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-916909244", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cc0d10b1-5a5f-4cec-9d92-d4cc20f309fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:30:57.770027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:30:57.910614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:30:57.911049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:30:57.911532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:30:57.911948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:30:57.912363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:30:57.927253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:57.929500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:57.931951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:57.932921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:57.933573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:57.935524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:57.976768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Getting quotas for project 2807e06b2fea49d0b35bd4f227bb8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:30:57.985942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Getting quotas for user f777312225d24ba7b8c686e49d0cd4f7 and project 2807e06b2fea49d0b35bd4f227bb8b79. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:30:58.020157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:30:58.022736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:30:58.125016 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17eb7aad-e0f8-4b1d-9c01-2da2fe84c8b1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.201324 Oct 28 10:30:58.127673 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3314/6632] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:30:56 2022] POST /compute/v2.1/servers => generated 361 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:30:58.139019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d40cb380-b063-454c-9b6b-084351db16b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:58.139590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d40cb380-b063-454c-9b6b-084351db16b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:58.257977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d40cb380-b063-454c-9b6b-084351db16b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:58.268018 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d40cb380-b063-454c-9b6b-084351db16b9 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1237 microversion: 2.1 time: 0.139037 Oct 28 10:30:58.278997 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3315/6633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:58 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1237 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:58.290571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c41816ee-616c-4975-8522-cf4c8e13f347 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:58.291182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c41816ee-616c-4975-8522-cf4c8e13f347 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:58.339375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:30:58.339935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:30:58.340651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:30:58.341246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:30:58.341866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:30:58.352234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c41816ee-616c-4975-8522-cf4c8e13f347 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:58.360123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:58.360772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:58.361072 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c41816ee-616c-4975-8522-cf4c8e13f347 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1241 microversion: 2.1 time: 0.080507 Oct 28 10:30:58.361737 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3316/6634] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:58 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:58.363048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:58.365653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:58.368165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:58.368631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:58.415388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:30:58.426092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:30:58.518469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:30:58.520755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cc0d10b1-5a5f-4cec-9d92-d4cc20f309fd',volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:30:58.728463 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-952c2615-1469-43bd-a174-cbdee47fc34d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.053862 Oct 28 10:30:58.736512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3319/6635] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:30:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:30:58.742454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d3fee89a-664e-4726-bec5-1146590b8698 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:58.743167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3fee89a-664e-4726-bec5-1146590b8698 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:58.851381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d3fee89a-664e-4726-bec5-1146590b8698 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:58.861815 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d3fee89a-664e-4726-bec5-1146590b8698 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1056 microversion: 2.1 time: 0.123136 Oct 28 10:30:58.879061 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3317/6636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:58 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1056 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:59.297978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:59.301626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:59.327408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:59.329306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:59.330813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:59.331725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:59.333452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:59.333903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:59.398997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:59.400569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:59.421142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:59.424947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:59.427449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:59.430442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:59.431828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:59.433113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:59.507547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:59.518088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5bbe7d61-12a4-4144-a17d-cda3c76e31ef tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1297 microversion: 2.1 time: 0.228136 Oct 28 10:30:59.537702 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3320/6637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:59 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1297 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:59.566865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:30:59.580248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cad3945d-4081-4d0b-b199-0ddd2934de36 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1293 microversion: 2.1 time: 0.195481 Oct 28 10:30:59.601470 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3318/6638] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:59 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1293 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:30:59.887953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:30:59.889475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:30:59.904219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:59.904747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:59.905230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:30:59.909253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:30:59.910100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:30:59.910710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:00.023652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:00.033274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-41d43018-dc7a-4735-b62b-2d3037e378f9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1154 microversion: 2.1 time: 0.150101 Oct 28 10:31:00.034076 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3321/6639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:30:59 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1154 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:00.553253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:00.554053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:00.566630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:00.569091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:00.570050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:00.571110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:00.571731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:00.572375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:00.609309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:00.610177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:00.616956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:00.617733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:00.618376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:00.619293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:00.619950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:00.620576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:00.696578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:00.705733 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d498693-be3a-4b71-aef6-e1cc8af1d6d6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.100750 Oct 28 10:31:00.724488 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3322/6640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:00 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:31:01.058982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:01.059678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:01.071715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:01.072436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:01.073114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:01.074772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:01.076721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:01.078743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:01.180291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:01.189716 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-942b8d17-b5e6-4a26-9357-8a4dd4997208 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1172 microversion: 2.1 time: 0.134773 Oct 28 10:31:01.191024 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3323/6641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:01 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1172 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:01.195859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:01.212712 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53a9177f-4594-4fe0-9faa-e2171f620fc7 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.663046 Oct 28 10:31:01.213678 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3319/6642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:00 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:01.730049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:01.731035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:01.737397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:01.738216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:01.738929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:01.740491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:01.741213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:01.741869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:01.817490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:01.826234 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72f4e65d-54c1-4f29-bc83-3dd6a0bbb3bc tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.099410 Oct 28 10:31:01.828505 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3324/6643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:01 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:02.218626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:02.220264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:02.232629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:02.233541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:02.234557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:02.235608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:02.236131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:02.237330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:02.238381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:02.239737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:02.249315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:02.249825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:02.250279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:02.254111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:02.254648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:02.255111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:02.386098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:02.398483 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e33f4da4-8fcd-4047-b193-c860b23c28d7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1172 microversion: 2.1 time: 0.184846 Oct 28 10:31:02.399866 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3320/6644] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:02 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1172 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:02.614336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:02.639508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-513f3752-543e-45f6-894c-03a645ad377d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.407573 Oct 28 10:31:02.656945 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3325/6645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:02 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:02.849374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:02.854053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:02.863242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:02.863888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:02.864480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:02.865331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:02.866067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:02.866725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:03.335676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:03.376121 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4528693d-6b10-4340-86bf-8057c1f6086a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.529423 Oct 28 10:31:03.377148 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3321/6646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:02 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:03.426457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:03.427748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:03.437334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:03.438729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:03.439765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:03.441006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:03.442031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:03.442680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:03.541872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d941d3d5-9c93-4a39-965a-446d2ec53989 req-fab6f7eb-a027-4c58-87ae-36dfe99aaef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e205cb5d-394c-42cf-ab9a-ebec1a62fd03", "tag": "2a48c59f-b212-42e0-bae2-ef7ebae0d0df"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:03.576043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d941d3d5-9c93-4a39-965a-446d2ec53989 req-fab6f7eb-a027-4c58-87ae-36dfe99aaef5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:03.577192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d941d3d5-9c93-4a39-965a-446d2ec53989 req-fab6f7eb-a027-4c58-87ae-36dfe99aaef5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:03.577939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d941d3d5-9c93-4a39-965a-446d2ec53989 req-fab6f7eb-a027-4c58-87ae-36dfe99aaef5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:03.610334 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d941d3d5-9c93-4a39-965a-446d2ec53989 req-fab6f7eb-a027-4c58-87ae-36dfe99aaef5 service nova] Creating event network-changed:2a48c59f-b212-42e0-bae2-ef7ebae0d0df for instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 on n-h1-zed-1 Oct 28 10:31:03.618532 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d941d3d5-9c93-4a39-965a-446d2ec53989 req-fab6f7eb-a027-4c58-87ae-36dfe99aaef5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081144 Oct 28 10:31:03.623107 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3322/6647] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:31:03.639192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:03.648276 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cae487c-a070-4ecc-bb68-888966e45c73 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1214 microversion: 2.1 time: 0.225641 Oct 28 10:31:03.664053 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3326/6648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:03 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:03.880062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:03.881436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:03.891737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:03.892549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:03.893258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:03.894865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:03.895741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:03.896389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:04.356373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:04.366585 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1599ba9-eee5-45c5-9427-58ac2d12cf19 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.700566 Oct 28 10:31:04.368060 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3323/6649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:03 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:04.402165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:04.403069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:04.410007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:04.410827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:04.411445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:04.412354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:04.413031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:04.413634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:04.503566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:04.512528 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-84185786-fee1-4cc5-be02-b93004f672b8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.114208 Oct 28 10:31:04.515197 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3327/6650] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:04 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:04.676176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:04.676793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:04.686613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:04.688306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:04.689261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:04.690484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:04.691266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:04.691908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:05.065693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:05.080947 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-697e1529-f6ba-46fc-94cf-c46f6ca6f275 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1214 microversion: 2.1 time: 0.408496 Oct 28 10:31:05.084941 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3324/6651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:04 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1214 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:05.391287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:05.392204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:05.399865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:05.400402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:05.400862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:05.401673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:05.402289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:05.402643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:05.539489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:05.540549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:05.561210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:05.561817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:05.563852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:05.569707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:05.570906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:05.571597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:05.576988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:05.593157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7246f621-2f28-4531-9ee4-f1b67c2b0a7f tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.201709 Oct 28 10:31:05.613475 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3328/6652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:05 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:05.715572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-04dc19f8-f54b-4bcc-af33-267409d700ca req-2c19f400-e98a-4822-867e-4fbfa09c058d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3a7ef02-e6b4-47fe-bca8-98adf106edb2", "tag": "8dc40147-fe73-41c4-977e-680e4ac2f1ab"}, {"name": "network-changed", "server_uuid": "da2dfe04-5e38-4fc5-bee7-a524a05a59bc", "tag": "786c4e47-92af-43df-8297-ab0bf12d81b9"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:05.734062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-04dc19f8-f54b-4bcc-af33-267409d700ca req-2c19f400-e98a-4822-867e-4fbfa09c058d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:05.734962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-04dc19f8-f54b-4bcc-af33-267409d700ca req-2c19f400-e98a-4822-867e-4fbfa09c058d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:05.735648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-04dc19f8-f54b-4bcc-af33-267409d700ca req-2c19f400-e98a-4822-867e-4fbfa09c058d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:05.748535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:05.753594 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-04dc19f8-f54b-4bcc-af33-267409d700ca req-2c19f400-e98a-4822-867e-4fbfa09c058d service nova] Creating event network-changed:8dc40147-fe73-41c4-977e-680e4ac2f1ab for instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 on n-h1-zed-1 Oct 28 10:31:05.754646 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-04dc19f8-f54b-4bcc-af33-267409d700ca req-2c19f400-e98a-4822-867e-4fbfa09c058d service nova] Creating event network-changed:786c4e47-92af-43df-8297-ab0bf12d81b9 for instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc on n-h2-zed-1 Oct 28 10:31:05.763824 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-80330c3b-f2c9-4c4e-af52-10e4bbba84a7 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.222022 Oct 28 10:31:05.774327 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3325/6653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:05 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:05.775177 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-04dc19f8-f54b-4bcc-af33-267409d700ca req-2c19f400-e98a-4822-867e-4fbfa09c058d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.063827 Oct 28 10:31:05.777102 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3329/6654] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:06.106860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:06.108352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:06.118137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:06.118921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:06.119724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:06.120632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:06.121655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:06.122797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:06.623026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:06.623734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:06.631027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:06.631518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:06.632116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:06.633027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:06.633480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:06.634092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:06.776665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:06.786734 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-51683340-9017-4f45-99ad-d3ccd9419cb8 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.169604 Oct 28 10:31:06.787313 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3330/6655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:06 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:31:06.793018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:06.793811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:06.802258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:06.803100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:06.803709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:06.804405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:06.804860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:06.805353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:06.810371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:06.938047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:06.948105 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-984cb62b-682f-4c92-a03f-19130d3d9433 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.159604 Oct 28 10:31:06.964167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3331/6656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:06 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:06.964517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:06.974806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb381960-4c65-406d-82c1-fb2b0833c5f0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1214 microversion: 2.1 time: 0.871318 Oct 28 10:31:06.983652 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3326/6657] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:06 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1214 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:07.811307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:07.811929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:07.819134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:07.819617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:07.820054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:07.820940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:07.821570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:07.822004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:07.968016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:07.973902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:07.974611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:07.977867 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3747ba8d-677e-4a82-93d9-92ef787d42ca tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.170913 Oct 28 10:31:07.979054 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3332/6658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:07 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:07.982965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:07.988294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:07.988917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:07.989621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:07.990776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:07.991347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:07.992281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:08.000584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:08.001804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:08.008330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:08.009192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:08.010380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:08.011316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:08.011815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:08.012439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:08.111129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:08.120406 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62a96c75-689a-456e-9813-c6a15ba84c14 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.152899 Oct 28 10:31:08.121024 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3327/6659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:07 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:08.173122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:08.181435 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24be04e9-568c-44cc-9124-4ae4ccfe0859 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.185725 Oct 28 10:31:08.182094 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3333/6660] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:07 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:09.003604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:09.004446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:09.007575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:09.013971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:09.014585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:09.015097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:09.015870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:09.016429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:09.016942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:09.149877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:09.152147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:09.161004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:09.163121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:09.166766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:09.168182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:09.169595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:09.170421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:09.172892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:09.174485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:09.186490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:09.196779 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b022f37-f26f-4cc0-9c9f-299fd7d37519 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.197025 Oct 28 10:31:09.221189 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3328/6661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:08 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:09.228353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5f9203a3-3b89-4d97-a3c6-5781348285f6 req-1d793c3e-eba4-4902-9c0b-703f15795907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e205cb5d-394c-42cf-ab9a-ebec1a62fd03", "name": "network-vif-plugged", "status": "completed", "tag": "2a48c59f-b212-42e0-bae2-ef7ebae0d0df"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:09.244716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f9203a3-3b89-4d97-a3c6-5781348285f6 req-1d793c3e-eba4-4902-9c0b-703f15795907 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:09.245518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f9203a3-3b89-4d97-a3c6-5781348285f6 req-1d793c3e-eba4-4902-9c0b-703f15795907 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:09.246305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f9203a3-3b89-4d97-a3c6-5781348285f6 req-1d793c3e-eba4-4902-9c0b-703f15795907 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:09.251875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:09.263690 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5f9203a3-3b89-4d97-a3c6-5781348285f6 req-1d793c3e-eba4-4902-9c0b-703f15795907 service nova] Creating event network-vif-plugged:2a48c59f-b212-42e0-bae2-ef7ebae0d0df for instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 on n-h1-zed-1 Oct 28 10:31:09.271056 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5f9203a3-3b89-4d97-a3c6-5781348285f6 req-1d793c3e-eba4-4902-9c0b-703f15795907 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047913 Oct 28 10:31:09.271884 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3329/6662] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:09.278072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:09.279015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:09.287807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:09.288310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:09.288750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:09.289561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:09.289944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:09.290660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:09.296773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:09.305191 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-435384bf-714d-4fbb-a2c9-33737ae6f094 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.161156 Oct 28 10:31:09.305982 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3334/6663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:09 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:09.489417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:09.502856 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d6a8637-59d1-40cc-a2df-b05289410c29 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.229479 Oct 28 10:31:09.504016 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3330/6664] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:09 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:10.223657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:10.224276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:10.231241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:10.231729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:10.232173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:10.232868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:10.233351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:10.233785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:10.330485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:10.331092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:10.338201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:10.338703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:10.339139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:10.339843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:10.340307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:10.340736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:10.372731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:10.381234 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4fd3a0e-6ce5-49ee-a1f0-fce0fe82e981 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1362 microversion: 2.1 time: 0.161440 Oct 28 10:31:10.381951 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3335/6665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:10 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:10.422822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:10.431165 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ba29096e-d19e-497b-948e-213430b3c4c6 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.104545 Oct 28 10:31:10.438730 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3331/6666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:10 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:10.526619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:10.527232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:10.533239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:10.533719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:10.534152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:10.534834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:10.535287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:10.535714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:10.673534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:10.683386 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-924273fe-62ed-4b1a-9f0f-41c4feb8a19f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.160540 Oct 28 10:31:10.684000 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3336/6667] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:10 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:11.298484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ec759a72-ca1d-4c08-9708-49240826dfcd req-643d05b1-dbc6-465f-b08e-ee6744010ed0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a7ef02-e6b4-47fe-bca8-98adf106edb2", "name": "network-vif-plugged", "status": "completed", "tag": "8dc40147-fe73-41c4-977e-680e4ac2f1ab"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:11.308142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec759a72-ca1d-4c08-9708-49240826dfcd req-643d05b1-dbc6-465f-b08e-ee6744010ed0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.308628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec759a72-ca1d-4c08-9708-49240826dfcd req-643d05b1-dbc6-465f-b08e-ee6744010ed0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.309094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec759a72-ca1d-4c08-9708-49240826dfcd req-643d05b1-dbc6-465f-b08e-ee6744010ed0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.322267 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ec759a72-ca1d-4c08-9708-49240826dfcd req-643d05b1-dbc6-465f-b08e-ee6744010ed0 service nova] Creating event network-vif-plugged:8dc40147-fe73-41c4-977e-680e4ac2f1ab for instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 on n-h1-zed-1 Oct 28 10:31:11.327542 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ec759a72-ca1d-4c08-9708-49240826dfcd req-643d05b1-dbc6-465f-b08e-ee6744010ed0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032796 Oct 28 10:31:11.328316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3332/6668] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:11.405454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:11.406210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:11.414060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.414552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.414993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.415716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.416168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.416593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.456789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:11.457510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:11.472269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.472995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.473436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.474135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.474583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.475004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.565385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:11.573955 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ec31c11-18af-4f90-8b29-1e697c8c80ce tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1547 microversion: 2.1 time: 0.172806 Oct 28 10:31:11.574728 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3337/6669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:11 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:11.582589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:11.590978 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b2a3b447-fcac-4488-a657-6780db190bdd tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1299 microversion: 2.1 time: 0.139598 Oct 28 10:31:11.591830 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3333/6670] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:11 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1299 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:31:11.597319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:11.598032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:11.604717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.605451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.606075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.607137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.607603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.608040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.699292 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b6e6936d-9b82-4e33-b6fb-ebac5f66934d tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105833 Oct 28 10:31:11.699903 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3338/6671] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:31:11 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:11.707595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:11.708203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:11.714338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.714732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.715167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.715913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:11.716361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:11.716979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:11.855521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:11.864453 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dc5f39c5-7b78-4de9-8e3a-03146661f93d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.160678 Oct 28 10:31:11.865209 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3334/6672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:11 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:12.615642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:12.618135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:12.627382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:12.629162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:12.630041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:12.631443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:12.632118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:12.632755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:12.703547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-92025218-4177-448c-a91e-bd0a23906fc1 req-97e0fadc-f7fa-48fa-9e80-7e4e52094f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e205cb5d-394c-42cf-ab9a-ebec1a62fd03", "tag": "2a48c59f-b212-42e0-bae2-ef7ebae0d0df"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:12.714550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-92025218-4177-448c-a91e-bd0a23906fc1 req-97e0fadc-f7fa-48fa-9e80-7e4e52094f90 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:12.715029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-92025218-4177-448c-a91e-bd0a23906fc1 req-97e0fadc-f7fa-48fa-9e80-7e4e52094f90 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:12.715666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-92025218-4177-448c-a91e-bd0a23906fc1 req-97e0fadc-f7fa-48fa-9e80-7e4e52094f90 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:12.728227 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-92025218-4177-448c-a91e-bd0a23906fc1 req-97e0fadc-f7fa-48fa-9e80-7e4e52094f90 service nova] Creating event network-changed:2a48c59f-b212-42e0-bae2-ef7ebae0d0df for instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 on n-h1-zed-1 Oct 28 10:31:12.733734 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-92025218-4177-448c-a91e-bd0a23906fc1 req-97e0fadc-f7fa-48fa-9e80-7e4e52094f90 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034276 Oct 28 10:31:12.734570 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3335/6673] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:31:12.751446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:12.760123 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8575d86-9ae0-4bcc-afec-eaa31bd9c03a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1471 microversion: 2.1 time: 0.149532 Oct 28 10:31:12.760730 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3339/6674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:12 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1471 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:12.785032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:12.786088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:12.792610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:12.793236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:12.793778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:12.794950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:12.795634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:12.796304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:12.889123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:12.890034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:12.908618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:12.908618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:12.909124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:12.910046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:12.910665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:12.911252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:12.951084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:12.962476 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8efacb5-be13-4d36-b1cb-7191629ed1ff tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1471 microversion: 2.1 time: 0.181659 Oct 28 10:31:12.966679 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3336/6675] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:12 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1471 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:12.990633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:12.991174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:13.002772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.003269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.003718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:13.004440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.004920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.005367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:13.060979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:13.071813 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-03176e84-3aa6-47ee-8a9f-a588418f5c16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.187971 Oct 28 10:31:13.073338 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3340/6676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:12 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:31:13.201413 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ed4674ce-318c-477e-9a77-20a21641d3f3 tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1616 microversion: 2.1 time: 0.214514 Oct 28 10:31:13.202395 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3337/6677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:12 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1616 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:13.226904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:13.226904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:13.234329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.234940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.235621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:13.236445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.240586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.240586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:13.409438 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-653d921f-8819-4fb1-bb54-63663b328f5f tempest-TestSecurityGroupsBasicOps-1270849513 tempest-TestSecurityGroupsBasicOps-1270849513-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1907 microversion: 2.1 time: 0.188159 Oct 28 10:31:13.410234 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3341/6678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:13 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1907 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:13.830566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:13.831395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:13.839110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.839738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.840416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:13.841886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.842423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.842928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:13.872708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:31:13.960962 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-934a7f19-957f-45a3-9ff5-40fd4059d13a tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 204 len: 0 microversion: 2.1 time: 0.133901 Oct 28 10:31:13.961754 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3338/6679] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:31:13 2022] DELETE /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:31:13.974300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:13.975184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:13.982688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.983561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.984219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:13.985169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:13.985860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:13.986504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:14.076196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:14.085699 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c0afba42-c50d-4908-94ad-98a97dd75a2d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1477 microversion: 2.1 time: 0.118593 Oct 28 10:31:14.086732 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3342/6680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:13 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1477 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:14.097554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:14.098499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:14.104794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:14.105376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:14.105813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:14.106564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:14.107021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:14.107450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:14.240971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:14.250473 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14af2bee-8543-4378-bcd3-cdb541ab7a97 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.158075 Oct 28 10:31:14.251148 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3339/6681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:14 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:31:15.109952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:15.110745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:15.117755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:15.118256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:15.118700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:15.119435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:15.119895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:15.120359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:15.205776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:15.213791 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0652b8e5-ad33-450d-9a00-9ce97205a6eb tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1477 microversion: 2.1 time: 0.107741 Oct 28 10:31:15.214382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3343/6682] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:15 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1477 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:15.274225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:15.274871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:15.281843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:15.282967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:15.282967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:15.283596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:15.284017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:15.284451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:15.488428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:15.499993 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-117d70cd-23dd-4753-a7f1-a4973335fffc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.229473 Oct 28 10:31:15.513986 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3340/6683] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:15 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:15.911243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-974ec1ee-958d-431d-8973-4531a3305994 req-cbf377f3-b127-4c65-8a44-ef9c3fc20617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3a7ef02-e6b4-47fe-bca8-98adf106edb2", "name": "network-vif-deleted", "tag": "8dc40147-fe73-41c4-977e-680e4ac2f1ab"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:15.939204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-974ec1ee-958d-431d-8973-4531a3305994 req-cbf377f3-b127-4c65-8a44-ef9c3fc20617 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:15.940750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-974ec1ee-958d-431d-8973-4531a3305994 req-cbf377f3-b127-4c65-8a44-ef9c3fc20617 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:15.941394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-974ec1ee-958d-431d-8973-4531a3305994 req-cbf377f3-b127-4c65-8a44-ef9c3fc20617 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:15.956457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-974ec1ee-958d-431d-8973-4531a3305994 req-cbf377f3-b127-4c65-8a44-ef9c3fc20617 service nova] Creating event network-vif-deleted:8dc40147-fe73-41c4-977e-680e4ac2f1ab for instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 on n-h1-zed-1 Oct 28 10:31:15.970952 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-974ec1ee-958d-431d-8973-4531a3305994 req-cbf377f3-b127-4c65-8a44-ef9c3fc20617 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066348 Oct 28 10:31:15.974655 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3344/6684] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:16.237727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:16.238256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:16.244230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:16.244715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:16.245185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:16.245876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:16.246329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:16.246755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:16.277485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:16.278108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:16.278948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:16.279467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lazy-loading 'fault' on Instance uuid b3a7ef02-e6b4-47fe-bca8-98adf106edb2 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:31:16.323972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:16.332250 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af6825b6-6493-4fb5-88fc-9833d922a7b0 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 200 len: 1331 microversion: 2.1 time: 0.098457 Oct 28 10:31:16.332820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3341/6685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:16 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:16.525130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:16.525872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:16.533061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:16.533659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:16.534173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:16.535098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:16.535631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:16.536294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:16.677170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:16.686028 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-541d7ac0-7221-45c9-9b5c-28913d0d9313 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.165827 Oct 28 10:31:16.687021 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3345/6686] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:16 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:17.355582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:17.356200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: b3a7ef02-e6b4-47fe-bca8-98adf106edb2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:17.363662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:17.364158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:17.364603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:17.365327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:17.365787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:17.366217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:17.380134 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] HTTP exception thrown: Instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 could not be found. Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Request method failure captured: Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 HTTP/1.1 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW670zAiVDZOvs83GG3UHFTwuoqbywnus9fIFgoHrqDgCsqhX8PqxXVzhGp18eUd4BhybunjsawCm4fUd57pgUoJ4YKvuk-ygdnBT6mehgYXNznhaMq9TQvcpqzvoR-1I-DB8ccpHGkWnMZbiknk2MgG-vfhE0rPXpMGdDptDr8A0dmI Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 2807e06b2fea49d0b35bd4f227bb8b79 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-937552413 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2807e06b2fea49d0b35bd4f227bb8b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2807e06b2fea49d0b35bd4f227bb8b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2807e06b2fea49d0b35bd4f227bb8b79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2807e06b2fea49d0b35bd4f227bb8b79"}]}] Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestSecurityGroupsBasicOps-937552413 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 2807e06b2fea49d0b35bd4f227bb8b79 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-937552413 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestSecurityGroupsBasicOps-937552413-project Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f777312225d24ba7b8c686e49d0cd4f7 Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestSecurityGroupsBasicOps-937552413-project Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 could not be found. Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'b3a7ef02-e6b4-47fe-bca8-98adf106edb2'} Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 could not be found. Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 could not be found. Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:31:17.381782 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 could not be found. Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Returning 404 to user: Instance b3a7ef02-e6b4-47fe-bca8-98adf106edb2 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49c58a66-812a-4c57-9025-eb4e88a34dcf tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2" status: 404 len: 111 microversion: 2.1 time: 0.031477 Oct 28 10:31:17.389886 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3342/6687] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:17 2022] GET /compute/v2.1/servers/b3a7ef02-e6b4-47fe-bca8-98adf106edb2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:31:17.564594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f04d8cec-f6ff-43e6-8ef0-7eafa6ff076c req-ecbc2149-b809-4cb4-9ed9-27eaf7cdf70f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2dfe04-5e38-4fc5-bee7-a524a05a59bc", "name": "network-vif-plugged", "status": "completed", "tag": "786c4e47-92af-43df-8297-ab0bf12d81b9"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:17.582596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f04d8cec-f6ff-43e6-8ef0-7eafa6ff076c req-ecbc2149-b809-4cb4-9ed9-27eaf7cdf70f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:17.583521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f04d8cec-f6ff-43e6-8ef0-7eafa6ff076c req-ecbc2149-b809-4cb4-9ed9-27eaf7cdf70f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:17.584687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f04d8cec-f6ff-43e6-8ef0-7eafa6ff076c req-ecbc2149-b809-4cb4-9ed9-27eaf7cdf70f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:17.601912 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f04d8cec-f6ff-43e6-8ef0-7eafa6ff076c req-ecbc2149-b809-4cb4-9ed9-27eaf7cdf70f service nova] Creating event network-vif-plugged:786c4e47-92af-43df-8297-ab0bf12d81b9 for instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc on n-h2-zed-1 Oct 28 10:31:17.608857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f04d8cec-f6ff-43e6-8ef0-7eafa6ff076c req-ecbc2149-b809-4cb4-9ed9-27eaf7cdf70f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048405 Oct 28 10:31:17.610013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3346/6688] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:17.719347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:17.719798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:17.729385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:17.731221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:17.736808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:17.737312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:17.738057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:17.738513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:17.741492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:17.918143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:17.926297 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee13d045-b5b9-4f52-b2b6-f69e42b34516 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.220624 Oct 28 10:31:17.927262 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3343/6689] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:17 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:18.950911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:18.951510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:18.961309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:18.962285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:18.962982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:18.963902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:18.964573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:18.965257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:19.193777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:19.207222 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4bb476d8-8387-4372-99af-1ab0a1658a9b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1202 microversion: 2.1 time: 0.261484 Oct 28 10:31:19.209172 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3347/6690] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:18 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1202 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:20.232336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:20.234350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:20.241941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:20.242719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:20.243389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:20.244420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:20.244895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:20.245597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:20.417296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:20.435072 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8afda64e-8ddc-47d4-b606-e246b54e262a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1390 microversion: 2.1 time: 0.207198 Oct 28 10:31:20.451216 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3344/6691] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:20 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1390 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:20.460674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:20.462017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:20.471409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:20.471935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:20.472378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:20.473213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:20.473673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:20.474099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:20.715074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:20.723613 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4a7ec5a6-9793-4e04-9740-5f316519f9b1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1390 microversion: 2.1 time: 0.266783 Oct 28 10:31:20.724795 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3348/6692] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:20 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1390 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:20.749387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:20.750017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:20.755932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:20.756422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:20.756859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:20.757794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:20.758406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:20.759000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:21.282329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:21.292252 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dcaea22c-6ecb-4b80-8192-26a2fc76897f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1390 microversion: 2.1 time: 0.549335 Oct 28 10:31:21.293390 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3345/6693] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:20 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1390 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:21.316705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:21.317444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:21.326196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:21.326692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:21.327131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:21.327843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:21.328301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:21.328736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:21.351442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:21.359072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:31:21.476258 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9f89920e-c64e-4e2a-8238-658572a173ff tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 204 len: 0 microversion: 2.1 time: 0.163135 Oct 28 10:31:21.480713 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3349/6694] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:31:21 2022] DELETE /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:31:21.487883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:21.488671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:21.495361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:21.495841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:21.496491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:21.497864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:21.498503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:21.498928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:21.517303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:21.743678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:21.752447 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1dcb3a01-d1e8-46bb-ac44-bc0f537da8e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1396 microversion: 2.1 time: 0.268876 Oct 28 10:31:21.753293 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3346/6695] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:21 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1396 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:31:22.120477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:22.121084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:22.123454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:22.129056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-66759a8a-d374-4d3f-a277-918c0529ea39 req-fec2d6c2-0b8b-4468-b435-8f316f9cccfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20", "tag": "d8d60f50-d10c-487f-8f0f-040964827929"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:22.141004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:22.141767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:22.142064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66759a8a-d374-4d3f-a277-918c0529ea39 req-fec2d6c2-0b8b-4468-b435-8f316f9cccfd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:22.142397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:22.142936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66759a8a-d374-4d3f-a277-918c0529ea39 req-fec2d6c2-0b8b-4468-b435-8f316f9cccfd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:22.143121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:22.143590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:22.143850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-66759a8a-d374-4d3f-a277-918c0529ea39 req-fec2d6c2-0b8b-4468-b435-8f316f9cccfd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:22.144024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:22.162251 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-66759a8a-d374-4d3f-a277-918c0529ea39 req-fec2d6c2-0b8b-4468-b435-8f316f9cccfd service nova] Creating event network-changed:d8d60f50-d10c-487f-8f0f-040964827929 for instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 on n-h2-zed-1 Oct 28 10:31:22.168326 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-66759a8a-d374-4d3f-a277-918c0529ea39 req-fec2d6c2-0b8b-4468-b435-8f316f9cccfd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042595 Oct 28 10:31:22.169423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3347/6696] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:22.181552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:31:22.262440 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7d0309dd-d9b7-4e60-9d8e-faf0ffb76cb3 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 204 len: 0 microversion: 2.1 time: 0.145840 Oct 28 10:31:22.264283 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3350/6697] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:31:22 2022] DELETE /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:31:22.273640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:22.274336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:22.281310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:22.282072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:22.282668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:22.283975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:22.284435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:22.284853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:22.448156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:22.458708 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f656755e-4628-42c5-b9b6-eb93dd51b38e tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1768 microversion: 2.1 time: 0.190073 Oct 28 10:31:22.460300 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3348/6698] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:22 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1768 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:22.776559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:22.777939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:22.784578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:22.785110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:22.785775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:22.786488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:22.787028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:22.787516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:22.945115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:22.955153 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e900ee51-cfef-4230-a003-4e1acee653cc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1396 microversion: 2.1 time: 0.182894 Oct 28 10:31:22.955808 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3351/6699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:22 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1396 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:23.484451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:23.485088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:23.492644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:23.493232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:23.493737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:23.494502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:23.495025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:23.495522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:23.656539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:23.670329 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b4d4530-83a3-4dfa-8313-b0d0faa829f1 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1768 microversion: 2.1 time: 0.190428 Oct 28 10:31:23.670941 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3349/6700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:23 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1768 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:23.978711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:23.979584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:23.986537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:23.987090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:23.987645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:23.988454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:23.989052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:23.989620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:24.128396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:24.138460 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-688aed2d-eb27-4b8e-b30f-bb2011d521f1 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1396 microversion: 2.1 time: 0.162778 Oct 28 10:31:24.139674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3352/6701] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:23 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1396 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:24.701265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:24.702947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:24.713439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:24.714833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:24.716379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:24.718832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:24.720363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:24.721543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:24.842334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f777312225d24ba7b8c686e49d0cd4f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2807e06b2fea49d0b35bd4f227bb8b79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:24.854302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3e1afebc-e9c9-424e-81df-dccb7a9963f8 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 200 len: 1649 microversion: 2.1 time: 0.163869 Oct 28 10:31:24.855444 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3350/6702] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:24 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 1649 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:24.951154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1fa69f18-7f55-4a6f-bfda-5f3ce1430619 req-f91371c7-c5cb-4645-bc3c-56a4607f15ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20", "name": "network-vif-deleted", "tag": "d8d60f50-d10c-487f-8f0f-040964827929"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:24.992401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1fa69f18-7f55-4a6f-bfda-5f3ce1430619 req-f91371c7-c5cb-4645-bc3c-56a4607f15ba service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:24.994232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1fa69f18-7f55-4a6f-bfda-5f3ce1430619 req-f91371c7-c5cb-4645-bc3c-56a4607f15ba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:24.994872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1fa69f18-7f55-4a6f-bfda-5f3ce1430619 req-f91371c7-c5cb-4645-bc3c-56a4607f15ba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:25.014589 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1fa69f18-7f55-4a6f-bfda-5f3ce1430619 req-f91371c7-c5cb-4645-bc3c-56a4607f15ba service nova] Creating event network-vif-deleted:d8d60f50-d10c-487f-8f0f-040964827929 for instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 on n-h2-zed-1 Oct 28 10:31:25.021661 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1fa69f18-7f55-4a6f-bfda-5f3ce1430619 req-f91371c7-c5cb-4645-bc3c-56a4607f15ba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076859 Oct 28 10:31:25.027804 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3353/6703] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:25.167340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:25.168110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:25.183440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:25.184731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:25.186290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:25.189999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:25.190920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:25.191570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:25.235392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-addfed14-a9e3-4c68-bd89-5678cc634d08 req-794b5840-8783-4939-b655-fb68c5210adc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da2dfe04-5e38-4fc5-bee7-a524a05a59bc", "name": "network-vif-deleted", "tag": "786c4e47-92af-43df-8297-ab0bf12d81b9"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:25.261406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-addfed14-a9e3-4c68-bd89-5678cc634d08 req-794b5840-8783-4939-b655-fb68c5210adc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:25.261755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-addfed14-a9e3-4c68-bd89-5678cc634d08 req-794b5840-8783-4939-b655-fb68c5210adc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:25.264414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-addfed14-a9e3-4c68-bd89-5678cc634d08 req-794b5840-8783-4939-b655-fb68c5210adc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:25.329942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:25.338419 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b3fc4db-82b3-4cf8-a609-1e31dbac5eb2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1354 microversion: 2.1 time: 0.177950 Oct 28 10:31:25.340268 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3351/6704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:25 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1354 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:25.341421 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-addfed14-a9e3-4c68-bd89-5678cc634d08 req-794b5840-8783-4939-b655-fb68c5210adc service nova] Creating event network-vif-deleted:786c4e47-92af-43df-8297-ab0bf12d81b9 for instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc on n-h2-zed-1 Oct 28 10:31:25.347106 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-addfed14-a9e3-4c68-bd89-5678cc634d08 req-794b5840-8783-4939-b655-fb68c5210adc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123050 Oct 28 10:31:25.352065 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3354/6705] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:25.878772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:25.879438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] [instance: 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:25.886635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:25.887130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:25.887573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:25.888276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:25.888734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:25.889187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:25.905002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] HTTP exception thrown: Instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 could not be found. Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Request method failure captured: Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 HTTP/1.1 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW670zAiVDZOvs83GG3UHFTwuoqbywnus9fIFgoHrqDgCsqhX8PqxXVzhGp18eUd4BhybunjsawCm4fUd57pgUoJ4YKvuk-ygdnBT6mehgYXNznhaMq9TQvcpqzvoR-1I-DB8ccpHGkWnMZbiknk2MgG-vfhE0rPXpMGdDptDr8A0dmI Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 2807e06b2fea49d0b35bd4f227bb8b79 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-937552413 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2807e06b2fea49d0b35bd4f227bb8b79"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/2807e06b2fea49d0b35bd4f227bb8b79"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_2807e06b2fea49d0b35bd4f227bb8b79", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/2807e06b2fea49d0b35bd4f227bb8b79"}]}] Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestSecurityGroupsBasicOps-937552413 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 2807e06b2fea49d0b35bd4f227bb8b79 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-937552413 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestSecurityGroupsBasicOps-937552413-project Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: f777312225d24ba7b8c686e49d0cd4f7 Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestSecurityGroupsBasicOps-937552413-project Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 could not be found. Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20'} Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 could not be found. Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 could not be found. Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:31:25.906659 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 could not be found. Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Returning 404 to user: Instance 48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:31:25.911823 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97312897-a76e-433c-a4c3-a3e0b9a33d4d tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20" status: 404 len: 111 microversion: 2.1 time: 0.033235 Oct 28 10:31:25.912577 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3352/6706] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:25 2022] GET /compute/v2.1/servers/48b88e3c-0fe2-4552-b7e6-c1c6fe14ff20 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:31:26.367392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:26.368862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:26.376802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:26.377906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:26.378573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:26.379652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:26.380878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:26.381583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:26.456181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:26.464885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4afbdba8-8a41-4d2a-a200-a2eba812f16b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1187 microversion: 2.1 time: 0.103417 Oct 28 10:31:26.484046 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3355/6707] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:26 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1187 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:27.494032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:27.495297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:27.504101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:27.504804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:27.505425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:27.506355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:27.507121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:27.507736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:27.620632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:27.631390 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce1dd2c6-a4df-4730-9556-8dfabf73356b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1187 microversion: 2.1 time: 0.141323 Oct 28 10:31:27.638416 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3353/6708] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:27 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1187 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:28.662305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:28.662860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:28.670964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:28.671468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:28.671995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:28.672633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:28.673122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:28.673558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:28.774748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:28.788227 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ffc3d304-e801-4684-8238-b1c0bd6461ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1187 microversion: 2.1 time: 0.131181 Oct 28 10:31:28.788862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3356/6709] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:28 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1187 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:29.814879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:29.816155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:29.837248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:29.837932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:29.838389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:29.839203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:29.839671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:29.840105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:29.935837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:29.948207 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-914389fc-60a0-417c-8ec1-9663ccb06543 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 200 len: 1187 microversion: 2.1 time: 0.137139 Oct 28 10:31:29.948804 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3354/6710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:29 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 1187 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:30.178310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1ce7b02-5128-4713-890d-5c078d158863 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] Calling method '.version_select at 0x7fca32603ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:30.203253 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1ce7b02-5128-4713-890d-5c078d158863 tempest-TestSecurityGroupsBasicOps-937552413 tempest-TestSecurityGroupsBasicOps-937552413-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1110613118" status: 202 len: 0 microversion: 2.1 time: 0.028858 Oct 28 10:31:30.213079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3357/6711] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 10:31:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-1110613118 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:31:30.974099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:30.974839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: da2dfe04-5e38-4fc5-bee7-a524a05a59bc] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:30.982541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:30.983172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:30.983713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:30.984655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:30.985152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:30.985586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:31.001343 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc could not be found. Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc HTTP/1.1 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc could not be found. Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'da2dfe04-5e38-4fc5-bee7-a524a05a59bc'} Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc could not be found. Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc could not be found. Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:31:31.003249 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:31.008144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:31:31.008144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:31:31.008144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:31:31.008144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:31:31.008144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:31:31.008144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc could not be found. Oct 28 10:31:31.008144 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:31:31.009562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance da2dfe04-5e38-4fc5-bee7-a524a05a59bc could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:31:31.011220 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2014d97-cb68-4233-a391-473420c3926b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc" status: 404 len: 111 microversion: 2.1 time: 0.041165 Oct 28 10:31:31.012429 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3355/6712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:30 2022] GET /compute/v2.1/servers/da2dfe04-5e38-4fc5-bee7-a524a05a59bc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:31:48.526605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:48.528820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:48.533729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:48.534243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:48.542916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:48.543458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:48.543896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:48.544616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:48.545115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:48.545555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:48.572076 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55c73e72-c155-488a-967d-2c6831054ce3 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/ips" status: 200 len: 145 microversion: 2.1 time: 0.047834 Oct 28 10:31:48.579371 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3358/6713] 10.222.0.16 () {58 vars in 1248 bytes} [Fri Oct 28 10:31:48 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:49.954090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77e8233f-b876-458e-9bf2-eec127927051"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:49.956546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:49.960009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=25 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:49.960679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=44 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:31:49.969174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:49.969977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:49.970595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:49.971522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:49.972337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:49.973002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:50.272330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-701425f7-f839-4afc-8349-42025604a810 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322636 Oct 28 10:31:50.273038 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3356/6714] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:31:49 2022] POST /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:53.423242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1204514414", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "db83c43e-7e54-4f76-8453-b711b6947dd2", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:53.525704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:31:53.979876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:31:53.980315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:31:53.981013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:31:53.981619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:31:53.982076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:31:53.993315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:53.994005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:53.994565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:53.995449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:53.996021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:53.996778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:54.017886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:31:54.023950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:31:54.040053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:31:54.042155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='db83c43e-7e54-4f76-8453-b711b6947dd2',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:31:54.131422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-786e42a0-7547-463c-9441-f4b5365a7cb7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.712652 Oct 28 10:31:54.132442 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3359/6715] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:31:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:31:54.144648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15edb4f2-1476-48ff-86f7-7fc99ef52a15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:54.145379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15edb4f2-1476-48ff-86f7-7fc99ef52a15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:54.248757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15edb4f2-1476-48ff-86f7-7fc99ef52a15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:54.257400 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15edb4f2-1476-48ff-86f7-7fc99ef52a15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1057 microversion: 2.1 time: 0.117049 Oct 28 10:31:54.258302 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3357/6716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:54 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1057 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:55.281134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:55.281774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:55.302839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:55.303374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:55.303824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:55.304544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:55.305031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:55.305464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:55.383930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:55.396141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92d1ab5f-3108-4965-b22a-0604f4b0d2cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1117 microversion: 2.1 time: 0.120320 Oct 28 10:31:55.397552 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3360/6717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:55 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1117 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:56.420240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:56.421021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:56.450911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:56.451710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:56.452477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:56.453690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:56.454383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:56.455057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:56.788135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:56.798810 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34c644d2-4675-49b9-949a-5aa07889fa86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.382349 Oct 28 10:31:56.800010 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3358/6718] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:56 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:57.328056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-aad7e449-8283-496d-94cb-791160306865 req-29ad292c-04b2-4b5b-8538-004c0f69e969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f51e85a2-d9ec-4073-9af1-7bb80b6ea87c", "tag": "720ef5b3-a005-40db-ac04-1b23dae29cd4"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:31:57.338687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-aad7e449-8283-496d-94cb-791160306865 req-29ad292c-04b2-4b5b-8538-004c0f69e969 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:57.339169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-aad7e449-8283-496d-94cb-791160306865 req-29ad292c-04b2-4b5b-8538-004c0f69e969 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:57.339610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-aad7e449-8283-496d-94cb-791160306865 req-29ad292c-04b2-4b5b-8538-004c0f69e969 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:57.354426 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-aad7e449-8283-496d-94cb-791160306865 req-29ad292c-04b2-4b5b-8538-004c0f69e969 service nova] Creating event network-changed:720ef5b3-a005-40db-ac04-1b23dae29cd4 for instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c on n-h2-zed-1 Oct 28 10:31:57.360953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-aad7e449-8283-496d-94cb-791160306865 req-29ad292c-04b2-4b5b-8538-004c0f69e969 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.212720 Oct 28 10:31:57.361878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3361/6719] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:31:57.827954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:57.828581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:57.837746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:57.838239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:57.838677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:57.839383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:57.839840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:57.840812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:58.054902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:58.063480 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d4fbcda5-7ab2-4c1e-9e1d-f71b285e4e19 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.240209 Oct 28 10:31:58.064057 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3359/6720] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:57 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:31:59.088177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:31:59.088887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:31:59.096688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:59.097231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:59.097684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:59.098398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:31:59.098866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:31:59.099449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:31:59.247665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:31:59.255663 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc4c678f-00eb-4d05-9adc-f7a8c86b76fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.172648 Oct 28 10:31:59.256529 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3362/6721] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:31:59 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:00.281313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:00.282642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:00.291005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:00.292051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:00.293373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:00.294754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:00.295224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:00.295662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:00.477591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:00.485631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0836e309-30c7-4b09-a55b-2659439d1954 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.209962 Oct 28 10:32:00.486490 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3360/6722] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:00 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:01.514912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:01.517373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:01.524326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:01.525170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:01.526326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:01.527056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:01.528202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:01.528441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:01.699618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:01.709600 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-276a6a01-738c-4bc9-9f01-30b2f4cd954d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.200189 Oct 28 10:32:01.710192 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3363/6723] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:01 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:02.344127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:02.347321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:02.355342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:02.356182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:02.356961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:02.357892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:02.358583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:02.359233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:02.398438 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-90064333-5689-4586-870d-ef9ea0862b44 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059486 Oct 28 10:32:02.399547 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3361/6724] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:32:02 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:32:02.415501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:02.415983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:02.428316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:02.429262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:02.430266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:02.430498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:02.430847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:02.431280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:02.482021 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f2a45b3e-222d-4acc-bb10-7e2430aeeabe tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/77e8233f-b876-458e-9bf2-eec127927051" status: 200 len: 194 microversion: 2.1 time: 0.071026 Oct 28 10:32:02.482757 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3364/6725] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Oct 28 10:32:02 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/77e8233f-b876-458e-9bf2-eec127927051 => generated 194 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:32:02.751803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:02.752417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:02.758725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:02.759401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:02.760485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:02.761565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:02.762245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:02.763281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:02.995765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:03.004717 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38df2b88-f2a7-4b5f-8492-ed7dabaa0452 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.256609 Oct 28 10:32:03.005587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3362/6726] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:02 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:04.035963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:04.037345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:04.044780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:04.046164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:04.047961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:04.048813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:04.050026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:04.050158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:04.050569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:04.051048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:04.208005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:04.217374 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-470d9e81-baed-4d06-ada2-d35570fd20f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.185952 Oct 28 10:32:04.218479 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3365/6727] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:04 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:05.062356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "549fa675-18d6-4126-afd9-35e91ca30997"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:32:05.065231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:05.072892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:05.075860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:05.076502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:05.077425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:05.078501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:05.079201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:05.080307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:05.241837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:05.243084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:05.251155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:05.252037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:05.252754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:05.253915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:05.254641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:05.255451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:05.402555 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46455691-7345-42d2-9285-2722b2a7fdc0 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "POST /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345356 Oct 28 10:32:05.403185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3363/6728] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:32:05 2022] POST /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:32:05.460931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:05.474100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-be98b4f2-45ee-45b3-8b79-c6ec3378f7da tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.236129 Oct 28 10:32:05.475257 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3366/6729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:05 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:32:06.500185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:06.502100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:06.511169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:06.512419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:06.512881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:06.513625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:06.514086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:06.514516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:06.695830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:06.705381 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0595a06-3b85-4ffc-a9da-561522f23ceb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.210222 Oct 28 10:32:06.718602 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3364/6730] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:06 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:07.730169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:07.731511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:07.738907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:07.739543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:07.740159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:07.740836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:07.741348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:07.741790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:07.901634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:07.910053 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8bb9d36b-4d4a-4048-8006-ec241b198730 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.184837 Oct 28 10:32:07.914773 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3367/6731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:07 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:08.933849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:08.934417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:08.941200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:08.941687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:08.942150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:08.942830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:08.943275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:08.943696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:09.072156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:09.080447 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01895950-c77d-4ef9-936e-52866c890ffe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.150515 Oct 28 10:32:09.081033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3365/6732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:08 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:10.104069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:10.104843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:10.112623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:10.113167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:10.113614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:10.114325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:10.114788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:10.115219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:10.249662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:10.257565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ee43c1c-2cf3-4772-85b6-07965e6a3122 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.157454 Oct 28 10:32:10.258145 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3368/6733] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:10 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:11.281631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:11.282176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:11.289360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:11.289848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:11.290293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:11.290990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:11.291448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:11.291876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:11.423362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:11.431442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84cf1548-a3b7-4ecf-a608-a6cf25f4861c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.154485 Oct 28 10:32:11.432020 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3366/6734] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:11 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:12.455093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:12.455704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:12.463088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:12.463519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:12.464079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:12.464729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:12.465889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:12.466364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:12.607946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:12.616067 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e750ec3-8c87-4009-8a29-c79e1a2a3167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.164930 Oct 28 10:32:12.616957 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3369/6735] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:12 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:32:13.639369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:13.639887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:13.646914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:13.647402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:13.647841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:13.648535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:13.649013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:13.649440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:13.781573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:13.789463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-662c4a21-5fba-48d7-b22b-450e8dc0e3df tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.154167 Oct 28 10:32:13.790038 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3367/6736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:13 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:14.814155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:14.815417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:14.823434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:14.823928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:14.824370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:14.825139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:14.825602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:14.826036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:14.967702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:14.975443 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-37c6002f-e798-4e8c-b08f-6b47d66d557e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.166305 Oct 28 10:32:14.976019 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3370/6737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:14 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:15.999361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:15.999897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:16.006904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:16.007390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:16.007833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:16.008533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:16.009021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:16.009455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:16.139961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:16.147710 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f785290f-18e1-4ae8-8b5c-37245238b7c0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.152865 Oct 28 10:32:16.148493 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3368/6738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:15 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:17.171647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:17.172248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:17.179268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:17.179761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:17.180204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:17.180929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:17.181401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:17.181835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:17.319948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:17.328561 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95aa41e5-73cc-4acd-be28-f38e2376148e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1169 microversion: 2.1 time: 0.160857 Oct 28 10:32:17.329180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3371/6739] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:17 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1169 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:18.351648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:18.352316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:18.360448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:18.360983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:18.361425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:18.362120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:18.362574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:18.362998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:18.503778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:18.511532 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e57df4f8-08d0-4464-af21-faaf0901d7cf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1215 microversion: 2.1 time: 0.163822 Oct 28 10:32:18.512610 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3369/6740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:18 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:19.535635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:19.536457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:19.539901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:19.546609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:19.547116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:19.547563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:19.548281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:19.548745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:19.549202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:19.552896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=75 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:19.691788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:19.700053 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d4499d36-90f9-401a-80c1-9292dcf133d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.168806 Oct 28 10:32:19.700695 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3372/6741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:19 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:20.725611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:20.726794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:20.731966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=31 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:20.736295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:20.736797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:20.737268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:20.737984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:20.738443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:20.738897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:20.741956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:20.795279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:20.798474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:20.807727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:20.808529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:20.809791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:20.811006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:20.811647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:20.812261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:20.856049 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9f29160b-d83b-4dc3-acaf-49b2c182f703 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064571 Oct 28 10:32:20.856712 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3373/6742] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:32:20 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments => generated 371 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:32:20.916634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:20.926126 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9c920123-c444-453b-b96e-980583a16a5b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.204719 Oct 28 10:32:20.926970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3370/6743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:20 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:21.000512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:21.001113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:21.007778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:21.008395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:21.008940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:21.009729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:21.010263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:21.010760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:21.049457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-011b3e6e-4229-45a0-9a37-893092566a88 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/77e8233f-b876-458e-9bf2-eec127927051" status: 200 len: 194 microversion: 2.1 time: 0.053730 Oct 28 10:32:21.050161 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3374/6744] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Oct 28 10:32:20 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/77e8233f-b876-458e-9bf2-eec127927051 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:32:21.061540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:21.062043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:21.068278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:21.068782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:21.069329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:21.070356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:21.070747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:21.071179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:21.175371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lazy-loading 'services' on Instance uuid e205cb5d-394c-42cf-ab9a-ebec1a62fd03 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:32:21.255526 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a667d9d-2293-4e12-8866-06e2a7553ed1 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/77e8233f-b876-458e-9bf2-eec127927051" status: 202 len: 0 microversion: 2.1 time: 0.198812 Oct 28 10:32:21.256381 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3371/6745] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:32:21 2022] DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/77e8233f-b876-458e-9bf2-eec127927051 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:32:21.950755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:21.952126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:21.967515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:21.968018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:21.968467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:21.969202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:21.969980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:21.970582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:22.127468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:22.137935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c640a1c1-e703-472e-a0f5-9d4c20b48c8a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.191305 Oct 28 10:32:22.148992 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3375/6746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:21 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:23.163311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:23.165707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:23.173297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:23.173849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:23.174326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:23.175209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:23.175670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:23.176100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:23.774797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:23.783999 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6e9b1a49-4175-41bb-96e3-117aceffe635 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.624992 Oct 28 10:32:23.800527 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3372/6747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:23 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:24.807555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:24.808067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:24.814586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:24.815077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:24.815520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:24.816219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:24.816675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:24.817135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:24.958001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:24.966186 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3823d89e-dfc6-4dd1-8648-a2314d1a18ef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.162685 Oct 28 10:32:24.966770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3376/6748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:24 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:25.989422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:25.990230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:25.997371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:25.997948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:25.998611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:25.999423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:25.999954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:26.000448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:26.140623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:26.149557 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd7e08b2-fbe2-4421-81ec-1ce6c72d2fc9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.164125 Oct 28 10:32:26.150251 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3373/6749] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:25 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:26.705113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:26.705650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:26.712373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:26.712861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:26.713336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:26.714029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:26.714486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:26.714911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:26.743905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-096f241d-bb2f-4fe3-9ad0-d2919f1c2a99 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/549fa675-18d6-4126-afd9-35e91ca30997" status: 200 len: 194 microversion: 2.1 time: 0.042785 Oct 28 10:32:26.744505 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3377/6750] 10.222.0.16 () {58 vars in 1413 bytes} [Fri Oct 28 10:32:26 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/549fa675-18d6-4126-afd9-35e91ca30997 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:32:26.755875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:26.756376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:26.762443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:26.762938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:26.763401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:26.764084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:26.764560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:26.764973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:26.846139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lazy-loading 'services' on Instance uuid e205cb5d-394c-42cf-ab9a-ebec1a62fd03 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:32:26.919613 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb48d0dc-51f9-452e-bbac-4db61002c9f5 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/549fa675-18d6-4126-afd9-35e91ca30997" status: 202 len: 0 microversion: 2.1 time: 0.167547 Oct 28 10:32:26.920214 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3374/6751] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:32:26 2022] DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments/549fa675-18d6-4126-afd9-35e91ca30997 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:32:27.174157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:27.174760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:27.180699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:27.181295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:27.181734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:27.182415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:27.182867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:27.183291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:27.317019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:27.325271 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1101f5ab-66f5-4cf4-bbb9-01659f45d8ab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.155047 Oct 28 10:32:27.325850 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3378/6752] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:27 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:28.349598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:28.350942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:28.359304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:28.359791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:28.360407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:28.361334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:28.361793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:28.362395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:28.497966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:28.505760 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e4cc30c-aba7-4580-b34b-b397a23fe8bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.160433 Oct 28 10:32:28.506340 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3375/6753] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:28 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:29.529675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:29.530351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:29.538006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:29.538504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:29.538947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:29.539648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:29.540109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:29.540539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:29.670776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:29.679299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92e13148-a5c6-4727-9978-a559e3f75d6a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.153613 Oct 28 10:32:29.679885 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3379/6754] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:29 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:29.925707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-84076d34-a9a3-4ab4-9e2e-31dd42a89a57 req-61234b0e-db3f-4cc0-a09e-8270b1d983c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51e85a2-d9ec-4073-9af1-7bb80b6ea87c", "name": "network-vif-plugged", "status": "completed", "tag": "720ef5b3-a005-40db-ac04-1b23dae29cd4"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:32:29.936078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-84076d34-a9a3-4ab4-9e2e-31dd42a89a57 req-61234b0e-db3f-4cc0-a09e-8270b1d983c9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:29.936639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-84076d34-a9a3-4ab4-9e2e-31dd42a89a57 req-61234b0e-db3f-4cc0-a09e-8270b1d983c9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:29.937174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-84076d34-a9a3-4ab4-9e2e-31dd42a89a57 req-61234b0e-db3f-4cc0-a09e-8270b1d983c9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:29.948403 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-84076d34-a9a3-4ab4-9e2e-31dd42a89a57 req-61234b0e-db3f-4cc0-a09e-8270b1d983c9 service nova] Creating event network-vif-plugged:720ef5b3-a005-40db-ac04-1b23dae29cd4 for instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c on n-h2-zed-1 Oct 28 10:32:29.953349 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-84076d34-a9a3-4ab4-9e2e-31dd42a89a57 req-61234b0e-db3f-4cc0-a09e-8270b1d983c9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105521 Oct 28 10:32:29.954033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3376/6755] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:32:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:32:30.704237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:30.704868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:30.711589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:30.712079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:30.712517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:30.713251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:30.713750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:30.714501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:30.849775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:30.857711 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-04297af3-8e3e-498d-abaf-8711bf9359ed tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1203 microversion: 2.1 time: 0.157433 Oct 28 10:32:30.858298 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3380/6756] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:30 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:31.882947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:31.883682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:31.890127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:31.890640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:31.891074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:31.891774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:31.892230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:31.892651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.027138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:32.035659 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c8d24fb-ca1d-4ef0-8f65-46b5c4805949 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1391 microversion: 2.1 time: 0.157842 Oct 28 10:32:32.036227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3377/6757] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:31 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:32.058983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:32.059712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:32.066758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.067320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.067830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.068592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.069156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.070021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.199928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:32.207762 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-14911795-4633-4169-8431-f00ba4ba3bef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1391 microversion: 2.1 time: 0.152668 Oct 28 10:32:32.208341 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3381/6758] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:32 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:32.230050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:32.230669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:32.236865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.237497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.237937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.238633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.239088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.239516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.371923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:32.379752 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6dba863f-0be5-4756-beb9-76e82b174b49 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1391 microversion: 2.1 time: 0.153512 Oct 28 10:32:32.380320 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3378/6759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:32 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:32.472394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:32.473060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:32.479487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.480059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.480546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.481287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.481752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.482189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.507970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:32:32.587533 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-644828dd-d66f-4b65-acfe-97677e288252 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 204 len: 0 microversion: 2.1 time: 0.120202 Oct 28 10:32:32.588498 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3382/6760] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:32:32 2022] DELETE /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:32:32.596605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:32.597277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:32.606501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.607007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.607475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.609897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:32.610459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:32.610877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:32.754714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:32.763560 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aa31e130-5c0d-44e6-8d90-761eef00bbf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1397 microversion: 2.1 time: 0.171006 Oct 28 10:32:32.764135 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3379/6761] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:32 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1397 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:33.413917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:33.416400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:33.424878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.425468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.425915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.426629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.427089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.427524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.459268 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3dc2b70-69c9-4c29-98fd-16987d2b7dad tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049668 Oct 28 10:32:33.459866 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3383/6762] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:32:33 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:32:33.577376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:33.579621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:33.586809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.587307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.587747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.588670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.589163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.589596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.620477 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d88739a9-e250-4658-a232-d03474b18b72 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047908 Oct 28 10:32:33.621295 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3380/6763] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:32:33 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:32:33.692217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:33.692813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:33.699787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.700339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.700839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.701613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.702138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.702649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.732109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:32:33.787867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:33.788655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:33.794924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.795524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.796079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.796963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.797448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.798114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.815763 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-568efaa8-46f6-4171-8fea-cf1f89101238 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 204 len: 0 microversion: 2.1 time: 0.127018 Oct 28 10:32:33.817072 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3384/6764] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:32:33 2022] DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:32:33.827847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:33.828647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:33.835629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.836219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.836826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.837563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:33.838196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:33.838634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:33.857590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:33.968324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:33.976763 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-da713d61-6046-4d1b-8ad4-27df3f8fe3e2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1397 microversion: 2.1 time: 0.193708 Oct 28 10:32:33.978104 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3381/6765] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:33 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1397 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:32:33.997544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:34.005299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f977bf63-faa2-4227-ad97-87905330808b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1672 microversion: 2.1 time: 0.183168 Oct 28 10:32:34.005877 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3385/6766] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:33 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1672 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:34.908088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fada71c4-fde9-414d-a28d-3418be57b77b req-e99dac66-a4c3-4200-bcee-711d0c8c0160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f51e85a2-d9ec-4073-9af1-7bb80b6ea87c", "name": "network-vif-deleted", "tag": "720ef5b3-a005-40db-ac04-1b23dae29cd4"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:32:34.922706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fada71c4-fde9-414d-a28d-3418be57b77b req-e99dac66-a4c3-4200-bcee-711d0c8c0160 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:34.923190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fada71c4-fde9-414d-a28d-3418be57b77b req-e99dac66-a4c3-4200-bcee-711d0c8c0160 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:34.923621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fada71c4-fde9-414d-a28d-3418be57b77b req-e99dac66-a4c3-4200-bcee-711d0c8c0160 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:34.936033 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fada71c4-fde9-414d-a28d-3418be57b77b req-e99dac66-a4c3-4200-bcee-711d0c8c0160 service nova] Creating event network-vif-deleted:720ef5b3-a005-40db-ac04-1b23dae29cd4 for instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c on n-h2-zed-1 Oct 28 10:32:34.941548 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fada71c4-fde9-414d-a28d-3418be57b77b req-e99dac66-a4c3-4200-bcee-711d0c8c0160 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037105 Oct 28 10:32:34.942169 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3382/6767] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:32:35.000146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:35.000992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:35.008652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:35.009167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:35.009609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:35.010307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:35.010788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:35.011213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:35.030842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:35.031547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:35.038502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:35.039187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:35.039690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:35.040321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:35.041003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:35.041622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:35.084260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:35.094672 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7c75d70f-0531-45b9-81a1-43579e224e91 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1188 microversion: 2.1 time: 0.098426 Oct 28 10:32:35.095297 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3386/6768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:34 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:35.191552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:35.200285 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0722f6bf-21a3-4b17-a46d-41a86ca24b64 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1672 microversion: 2.1 time: 0.174565 Oct 28 10:32:35.205762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3383/6769] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:35 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:36.129532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:36.142351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:36.162028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:36.162858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:36.163460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:36.164361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:36.165000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:36.165585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:36.224534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:36.225785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:36.233036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:36.234654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:36.235530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:36.236440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:36.237173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:36.237830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:36.265398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:36.274543 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ff29023-8082-41c1-8076-3cfdf242d811 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1188 microversion: 2.1 time: 0.159492 Oct 28 10:32:36.289369 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3387/6770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:36 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1188 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:36.376311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3a28b4dcd9f4cdfb724f5b29ce26b16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1abb2b7300b44b4af7b177c76b74216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:36.389117 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d5371da0-c195-4df4-97e1-89e35aa73632 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 200 len: 1605 microversion: 2.1 time: 0.168984 Oct 28 10:32:36.390336 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3384/6771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:36 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 1605 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:36.955669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-30a73391-48fe-443b-8f08-b17c6fd00586 req-781fc804-7181-43e2-b656-be5c6219403a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e205cb5d-394c-42cf-ab9a-ebec1a62fd03", "name": "network-vif-deleted", "tag": "2a48c59f-b212-42e0-bae2-ef7ebae0d0df"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:32:36.965790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-30a73391-48fe-443b-8f08-b17c6fd00586 req-781fc804-7181-43e2-b656-be5c6219403a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:36.966490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-30a73391-48fe-443b-8f08-b17c6fd00586 req-781fc804-7181-43e2-b656-be5c6219403a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:36.967090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-30a73391-48fe-443b-8f08-b17c6fd00586 req-781fc804-7181-43e2-b656-be5c6219403a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:36.978408 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-30a73391-48fe-443b-8f08-b17c6fd00586 req-781fc804-7181-43e2-b656-be5c6219403a service nova] Creating event network-vif-deleted:2a48c59f-b212-42e0-bae2-ef7ebae0d0df for instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 on n-h1-zed-1 Oct 28 10:32:36.984136 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-30a73391-48fe-443b-8f08-b17c6fd00586 req-781fc804-7181-43e2-b656-be5c6219403a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032100 Oct 28 10:32:36.985301 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3388/6772] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:32:37.301129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:37.302414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:37.316210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:37.317287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:37.318440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:37.319417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:37.320427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:37.321200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:37.405210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:37.414781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:37.416674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:37.422598 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c62f439-9176-4bd6-b7a2-71862f7ab819 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1188 microversion: 2.1 time: 0.126578 Oct 28 10:32:37.424647 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3385/6773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:37 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1188 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:37.429725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:37.430422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:37.431176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:37.432102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:37.432725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:37.433383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:37.455954 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] HTTP exception thrown: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Request method failure captured: Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 HTTP/1.1 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW647805cRrxMd9qedfzj9YFEhZMGrGUxITGSAA8uOYlHLH7k-RgPuHnp_S0CHpbWEmTnBW342BASFeturT8NcM_-rfJDcP6mIsxqdxr9MC3anY7_faNyOa0jegAn9AmUiWQ1gl5tcOSC67hnEd6TgRLJKULBXylxsK21xiAklRMWYzc Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1abb2b7300b44b4af7b177c76b74216", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1abb2b7300b44b4af7b177c76b74216"}]}] Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: c3a28b4dcd9f4cdfb724f5b29ce26b16 Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e205cb5d-394c-42cf-ab9a-ebec1a62fd03'} Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:37.458414 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:37.463409 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:37.463409 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:37.463409 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:37.463409 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:37.463409 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:37.463409 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:37.463409 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:37.473762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Returning 404 to user: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:37.474694 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a33e93c2-2f8c-44c0-aa58-32f0f3a047ba tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 404 len: 111 microversion: 2.1 time: 0.064561 Oct 28 10:32:37.475632 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3389/6774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:37 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:32:37.483988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b7b460d-7c0d-4b8d-a618-6bfd0ae364df tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '.version_select at 0x7fca321abd30>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:37.506177 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b7b460d-7c0d-4b8d-a618-6bfd0ae364df tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437925132" status: 202 len: 0 microversion: 2.1 time: 0.026076 Oct 28 10:32:37.508153 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3386/6775] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1437925132 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:32:38.447960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:38.448635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:38.456932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:38.457441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:38.457888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:38.458590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:38.459047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:38.459476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:38.522509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:38.530726 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-996b3c70-0deb-4806-a9f0-333891861188 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1188 microversion: 2.1 time: 0.087003 Oct 28 10:32:38.531299 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3390/6776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:38 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:39.555229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:39.556212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:39.563887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:39.564390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:39.564831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:39.565568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:39.566063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:39.566648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:39.656651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:32:39.659051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:32:39.666615 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4cda168-6a13-4756-b52e-3450724703e6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 200 len: 1188 microversion: 2.1 time: 0.116338 Oct 28 10:32:39.667197 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3387/6777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:39 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 1188 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:32:40.690133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:40.691444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:40.700694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:40.701508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:40.702893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:40.703870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:40.704706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:40.705404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:40.727078 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c HTTP/1.1 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f51e85a2-d9ec-4073-9af1-7bb80b6ea87c'} Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:40.731722 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:40.736196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:40.736196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:40.736196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:40.736196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:40.736196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:40.736196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:40.736196 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:40.738764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:40.740100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b1bb97e-9268-4442-8078-59bc17445885 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 404 len: 111 microversion: 2.1 time: 0.054188 Oct 28 10:32:40.741293 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3391/6778] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:40 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:32:44.051419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:44.052561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:44.062433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:44.063183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:44.063792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:44.064700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:44.065359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:44.065951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:44.081716 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c HTTP/1.1 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'f51e85a2-d9ec-4073-9af1-7bb80b6ea87c'} Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:44.083376 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.087559 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.089475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:44.090581 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a3dae9d3-9a69-473b-94b0-eb4a01209ec4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 404 len: 111 microversion: 2.1 time: 0.043060 Oct 28 10:32:44.094652 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3388/6779] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:32:44 2022] DELETE /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:32:44.099523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:44.100712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: f51e85a2-d9ec-4073-9af1-7bb80b6ea87c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:44.108801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:44.109531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:44.110185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:44.111124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:44.111820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:44.112469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:44.127731 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c HTTP/1.1 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'f51e85a2-d9ec-4073-9af1-7bb80b6ea87c'} Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:44.129583 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.133617 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:44.133617 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:44.133617 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:44.133617 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:44.133617 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:44.133617 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. Oct 28 10:32:44.133617 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:44.135347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance f51e85a2-d9ec-4073-9af1-7bb80b6ea87c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:44.136463 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-921e012d-b6e9-42fd-81f9-3d56b493172f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c" status: 404 len: 111 microversion: 2.1 time: 0.040675 Oct 28 10:32:44.137734 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3392/6780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:44 2022] GET /compute/v2.1/servers/f51e85a2-d9ec-4073-9af1-7bb80b6ea87c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:32:45.915080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:45.915828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:45.922974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:45.923462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:45.923895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:45.924611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:45.925082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:45.925506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:45.942139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] HTTP exception thrown: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Request method failure captured: Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 HTTP/1.1 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW647805cRrxMd9qedfzj9YFEhZMGrGUxITGSAA8uOYlHLH7k-RgPuHnp_S0CHpbWEmTnBW342BASFeturT8NcM_-rfJDcP6mIsxqdxr9MC3anY7_faNyOa0jegAn9AmUiWQ1gl5tcOSC67hnEd6TgRLJKULBXylxsK21xiAklRMWYzc Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1abb2b7300b44b4af7b177c76b74216", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1abb2b7300b44b4af7b177c76b74216"}]}] Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c3a28b4dcd9f4cdfb724f5b29ce26b16 Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'e205cb5d-394c-42cf-ab9a-ebec1a62fd03'} Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:45.943690 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.948710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Returning 404 to user: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:45.957344 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5786c7b-39d8-466b-96dd-6f739d5b966b tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 404 len: 111 microversion: 2.1 time: 0.034691 Oct 28 10:32:45.957981 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3389/6781] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:32:45 2022] DELETE /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:32:45.966532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:45.967350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: e205cb5d-394c-42cf-ab9a-ebec1a62fd03] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:45.976013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:45.976519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:45.976998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:45.977873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:45.978336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:45.978778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:45.992761 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] HTTP exception thrown: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Request method failure captured: Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 HTTP/1.1 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW647805cRrxMd9qedfzj9YFEhZMGrGUxITGSAA8uOYlHLH7k-RgPuHnp_S0CHpbWEmTnBW342BASFeturT8NcM_-rfJDcP6mIsxqdxr9MC3anY7_faNyOa0jegAn9AmUiWQ1gl5tcOSC67hnEd6TgRLJKULBXylxsK21xiAklRMWYzc Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1abb2b7300b44b4af7b177c76b74216", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1abb2b7300b44b4af7b177c76b74216"}]}] Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: c3a28b4dcd9f4cdfb724f5b29ce26b16 Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'e205cb5d-394c-42cf-ab9a-ebec1a62fd03'} Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:45.994406 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Returning 404 to user: Instance e205cb5d-394c-42cf-ab9a-ebec1a62fd03 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:45.999094 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-26e95f0c-01a6-4406-b874-f8f6c8a8c10e tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03" status: 404 len: 111 microversion: 2.1 time: 0.033277 Oct 28 10:32:45.999684 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3393/6782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:45 2022] GET /compute/v2.1/servers/e205cb5d-394c-42cf-ab9a-ebec1a62fd03 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:32:49.295785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:49.296982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:49.305990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:49.306929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:49.307807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:49.309582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:49.310207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:49.310804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:49.326716 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] HTTP exception thrown: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Request method failure captured: Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b HTTP/1.1 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW647805cRrxMd9qedfzj9YFEhZMGrGUxITGSAA8uOYlHLH7k-RgPuHnp_S0CHpbWEmTnBW342BASFeturT8NcM_-rfJDcP6mIsxqdxr9MC3anY7_faNyOa0jegAn9AmUiWQ1gl5tcOSC67hnEd6TgRLJKULBXylxsK21xiAklRMWYzc Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1abb2b7300b44b4af7b177c76b74216", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1abb2b7300b44b4af7b177c76b74216"}]}] Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c3a28b4dcd9f4cdfb724f5b29ce26b16 Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'bf469daa-59f1-4892-bd8c-76e8f947722b'} Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:49.329148 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.334081 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.336428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Returning 404 to user: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:49.337693 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a0567b3-2267-4ede-9c3e-ce7175e2d397 tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "DELETE /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 404 len: 111 microversion: 2.1 time: 0.046467 Oct 28 10:32:49.339204 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3390/6783] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:32:49 2022] DELETE /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:32:49.347101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:32:49.347839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] [instance: bf469daa-59f1-4892-bd8c-76e8f947722b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:32:49.355675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:49.356465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:49.357155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:49.358088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:32:49.358755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:32:49.359393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:32:49.378065 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] HTTP exception thrown: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Request method failure captured: Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b HTTP/1.1 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW647805cRrxMd9qedfzj9YFEhZMGrGUxITGSAA8uOYlHLH7k-RgPuHnp_S0CHpbWEmTnBW342BASFeturT8NcM_-rfJDcP6mIsxqdxr9MC3anY7_faNyOa0jegAn9AmUiWQ1gl5tcOSC67hnEd6TgRLJKULBXylxsK21xiAklRMWYzc Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d1abb2b7300b44b4af7b177c76b74216"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d1abb2b7300b44b4af7b177c76b74216", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d1abb2b7300b44b4af7b177c76b74216"}]}] Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: d1abb2b7300b44b4af7b177c76b74216 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1842370642 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: c3a28b4dcd9f4cdfb724f5b29ce26b16 Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-AttachVolumeTestJSON-1842370642-project Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'bf469daa-59f1-4892-bd8c-76e8f947722b'} Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:32:49.379713 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.383858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:32:49.383858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:32:49.383858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:32:49.383858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:32:49.383858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:32:49.383858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. Oct 28 10:32:49.383858 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:32:49.386230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] Returning 404 to user: Instance bf469daa-59f1-4892-bd8c-76e8f947722b could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:32:49.387406 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4d78bfb-aa53-44a6-958c-7cea028ddfdd tempest-AttachVolumeTestJSON-1842370642 tempest-AttachVolumeTestJSON-1842370642-project] 10.222.0.16 "GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b" status: 404 len: 111 microversion: 2.1 time: 0.044125 Oct 28 10:32:49.391813 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3394/6784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:32:49 2022] GET /compute/v2.1/servers/bf469daa-59f1-4892-bd8c-76e8f947722b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:33:08.871513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1180471459", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d07122d6-1cd0-4905-8d8e-37d45e04a0f5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:33:08.884669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:08.885885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=7 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:08.951591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:33:09.377782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:33:09.378276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:33:09.378821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:33:09.379307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:33:09.379782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:33:09.403659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:09.404405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:09.405053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:09.405800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:09.406258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:09.406679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:09.427919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:33:09.435414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:33:09.505095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:33:09.511301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d07122d6-1cd0-4905-8d8e-37d45e04a0f5',volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:33:09.669217 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-66c115c9-651a-4c24-bacf-d9ef920d712b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801499 Oct 28 10:33:09.669948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3391/6785] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:33:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:33:09.681932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48cf1a22-eb0c-40d9-8054-fc42d1f667fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:09.683764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48cf1a22-eb0c-40d9-8054-fc42d1f667fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:09.688630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:09.689466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=33 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:09.758335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48cf1a22-eb0c-40d9-8054-fc42d1f667fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:09.766655 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48cf1a22-eb0c-40d9-8054-fc42d1f667fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1071 microversion: 2.1 time: 0.089264 Oct 28 10:33:09.783389 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3395/6786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:09 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1071 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:10.792179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:10.792975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:10.800746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:10.801518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:10.801966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:10.802832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:10.803610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:10.804217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:10.897395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:10.908030 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0f113d3b-c11b-4fb5-949c-c17c66fe35d2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1169 microversion: 2.1 time: 0.123025 Oct 28 10:33:10.923431 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3392/6787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:10 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1169 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:11.935793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:11.936420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:11.945938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:11.949063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:11.949846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:11.953181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:11.953838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:11.954464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:12.203235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:12.222115 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-531f884b-5eee-4889-90ff-02bd56e06512 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1229 microversion: 2.1 time: 0.291772 Oct 28 10:33:12.227805 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3396/6788] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:11 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1229 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:12.678179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-25cca4ee-c6b3-4bee-925e-79f2acd416be req-3861c398-0a44-49aa-aad7-58a772100913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad641903-47d6-4250-ad50-70c355ef8a34", "tag": "4cab4a25-bd1b-42a7-aa74-b3507d8c45d8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:33:12.694164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-25cca4ee-c6b3-4bee-925e-79f2acd416be req-3861c398-0a44-49aa-aad7-58a772100913 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:12.694643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-25cca4ee-c6b3-4bee-925e-79f2acd416be req-3861c398-0a44-49aa-aad7-58a772100913 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:12.695502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-25cca4ee-c6b3-4bee-925e-79f2acd416be req-3861c398-0a44-49aa-aad7-58a772100913 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:12.707741 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-25cca4ee-c6b3-4bee-925e-79f2acd416be req-3861c398-0a44-49aa-aad7-58a772100913 service nova] Creating event network-changed:4cab4a25-bd1b-42a7-aa74-b3507d8c45d8 for instance ad641903-47d6-4250-ad50-70c355ef8a34 on n-h2-zed-1 Oct 28 10:33:12.712638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-25cca4ee-c6b3-4bee-925e-79f2acd416be req-3861c398-0a44-49aa-aad7-58a772100913 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038090 Oct 28 10:33:12.713887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3393/6789] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:33:13.252619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:13.254111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:13.263087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:13.263963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:13.264616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:13.265682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:13.266315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:13.266915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:13.475826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:13.484645 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d00c0a89-d5c5-44dd-a033-839e07e54b3c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1229 microversion: 2.1 time: 0.236138 Oct 28 10:33:13.486224 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3397/6790] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:13 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1229 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:14.510404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:14.512447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:14.519121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:14.519965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:14.520629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:14.521627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:14.522311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:14.522965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:14.729006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:14.739923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-963387e9-3599-423f-b0fc-a92311489e0c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1229 microversion: 2.1 time: 0.234644 Oct 28 10:33:14.755765 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3394/6791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:14 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1229 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:15.765533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:15.766386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:15.773079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:15.773575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:15.774023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:15.774806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:15.775214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:15.775648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:15.952180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:15.960860 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5a47fb43-e526-4cca-8687-4a750cf7e0ba tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1229 microversion: 2.1 time: 0.200852 Oct 28 10:33:15.961645 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3398/6792] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:15 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1229 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:16.984875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:16.985621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:16.992767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:16.993522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:16.994016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:16.994998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:16.995675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:16.996177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:17.145005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:17.153343 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-310ed290-163d-4eb6-8d56-29c5a2ef367b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.173089 Oct 28 10:33:17.153985 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3395/6793] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:16 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:18.177527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:18.178658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:18.186576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:18.187071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:18.187508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:18.188220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:18.188804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:18.189260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:18.345301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:18.353767 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-28d7afc4-0663-4014-b3f1-8230bd56b430 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.180181 Oct 28 10:33:18.354533 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3399/6794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:18 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:19.377187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:19.378288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:19.387593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:19.388331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:19.389023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:19.390425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:19.391094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:19.392135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:19.415693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:19.442876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:19.543251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:19.552950 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-18789582-5839-457f-8118-8ed8304057d9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.180740 Oct 28 10:33:19.553604 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3396/6795] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:19 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:20.578567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:20.580509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:20.584354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:20.592791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:20.593331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:20.593785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:20.594538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:20.594999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:20.599817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:20.763240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:20.771732 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e469d535-07c6-455e-ab0e-4898cd77415a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.198991 Oct 28 10:33:20.785308 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3400/6796] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:20 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:21.798878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:21.799493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:21.806436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:21.806920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:21.807358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:21.808051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:21.808513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:21.808963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:21.946592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:21.955301 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb57d0a1-a6a1-47f5-a979-795b635b9f06 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.160549 Oct 28 10:33:21.956000 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3397/6797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:21 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:22.978772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:22.979572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:22.987062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:22.987567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:22.988013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:22.988833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:22.989337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:22.989688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:23.201753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:23.209795 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8a597e8-e827-4a99-ae8f-a113f3d4fc86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.235018 Oct 28 10:33:23.210375 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3401/6798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:22 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:24.238118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:24.238855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:24.246274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:24.246756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:24.247189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:24.247880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:24.248449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:24.248952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:24.434288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:24.443942 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f0c5cce-3bfa-415b-9e2d-969665423c94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.209863 Oct 28 10:33:24.444621 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3398/6799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:24 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:33:25.470323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:25.471768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:25.479307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:25.480613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:25.481204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:25.481979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:25.482644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:25.483339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:25.653558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:25.661509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4544792d-bb57-4697-ad89-4ebee9dff24e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.195779 Oct 28 10:33:25.662184 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3402/6800] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:25 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:26.684634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:26.685283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:26.692407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:26.692939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:26.693386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:26.694090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:26.694577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:26.695006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:26.841006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:26.848980 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d786c540-1b4b-4ab2-bfbb-347584c16633 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.168602 Oct 28 10:33:26.849584 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3399/6801] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:26 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:27.874110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:27.874829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:27.883927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:27.886074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:27.888195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:27.892205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:27.892695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:27.893175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:28.102435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:28.126925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1158f887-a2c8-4c62-ac8e-9bf495cbd917 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.256590 Oct 28 10:33:28.128121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3403/6802] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:27 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:33:28.197856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1a64b7fc-7d5d-472d-a213-b115a42a3c52 req-1a4f404d-59e1-4174-a1be-4c366d0b11fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad641903-47d6-4250-ad50-70c355ef8a34", "name": "network-vif-plugged", "status": "completed", "tag": "4cab4a25-bd1b-42a7-aa74-b3507d8c45d8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:33:28.213017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1a64b7fc-7d5d-472d-a213-b115a42a3c52 req-1a4f404d-59e1-4174-a1be-4c366d0b11fd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:28.213885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1a64b7fc-7d5d-472d-a213-b115a42a3c52 req-1a4f404d-59e1-4174-a1be-4c366d0b11fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:28.215538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1a64b7fc-7d5d-472d-a213-b115a42a3c52 req-1a4f404d-59e1-4174-a1be-4c366d0b11fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:28.228494 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1a64b7fc-7d5d-472d-a213-b115a42a3c52 req-1a4f404d-59e1-4174-a1be-4c366d0b11fd service nova] Creating event network-vif-plugged:4cab4a25-bd1b-42a7-aa74-b3507d8c45d8 for instance ad641903-47d6-4250-ad50-70c355ef8a34 on n-h2-zed-1 Oct 28 10:33:28.235805 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1a64b7fc-7d5d-472d-a213-b115a42a3c52 req-1a4f404d-59e1-4174-a1be-4c366d0b11fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043675 Oct 28 10:33:28.236570 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3400/6803] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:33:29.153089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:29.153711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:29.161193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:29.161898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:29.162380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:29.163093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:29.163587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:29.164053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:29.320258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:29.337103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f9a8232-e5c0-4bda-b9eb-85abb8fe5418 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1217 microversion: 2.1 time: 0.190255 Oct 28 10:33:29.347346 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3404/6804] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:29 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1217 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:30.361944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:30.363394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:30.372304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:30.373492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:30.373933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:30.374662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:30.375068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:30.375661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:30.529885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:30.539431 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-604dd9ca-31c0-427a-a25e-0f5e461c4c14 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1404 microversion: 2.1 time: 0.182074 Oct 28 10:33:30.550005 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3401/6805] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:30 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:30.566425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:30.567053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:30.574951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:30.575427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:30.575900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:30.581871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:30.582651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:30.583216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:30.759005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:30.779895 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96802572-b705-4fc7-aa4c-b8331348f724 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1404 microversion: 2.1 time: 0.219961 Oct 28 10:33:30.782317 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3405/6806] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:30 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:30.804610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1642917176"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:33:30.806960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:30.814192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:30.814789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:30.815302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:30.816238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:30.816702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:30.817161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:30.935182 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Attempting to quiesce instance before volume snapshot. Oct 28 10:33:31.012037 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 28 10:33:31.106956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Creating snapshot from volume d07122d6-1cd0-4905-8d8e-37d45e04a0f5. {{(pid=128748) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 28 10:33:32.000269 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25b0b072-9142-4385-b31b-1fd72821a2d4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34/action" status: 202 len: 0 microversion: 2.1 time: 1.199387 Oct 28 10:33:32.001135 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3402/6807] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:33:30 2022] POST /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34/action => generated 0 bytes in 1201 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 10:33:34.279590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-395577218", "imageRef": "6fa38a13-34f3-40bd-ad7c-63bfb3fe5b6f", "flavorRef": "452", "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:33:34.349053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:33:34.788872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:33:34.789332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:33:34.789960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:33:34.790373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:33:34.790789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:33:34.804056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:34.804552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:34.805053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:34.805813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:34.806268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:34.806888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:34.825820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:33:34.831943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:33:34.845413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:33:34.847967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='5bf9fe7d-a4cf-4153-a0f4-1178eb3ad64b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:33:34.930608 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-464350fc-a495-42ae-9f68-8e914d91472e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.655800 Oct 28 10:33:34.931656 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3406/6808] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:33:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:33:34.944224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bdd3c8a0-35fa-4c78-8a4d-b42b1fbad73b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:34.945003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bdd3c8a0-35fa-4c78-8a4d-b42b1fbad73b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:35.002923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bdd3c8a0-35fa-4c78-8a4d-b42b1fbad73b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:35.013279 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bdd3c8a0-35fa-4c78-8a4d-b42b1fbad73b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1229 microversion: 2.1 time: 0.073363 Oct 28 10:33:35.014400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3403/6809] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:34 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1229 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:36.037900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:36.038516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:36.046625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:36.047225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:36.047749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:36.048501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:36.049066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:36.049558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:36.146267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:36.158519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d13b28e6-443e-4840-9f6d-44ce53e46c70 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1281 microversion: 2.1 time: 0.125271 Oct 28 10:33:36.170312 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3407/6810] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:36 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1281 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:37.183835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:37.185288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:37.203263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:37.205718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:37.206776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:37.209890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:37.210648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:37.211752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:37.546778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:37.554724 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-97819241-0e4f-485a-8c16-44a373ad2042 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.375539 Oct 28 10:33:37.555313 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3404/6811] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:37 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:33:38.243246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-06d2890e-9436-4319-bc90-5be9a862dbc5 req-c5ba4692-77a7-4f80-944f-644f135ee3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c", "tag": "58a61840-b6a9-4034-a1c3-ff41b7a90ecd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:33:38.271897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-06d2890e-9436-4319-bc90-5be9a862dbc5 req-c5ba4692-77a7-4f80-944f-644f135ee3a4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:38.273157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-06d2890e-9436-4319-bc90-5be9a862dbc5 req-c5ba4692-77a7-4f80-944f-644f135ee3a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:38.285684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-06d2890e-9436-4319-bc90-5be9a862dbc5 req-c5ba4692-77a7-4f80-944f-644f135ee3a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:38.320971 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-06d2890e-9436-4319-bc90-5be9a862dbc5 req-c5ba4692-77a7-4f80-944f-644f135ee3a4 service nova] Creating event network-changed:58a61840-b6a9-4034-a1c3-ff41b7a90ecd for instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c on n-h1-zed-1 Oct 28 10:33:38.330705 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-06d2890e-9436-4319-bc90-5be9a862dbc5 req-c5ba4692-77a7-4f80-944f-644f135ee3a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102590 Oct 28 10:33:38.333817 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3408/6812] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:33:38.579876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:38.589322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:38.613917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:38.617559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:38.619041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:38.619856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:38.621978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:38.622722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:38.993513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:38.996659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:39.008985 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1622bf46-3a56-4db3-959c-17fb6726db60 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.432500 Oct 28 10:33:39.026420 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3405/6813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:38 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:40.039202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:40.039943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:40.049130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:40.051200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:40.051963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:40.052739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:40.054665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:40.055400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:40.056205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:40.086420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=71 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:40.275915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:40.284997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f15a49e-f588-4217-9625-a12c8e0bd402 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.252892 Oct 28 10:33:40.285720 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3409/6814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:40 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:41.312114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:41.312830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:41.321804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:41.331159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:41.331941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:41.347091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:41.348152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:41.353190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:41.354032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:41.550431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:41.562864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d36441b-077d-44b6-82e7-41c6cedcbf12 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.254820 Oct 28 10:33:41.563468 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3406/6815] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:41 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:42.591219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:42.592224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:42.606183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:42.607438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:42.608168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:42.609652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:42.610967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:42.611943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:42.824282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:42.847690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65df0858-f89b-4cfb-a707-e2aab3bbaf32 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.260596 Oct 28 10:33:42.851218 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3410/6816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:42 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:43.878216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:43.881812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:43.889014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:43.891327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:43.892040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:43.893182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:43.893796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:43.894336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:44.125758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:44.138631 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96d2ebb3-d2e8-4997-9164-2e99b4673b92 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.266786 Oct 28 10:33:44.140107 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3407/6817] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:43 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:45.168526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:45.170663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:45.174007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:45.174732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:45.187185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:45.187701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:45.188326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:45.189736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:45.190626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:45.191312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:45.389924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:45.414134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5628b3d7-654d-4a6a-a0a5-43592385faa3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.249723 Oct 28 10:33:45.415808 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3411/6818] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:45 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:46.442983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:46.443652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:46.447504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:33:46.460036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:46.460036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:46.460036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:46.461740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:46.461740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:46.464145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:46.708753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:46.718812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1b0c8d64-e069-4ee5-b493-c44e400b14ca tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.280087 Oct 28 10:33:46.736096 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3408/6819] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:46 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:47.748126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:47.748998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:47.756516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:47.758117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:47.758117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:47.759454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:47.760139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:47.761430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:47.956443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:47.968547 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52b3bfc8-0087-4096-830c-1dc19d3bcdbf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.225872 Oct 28 10:33:47.969180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3412/6820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:47 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:48.994044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:48.994825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:49.005010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:49.005010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:49.005010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:49.005010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:49.005414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:49.005915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:49.195400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:49.204893 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2bd60df9-eadc-4b0b-a9c4-292a97ad893e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.214818 Oct 28 10:33:49.205715 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3409/6821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:48 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:50.230985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:50.231787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:50.240418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:50.240915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:50.242578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:50.243952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:50.244691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:50.245802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:50.408210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:50.417711 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3028ab29-ef6c-4155-b843-f5cb4781d625 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.190657 Oct 28 10:33:50.418810 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3413/6822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:50 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:51.442735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:51.443448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:51.451834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:51.452492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:51.452979 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:51.453796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:51.454336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:51.454925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:51.694700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:51.705010 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e2da20ac-1e07-417e-a8f7-ce449743f2b2 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.266592 Oct 28 10:33:51.705974 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3410/6823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:51 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:52.728876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:52.729562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:52.742288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:52.742794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:52.743245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:52.743974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:52.744442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:52.745443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:52.950800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:52.959766 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dcb3fce0-3efa-4436-8559-61c3b8f5ba8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.234833 Oct 28 10:33:52.960371 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3414/6824] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:52 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:53.987482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:53.989494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:54.008554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:54.016774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:54.017777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:54.019575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:54.021175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:54.021879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:54.370075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:54.385079 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-51ebc0ae-14a6-461e-af86-88c435372f94 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.403237 Oct 28 10:33:54.392367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3411/6825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:53 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:33:55.420544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:55.421118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:55.438357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:55.438877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:55.439328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:55.440064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:55.440527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:55.453925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:55.784644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:55.794965 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3a367fb-ab6e-4da4-9218-0f4a9aaf7e34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.378930 Oct 28 10:33:55.799591 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3415/6826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:55 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:56.824556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:56.825935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:56.856213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:56.856768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:56.857391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:56.858208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:56.858679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:56.859139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:57.127878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:57.138614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f08fdb11-6832-4095-af0b-5252f6ac3c76 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1341 microversion: 2.1 time: 0.319542 Oct 28 10:33:57.148224 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3412/6827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:56 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1341 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:58.161643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:58.162264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:58.169729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:58.170529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:58.171222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:58.172126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:58.172804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:58.173505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:58.337100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:58.347927 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8c949fc-38fb-40b9-aea4-122b560e5bcc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.190140 Oct 28 10:33:58.366493 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3416/6828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:58 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:33:59.375056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:33:59.375689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:33:59.385255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:59.386325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:59.386876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:59.388063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:33:59.388735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:33:59.389680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:33:59.545632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:33:59.555760 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7564699a-b0fc-440d-aadb-1b175d5cce6f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.186297 Oct 28 10:33:59.556995 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3413/6829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:33:59 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:00.580550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:00.581343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:00.594550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:00.595215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:00.595513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:00.596426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:00.596790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:00.597534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:00.833827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:00.843962 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-21ff355f-9aae-457c-a246-8f11c490019e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.267087 Oct 28 10:34:00.845105 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3417/6830] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:00 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:01.868286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:01.869237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:01.879382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:01.880106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:01.880504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:01.881263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:01.881885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:01.882336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:02.170529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:02.180307 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edbb3bd9-ae69-49b7-922c-ac6216e37044 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.316196 Oct 28 10:34:02.181389 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3414/6831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:01 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:03.206226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:03.206845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:03.215887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:03.216394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:03.216837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:03.217783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:03.218433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:03.218870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:03.787900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:03.800509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d32d0d59-a70f-4e1a-b88e-7f6b93cdb800 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.597917 Oct 28 10:34:03.801614 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3418/6832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:03 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:04.832365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:04.832995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:04.843939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:04.845411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:04.846133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:04.847203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:04.847905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:04.848561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:05.037530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:05.048362 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63415e4b-13ec-42a2-add2-12e78e3d25b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.222985 Oct 28 10:34:05.049071 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3415/6833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:04 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:06.075412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:06.076310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:06.086747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:06.087385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:06.088115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:06.089889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:06.090431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:06.090968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:06.236563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:06.248346 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c39a4d02-4ff9-4ca9-82ed-64cd16e52550 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.177600 Oct 28 10:34:06.249341 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3419/6834] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:06 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:07.273444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:07.274716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:07.282207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:07.282713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:07.283175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:07.283913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:07.284359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:07.284807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:07.432364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:07.441465 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0fb31701-cd57-4eb1-a320-97bab916a1e8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.171622 Oct 28 10:34:07.453452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3416/6835] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:07 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:08.467957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:08.469580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:08.476618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:08.477465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:08.478104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:08.478969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:08.480220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:08.481285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:08.624100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:08.634881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2cdf2885-6b99-4533-9f1e-dd11b48b0a9d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.171885 Oct 28 10:34:08.636796 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3420/6836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:08 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:09.660861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:09.662763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:09.673555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:09.674384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:09.674837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:09.675558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:09.677268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:09.677891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:09.867070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5739e906-0e7d-4722-be8b-e757ba0f4f97 req-b5799066-0af5-430c-bc6c-eadb2988de37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c", "name": "network-vif-plugged", "status": "completed", "tag": "58a61840-b6a9-4034-a1c3-ff41b7a90ecd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:34:09.873638 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:34:09.881332 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:34:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 10:34:09.925115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5739e906-0e7d-4722-be8b-e757ba0f4f97 req-b5799066-0af5-430c-bc6c-eadb2988de37 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:09.926055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5739e906-0e7d-4722-be8b-e757ba0f4f97 req-b5799066-0af5-430c-bc6c-eadb2988de37 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:09.926726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5739e906-0e7d-4722-be8b-e757ba0f4f97 req-b5799066-0af5-430c-bc6c-eadb2988de37 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:09.952878 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5739e906-0e7d-4722-be8b-e757ba0f4f97 req-b5799066-0af5-430c-bc6c-eadb2988de37 service nova] Creating event network-vif-plugged:58a61840-b6a9-4034-a1c3-ff41b7a90ecd for instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c on n-h1-zed-1 Oct 28 10:34:09.960419 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5739e906-0e7d-4722-be8b-e757ba0f4f97 req-b5799066-0af5-430c-bc6c-eadb2988de37 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096235 Oct 28 10:34:09.962038 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3421/6837] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:34:10.346465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:10.377584 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ac6b110-0dd2-4289-8db3-a0d7c94d3d7d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.722089 Oct 28 10:34:10.378463 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3417/6838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:09 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:11.402663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:11.403647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:11.408670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=26 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:11.419402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:11.420325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:11.421194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:11.423445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:11.424370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:11.425082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:11.430655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=74 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:11.703684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:11.712990 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7c82403-5ee7-445c-99df-d217a27e2311 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1375 microversion: 2.1 time: 0.314637 Oct 28 10:34:11.713627 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3422/6839] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:11 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1375 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:12.737723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:12.739315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:12.743482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=24 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:12.749371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:12.750026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:12.750826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:12.751772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:12.752466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:12.753240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:12.756301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=74 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:12.922693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:12.935794 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8678b892-f5e7-441a-93fd-7016fcecda30 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1562 microversion: 2.1 time: 0.201926 Oct 28 10:34:12.937470 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3418/6840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:12 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1562 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:12.961228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:12.961997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:12.972503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:12.973109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:12.973663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:12.974600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:12.975181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:12.975871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:13.169983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:13.184421 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f93f8014-271b-4c25-8223-d27e49474369 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1562 microversion: 2.1 time: 0.227031 Oct 28 10:34:13.188942 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3423/6841] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:12 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1562 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:13.288728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:13.289748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:13.306101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:13.308133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:13.309515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:13.311438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:13.312331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:13.313133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:13.374818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:34:13.478398 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7c4d101-aa76-41cc-8cb6-cd413373500d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 204 len: 0 microversion: 2.1 time: 0.194040 Oct 28 10:34:13.480159 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3419/6842] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:34:13 2022] DELETE /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:34:13.488880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:13.489684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:13.498848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:13.499604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:13.500342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:13.501350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:13.502232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:13.502878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:13.688945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:13.700029 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-476e9911-52ab-46ef-905c-29a193a94fbe tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1568 microversion: 2.1 time: 0.215486 Oct 28 10:34:13.701076 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3424/6843] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:13 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1568 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:14.728095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:14.730364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:14.738428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:14.739267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:14.740122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:14.740951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:14.741487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:14.742177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:14.963782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:14.972524 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e78d7b3-49bb-49bd-97c1-f11af23ee069 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1568 microversion: 2.1 time: 0.248747 Oct 28 10:34:14.973665 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3420/6844] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:14 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:15.622992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5e2cc28e-82ca-46d1-a0a2-c2e4a3fabf80 req-5d3a21b1-eb6c-4faa-8dc8-b8dd462f40c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c", "name": "network-vif-deleted", "tag": "58a61840-b6a9-4034-a1c3-ff41b7a90ecd"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:34:15.640734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5e2cc28e-82ca-46d1-a0a2-c2e4a3fabf80 req-5d3a21b1-eb6c-4faa-8dc8-b8dd462f40c4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:15.641258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5e2cc28e-82ca-46d1-a0a2-c2e4a3fabf80 req-5d3a21b1-eb6c-4faa-8dc8-b8dd462f40c4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:15.641860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5e2cc28e-82ca-46d1-a0a2-c2e4a3fabf80 req-5d3a21b1-eb6c-4faa-8dc8-b8dd462f40c4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:15.660295 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5e2cc28e-82ca-46d1-a0a2-c2e4a3fabf80 req-5d3a21b1-eb6c-4faa-8dc8-b8dd462f40c4 service nova] Creating event network-vif-deleted:58a61840-b6a9-4034-a1c3-ff41b7a90ecd for instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c on n-h1-zed-1 Oct 28 10:34:15.666999 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5e2cc28e-82ca-46d1-a0a2-c2e4a3fabf80 req-5d3a21b1-eb6c-4faa-8dc8-b8dd462f40c4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048275 Oct 28 10:34:15.674334 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3425/6845] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:34:15.998174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:15.999520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:16.011768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:16.012293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:16.012752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:16.013799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:16.014463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:16.015223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:16.090559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:16.102026 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4c8c5a67-46bd-4c1c-9f8c-ae5b7adbd119 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1360 microversion: 2.1 time: 0.109851 Oct 28 10:34:16.103803 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3421/6846] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:15 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1360 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:17.126000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:17.126584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:17.140427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:17.141419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:17.142393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:17.143510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:17.145375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:17.147088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:17.233040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:17.245293 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe12d85e-1fb0-4294-98a5-2dc4a44c0b86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1360 microversion: 2.1 time: 0.122364 Oct 28 10:34:17.245877 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3426/6847] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:17 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1360 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:18.271787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:18.272500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:18.282088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:18.282604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:18.283061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:18.284025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:18.284849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:18.285289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:18.386764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:18.395862 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-049fb6ef-4f63-4aab-abad-089616727e78 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1360 microversion: 2.1 time: 0.128205 Oct 28 10:34:18.396542 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3422/6848] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:18 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1360 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:19.419522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:19.420198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:19.427734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:19.428239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:19.428677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:19.429610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:19.430242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:19.430849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:19.508133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:19.517703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4680088-24be-412b-8059-0da30689c45e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1360 microversion: 2.1 time: 0.101984 Oct 28 10:34:19.518289 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3427/6849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:19 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1360 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:20.542555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:20.543823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:20.551629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:20.552141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:20.552710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:20.553598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:20.554070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:20.554703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:20.611065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:20.611575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:20.612036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:20.612699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lazy-loading 'fault' on Instance uuid 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:34:20.685568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:20.701313 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87afb811-24d4-4be0-82bd-77820e4894c6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 200 len: 1365 microversion: 2.1 time: 0.161736 Oct 28 10:34:20.702567 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3423/6850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:20 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:21.725301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:21.726486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:21.733825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:21.734538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:21.735173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:21.735879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:21.736531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:21.737172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:21.751762 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c HTTP/1.1 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c'} Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:21.753985 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:21.759523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:21.759523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:21.759523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:21.759523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:34:21.759523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:34:21.759523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:21.759523 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:21.761491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:34:21.762601 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49e9e1d6-86ba-4c45-96c6-a6709cdb13d8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 404 len: 111 microversion: 2.1 time: 0.040937 Oct 28 10:34:21.766419 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3428/6851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:21 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:26.213104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:26.213104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:26.216064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:26.216567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:26.217054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:26.217768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:26.218242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:26.218690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:26.246850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:34:26.340701 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6085c5c-8279-4053-9b22-51cfba8cdc74 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 204 len: 0 microversion: 2.1 time: 0.140214 Oct 28 10:34:26.341480 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3424/6852] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:34:26 2022] DELETE /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:34:26.350139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:26.350844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:26.363707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:26.364566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:26.365139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:26.366285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:26.366839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:26.367241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:26.516374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:26.528237 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aec9ecb5-7738-4205-9a3a-6ebb0b594e80 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1410 microversion: 2.1 time: 0.181487 Oct 28 10:34:26.528635 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3429/6853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:26 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1410 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:27.551756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:27.552469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:27.559120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:27.559626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:27.560081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:27.560793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:27.561286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:27.561725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:27.744743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:27.752928 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38cc5684-741b-4cbd-a243-0c46842ec8fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1410 microversion: 2.1 time: 0.205353 Oct 28 10:34:27.753523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3425/6854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:27 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1410 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:28.780450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:28.790301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:28.810989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:28.813046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:28.813240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:28.814233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:28.817521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:28.818611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:28.847865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9f3908ba-ee28-46b1-8eeb-e2ff0b904551 req-ca52e69c-4a17-491f-9a15-dfca3cd0d138 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad641903-47d6-4250-ad50-70c355ef8a34", "name": "network-vif-deleted", "tag": "4cab4a25-bd1b-42a7-aa74-b3507d8c45d8"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:34:28.860566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9f3908ba-ee28-46b1-8eeb-e2ff0b904551 req-ca52e69c-4a17-491f-9a15-dfca3cd0d138 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:28.861191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9f3908ba-ee28-46b1-8eeb-e2ff0b904551 req-ca52e69c-4a17-491f-9a15-dfca3cd0d138 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:28.861716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9f3908ba-ee28-46b1-8eeb-e2ff0b904551 req-ca52e69c-4a17-491f-9a15-dfca3cd0d138 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:28.874446 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9f3908ba-ee28-46b1-8eeb-e2ff0b904551 req-ca52e69c-4a17-491f-9a15-dfca3cd0d138 service nova] Creating event network-vif-deleted:4cab4a25-bd1b-42a7-aa74-b3507d8c45d8 for instance ad641903-47d6-4250-ad50-70c355ef8a34 on n-h2-zed-1 Oct 28 10:34:28.881834 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9f3908ba-ee28-46b1-8eeb-e2ff0b904551 req-ca52e69c-4a17-491f-9a15-dfca3cd0d138 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037905 Oct 28 10:34:28.882904 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3426/6855] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:34:28.893001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:28.901760 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-427b8beb-233d-4483-9459-2ad8cc967b51 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1368 microversion: 2.1 time: 0.125840 Oct 28 10:34:28.902340 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3430/6856] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:28 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:29.928426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:29.929231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:29.936568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:29.937127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:29.937512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:29.943252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:29.943807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:29.944267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:30.011463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:30.019590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f51f60f6-555a-4897-87e9-7a171d61e9dc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1202 microversion: 2.1 time: 0.096218 Oct 28 10:34:30.033220 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3427/6857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:29 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1202 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:31.044237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:31.046231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:31.053799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:31.054489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:31.055056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:31.056074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:31.056632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:31.057282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:31.131627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:31.139728 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44daa076-7a33-474a-9c29-5249297cf33a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1202 microversion: 2.1 time: 0.100024 Oct 28 10:34:31.140304 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3431/6858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:31 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1202 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:32.163365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:32.164259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:32.173231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:32.173755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:32.174216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:32.174960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:32.175627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:32.176086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:32.246891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:32.254974 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-36b41fa8-0425-4879-acc0-ff8396c494ee tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1202 microversion: 2.1 time: 0.095671 Oct 28 10:34:32.256081 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3428/6859] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:32 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:33.281619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:33.282897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:33.302339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:33.302852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:33.303303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:33.304022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:33.304487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:33.304934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:33.352500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:33.353303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:33.354517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:33.355163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lazy-loading 'fault' on Instance uuid ad641903-47d6-4250-ad50-70c355ef8a34 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:34:33.405303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:33.414078 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc9304be-2a92-4b08-b964-fc35d4161401 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 200 len: 1207 microversion: 2.1 time: 0.138386 Oct 28 10:34:33.414671 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3432/6860] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:33 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 1207 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:34.439076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:34.439874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:34.448893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:34.449550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:34.450209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:34.451776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:34.452364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:34.452961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:34.468730 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 HTTP/1.1 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ad641903-47d6-4250-ad50-70c355ef8a34'} Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:34.470595 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:34.476086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:34:34.477493 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a8603cf5-c615-4904-982b-16c1442c884e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 404 len: 111 microversion: 2.1 time: 0.042419 Oct 28 10:34:34.482293 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3429/6861] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:34 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:38.792658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:38.793307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:38.800208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:38.800692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:38.801168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:38.801965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:38.802647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:38.803130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:38.817238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c HTTP/1.1 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c'} Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:34:38.818820 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f02a68c0-9a04-4c25-bc16-cbf391819c8f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 404 len: 111 microversion: 2.1 time: 0.031666 Oct 28 10:34:38.824693 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3433/6862] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:34:38 2022] DELETE /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:38.829894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:38.830559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:38.837546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:38.838638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:38.839096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:38.840087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:38.840521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:38.840996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:38.854607 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c HTTP/1.1 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c'} Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:38.856147 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance 0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1fa6b7f0-a788-4d65-a4eb-834c0e77e196 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c" status: 404 len: 111 microversion: 2.1 time: 0.031735 Oct 28 10:34:38.865019 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3430/6863] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:38 2022] GET /compute/v2.1/servers/0a0ebbb6-bebb-4fa5-b5c4-12713b4e646c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:39.403429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:39.404050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:39.410349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:39.410925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:39.411511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:39.412263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:39.412861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:39.413422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:39.427443 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 HTTP/1.1 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'ad641903-47d6-4250-ad50-70c355ef8a34'} Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:34:39.429285 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cac620d2-da5a-480d-8eb3-c1ea9317695d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 404 len: 111 microversion: 2.1 time: 0.033118 Oct 28 10:34:39.438405 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3434/6864] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:34:39 2022] DELETE /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:39.442677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:39.443302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: ad641903-47d6-4250-ad50-70c355ef8a34] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:39.450316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:39.450837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:39.451288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:39.452112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:39.452586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:39.453056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:39.467422 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 HTTP/1.1 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ad641903-47d6-4250-ad50-70c355ef8a34'} Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:34:39.469377 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.474761 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:34:39.474761 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:34:39.474761 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:34:39.474761 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:34:39.474761 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:34:39.474761 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. Oct 28 10:34:39.474761 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:34:39.476211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance ad641903-47d6-4250-ad50-70c355ef8a34 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:34:39.477358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aa844ef4-8607-4dee-bb54-afa7fd3e16eb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34" status: 404 len: 111 microversion: 2.1 time: 0.038660 Oct 28 10:34:39.478478 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3431/6865] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:39 2022] GET /compute/v2.1/servers/ad641903-47d6-4250-ad50-70c355ef8a34 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:34:39.579979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ebd2524-059d-4fa7-924e-5b425b4c9932 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: .version_select at 0x7fca32337310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-351906278", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFKwMpuOY4Az57Ug+SpzfgDw2DFkar0MeDj3yynZEG9mgtUR+RiYw/yzXPgmwdmuJReyQ2nbyKaqJuPLzeE0qCnt+ZvgnKOmMbrY8IxseK6idtN/VK6mzVCV2fc7ROGsgQ=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:34:39.600502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-1ebd2524-059d-4fa7-924e-5b425b4c9932 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:34:39.608366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-1ebd2524-059d-4fa7-924e-5b425b4c9932 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:34:39.641031 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ebd2524-059d-4fa7-924e-5b425b4c9932 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.067542 Oct 28 10:34:39.641973 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3435/6866] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:34:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:34:57.260277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-203288209", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-351906278", "security_groups": [{"name": "tempest-secgroup-smoke-287004008"}], "block_device_mapping_v2": [{"uuid": "cd87678b-ddff-4996-986e-24650f11a11b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:34:57.270994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:57.271653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:57.399941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:34:57.788495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:34:57.788960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:34:57.789458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:34:57.790150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:34:57.790585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:34:57.800483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:57.801034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:57.801492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:57.802252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:57.802724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:57.803453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:57.822393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:34:57.828998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:34:57.896759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:34:57.899262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd87678b-ddff-4996-986e-24650f11a11b',volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:34:58.035654 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-280a00bf-024f-4e87-a3eb-e22e39c62050 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780095 Oct 28 10:34:58.036484 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3432/6867] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:34:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:34:58.047819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f3535f0-6840-4c69-be56-eea7d8f51d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:58.049299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f3535f0-6840-4c69-be56-eea7d8f51d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:58.053223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=63 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:58.054465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:58.055366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:34:58.117791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f3535f0-6840-4c69-be56-eea7d8f51d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:58.126168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f3535f0-6840-4c69-be56-eea7d8f51d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1093 microversion: 2.1 time: 0.082085 Oct 28 10:34:58.127105 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3436/6868] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:58 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:34:59.154032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:34:59.155314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:34:59.162180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:59.162920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:59.163579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:59.165045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:34:59.165692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:34:59.166893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:34:59.284362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:34:59.293424 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-15b4ba2f-6dc1-4475-a538-217ca87575f7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1199 microversion: 2.1 time: 0.148070 Oct 28 10:34:59.294022 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3433/6869] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:34:59 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1199 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:00.317607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:00.319148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:00.327163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:00.327944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:00.329172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:00.330085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:00.330729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:00.331341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:00.517641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:00.528561 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-93f4972e-ef11-4f72-b563-0ad4b8d88ddd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1276 microversion: 2.1 time: 0.215577 Oct 28 10:35:00.539163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3437/6870] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:00 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:00.828255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-59d800ef-d43e-4d3d-848b-7374d3c1e5e1 req-89bf430d-bddd-4f9c-b357-963ae992b8f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9339f0d1-aaee-4726-aed8-5efb32bb1393", "tag": "7434a206-d450-4acc-afb2-bdb15200eeb3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:35:00.876658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59d800ef-d43e-4d3d-848b-7374d3c1e5e1 req-89bf430d-bddd-4f9c-b357-963ae992b8f7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:00.876658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59d800ef-d43e-4d3d-848b-7374d3c1e5e1 req-89bf430d-bddd-4f9c-b357-963ae992b8f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:00.876658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-59d800ef-d43e-4d3d-848b-7374d3c1e5e1 req-89bf430d-bddd-4f9c-b357-963ae992b8f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:00.889741 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-59d800ef-d43e-4d3d-848b-7374d3c1e5e1 req-89bf430d-bddd-4f9c-b357-963ae992b8f7 service nova] Creating event network-changed:7434a206-d450-4acc-afb2-bdb15200eeb3 for instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 on n-h2-zed-1 Oct 28 10:35:00.895305 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-59d800ef-d43e-4d3d-848b-7374d3c1e5e1 req-89bf430d-bddd-4f9c-b357-963ae992b8f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071338 Oct 28 10:35:00.896501 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3434/6871] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:35:01.553219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:01.553753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:01.561990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:01.562498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:01.562948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:01.563667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:01.564135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:01.564575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:01.725867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:01.734875 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5193deb4-da99-47cf-a966-cad388a97277 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1276 microversion: 2.1 time: 0.186226 Oct 28 10:35:01.736962 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3438/6872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:01 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1276 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:02.761619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:02.763020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:02.770789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:02.771306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:02.771758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:02.772692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:02.773379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:02.773830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:02.932678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:02.942258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84306710-a395-45db-8d59-930c941049c4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1276 microversion: 2.1 time: 0.186509 Oct 28 10:35:02.943431 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3435/6873] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:02 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:03.966333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:03.969658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:03.977642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:03.978151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:03.978635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:03.980262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:03.980262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:03.980493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:04.124210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:04.132413 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-67730d97-447c-493e-bec0-1bceb14a5daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1276 microversion: 2.1 time: 0.170628 Oct 28 10:35:04.133406 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3439/6874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:03 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:05.156109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:05.156735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:05.163538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:05.164036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:05.164486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:05.165284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:05.165753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:05.166835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:05.309857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:05.317592 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aaf2fbd7-2913-4548-96fa-66f672003013 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.165314 Oct 28 10:35:05.318176 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3436/6875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:05 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:06.341263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:06.341892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:06.349317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:06.349819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:06.350301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:06.351026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:06.351488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:06.351919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:06.486478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:06.494320 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ff57594-d7e8-4c68-b45b-a665eed59b99 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.157068 Oct 28 10:35:06.494898 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3440/6876] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:06 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:07.517047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:07.517786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:07.524737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:07.525555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:07.525860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:07.526578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:07.527054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:07.527502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:07.666451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:07.674521 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa50df81-4518-4b0e-8459-0995f073257a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.161424 Oct 28 10:35:07.675260 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3437/6877] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:07 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:08.698330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:08.699043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:08.701911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:08.707256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:08.707737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:08.708200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:08.708894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:08.709464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:08.709893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:08.851021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:08.859422 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-888470f2-b1a9-486e-8024-def1e58bf1b5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.165834 Oct 28 10:35:08.860015 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3441/6878] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:08 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:09.882374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:09.882944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:09.884988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:09.885689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:35:09.892855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:09.893793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:09.894556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:09.895624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:09.896113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:09.896932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:10.036322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:10.044639 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa19667c-7526-4bdd-8fe9-663a400704b7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.166410 Oct 28 10:35:10.045246 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3438/6879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:09 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:11.067993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:11.068575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:11.076203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:11.076704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:11.077176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:11.077948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:11.078416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:11.078853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:11.215268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:11.223002 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ee0b7e2-a538-489d-9eed-0a6815748844 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.159065 Oct 28 10:35:11.223577 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3442/6880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:11 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:12.245615 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:12.246338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:12.253412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:12.253992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:12.254518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:12.255300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:12.255848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:12.256382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:12.390406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:12.398260 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39caa140-f316-4676-b248-f9a8e2fba314 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.156455 Oct 28 10:35:12.398841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3439/6881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:12 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:13.422224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:13.422862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:13.429454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:13.429945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:13.430387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:13.431082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:13.431541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:13.431994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:13.570037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:13.578537 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c4d91c0c-1970-481a-a2f5-f3b618cead54 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.160114 Oct 28 10:35:13.579121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3443/6882] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:13 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:14.603119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:14.603782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:14.611116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:14.611617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:14.612066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:14.612792 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:14.613300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:14.613733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:14.754243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:14.763443 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dd51015c-62bd-4f6a-8b83-e2002ae1bf48 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.164081 Oct 28 10:35:14.764045 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3440/6883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:14 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:15.786880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:15.787591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:15.795545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:15.796041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:15.796485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:15.797222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:15.797715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:15.798148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:15.934240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:15.942101 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b1fd511-14e8-4f1b-8124-5001fc2df152 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.159255 Oct 28 10:35:15.942679 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3444/6884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:15 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:16.704949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c4750057-ed44-4bbc-b86d-f40d04e48f4d req-611c1607-bfa1-4438-9a87-7c44e999668b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9339f0d1-aaee-4726-aed8-5efb32bb1393", "name": "network-vif-plugged", "status": "completed", "tag": "7434a206-d450-4acc-afb2-bdb15200eeb3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:35:16.719811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c4750057-ed44-4bbc-b86d-f40d04e48f4d req-611c1607-bfa1-4438-9a87-7c44e999668b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:16.720324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c4750057-ed44-4bbc-b86d-f40d04e48f4d req-611c1607-bfa1-4438-9a87-7c44e999668b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:16.720776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c4750057-ed44-4bbc-b86d-f40d04e48f4d req-611c1607-bfa1-4438-9a87-7c44e999668b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:16.735527 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c4750057-ed44-4bbc-b86d-f40d04e48f4d req-611c1607-bfa1-4438-9a87-7c44e999668b service nova] Creating event network-vif-plugged:7434a206-d450-4acc-afb2-bdb15200eeb3 for instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 on n-h2-zed-1 Oct 28 10:35:16.741330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c4750057-ed44-4bbc-b86d-f40d04e48f4d req-611c1607-bfa1-4438-9a87-7c44e999668b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040442 Oct 28 10:35:16.741949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3441/6885] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:35:16.966317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:16.966903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:16.973928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:16.974421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:16.974864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:16.975584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:16.976044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:16.976474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:17.109895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:17.117820 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c586f86a-7ae5-4a78-a7d5-270787bec483 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.155967 Oct 28 10:35:17.118397 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3445/6886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:16 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:18.141738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:18.142467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:18.149771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:18.150918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:18.151380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:18.152119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:18.152595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:18.153071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:18.292217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:18.300459 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-13884141-d51f-4b61-9679-4387d9fe4167 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1264 microversion: 2.1 time: 0.162932 Oct 28 10:35:18.301264 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3442/6887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:18 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:19.324754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:19.325337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:19.332609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:19.333142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:19.333596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:19.334289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:19.334751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:19.335328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:19.472628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:19.481059 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72c4aaa7-a321-4212-ad0c-9603a1f62bf7 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1452 microversion: 2.1 time: 0.161242 Oct 28 10:35:19.481644 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3446/6888] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:19 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:19.504483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:35:19.505172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:35:19.512160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:19.512684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:19.513166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:19.513884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:19.514364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:19.514820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:19.656987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:35:19.665313 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0f4259b6-c6dd-4285-a369-7dc288477c6e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1452 microversion: 2.1 time: 0.164812 Oct 28 10:35:19.665911 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3443/6889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:35:19 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:35:21.453585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a56aec49-ffa4-4be7-99b3-f710b481fc9f req-52403f5e-21d3-42a3-a1e2-1336e30f0262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9339f0d1-aaee-4726-aed8-5efb32bb1393", "tag": "7434a206-d450-4acc-afb2-bdb15200eeb3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:35:21.464395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a56aec49-ffa4-4be7-99b3-f710b481fc9f req-52403f5e-21d3-42a3-a1e2-1336e30f0262 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:35:21.464881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a56aec49-ffa4-4be7-99b3-f710b481fc9f req-52403f5e-21d3-42a3-a1e2-1336e30f0262 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:35:21.465341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a56aec49-ffa4-4be7-99b3-f710b481fc9f req-52403f5e-21d3-42a3-a1e2-1336e30f0262 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:35:21.480254 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a56aec49-ffa4-4be7-99b3-f710b481fc9f req-52403f5e-21d3-42a3-a1e2-1336e30f0262 service nova] Creating event network-changed:7434a206-d450-4acc-afb2-bdb15200eeb3 for instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 on n-h2-zed-1 Oct 28 10:35:21.485354 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a56aec49-ffa4-4be7-99b3-f710b481fc9f req-52403f5e-21d3-42a3-a1e2-1336e30f0262 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035909 Oct 28 10:35:21.486137 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3447/6890] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:36:34.926248 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:36:34.926768 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 10:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 10:36:34.927353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:34.928115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=60 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:34.933868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-333165724", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:36:35.185018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] validate_networks() for None {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:36:35.374324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:36:35.374765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:36:35.375610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:36:35.376050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:36:35.376484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:36:35.385674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:35.386118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:35.386575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:35.387329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:35.387804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:35.388248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:35.404895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Getting quotas for project 628e90da965e40aabf219c6698e53e72. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:36:35.410200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Getting quotas for user 77ec81f5292f4d0da1df8f61adc9ef4c and project 628e90da965e40aabf219c6698e53e72. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:36:35.422970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:36:35.425494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:36:35.469614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-47897abf-3e86-4e45-a274-eacaa2803960 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545441 Oct 28 10:36:35.470309 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3444/6891] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:36:35.480612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=26 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:35.481546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=62 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:35.483303 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:36:35.483439 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:36:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf (ip 10.222.0.16) !!! Oct 28 10:36:35.490137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cc3e1545-5de2-4b93-8e39-6c50baa4d5fb tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:35.490844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cc3e1545-5de2-4b93-8e39-6c50baa4d5fb tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:35.652096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cc3e1545-5de2-4b93-8e39-6c50baa4d5fb tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:35.659570 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cc3e1545-5de2-4b93-8e39-6c50baa4d5fb tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1214 microversion: 2.1 time: 0.181848 Oct 28 10:36:35.660182 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3448/6892] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:35 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:36.683140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d5059172-9bbf-40e7-95b8-3805ce5d7bfd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:36.683776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d5059172-9bbf-40e7-95b8-3805ce5d7bfd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:36.738158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d5059172-9bbf-40e7-95b8-3805ce5d7bfd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:36.745226 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d5059172-9bbf-40e7-95b8-3805ce5d7bfd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1214 microversion: 2.1 time: 0.065955 Oct 28 10:36:36.745740 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3445/6893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:36 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:37.769301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15c3aa0d-7458-4ce4-abc3-57ed99cc244f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:37.769913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15c3aa0d-7458-4ce4-abc3-57ed99cc244f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:37.827117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15c3aa0d-7458-4ce4-abc3-57ed99cc244f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:37.834089 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15c3aa0d-7458-4ce4-abc3-57ed99cc244f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1214 microversion: 2.1 time: 0.068670 Oct 28 10:36:37.834657 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3449/6894] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:37 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:38.858614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c856a00-fa04-4ff8-914d-4ee5bdbbd242 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:38.859241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5c856a00-fa04-4ff8-914d-4ee5bdbbd242 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:38.914118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5c856a00-fa04-4ff8-914d-4ee5bdbbd242 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:38.921214 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c856a00-fa04-4ff8-914d-4ee5bdbbd242 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1214 microversion: 2.1 time: 0.066590 Oct 28 10:36:38.922330 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3446/6895] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:38 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:39.944705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:39.945358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:39.954311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:39.954883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:39.955770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:39.956534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:39.957013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:39.957487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:40.026052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:40.035339 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-16748e72-d80d-492e-b2ec-9975272048b4 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1272 microversion: 2.1 time: 0.095064 Oct 28 10:36:40.035945 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3450/6896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:39 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:41.058213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:41.058747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:41.067703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:41.068233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:41.068685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:41.069430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:41.069987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:41.070339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:41.310645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:41.318965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-024c00e2-4dd8-49ab-a408-e322e4e84a22 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.264840 Oct 28 10:36:41.319547 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3447/6897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:41 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:41.512358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-f8fe5650-fde6-4116-b987-4e270f6b2fc1 req-e59955aa-ecc4-4397-8d11-c091a94ea360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "180acf70-4104-490f-a32a-8e6b0a22cebf", "tag": "d04deaf8-704c-4ba9-9f8d-2472c4675a07"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:36:41.523636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f8fe5650-fde6-4116-b987-4e270f6b2fc1 req-e59955aa-ecc4-4397-8d11-c091a94ea360 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:41.524173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f8fe5650-fde6-4116-b987-4e270f6b2fc1 req-e59955aa-ecc4-4397-8d11-c091a94ea360 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:41.524982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-f8fe5650-fde6-4116-b987-4e270f6b2fc1 req-e59955aa-ecc4-4397-8d11-c091a94ea360 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:41.537301 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-f8fe5650-fde6-4116-b987-4e270f6b2fc1 req-e59955aa-ecc4-4397-8d11-c091a94ea360 service nova] Creating event network-changed:d04deaf8-704c-4ba9-9f8d-2472c4675a07 for instance 180acf70-4104-490f-a32a-8e6b0a22cebf on n-h1-zed-1 Oct 28 10:36:41.551921 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-f8fe5650-fde6-4116-b987-4e270f6b2fc1 req-e59955aa-ecc4-4397-8d11-c091a94ea360 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043420 Oct 28 10:36:41.552551 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3451/6898] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:36:42.342571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:42.343203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:42.350606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:42.351104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:42.351562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:42.352266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:42.352732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:42.353202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:42.481529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:42.489773 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af5f96aa-7b28-443d-8056-6ffc40dba4d0 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.151140 Oct 28 10:36:42.490346 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3448/6899] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:42 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:43.513167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:43.513867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:43.520626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:43.521224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:43.521661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:43.522359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:43.522819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:43.523247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:43.654859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:43.663514 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dfaf103-7f2b-4090-aae0-f71bb2f941b8 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.155391 Oct 28 10:36:43.664094 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3452/6900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:43 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:44.686620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:44.687243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:44.694068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:44.694559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:44.695007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:44.695703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:44.696167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:44.696602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:44.825102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:44.832698 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b4740d1e-3dca-4989-9147-4d9e87b15f62 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.150083 Oct 28 10:36:44.833304 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3449/6901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:44 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:45.856727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:45.857441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:45.865313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:45.865808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:45.866250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:45.866964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:45.867481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:45.867916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:45.997638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:46.005882 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64ffe230-1322-4667-944d-779ddbd07cb2 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.153218 Oct 28 10:36:46.006460 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3453/6902] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:45 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:47.028802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:47.029480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:47.031362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:47.037521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:47.038018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:47.038476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:47.039189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:47.039664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:47.040110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:47.170699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:47.179042 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e470936-a7c8-48fa-befa-8f4757335d1b tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.154187 Oct 28 10:36:47.179618 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3450/6903] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:47 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:48.202896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:48.204065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:48.206898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:48.212414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:48.212928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:48.213373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:48.214094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:48.214552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:48.214979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:48.350248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:48.358053 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-181eb4db-be22-4c12-b213-79ad61df861f tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.159303 Oct 28 10:36:48.358633 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3454/6904] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:48 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:48.415622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4f8a0fca-b08a-4f2a-b91e-0cc0a8a0a400 req-4a8d59cb-ada5-4b38-a017-06cdb33936a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180acf70-4104-490f-a32a-8e6b0a22cebf", "name": "network-vif-plugged", "status": "completed", "tag": "d04deaf8-704c-4ba9-9f8d-2472c4675a07"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:36:48.426269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4f8a0fca-b08a-4f2a-b91e-0cc0a8a0a400 req-4a8d59cb-ada5-4b38-a017-06cdb33936a6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:48.426847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4f8a0fca-b08a-4f2a-b91e-0cc0a8a0a400 req-4a8d59cb-ada5-4b38-a017-06cdb33936a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:48.427311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4f8a0fca-b08a-4f2a-b91e-0cc0a8a0a400 req-4a8d59cb-ada5-4b38-a017-06cdb33936a6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:48.442150 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4f8a0fca-b08a-4f2a-b91e-0cc0a8a0a400 req-4a8d59cb-ada5-4b38-a017-06cdb33936a6 service nova] Creating event network-vif-plugged:d04deaf8-704c-4ba9-9f8d-2472c4675a07 for instance 180acf70-4104-490f-a32a-8e6b0a22cebf on n-h1-zed-1 Oct 28 10:36:48.447232 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4f8a0fca-b08a-4f2a-b91e-0cc0a8a0a400 req-4a8d59cb-ada5-4b38-a017-06cdb33936a6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035381 Oct 28 10:36:48.447950 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3451/6905] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:36:49.380704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:49.381345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:49.388063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:49.388544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:49.389160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:49.389850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:49.390302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:49.391357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:49.521152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:49.528997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08f28d1e-8b42-4586-949a-5a03702ced66 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1314 microversion: 2.1 time: 0.152189 Oct 28 10:36:49.529577 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3455/6906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:49 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:50.548898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:36:50.554100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:50.554848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:50.561336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:50.561840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:50.562304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:50.563564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:50.564037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:50.564479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:50.698021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:50.706684 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb19d777-9398-4952-ae80-8fa3f8bcec0e tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1463 microversion: 2.1 time: 0.158748 Oct 28 10:36:50.707265 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3452/6907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:50 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:50.752777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:50.753343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:50.759990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:50.760473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:50.760930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:50.761624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:50.762077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:50.762507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:50.788336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:36:50.867430 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02b47dfc-8243-4821-a801-5b68cb0c08e3 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 204 len: 0 microversion: 2.1 time: 0.118432 Oct 28 10:36:50.868289 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3456/6908] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:36:50 2022] DELETE /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:36:50.876847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:50.877511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:50.884032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:50.884564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:50.885059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:50.885776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:50.886252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:50.886707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:51.017134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:51.024894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ea86d8d-de05-46f3-921c-a4b7ace70315 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1469 microversion: 2.1 time: 0.152479 Oct 28 10:36:51.025485 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3453/6909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:50 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1469 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:36:52.048813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:52.049556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:52.056440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:52.056965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:52.057435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:52.058129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:52.058588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:52.059018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:52.190996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:52.199022 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a995f926-326c-41cb-8744-97a969916f08 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1469 microversion: 2.1 time: 0.155148 Oct 28 10:36:52.199871 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3457/6910] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:52 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:53.036053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6892552c-9b9d-4202-be2c-f39b7b40f018 req-d7af080f-0281-4e23-b806-131d982b5eba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "180acf70-4104-490f-a32a-8e6b0a22cebf", "name": "network-vif-deleted", "tag": "d04deaf8-704c-4ba9-9f8d-2472c4675a07"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:36:53.048128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6892552c-9b9d-4202-be2c-f39b7b40f018 req-d7af080f-0281-4e23-b806-131d982b5eba service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:53.048635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6892552c-9b9d-4202-be2c-f39b7b40f018 req-d7af080f-0281-4e23-b806-131d982b5eba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:53.049113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6892552c-9b9d-4202-be2c-f39b7b40f018 req-d7af080f-0281-4e23-b806-131d982b5eba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:53.063666 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6892552c-9b9d-4202-be2c-f39b7b40f018 req-d7af080f-0281-4e23-b806-131d982b5eba service nova] Creating event network-vif-deleted:d04deaf8-704c-4ba9-9f8d-2472c4675a07 for instance 180acf70-4104-490f-a32a-8e6b0a22cebf on n-h1-zed-1 Oct 28 10:36:53.068812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6892552c-9b9d-4202-be2c-f39b7b40f018 req-d7af080f-0281-4e23-b806-131d982b5eba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036498 Oct 28 10:36:53.069859 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3454/6911] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:36:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:36:53.222180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:53.222794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:53.229957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:53.230459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:53.230883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:53.231573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:53.232030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:53.232458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:53.265766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:53.266396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:53.266840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:53.267286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lazy-loading 'fault' on Instance uuid 180acf70-4104-490f-a32a-8e6b0a22cebf {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:36:53.307177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77ec81f5292f4d0da1df8f61adc9ef4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628e90da965e40aabf219c6698e53e72', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:36:53.315530 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-977d42e8-b75a-4f7e-8238-8d52965b73c1 tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 200 len: 1304 microversion: 2.1 time: 0.097333 Oct 28 10:36:53.316106 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3458/6912] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:53 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:36:54.340879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:36:54.341627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] [instance: 180acf70-4104-490f-a32a-8e6b0a22cebf] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:36:54.347793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:54.348298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:54.348755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:54.349497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:36:54.349972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:36:54.350415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:36:54.363921 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] HTTP exception thrown: Instance 180acf70-4104-490f-a32a-8e6b0a22cebf could not be found. Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Request method failure captured: Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf HTTP/1.1 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7CxvKXdFTfe9E5z0P3ffHjKIM_jH27ubC-BsdB6gb7KLuK01tfHWjiHDymQT3kGC_Bb1hMSLI4GUrn_oblQkGJWneuBLjn0Ih8jHeEFfLyRm0ePcO3hjO0xTQ54Mx1CNlTECe44AyRxUUJ6ctRd6LtcfpVT1idVfolJEDO4rBRHwG0 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 628e90da965e40aabf219c6698e53e72 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-VolumesNegativeTest-341438978 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/628e90da965e40aabf219c6698e53e72"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/628e90da965e40aabf219c6698e53e72"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_628e90da965e40aabf219c6698e53e72", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/628e90da965e40aabf219c6698e53e72"}]}] Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-VolumesNegativeTest-341438978 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 628e90da965e40aabf219c6698e53e72 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-VolumesNegativeTest-341438978 Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-VolumesNegativeTest-341438978-project Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 77ec81f5292f4d0da1df8f61adc9ef4c Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-VolumesNegativeTest-341438978-project Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 180acf70-4104-490f-a32a-8e6b0a22cebf could not be found. Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '180acf70-4104-490f-a32a-8e6b0a22cebf'} Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 180acf70-4104-490f-a32a-8e6b0a22cebf could not be found. Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 180acf70-4104-490f-a32a-8e6b0a22cebf could not be found. Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:36:54.365637 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 180acf70-4104-490f-a32a-8e6b0a22cebf could not be found. Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] Returning 404 to user: Instance 180acf70-4104-490f-a32a-8e6b0a22cebf could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76c60550-1532-4867-9d0c-1b1b24cd27cd tempest-VolumesNegativeTest-341438978 tempest-VolumesNegativeTest-341438978-project] 10.222.0.16 "GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf" status: 404 len: 111 microversion: 2.1 time: 0.031434 Oct 28 10:36:54.370745 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3455/6913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:36:54 2022] GET /compute/v2.1/servers/180acf70-4104-490f-a32a-8e6b0a22cebf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:37:17.334440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:17.335367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:17.513681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:17.514259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:17.521015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:17.521571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:17.522039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:17.522806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:17.523330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:17.523840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:17.551106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:37:17.631970 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd10fa41-c0b5-4695-9d76-586ad88acd34 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 204 len: 0 microversion: 2.1 time: 0.302598 Oct 28 10:37:17.633691 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3459/6914] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:37:17 2022] DELETE /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:37:17.642572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:17.643196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:17.646137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:17.646929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=44 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:17.653358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:17.653857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:17.654306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:17.655014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:17.655473 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:17.655910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:17.797826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:17.805655 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a369e707-2a75-4ade-87f3-e99e1bddc70f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1577 microversion: 2.1 time: 0.167745 Oct 28 10:37:17.806600 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3456/6915] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:17 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:18.830988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:18.831810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:18.839109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:18.840327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:18.840782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:18.841530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:18.841998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:18.842429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:18.995623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:19.003466 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-628c324a-6942-42df-be25-11ad8c12822e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1577 microversion: 2.1 time: 0.177523 Oct 28 10:37:19.004051 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3460/6916] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:18 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:20.027876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:20.028625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:20.036345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:20.037036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:20.037583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:20.038373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:20.039017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:20.039456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:20.339676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:20.348457 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2ca8f12f-d6e9-4089-9c15-7c576f79e88c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1577 microversion: 2.1 time: 0.324589 Oct 28 10:37:20.349258 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3457/6917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:20 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1577 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:20.856894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-9b563e29-12ea-4b0b-a1ee-925c4f30a2dd req-e7579573-3a3c-4f1a-aaf3-e68d4044a1fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9339f0d1-aaee-4726-aed8-5efb32bb1393", "name": "network-vif-deleted", "tag": "7434a206-d450-4acc-afb2-bdb15200eeb3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:20.869058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9b563e29-12ea-4b0b-a1ee-925c4f30a2dd req-e7579573-3a3c-4f1a-aaf3-e68d4044a1fd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:20.869058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9b563e29-12ea-4b0b-a1ee-925c4f30a2dd req-e7579573-3a3c-4f1a-aaf3-e68d4044a1fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:20.869632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9b563e29-12ea-4b0b-a1ee-925c4f30a2dd req-e7579573-3a3c-4f1a-aaf3-e68d4044a1fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:20.886765 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-9b563e29-12ea-4b0b-a1ee-925c4f30a2dd req-e7579573-3a3c-4f1a-aaf3-e68d4044a1fd service nova] Creating event network-vif-deleted:7434a206-d450-4acc-afb2-bdb15200eeb3 for instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 on n-h2-zed-1 Oct 28 10:37:20.893049 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-9b563e29-12ea-4b0b-a1ee-925c4f30a2dd req-e7579573-3a3c-4f1a-aaf3-e68d4044a1fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218295 Oct 28 10:37:20.893777 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3461/6918] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:37:21.373064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:21.375801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:21.390192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:21.390842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:21.391384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:21.392214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:21.392770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:21.393320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:21.464482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:21.474020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0691c547-e23d-4cc0-b0cc-c6f0b32e734a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1224 microversion: 2.1 time: 0.106138 Oct 28 10:37:21.475335 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3458/6919] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:21 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:22.501936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:22.502837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:22.511262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:22.511898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:22.512614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:22.513606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:22.514318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:22.515358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:22.602155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:22.611550 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f20fe8c6-685d-435b-8c03-5b680eda2ae5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1224 microversion: 2.1 time: 0.115641 Oct 28 10:37:22.611897 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3462/6920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:22 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1224 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:23.639969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:23.641302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:23.655964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:23.656870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:23.657603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:23.661157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:23.664597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:23.665190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:23.870862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:23.881398 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d1b69d5a-aae7-45ed-822f-e1cbef84e72c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1224 microversion: 2.1 time: 0.246934 Oct 28 10:37:23.905215 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3459/6921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:23 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1224 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:24.931072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:24.931495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:24.949438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:24.952156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:24.952797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:24.957923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:24.958270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:24.958913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:25.102567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:25.111495 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-205eab59-e055-4f5c-85e6-741eab8e555d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1224 microversion: 2.1 time: 0.195023 Oct 28 10:37:25.112104 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3463/6922] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:24 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1224 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:26.136829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:26.138368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:26.146493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:26.147633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:26.148538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:26.149844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:26.150503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:26.151130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:26.206892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:26.207355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:26.208177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:26.208665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lazy-loading 'fault' on Instance uuid 9339f0d1-aaee-4726-aed8-5efb32bb1393 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:37:26.308482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:26.320211 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b620a85-b1f6-4952-9207-3b91d05c3e86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 200 len: 1229 microversion: 2.1 time: 0.188043 Oct 28 10:37:26.332877 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3460/6923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:26 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 1229 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:26.731012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bbef3144-f26f-4996-9e94-e14e0a897908 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'create', calling method: .version_select at 0x7fca322da3a0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2134623130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaxRP46uhBbpVQiLDJn22lrz2Qyc+Fjds/tGxcqmMdUIshqX5ZSgA8pyqSvMBWgQ+X4Bl+0O6I2t0grmI8C1TQO2tEiMvuxHIDRdjPtNLzo15IfAUUAqJQsldygyUZYvw=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:26.748039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bbef3144-f26f-4996-9e94-e14e0a897908 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for project a485e438f2354f7a8debf470aa4175b2. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:37:26.753996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-bbef3144-f26f-4996-9e94-e14e0a897908 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for user e2c2a85ee08f4159afe534bc318b2ca4 and project a485e438f2354f7a8debf470aa4175b2. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:37:26.767365 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [None req-bbef3144-f26f-4996-9e94-e14e0a897908 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [2330d91e-2023-421e-b116-bc73d1f9a12b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 10:37:27.347244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:27.348415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:27.354994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:27.355572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:27.356102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:27.356845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:27.357328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:27.357780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:27.371765 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 HTTP/1.1 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '9339f0d1-aaee-4726-aed8-5efb32bb1393'} Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:37:27.373510 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6af42046-02c4-470e-bfa8-2cb05dc6ae21 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 404 len: 111 microversion: 2.1 time: 0.032167 Oct 28 10:37:27.379381 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3461/6924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:27 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:37:27.486851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-796256459", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-351906278", "security_groups": [{"name": "tempest-secgroup-smoke-287004008"}], "block_device_mapping_v2": [{"uuid": "cd87678b-ddff-4996-986e-24650f11a11b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:27.613071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:37:27.775409 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [None req-bbef3144-f26f-4996-9e94-e14e0a897908 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [2330d91e-2023-421e-b116-bc73d1f9a12b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59472. Oct 28 10:37:27.794858 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bbef3144-f26f-4996-9e94-e14e0a897908 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.067709 Oct 28 10:37:27.795794 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3464/6925] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:37:26 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:37:28.167118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:37:28.168189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:37:28.169229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:37:28.170103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:37:28.170955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:37:28.187076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:28.191381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:28.192611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:28.195370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:28.197756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:28.198427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:28.225035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:37:28.232294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:37:28.310168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:37:28.313189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cd87678b-ddff-4996-986e-24650f11a11b',volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:37:28.462452 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f57853b4-9f4c-4ae9-85c1-efceb81e6192 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.979882 Oct 28 10:37:28.470499 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3462/6926] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:37:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:37:28.483032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8b4ed68-8d39-499d-b316-6427ee24f076 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:28.483806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8b4ed68-8d39-499d-b316-6427ee24f076 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:28.551479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8b4ed68-8d39-499d-b316-6427ee24f076 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:28.560040 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8b4ed68-8d39-499d-b316-6427ee24f076 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1093 microversion: 2.1 time: 0.088477 Oct 28 10:37:28.561179 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3465/6927] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:28 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1093 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:29.028883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-702623741", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "ca0b3ad2-5574-4647-8221-f9d9216fe031"}], "key_name": "tempest-TestNetworkBasicOps-2134623130", "security_groups": [{"name": "tempest-secgroup-smoke-1087483495"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:29.146156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] validate_networks() for [('ca0b3ad2-5574-4647-8221-f9d9216fe031', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:37:29.575154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:37:29.576345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:37:29.577262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:37:29.577715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:37:29.578803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:37:29.584680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:29.585325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:29.594850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:29.595570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:29.596198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:29.596942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:29.597575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:29.598213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:29.610260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:29.610813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:29.611283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:29.612037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:29.612516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:29.613050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:29.650428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for project a485e438f2354f7a8debf470aa4175b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:37:29.656778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for user e2c2a85ee08f4159afe534bc318b2ca4 and project a485e438f2354f7a8debf470aa4175b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:37:29.674969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:37:29.677392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:37:29.680210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:29.691328 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-58b4d065-0689-4194-adc9-4b7257ffef15 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1191 microversion: 2.1 time: 0.110375 Oct 28 10:37:29.700602 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3466/6928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:29 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1191 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:37:29.742088 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b875a585-3057-4816-80bd-6c27b2a05152 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.716943 Oct 28 10:37:29.749529 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3463/6929] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:37:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:37:29.754545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07a8b0da-acc7-4b3b-b06d-a78bb76325f2 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:29.755389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07a8b0da-acc7-4b3b-b06d-a78bb76325f2 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:29.844612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07a8b0da-acc7-4b3b-b06d-a78bb76325f2 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:29.853213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07a8b0da-acc7-4b3b-b06d-a78bb76325f2 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1248 microversion: 2.1 time: 0.102926 Oct 28 10:37:29.854022 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3467/6930] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:29 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1248 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:37:30.717364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:30.717986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:30.728378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:30.729197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:30.729850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:30.730761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:30.731412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:30.732065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:30.876058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:30.876685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:30.886530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:30.887031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:30.889411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:30.891228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:30.891947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:30.893716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:30.975869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:30.985881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8bdd1719-4dbc-46f1-8aec-4cc763d327d8 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1300 microversion: 2.1 time: 0.113822 Oct 28 10:37:30.986791 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3468/6931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:30 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1300 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:31.494963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:31.506214 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-10c867ab-35d4-403b-b92a-8a8e76103143 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1276 microversion: 2.1 time: 0.793861 Oct 28 10:37:31.507504 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3464/6932] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:30 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1276 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:32.010308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:32.010923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:32.018744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:32.019237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:32.019684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:32.020389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:32.020849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:32.021484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:32.169084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e650466f-050c-4f28-83e2-afa910b7cd10 req-eede23f5-40a3-4545-a1bf-b5f531cd44ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85adddd-047a-4bc9-885a-010eff9accce", "tag": "6cb413d3-a3d7-482a-8018-7404a4a47c5a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:32.169084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e650466f-050c-4f28-83e2-afa910b7cd10 req-eede23f5-40a3-4545-a1bf-b5f531cd44ef service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:32.169084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e650466f-050c-4f28-83e2-afa910b7cd10 req-eede23f5-40a3-4545-a1bf-b5f531cd44ef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:32.169084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e650466f-050c-4f28-83e2-afa910b7cd10 req-eede23f5-40a3-4545-a1bf-b5f531cd44ef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:32.170409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:32.170409 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8b390225-cf35-42de-8905-b7e04ce9424c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1306 microversion: 2.1 time: 0.139743 Oct 28 10:37:32.170409 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3469/6933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:32 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1306 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:32.170808 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e650466f-050c-4f28-83e2-afa910b7cd10 req-eede23f5-40a3-4545-a1bf-b5f531cd44ef service nova] Creating event network-changed:6cb413d3-a3d7-482a-8018-7404a4a47c5a for instance c85adddd-047a-4bc9-885a-010eff9accce on n-h2-zed-1 Oct 28 10:37:32.174511 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e650466f-050c-4f28-83e2-afa910b7cd10 req-eede23f5-40a3-4545-a1bf-b5f531cd44ef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088566 Oct 28 10:37:32.176305 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3465/6934] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:37:32.530198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:32.531722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:32.537912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:32.538522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:32.539086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:32.539893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:32.540459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:32.541137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:32.698914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:32.710502 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-876b3e90-855f-4344-9442-71dbd161629f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1276 microversion: 2.1 time: 0.184011 Oct 28 10:37:32.718214 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3470/6935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:32 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:37:33.180929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:33.182310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:33.189469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:33.190147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:33.191283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:33.191475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:33.192040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:33.192732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:33.523584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:33.532169 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c471dca2-1896-474a-9375-34dbd50a8545 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.357259 Oct 28 10:37:33.532767 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3466/6936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:33 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:33.736377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:33.737964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:33.746280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:33.747313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:33.748215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:33.749198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:33.749806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:33.750407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:33.905747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:33.915006 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12941777-90e4-4529-a3d0-43bc8fbb8404 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1276 microversion: 2.1 time: 0.183841 Oct 28 10:37:33.927479 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3471/6937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:33 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1276 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:34.193725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0b79af49-21ef-4d9e-954f-cc49a3e7defe req-8c9ccdab-7b4c-440d-b04b-13f4f7cf3928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3a277f-41b0-4783-addc-67030f8b16da", "tag": "5a2ca391-5c68-450a-b08b-364d9c2c3b84"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:34.205601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0b79af49-21ef-4d9e-954f-cc49a3e7defe req-8c9ccdab-7b4c-440d-b04b-13f4f7cf3928 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:34.206134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0b79af49-21ef-4d9e-954f-cc49a3e7defe req-8c9ccdab-7b4c-440d-b04b-13f4f7cf3928 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:34.206585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0b79af49-21ef-4d9e-954f-cc49a3e7defe req-8c9ccdab-7b4c-440d-b04b-13f4f7cf3928 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:34.219974 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0b79af49-21ef-4d9e-954f-cc49a3e7defe req-8c9ccdab-7b4c-440d-b04b-13f4f7cf3928 service nova] Creating event network-changed:5a2ca391-5c68-450a-b08b-364d9c2c3b84 for instance 0b3a277f-41b0-4783-addc-67030f8b16da on n-h1-zed-1 Oct 28 10:37:34.225271 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0b79af49-21ef-4d9e-954f-cc49a3e7defe req-8c9ccdab-7b4c-440d-b04b-13f4f7cf3928 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035408 Oct 28 10:37:34.225874 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3467/6938] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:37:34.555652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:34.556355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:34.563021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:34.563712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:34.564147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:34.564838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:34.565326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:34.565750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:34.709643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:34.717970 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f4c5a9a-01b6-44dd-8518-68b46c9d9b4d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.166059 Oct 28 10:37:34.718598 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3472/6939] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:34 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:37:34.940726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:34.941481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:34.947658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:34.948151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:34.949064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:34.949421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:34.950150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:34.950590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:35.086781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:35.095152 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bbdf5cc0-03b8-4493-b5b7-1ea21c15cefa tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1276 microversion: 2.1 time: 0.158634 Oct 28 10:37:35.095739 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3468/6940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:34 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:35.740488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:35.741185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:35.748196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:35.748690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:35.749156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:35.750404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:35.750893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:35.751465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:35.887250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:35.895633 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a591ba33-911e-4f30-accf-79c4a52d17ba tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.159120 Oct 28 10:37:35.896232 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3473/6941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:35 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:36.120024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:36.120648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:36.128070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:36.128565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:36.129047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:36.129746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:36.130207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:36.130640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:36.262272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:36.270113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c83fd675-5c90-4583-bc58-568329ab47fc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.154796 Oct 28 10:37:36.270690 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3469/6942] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:36 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:36.918385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:36.919045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:36.925991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:36.926519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:36.926964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:36.927671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:36.928296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:36.928555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:37.058408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:37.066595 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a171540-9d82-4d3c-85a9-8ad5a761b11a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.152071 Oct 28 10:37:37.067179 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3474/6943] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:36 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:37.293944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:37.294558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:37.301380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:37.301885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:37.302345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:37.303064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:37.303536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:37.303980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:37.432586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:37.441248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0760058a-beb1-4da7-a633-224862ef85bb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.151367 Oct 28 10:37:37.441818 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3470/6944] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:37 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:38.090441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:38.091072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:38.098892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:38.099385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:38.099827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:38.100520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:38.101024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:38.101454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:38.236560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:38.244212 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c967bb1c-e4a6-45b0-950f-aadfe13651bd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.157722 Oct 28 10:37:38.244787 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3475/6945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:38 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:38.463809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:38.464401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:38.472096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:38.472603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:38.473102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:38.473826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:38.474303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:38.474749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:38.611504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:38.619149 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ebef024-212f-4334-a364-1b2737c4f282 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.159374 Oct 28 10:37:38.619723 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3471/6946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:38 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:39.267846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:39.268388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:39.275260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:39.275751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:39.276197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:39.276920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:39.277506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:39.277941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:39.410249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:39.417857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a1d6abe9-c5c5-4d02-a89f-a27d15c4afcd tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.154032 Oct 28 10:37:39.418439 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3476/6947] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:39 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:39.643525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:39.644161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:39.647173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:39.653186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:39.653698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:39.654160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:39.654885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:39.655363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:39.655809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:39.671290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:39.786614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:39.794458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5de741f1-5af4-418d-a22a-d5a4f7873725 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.155339 Oct 28 10:37:39.795037 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3472/6948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:39 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:40.441894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:40.442513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:40.444482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:40.450867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:40.451358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:40.451801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:40.452494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:40.453136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:40.453608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:40.471779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:40.589163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:40.597451 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08c5c319-d965-48fd-80d0-e8f82483f943 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.159843 Oct 28 10:37:40.606385 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3477/6949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:40 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:40.747822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1aba9fd1-b3b1-415f-8033-2ad0c48663ee req-c1d79457-6f81-4a49-bb99-c18e14ee278d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3a277f-41b0-4783-addc-67030f8b16da", "name": "network-vif-plugged", "status": "completed", "tag": "5a2ca391-5c68-450a-b08b-364d9c2c3b84"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:40.758243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1aba9fd1-b3b1-415f-8033-2ad0c48663ee req-c1d79457-6f81-4a49-bb99-c18e14ee278d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:40.758742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1aba9fd1-b3b1-415f-8033-2ad0c48663ee req-c1d79457-6f81-4a49-bb99-c18e14ee278d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:40.759188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1aba9fd1-b3b1-415f-8033-2ad0c48663ee req-c1d79457-6f81-4a49-bb99-c18e14ee278d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:40.773297 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1aba9fd1-b3b1-415f-8033-2ad0c48663ee req-c1d79457-6f81-4a49-bb99-c18e14ee278d service nova] Creating event network-vif-plugged:5a2ca391-5c68-450a-b08b-364d9c2c3b84 for instance 0b3a277f-41b0-4783-addc-67030f8b16da on n-h1-zed-1 Oct 28 10:37:40.778482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1aba9fd1-b3b1-415f-8033-2ad0c48663ee req-c1d79457-6f81-4a49-bb99-c18e14ee278d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102626 Oct 28 10:37:40.779075 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3473/6950] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:37:40.818308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:40.818929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:40.825419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:40.826362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:40.826827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:40.827524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:40.827982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:40.828413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:40.969631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:40.977357 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5d64496-9577-48b3-8bb0-454b307add00 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.163645 Oct 28 10:37:40.977871 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3478/6951] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:40 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:41.621220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:41.621944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:41.628793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:41.629331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:41.629791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:41.630509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:41.630988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:41.631432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:41.761793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:41.770307 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4fadfd09-930d-4113-abcc-1f96bcd1edb9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1374 microversion: 2.1 time: 0.153432 Oct 28 10:37:41.770869 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3474/6952] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:41 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:42.000515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:42.001172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:42.008006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:42.008497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:42.008978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:42.009692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:42.010137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:42.010570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:42.144159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:42.151925 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2d51c4d7-c1dc-4805-9233-1b3a870bd16c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.156101 Oct 28 10:37:42.152502 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3479/6953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:41 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:42.792973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:42.793526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:42.801172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:42.801678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:42.802135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:42.802849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:42.803321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:42.803765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:42.939496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:42.947188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93b7959e-0735-4af4-9cc4-0276d6f2e65c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1546 microversion: 2.1 time: 0.158293 Oct 28 10:37:42.947760 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3475/6954] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:42 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:42.969494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:42.970114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:42.976276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:42.976758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:42.977232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:42.977912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:42.978365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:42.978786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:43.126532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:43.134590 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5f85c7d-db29-4739-8426-0f6c67d344d4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1546 microversion: 2.1 time: 0.168926 Oct 28 10:37:43.135159 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3480/6955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:42 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:43.174565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:43.175199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:43.181425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:43.181934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:43.182420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:43.183136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:43.183608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:43.184057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:43.188823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=100 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:43.731837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:43.740178 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec98bdfb-e201-432d-81e7-db13b212b7f8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.569542 Oct 28 10:37:43.740813 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3476/6956] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:43 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:44.763301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:44.764035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:44.771006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:44.771570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:44.772078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:44.772877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:44.773427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:44.773946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:44.908969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:44.916924 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8b34c68-0b67-4b29-a6c9-0318b0bb95fd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.157534 Oct 28 10:37:44.917522 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3481/6957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:44 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:45.136723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6005a716-ac9d-48b0-b89b-de049e578a13 req-ef91dac4-5b9d-4b59-a546-5ea63d1ffef4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3a277f-41b0-4783-addc-67030f8b16da", "tag": "5a2ca391-5c68-450a-b08b-364d9c2c3b84"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:45.146174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6005a716-ac9d-48b0-b89b-de049e578a13 req-ef91dac4-5b9d-4b59-a546-5ea63d1ffef4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:45.146663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6005a716-ac9d-48b0-b89b-de049e578a13 req-ef91dac4-5b9d-4b59-a546-5ea63d1ffef4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:45.147107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6005a716-ac9d-48b0-b89b-de049e578a13 req-ef91dac4-5b9d-4b59-a546-5ea63d1ffef4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:45.159373 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6005a716-ac9d-48b0-b89b-de049e578a13 req-ef91dac4-5b9d-4b59-a546-5ea63d1ffef4 service nova] Creating event network-changed:5a2ca391-5c68-450a-b08b-364d9c2c3b84 for instance 0b3a277f-41b0-4783-addc-67030f8b16da on n-h1-zed-1 Oct 28 10:37:45.164495 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6005a716-ac9d-48b0-b89b-de049e578a13 req-ef91dac4-5b9d-4b59-a546-5ea63d1ffef4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032896 Oct 28 10:37:45.165151 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3477/6958] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:37:45.465432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-7184bbf8-13c1-4dc4-a732-ccdefc619249 req-26116817-f53d-4a09-9852-9e0ae878f27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85adddd-047a-4bc9-885a-010eff9accce", "name": "network-vif-plugged", "status": "completed", "tag": "6cb413d3-a3d7-482a-8018-7404a4a47c5a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:45.483545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7184bbf8-13c1-4dc4-a732-ccdefc619249 req-26116817-f53d-4a09-9852-9e0ae878f27e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:45.484673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7184bbf8-13c1-4dc4-a732-ccdefc619249 req-26116817-f53d-4a09-9852-9e0ae878f27e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:45.485204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-7184bbf8-13c1-4dc4-a732-ccdefc619249 req-26116817-f53d-4a09-9852-9e0ae878f27e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:45.499219 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-7184bbf8-13c1-4dc4-a732-ccdefc619249 req-26116817-f53d-4a09-9852-9e0ae878f27e service nova] Creating event network-vif-plugged:6cb413d3-a3d7-482a-8018-7404a4a47c5a for instance c85adddd-047a-4bc9-885a-010eff9accce on n-h2-zed-1 Oct 28 10:37:45.507902 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-7184bbf8-13c1-4dc4-a732-ccdefc619249 req-26116817-f53d-4a09-9852-9e0ae878f27e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049670 Oct 28 10:37:45.509409 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3482/6959] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:37:45.941326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:45.942044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:45.948378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:45.948880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:45.949354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:45.950336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:45.950804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:45.951413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:46.097026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:46.105008 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e874c88-4bc4-4f8e-ad21-17a5668c6fef tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.168545 Oct 28 10:37:46.105632 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3478/6960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:45 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:47.128771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:47.129530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:47.138130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:47.138616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:47.139060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:47.139759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:47.140275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:47.141283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:47.283427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:47.291330 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-38f930e6-5f95-4be7-aeed-a862de55f445 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1264 microversion: 2.1 time: 0.167353 Oct 28 10:37:47.291980 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3483/6961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:47 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:48.314954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:48.315584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:48.318454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:48.324006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:48.324530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:48.325017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:48.325978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:48.326447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:48.326897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:48.457343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:48.465123 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56ae0126-d479-4ef2-b3d9-6fcdd6726c88 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1452 microversion: 2.1 time: 0.154554 Oct 28 10:37:48.465694 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3479/6962] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:48 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:48.487001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:37:48.487612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:37:48.490479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:37:48.495583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:48.496066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:48.496506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:48.497219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:48.497673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:48.498097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:48.632126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:37:48.639881 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-768496c9-2c72-4313-8fe2-96793af3fa04 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1452 microversion: 2.1 time: 0.156718 Oct 28 10:37:48.641121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3484/6963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:37:48 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:37:50.204481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-75d4e744-d6b2-4607-a8af-f43debd0e9c6 req-80290887-9656-4aae-a074-ebc0bbc5b791 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85adddd-047a-4bc9-885a-010eff9accce", "tag": "6cb413d3-a3d7-482a-8018-7404a4a47c5a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:37:50.214919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-75d4e744-d6b2-4607-a8af-f43debd0e9c6 req-80290887-9656-4aae-a074-ebc0bbc5b791 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:37:50.215417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-75d4e744-d6b2-4607-a8af-f43debd0e9c6 req-80290887-9656-4aae-a074-ebc0bbc5b791 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:37:50.215867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-75d4e744-d6b2-4607-a8af-f43debd0e9c6 req-80290887-9656-4aae-a074-ebc0bbc5b791 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:37:50.228347 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-75d4e744-d6b2-4607-a8af-f43debd0e9c6 req-80290887-9656-4aae-a074-ebc0bbc5b791 service nova] Creating event network-changed:6cb413d3-a3d7-482a-8018-7404a4a47c5a for instance c85adddd-047a-4bc9-885a-010eff9accce on n-h2-zed-1 Oct 28 10:37:50.233397 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-75d4e744-d6b2-4607-a8af-f43debd0e9c6 req-80290887-9656-4aae-a074-ebc0bbc5b791 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033349 Oct 28 10:37:50.234197 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3480/6964] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:37:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:38:07.423247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:38:07.426071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:07.428527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:07.429364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:07.435224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:07.435726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:07.436176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:07.436887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:07.437377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:07.437815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:07.508615 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dd7c6b10-9983-4607-8281-e2236e444953 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da/action" status: 200 len: 24559 microversion: 2.1 time: 0.089206 Oct 28 10:38:07.509293 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3485/6965] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:38:07 2022] POST /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da/action => generated 24559 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 28 10:38:19.667986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:19.669039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=20 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:19.674228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b91c3faa-db13-4dd7-af16-776461b7f164 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'create', calling method: .version_select at 0x7fca3296cca0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-2002776788", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAxWn0pOHUxB2PxUhjZFkl//RYMP8CdFKWo7G6wJOi7T9A2ptWOnySC1R0ECMUDZik2wIug9A3nELk9DGmpwfAppzo8twMlHd6b3lck8TOWjmrLDDtgonXPu6hkFSfMCA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:38:19.692374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b91c3faa-db13-4dd7-af16-776461b7f164 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for project a485e438f2354f7a8debf470aa4175b2. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:38:19.697644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b91c3faa-db13-4dd7-af16-776461b7f164 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for user e2c2a85ee08f4159afe534bc318b2ca4 and project a485e438f2354f7a8debf470aa4175b2. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:38:19.726913 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b91c3faa-db13-4dd7-af16-776461b7f164 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.060928 Oct 28 10:38:19.727944 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3481/6966] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:38:19 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:38:20.786211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-831713926", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "9ee9d6b4-12ea-49a4-806f-1d8fd8ec94bc"}], "key_name": "tempest-TestNetworkBasicOps-2002776788", "security_groups": [{"name": "tempest-secgroup-smoke-1599559531"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:38:20.797358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:20.798039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:20.906505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] validate_networks() for [('9ee9d6b4-12ea-49a4-806f-1d8fd8ec94bc', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:38:21.381931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:38:21.382368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:38:21.382845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:38:21.383266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:38:21.384252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:38:21.394538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:21.395140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:21.395537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:21.396280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:21.396934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:21.397465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:21.414892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for project a485e438f2354f7a8debf470aa4175b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:38:21.420300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for user e2c2a85ee08f4159afe534bc318b2ca4 and project a485e438f2354f7a8debf470aa4175b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:38:21.433446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:38:21.435989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:38:21.484964 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9af97c58-414b-4c05-9265-f0b4e4c39db0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.703128 Oct 28 10:38:21.485925 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3486/6967] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:38:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:38:21.497407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0e1d4349-5d16-468f-94e4-f84c728e862d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:21.498736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0e1d4349-5d16-468f-94e4-f84c728e862d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:21.560129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0e1d4349-5d16-468f-94e4-f84c728e862d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:21.570020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0e1d4349-5d16-468f-94e4-f84c728e862d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1248 microversion: 2.1 time: 0.076392 Oct 28 10:38:21.572680 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3482/6968] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:21 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1248 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:22.598466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:22.599077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:22.606125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:22.606607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:22.607045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:22.607731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:22.608184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:22.608605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:22.670995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:22.679856 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e22f595c-d10e-4ce6-8fc3-21e2b44219bb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1300 microversion: 2.1 time: 0.086626 Oct 28 10:38:22.680438 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3487/6969] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:22 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:23.703355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:23.704625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:23.712573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:23.713532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:23.714196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:23.715154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:23.715847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:23.716493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:23.973931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:23.983399 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d39a3d1c-6d3a-4412-93c5-8a9d2758344f tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.283426 Oct 28 10:38:23.984293 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3483/6970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:23 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:24.306920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-68982d8f-63b6-49ae-96e3-06078e7c64b1 req-9c77214c-8184-40e6-bb01-33b7ada863ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b812bad-9186-4cd7-88d6-e1b09a49eb5e", "tag": "b688c7f5-76ee-43db-8c91-f2a27fcd527f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:38:24.320020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-68982d8f-63b6-49ae-96e3-06078e7c64b1 req-9c77214c-8184-40e6-bb01-33b7ada863ab service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:24.320805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-68982d8f-63b6-49ae-96e3-06078e7c64b1 req-9c77214c-8184-40e6-bb01-33b7ada863ab service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:24.321463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-68982d8f-63b6-49ae-96e3-06078e7c64b1 req-9c77214c-8184-40e6-bb01-33b7ada863ab service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:24.334286 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-68982d8f-63b6-49ae-96e3-06078e7c64b1 req-9c77214c-8184-40e6-bb01-33b7ada863ab service nova] Creating event network-changed:b688c7f5-76ee-43db-8c91-f2a27fcd527f for instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e on n-h2-zed-1 Oct 28 10:38:24.339739 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-68982d8f-63b6-49ae-96e3-06078e7c64b1 req-9c77214c-8184-40e6-bb01-33b7ada863ab service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036829 Oct 28 10:38:24.340328 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3488/6971] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:38:25.007959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:25.008613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:25.015509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:25.016019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:25.016477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:25.017228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:25.017707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:25.018159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:25.150378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:25.158145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad281329-e67e-484d-a34c-9fd1856d6b12 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.154043 Oct 28 10:38:25.158725 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3484/6972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:25 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:26.184552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:26.185499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:26.191822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:26.192314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:26.192760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:26.193488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:26.193957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:26.194385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:26.339535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:26.348548 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a3fdd0a-9894-4b47-b95a-ce645d31d5b3 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.170461 Oct 28 10:38:26.349336 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3489/6973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:26 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:27.373394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:27.374065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:27.381494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:27.382095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:27.382590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:27.383358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:27.383868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:27.384312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:27.612416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:27.620215 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-72fe1b82-d258-4223-a418-3958979abed9 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.251011 Oct 28 10:38:27.620726 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3485/6974] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:27 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:28.643346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:28.643973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:28.650819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:28.651310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:28.651756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:28.652455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:28.652945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:28.653379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:28.792396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:28.800715 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fb264c1-7337-488d-9372-162e8665cc5c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.160931 Oct 28 10:38:28.801339 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3490/6975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:28 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:29.823742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:29.824364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:29.830828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:29.831335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:29.831788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:29.832503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:29.833012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:29.833461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:29.969687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:29.977436 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-27dd9b51-b9ad-4840-8b16-976a16135958 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.158587 Oct 28 10:38:29.978009 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3486/6976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:29 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:31.000753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:31.001386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:31.008660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:31.009175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:31.009613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:31.010381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:31.010752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:31.011174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:31.403059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:31.405394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:31.411939 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff65afa5-125f-449a-ba40-ba2a47aa9f24 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.414958 Oct 28 10:38:31.412512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3491/6977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:30 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:31.677614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:31.682254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c66ae3c4-6ce8-4a26-9402-4fe42778b85b req-27bde438-b33a-4d7c-8b4f-b9494026d053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b812bad-9186-4cd7-88d6-e1b09a49eb5e", "name": "network-vif-plugged", "status": "completed", "tag": "b688c7f5-76ee-43db-8c91-f2a27fcd527f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:38:31.692742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c66ae3c4-6ce8-4a26-9402-4fe42778b85b req-27bde438-b33a-4d7c-8b4f-b9494026d053 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:31.693260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c66ae3c4-6ce8-4a26-9402-4fe42778b85b req-27bde438-b33a-4d7c-8b4f-b9494026d053 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:31.693704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c66ae3c4-6ce8-4a26-9402-4fe42778b85b req-27bde438-b33a-4d7c-8b4f-b9494026d053 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:31.707201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c66ae3c4-6ce8-4a26-9402-4fe42778b85b req-27bde438-b33a-4d7c-8b4f-b9494026d053 service nova] Creating event network-vif-plugged:b688c7f5-76ee-43db-8c91-f2a27fcd527f for instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e on n-h2-zed-1 Oct 28 10:38:31.712300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c66ae3c4-6ce8-4a26-9402-4fe42778b85b req-27bde438-b33a-4d7c-8b4f-b9494026d053 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036422 Oct 28 10:38:31.712941 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3487/6978] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:38:32.434962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:32.435683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:32.441763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:38:32.444207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:32.444764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:32.445237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:32.445940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:32.446404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:32.446835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:32.583351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:32.591265 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3cc35d7a-c37e-4bd4-aa30-4699272a8eb0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1374 microversion: 2.1 time: 0.160403 Oct 28 10:38:32.591831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3492/6979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:32 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:33.614935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:33.615664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:33.622700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:33.623192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:33.623643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:33.624344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:33.625030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:33.625513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:33.761203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:33.769587 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-684b904a-b126-4393-be21-720378dd0d45 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1546 microversion: 2.1 time: 0.158924 Oct 28 10:38:33.770406 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3488/6980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:33 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1546 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:38:33.792109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:38:33.792726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:38:33.799699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:33.800194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:33.800644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:33.801376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:38:33.801841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:38:33.802275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:38:33.934971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:38:33.943253 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-214fe38d-919f-4af2-be34-9709332d5f67 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1546 microversion: 2.1 time: 0.155088 Oct 28 10:38:33.943863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3493/6981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:38:33 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1546 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:10.627113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:10.627663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:10.629925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:10.630673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=32 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:10.637835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:10.639012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:10.639480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:10.640239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:10.640766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:10.641245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:10.667904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:39:10.750827 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bbe4b2cd-334d-4ec9-b80a-7dc1ce331eeb tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 204 len: 0 microversion: 2.1 time: 0.128367 Oct 28 10:39:10.751593 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3489/6982] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:39:10 2022] DELETE /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:39:10.760344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:10.760884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:10.764983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:10.765616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:10.769846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:10.770346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:10.770795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:10.771505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:10.771967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:10.772399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:10.904561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:10.912554 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-522b995d-4d36-4de6-b6c6-440dbaa0d9e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1552 microversion: 2.1 time: 0.156561 Oct 28 10:39:10.913167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3494/6983] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:10 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:39:11.936952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:11.937804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:11.946337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:11.946899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:11.947359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:11.948118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:11.948588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:11.949061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:12.087321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:12.095593 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-12c9381a-965b-40e4-9b05-406a0da2c079 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1552 microversion: 2.1 time: 0.163668 Oct 28 10:39:12.096163 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3490/6984] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:11 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:12.795086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b5d13502-204a-4c37-9d93-2d5f4eb315f8 req-3753e0ba-a6bb-4f9a-abcc-34297f95d9df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b812bad-9186-4cd7-88d6-e1b09a49eb5e", "name": "network-vif-deleted", "tag": "b688c7f5-76ee-43db-8c91-f2a27fcd527f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:12.807214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b5d13502-204a-4c37-9d93-2d5f4eb315f8 req-3753e0ba-a6bb-4f9a-abcc-34297f95d9df service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:12.807708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b5d13502-204a-4c37-9d93-2d5f4eb315f8 req-3753e0ba-a6bb-4f9a-abcc-34297f95d9df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:12.808943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b5d13502-204a-4c37-9d93-2d5f4eb315f8 req-3753e0ba-a6bb-4f9a-abcc-34297f95d9df service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:12.822425 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b5d13502-204a-4c37-9d93-2d5f4eb315f8 req-3753e0ba-a6bb-4f9a-abcc-34297f95d9df service nova] Creating event network-vif-deleted:b688c7f5-76ee-43db-8c91-f2a27fcd527f for instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e on n-h2-zed-1 Oct 28 10:39:12.830238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b5d13502-204a-4c37-9d93-2d5f4eb315f8 req-3753e0ba-a6bb-4f9a-abcc-34297f95d9df service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039006 Oct 28 10:39:12.830849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3495/6985] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:39:13.119329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:13.119957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:13.127957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:13.128558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:13.129034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:13.129760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:13.130233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:13.130674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:13.166744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:13.167297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:13.167754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:13.168233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lazy-loading 'fault' on Instance uuid 1b812bad-9186-4cd7-88d6-e1b09a49eb5e {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:39:13.211295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:13.219702 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c416969-b37b-4cf7-b9f3-b8253e5ea82a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 200 len: 1338 microversion: 2.1 time: 0.104249 Oct 28 10:39:13.220269 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3491/6986] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:13 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 1338 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:14.249626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:14.250329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 1b812bad-9186-4cd7-88d6-e1b09a49eb5e] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:14.257352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:14.257840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:14.258282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:14.258968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:14.259429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:14.259857 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:14.273524 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] HTTP exception thrown: Instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e could not be found. Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Request method failure captured: Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e HTTP/1.1 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7DeMDHK-289KYzJzsSLsS1EAZhnZziBukf7W7EsRWnU55So4bvXyHFwlE4DNhX4BPAzmKRj-8mSSGI3ROYcOi66Z7xr-LJj_IZ-oV0uc3Nb5AK8M8fyje4vzN4Pu5xJIFzhzK3zAVb7fmVzdCZ_8EC_c_fI0iS6B9kc1BIkWSEXb1w Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: a485e438f2354f7a8debf470aa4175b2 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a485e438f2354f7a8debf470aa4175b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a485e438f2354f7a8debf470aa4175b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a485e438f2354f7a8debf470aa4175b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a485e438f2354f7a8debf470aa4175b2"}]}] Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: a485e438f2354f7a8debf470aa4175b2 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkBasicOps-2108387462-project Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: e2c2a85ee08f4159afe534bc318b2ca4 Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkBasicOps-2108387462-project Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e could not be found. Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '1b812bad-9186-4cd7-88d6-e1b09a49eb5e'} Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e could not be found. Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e could not be found. Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:39:14.275150 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e could not be found. Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Returning 404 to user: Instance 1b812bad-9186-4cd7-88d6-e1b09a49eb5e could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3a3ce499-05f5-4d06-b942-d095d06e59fc tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e" status: 404 len: 111 microversion: 2.1 time: 0.031707 Oct 28 10:39:14.279638 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3496/6987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:14 2022] GET /compute/v2.1/servers/1b812bad-9186-4cd7-88d6-e1b09a49eb5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:39:14.440998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0eec6ede-3bb2-4a82-a48e-aeb4c4401b0d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '.version_select at 0x7fca307bf280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:14.461862 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0eec6ede-3bb2-4a82-a48e-aeb4c4401b0d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2002776788" status: 202 len: 0 microversion: 2.1 time: 0.024631 Oct 28 10:39:14.462488 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3492/6988] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 10:39:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2002776788 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:39:16.152749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:16.153341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:16.161372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:16.161876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:16.162320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:16.163722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:16.164201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:16.165490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:16.195417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:39:16.224774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-34e4c8cb-a03a-4cdb-80a5-0b90abe979ac req-da6a7f55-b4de-43a3-a2ab-1d61f9f03e3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b3a277f-41b0-4783-addc-67030f8b16da", "tag": "5a2ca391-5c68-450a-b08b-364d9c2c3b84"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:16.236397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34e4c8cb-a03a-4cdb-80a5-0b90abe979ac req-da6a7f55-b4de-43a3-a2ab-1d61f9f03e3a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:16.236993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34e4c8cb-a03a-4cdb-80a5-0b90abe979ac req-da6a7f55-b4de-43a3-a2ab-1d61f9f03e3a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:16.237515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-34e4c8cb-a03a-4cdb-80a5-0b90abe979ac req-da6a7f55-b4de-43a3-a2ab-1d61f9f03e3a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:16.249511 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-34e4c8cb-a03a-4cdb-80a5-0b90abe979ac req-da6a7f55-b4de-43a3-a2ab-1d61f9f03e3a service nova] Creating event network-changed:5a2ca391-5c68-450a-b08b-364d9c2c3b84 for instance 0b3a277f-41b0-4783-addc-67030f8b16da on n-h1-zed-1 Oct 28 10:39:16.255728 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-34e4c8cb-a03a-4cdb-80a5-0b90abe979ac req-da6a7f55-b4de-43a3-a2ab-1d61f9f03e3a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104366 Oct 28 10:39:16.256609 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3493/6989] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:39:16.278513 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7b1c82ff-4c1c-4aeb-9aa2-a3ec6a6d991c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 204 len: 0 microversion: 2.1 time: 0.129954 Oct 28 10:39:16.279325 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3497/6990] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:39:16 2022] DELETE /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:39:16.288037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:16.288752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:16.297129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:16.297872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:16.298474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:16.299734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:16.300359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:16.301111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:16.457157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:16.465051 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7507d1f2-82c8-4632-abb8-36e5c5ebca14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1670 microversion: 2.1 time: 0.181280 Oct 28 10:39:16.465634 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3494/6991] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:16 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:39:17.489632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:17.490336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:17.497398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:17.498389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:17.498831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:17.499532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:17.500048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:17.500476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:17.664255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:17.673081 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b82a4b38-7fe5-482c-a0e0-7d2cc0c0e3bf tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1670 microversion: 2.1 time: 0.187756 Oct 28 10:39:17.673668 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3498/6992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:17 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1670 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:18.697607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:18.698572 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:18.710691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:18.711373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:18.712121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:18.713093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:18.713998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:18.715498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:18.787166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d2abbec2-fd4f-40a1-8289-65d4be7e6461 req-41527afe-103b-4eaf-a07f-1a933712071b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b3a277f-41b0-4783-addc-67030f8b16da", "name": "network-vif-deleted", "tag": "5a2ca391-5c68-450a-b08b-364d9c2c3b84"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:18.798124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d2abbec2-fd4f-40a1-8289-65d4be7e6461 req-41527afe-103b-4eaf-a07f-1a933712071b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:18.798614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d2abbec2-fd4f-40a1-8289-65d4be7e6461 req-41527afe-103b-4eaf-a07f-1a933712071b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:18.799360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d2abbec2-fd4f-40a1-8289-65d4be7e6461 req-41527afe-103b-4eaf-a07f-1a933712071b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:18.814041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:18.818450 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d2abbec2-fd4f-40a1-8289-65d4be7e6461 req-41527afe-103b-4eaf-a07f-1a933712071b service nova] Creating event network-vif-deleted:5a2ca391-5c68-450a-b08b-364d9c2c3b84 for instance 0b3a277f-41b0-4783-addc-67030f8b16da on n-h1-zed-1 Oct 28 10:39:18.822643 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b13627c-66c5-48de-95b4-59c52226624a tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 200 len: 1484 microversion: 2.1 time: 0.129581 Oct 28 10:39:18.824566 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d2abbec2-fd4f-40a1-8289-65d4be7e6461 req-41527afe-103b-4eaf-a07f-1a933712071b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041593 Oct 28 10:39:18.825472 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3499/6993] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:39:18.837569 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3495/6994] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:18 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 1484 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:19.849226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:19.849870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: 0b3a277f-41b0-4783-addc-67030f8b16da] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:19.856264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:19.856761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:19.857274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:19.857985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:19.858446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:19.858882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:19.872301 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] HTTP exception thrown: Instance 0b3a277f-41b0-4783-addc-67030f8b16da could not be found. Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Request method failure captured: Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da HTTP/1.1 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7DeMDHK-289KYzJzsSLsS1EAZhnZziBukf7W7EsRWnU55So4bvXyHFwlE4DNhX4BPAzmKRj-8mSSGI3ROYcOi66Z7xr-LJj_IZ-oV0uc3Nb5AK8M8fyje4vzN4Pu5xJIFzhzK3zAVb7fmVzdCZ_8EC_c_fI0iS6B9kc1BIkWSEXb1w Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: a485e438f2354f7a8debf470aa4175b2 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a485e438f2354f7a8debf470aa4175b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a485e438f2354f7a8debf470aa4175b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a485e438f2354f7a8debf470aa4175b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a485e438f2354f7a8debf470aa4175b2"}]}] Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: a485e438f2354f7a8debf470aa4175b2 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkBasicOps-2108387462-project Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: e2c2a85ee08f4159afe534bc318b2ca4 Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkBasicOps-2108387462-project Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0b3a277f-41b0-4783-addc-67030f8b16da could not be found. Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0b3a277f-41b0-4783-addc-67030f8b16da'} Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b3a277f-41b0-4783-addc-67030f8b16da could not be found. Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b3a277f-41b0-4783-addc-67030f8b16da could not be found. Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:39:19.874047 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b3a277f-41b0-4783-addc-67030f8b16da could not be found. Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Returning 404 to user: Instance 0b3a277f-41b0-4783-addc-67030f8b16da could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4058e150-b347-4af5-8bc8-5bad2232bc36 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da" status: 404 len: 111 microversion: 2.1 time: 0.031321 Oct 28 10:39:19.877375 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3500/6995] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:19 2022] GET /compute/v2.1/servers/0b3a277f-41b0-4783-addc-67030f8b16da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:39:20.053721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28c6210d-1727-4654-95eb-e8b2f7ff0cf0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '.version_select at 0x7fca32297ee0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:20.083202 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28c6210d-1727-4654-95eb-e8b2f7ff0cf0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2134623130" status: 202 len: 0 microversion: 2.1 time: 0.036321 Oct 28 10:39:20.087770 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3496/6996] 10.222.0.16 () {58 vars in 1257 bytes} [Fri Oct 28 10:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-2134623130 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:39:30.029249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1255053699", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-351906278", "security_groups": [{"name": "tempest-secgroup-smoke-287004008"}], "block_device_mapping_v2": [{"uuid": "6c7cf73c-5366-4e5f-8616-8ac2349f7082", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "05bf8b9c-f758-4073-a7da-1a05a093a429"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:30.081971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:30.082865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:30.247354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f088085-d30b-42af-9d75-48d924e53d01 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'create', calling method: .version_select at 0x7fca3271e280>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-959794016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPOqTvv+NP1aefJtY4ElwYCijwrn2x+8RKyJfyT7XFCWCwbmKo9/Ityji5KRVkWZvwItR7kFnbx0mBY3Xa9TjI/ybMQTAgQGDajVXePMcPk2PxocV39LLK2qybl6UTbO+A=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:30.264885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:30.270878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:30.279746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] validate_networks() for [('05bf8b9c-f758-4073-a7da-1a05a093a429', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:39:30.298469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5f088085-d30b-42af-9d75-48d924e53d01 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for project a485e438f2354f7a8debf470aa4175b2. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:39:30.309258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-5f088085-d30b-42af-9d75-48d924e53d01 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for user e2c2a85ee08f4159afe534bc318b2ca4 and project a485e438f2354f7a8debf470aa4175b2. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:39:30.358105 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f088085-d30b-42af-9d75-48d924e53d01 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.114869 Oct 28 10:39:30.361787 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3497/6997] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:39:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:39:30.892275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:39:30.892706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:39:30.893377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:39:30.894041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:39:30.894670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:39:30.906861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:30.907367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:30.908551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:30.909501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:30.910160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:30.910747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:30.933618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:39:30.939366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Getting quotas for user 8b2ad8fbe36e43358ba644627ebb1d8b and project 7b98d113d6914d01a909378c1c96e3fa. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:39:31.008004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:39:31.008610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6c7cf73c-5366-4e5f-8616-8ac2349f7082',volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:39:31.162026 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a796e0d6-896a-407b-9835-056ec06dd29a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.141702 Oct 28 10:39:31.163895 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3501/6998] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:39:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:39:31.175166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-120be1a0-6f44-487f-a036-a80f73bebcab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:31.176554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-120be1a0-6f44-487f-a036-a80f73bebcab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:31.257171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-120be1a0-6f44-487f-a036-a80f73bebcab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:31.270923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-120be1a0-6f44-487f-a036-a80f73bebcab tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1094 microversion: 2.1 time: 0.099407 Oct 28 10:39:31.271539 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3498/6999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:31 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:39:31.621919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2065494408", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "5b2bcf60-0373-486d-87e7-c0e1b16e9521"}], "key_name": "tempest-TestNetworkBasicOps-959794016", "security_groups": [{"name": "tempest-secgroup-smoke-1327706539"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:31.744051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] validate_networks() for [('5b2bcf60-0373-486d-87e7-c0e1b16e9521', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:39:32.281702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:39:32.282271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:39:32.282604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:39:32.283025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:39:32.283445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:39:32.292789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:32.293555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:32.294004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:32.295482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:32.295947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:32.296409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:32.297567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:32.298210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:32.306037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:32.306552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:32.307011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:32.307742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:32.308226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:32.308674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:32.315153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for project a485e438f2354f7a8debf470aa4175b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:39:32.320283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Getting quotas for user e2c2a85ee08f4159afe534bc318b2ca4 and project a485e438f2354f7a8debf470aa4175b2. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:39:32.334492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:39:32.336685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:39:32.376255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:32.384813 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa893060-5f55-4365-af8e-25ff991799b3 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1192 microversion: 2.1 time: 0.091781 Oct 28 10:39:32.385464 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3499/7000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:32 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:39:32.389780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ceaa06dc-c5d3-4263-9971-a94a3d91dc16 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772661 Oct 28 10:39:32.390452 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3502/7001] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:39:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:39:32.401944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5cc7adf3-1c38-443a-8cef-46f7f8bf88d7 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:32.402683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5cc7adf3-1c38-443a-8cef-46f7f8bf88d7 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:32.476487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5cc7adf3-1c38-443a-8cef-46f7f8bf88d7 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:32.484961 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5cc7adf3-1c38-443a-8cef-46f7f8bf88d7 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1248 microversion: 2.1 time: 0.087212 Oct 28 10:39:32.485542 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3500/7002] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:32 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1248 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:39:33.414880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:33.415750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:33.429041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:33.430042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:33.430774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:33.431763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:33.432468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:33.433217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:33.508509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:33.510140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:33.520664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:33.533900 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4fdb142-63a2-42d6-9b68-87e80c6a0d38 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1210 microversion: 2.1 time: 0.129853 Oct 28 10:39:33.534993 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3503/7003] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:33 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:33.541535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:33.544127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:33.545168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:33.545941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:33.546747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:33.549387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:33.680193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:33.692514 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-514ff203-e3e5-4525-bbf0-20ea19f3e83e tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1300 microversion: 2.1 time: 0.188606 Oct 28 10:39:33.693496 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3501/7004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:33 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:34.559665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:34.560848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:34.569277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:34.570052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:34.570672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:34.571664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:34.572334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:34.572823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:34.719697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:34.721913 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:34.732493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:34.733428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:34.734258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:34.736355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:34.737114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:34.737797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:34.758243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:34.768153 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55aac0f5-0a3c-4e74-bca6-c452c7b9014a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1277 microversion: 2.1 time: 0.213124 Oct 28 10:39:34.769503 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3504/7005] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:34 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:34.858430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:34.866818 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bd74275e-e958-4726-a22e-d0213a8d4ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1306 microversion: 2.1 time: 0.154860 Oct 28 10:39:34.867401 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3502/7006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:34 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1306 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:35.306275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-689c6c44-b9c8-40cb-acdd-c208ad1319f1 req-8d0668a3-04a5-4718-8cbe-5144ba4afb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7661d95-f582-4a6a-b6b8-900bf9ff7511", "tag": "3a19fa59-126e-42fc-b2e8-10a36f48daee"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:35.318052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-689c6c44-b9c8-40cb-acdd-c208ad1319f1 req-8d0668a3-04a5-4718-8cbe-5144ba4afb79 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:35.318830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-689c6c44-b9c8-40cb-acdd-c208ad1319f1 req-8d0668a3-04a5-4718-8cbe-5144ba4afb79 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:35.319469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-689c6c44-b9c8-40cb-acdd-c208ad1319f1 req-8d0668a3-04a5-4718-8cbe-5144ba4afb79 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:35.336159 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-689c6c44-b9c8-40cb-acdd-c208ad1319f1 req-8d0668a3-04a5-4718-8cbe-5144ba4afb79 service nova] Creating event network-changed:3a19fa59-126e-42fc-b2e8-10a36f48daee for instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 on n-h1-zed-1 Oct 28 10:39:35.342014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-689c6c44-b9c8-40cb-acdd-c208ad1319f1 req-8d0668a3-04a5-4718-8cbe-5144ba4afb79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039916 Oct 28 10:39:35.342966 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3505/7007] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:39:35.793344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:35.795297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:35.804015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:35.804982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:35.805646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:35.806604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:35.807277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:35.808520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:35.892370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:35.894096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:35.905579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:35.906377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:35.908074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:35.909820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:35.910487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:35.912724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:36.061700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:36.071903 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15d1b9c9-4577-40ec-acb7-6ee160957287 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.184419 Oct 28 10:39:36.073170 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3506/7008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:35 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:36.167055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:36.176115 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cacf9ea5-2c36-44ea-ad9e-23df4d833af9 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1277 microversion: 2.1 time: 0.388392 Oct 28 10:39:36.183907 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3503/7009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:35 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1277 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:37.097965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:37.099554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:37.107966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:37.108672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:37.109328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:37.110384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:37.111062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:37.111791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:37.199790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:37.202656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:37.217867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:37.218638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:37.219107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:37.219879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:37.220356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:37.220804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:37.283668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:37.292066 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e1236b9-fc93-426e-9a09-b39c34b44e14 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.201011 Oct 28 10:39:37.292648 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3507/7010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:37 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:37.359430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6318906a-fa01-42f0-8420-b332670819be req-82046efc-2a30-4034-8725-985c2e7281d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c74602-5019-43cd-9a68-3036baf9b8b4", "tag": "f4224515-3cf1-40fd-883e-91f32eef51e2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:37.370483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6318906a-fa01-42f0-8420-b332670819be req-82046efc-2a30-4034-8725-985c2e7281d2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:37.371204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6318906a-fa01-42f0-8420-b332670819be req-82046efc-2a30-4034-8725-985c2e7281d2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:37.371646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6318906a-fa01-42f0-8420-b332670819be req-82046efc-2a30-4034-8725-985c2e7281d2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:37.386038 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6318906a-fa01-42f0-8420-b332670819be req-82046efc-2a30-4034-8725-985c2e7281d2 service nova] Creating event network-changed:f4224515-3cf1-40fd-883e-91f32eef51e2 for instance d3c74602-5019-43cd-9a68-3036baf9b8b4 on n-h2-zed-1 Oct 28 10:39:37.391411 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6318906a-fa01-42f0-8420-b332670819be req-82046efc-2a30-4034-8725-985c2e7281d2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036736 Oct 28 10:39:37.392791 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3508/7011] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:39:37.481689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:37.490367 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76dcc76a-1304-4fb6-844d-e50145d1ce81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1277 microversion: 2.1 time: 0.295173 Oct 28 10:39:37.491046 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3504/7012] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:37 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:39:38.317374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:38.318106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:38.327288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:38.327991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:38.328621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:38.329352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:38.329809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:38.330267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:38.483510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:38.492600 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7379cc10-42e3-4f11-9d47-778b4630b7e0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.180400 Oct 28 10:39:38.493443 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3509/7013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:38 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:38.514967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:38.515737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:38.523156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:38.523733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:38.524260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:38.525136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:38.525616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:38.526117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:38.668486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:38.677246 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4252548a-3e96-4c52-98fe-23ba9a49492c tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.166971 Oct 28 10:39:38.677820 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3505/7014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:38 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:39.518222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:39.519144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:39.527605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:39.528130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:39.529468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:39.530593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:39.531119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:39.531727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:39.679339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:39.688151 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3b9edab4-42b2-470e-b3c8-21aaf3c12512 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.175231 Oct 28 10:39:39.688634 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3510/7015] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:39 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:39.704058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:39.705419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:39.718904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:39.719417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:39.719897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:39.720605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:39.721150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:39.724263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:39.938195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:39.946652 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a10b0674-a800-4fed-89ea-eff86ef88fe0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.248634 Oct 28 10:39:39.947259 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3506/7016] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:39 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:40.714339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:40.714989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:40.722432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:40.722921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:40.723366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:40.724057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:40.724516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:40.724973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:40.861293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:40.869011 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b2ecae36-73ed-4b4b-9134-2bef2f97a329 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.158614 Oct 28 10:39:40.869603 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3511/7017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:40 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:40.970920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:40.971660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:40.978625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:40.979133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:40.979589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:40.980300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:40.980772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:40.981249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:41.113853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:41.121676 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a25d077e-f5e8-4524-9592-4d2c62069312 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.155218 Oct 28 10:39:41.122259 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3507/7018] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:40 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:41.891637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:41.892258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:41.899185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:41.899681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:41.900124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:41.900826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:41.901313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:41.901746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:42.034890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:42.042728 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7b1e6da5-fa59-4d36-8ca2-0090d3a93001 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.155033 Oct 28 10:39:42.043312 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3512/7019] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:41 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:42.145015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:42.145648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:42.154610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:42.155135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:42.155579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:42.156299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:42.156769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:42.157239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:42.288534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:42.296955 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67a05627-350c-4e89-ac45-0bb98472052f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.155944 Oct 28 10:39:42.297540 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3508/7020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:42 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:43.066791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:43.067508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:43.069513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:43.070311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:43.077917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:43.078416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:43.078865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:43.079574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:43.080038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:43.080474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:43.214120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:43.221838 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85c673e3-6286-45b0-afe0-6e78d1d9016b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.159112 Oct 28 10:39:43.222479 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3513/7021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:43 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:39:43.319990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:43.320627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:43.322553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:39:43.329217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:43.329715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:43.330257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:43.330968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:43.331437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:43.331879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:43.791604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:43.799923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b71fde43-c277-4679-ae67-cf0a49491c89 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.483832 Oct 28 10:39:43.800491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3509/7022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:43 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:44.143272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-97455488-8265-42e5-badf-4cd8d1d6876e req-da05f4db-f3c0-4df5-a35a-6b7bd4c32840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c74602-5019-43cd-9a68-3036baf9b8b4", "name": "network-vif-plugged", "status": "completed", "tag": "f4224515-3cf1-40fd-883e-91f32eef51e2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:44.154460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-97455488-8265-42e5-badf-4cd8d1d6876e req-da05f4db-f3c0-4df5-a35a-6b7bd4c32840 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:44.154956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-97455488-8265-42e5-badf-4cd8d1d6876e req-da05f4db-f3c0-4df5-a35a-6b7bd4c32840 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:44.155400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-97455488-8265-42e5-badf-4cd8d1d6876e req-da05f4db-f3c0-4df5-a35a-6b7bd4c32840 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:44.166507 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-97455488-8265-42e5-badf-4cd8d1d6876e req-da05f4db-f3c0-4df5-a35a-6b7bd4c32840 service nova] Creating event network-vif-plugged:f4224515-3cf1-40fd-883e-91f32eef51e2 for instance d3c74602-5019-43cd-9a68-3036baf9b8b4 on n-h2-zed-1 Oct 28 10:39:44.171639 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-97455488-8265-42e5-badf-4cd8d1d6876e req-da05f4db-f3c0-4df5-a35a-6b7bd4c32840 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032134 Oct 28 10:39:44.172284 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3514/7023] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:39:44.246414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:44.246963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:44.254065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:44.254574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:44.255016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:44.255726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:44.256194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:44.256630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:44.430717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:44.438974 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-94b6dece-34bb-4593-958e-beff1c447ac4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.197755 Oct 28 10:39:44.439548 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3510/7024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:44 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:44.823291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:44.823989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:44.830515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:44.831003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:44.831444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:44.832134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:44.832590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:44.833045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:44.963120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:44.971403 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3e33b7e-fb7a-4b14-a116-88a378ecb61b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.152390 Oct 28 10:39:44.971972 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3515/7025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:44 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:45.461727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:45.462298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:45.469926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:45.470427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:45.470877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:45.471584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:45.472075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:45.472513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:45.602759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:45.610711 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63e0034e-8214-402f-96c8-dee7c66e8543 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1374 microversion: 2.1 time: 0.152958 Oct 28 10:39:45.611290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3511/7026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:45 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:45.995147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:45.995669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:46.002920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:46.003409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:46.003845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:46.004535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:46.005017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:46.005443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:46.135446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:46.143103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19e5da1e-5d92-450c-885b-19ff057e5a86 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.152008 Oct 28 10:39:46.143674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3516/7027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:45 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:46.633656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:46.634290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:46.641309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:46.641812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:46.642270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:46.642981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:46.643456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:46.643914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:46.773264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:46.781442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8d00f34-c19a-4e80-8abb-a41251af29a4 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1545 microversion: 2.1 time: 0.151736 Oct 28 10:39:46.782231 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3512/7028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:46 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1545 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:46.804002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:46.804612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:46.810486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:46.810966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:46.811405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:46.812089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:46.812540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:46.812994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:46.947433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:46.955919 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6136c203-8c5a-4839-abc4-c715fd6f282d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1545 microversion: 2.1 time: 0.155771 Oct 28 10:39:46.956488 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3517/7029] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:46 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1545 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:47.166119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:47.166829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:47.176588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:47.177944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:47.178478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:47.179216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:47.180440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:47.180898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:47.407452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:47.415226 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17f50165-68cd-4320-8aca-d9f77683c304 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.253120 Oct 28 10:39:47.415771 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3513/7030] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:47 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:48.437399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:48.438038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:48.444855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:48.445369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:48.445811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:48.446501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:48.446955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:48.447383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:48.592603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:48.602885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-772292ab-5a52-4624-9da6-5d9b1ccc141e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.169444 Oct 28 10:39:48.603553 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3518/7031] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:48 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:48.664420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-bba6a155-0cbe-4b5f-9861-f9b140a90147 req-0d948e52-6b40-4123-ad35-1be2a5bec9fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c74602-5019-43cd-9a68-3036baf9b8b4", "tag": "f4224515-3cf1-40fd-883e-91f32eef51e2"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:48.678757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bba6a155-0cbe-4b5f-9861-f9b140a90147 req-0d948e52-6b40-4123-ad35-1be2a5bec9fa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:48.679413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bba6a155-0cbe-4b5f-9861-f9b140a90147 req-0d948e52-6b40-4123-ad35-1be2a5bec9fa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:48.679859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bba6a155-0cbe-4b5f-9861-f9b140a90147 req-0d948e52-6b40-4123-ad35-1be2a5bec9fa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:48.692300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-bba6a155-0cbe-4b5f-9861-f9b140a90147 req-0d948e52-6b40-4123-ad35-1be2a5bec9fa service nova] Creating event network-changed:f4224515-3cf1-40fd-883e-91f32eef51e2 for instance d3c74602-5019-43cd-9a68-3036baf9b8b4 on n-h2-zed-1 Oct 28 10:39:48.697620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-bba6a155-0cbe-4b5f-9861-f9b140a90147 req-0d948e52-6b40-4123-ad35-1be2a5bec9fa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038378 Oct 28 10:39:48.701762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3514/7032] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:39:49.395650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4db1be97-1e08-4aa7-a695-ec33a074ac9d req-01a3ac4c-f553-4f5a-b5b0-c7ba67d10b2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7661d95-f582-4a6a-b6b8-900bf9ff7511", "name": "network-vif-plugged", "status": "completed", "tag": "3a19fa59-126e-42fc-b2e8-10a36f48daee"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:49.405053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4db1be97-1e08-4aa7-a695-ec33a074ac9d req-01a3ac4c-f553-4f5a-b5b0-c7ba67d10b2c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:49.405562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4db1be97-1e08-4aa7-a695-ec33a074ac9d req-01a3ac4c-f553-4f5a-b5b0-c7ba67d10b2c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:49.406064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4db1be97-1e08-4aa7-a695-ec33a074ac9d req-01a3ac4c-f553-4f5a-b5b0-c7ba67d10b2c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:49.416838 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4db1be97-1e08-4aa7-a695-ec33a074ac9d req-01a3ac4c-f553-4f5a-b5b0-c7ba67d10b2c service nova] Creating event network-vif-plugged:3a19fa59-126e-42fc-b2e8-10a36f48daee for instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 on n-h1-zed-1 Oct 28 10:39:49.422625 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4db1be97-1e08-4aa7-a695-ec33a074ac9d req-01a3ac4c-f553-4f5a-b5b0-c7ba67d10b2c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Oct 28 10:39:49.423213 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3519/7033] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:39:49.627346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:49.628072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:49.634648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:49.635156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:49.635612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:49.636335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:49.636809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:49.637281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:49.776885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:49.784874 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2336ba7c-9c90-4735-a90c-1ca7d5e302dd tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1265 microversion: 2.1 time: 0.162396 Oct 28 10:39:49.785762 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3515/7034] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:49 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:50.808194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:50.808957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:50.816117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:50.816612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:50.817109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:50.817816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:50.818289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:50.818724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:50.956797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:50.964744 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4daa42e-2880-4618-ac86-1ec46cd5fedc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1452 microversion: 2.1 time: 0.160808 Oct 28 10:39:50.965356 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3520/7035] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:50 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:50.986915 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:39:50.987550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:39:50.994487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:50.995021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:50.995479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:50.996191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:50.996665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:50.997669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:51.125805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:39:51.133683 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-208a75ed-aca8-4a0e-bf82-29f303d20dd8 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1452 microversion: 2.1 time: 0.150658 Oct 28 10:39:51.134257 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3516/7036] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:39:50 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:39:53.012107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c58dacfc-864b-4ff3-818d-2de007192195 req-b24eda8e-924a-428f-a3b1-7b5cda7da366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7661d95-f582-4a6a-b6b8-900bf9ff7511", "tag": "3a19fa59-126e-42fc-b2e8-10a36f48daee"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:39:53.022286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c58dacfc-864b-4ff3-818d-2de007192195 req-b24eda8e-924a-428f-a3b1-7b5cda7da366 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:39:53.022778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c58dacfc-864b-4ff3-818d-2de007192195 req-b24eda8e-924a-428f-a3b1-7b5cda7da366 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:39:53.023224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c58dacfc-864b-4ff3-818d-2de007192195 req-b24eda8e-924a-428f-a3b1-7b5cda7da366 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:39:53.034371 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c58dacfc-864b-4ff3-818d-2de007192195 req-b24eda8e-924a-428f-a3b1-7b5cda7da366 service nova] Creating event network-changed:3a19fa59-126e-42fc-b2e8-10a36f48daee for instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 on n-h1-zed-1 Oct 28 10:39:53.039380 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c58dacfc-864b-4ff3-818d-2de007192195 req-b24eda8e-924a-428f-a3b1-7b5cda7da366 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030961 Oct 28 10:39:53.040163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3521/7037] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:40:19.022725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:40:19.024997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:40:19.027668 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:40:19.027812 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 10:40:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4/action (ip 10.222.0.16) !!! Oct 28 10:40:19.029713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:19.030544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:19.037785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:19.038331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:19.038789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:19.039510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:19.039988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:19.040433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:19.109881 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62e0ef99-5f3f-470e-80a6-8772da52f33d tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4/action" status: 200 len: 24571 microversion: 2.1 time: 0.091281 Oct 28 10:40:19.110719 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3517/7038] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:40:19 2022] POST /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4/action => generated 24571 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:40:49.397788 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:40:49.398313 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:40:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4/action (ip 10.222.0.16) !!! Oct 28 10:40:49.400212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:49.400995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:49.406547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:40:49.408841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:40:49.418575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:49.419078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:49.419521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:49.420228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:49.420694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:49.421232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:49.505134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8fcbf89-bcb5-41e2-9921-9a16ba5ac95b tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "POST /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4/action" status: 200 len: 32644 microversion: 2.1 time: 0.110058 Oct 28 10:40:49.506064 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3522/7039] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:40:49 2022] POST /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4/action => generated 32644 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 10:40:50.513068 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:40:50.513697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:40:50.522406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-930ba928-dac2-4a4c-81f8-ebd3a9564c39 req-9958cb8b-76e8-4288-a473-165e19219e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3c74602-5019-43cd-9a68-3036baf9b8b4", "tag": "f4224515-3cf1-40fd-883e-91f32eef51e2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:40:50.528989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:50.529806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:40:50.536773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:50.537313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:50.537767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:50.538224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-930ba928-dac2-4a4c-81f8-ebd3a9564c39 req-9958cb8b-76e8-4288-a473-165e19219e96 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:50.538480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:50.538713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-930ba928-dac2-4a4c-81f8-ebd3a9564c39 req-9958cb8b-76e8-4288-a473-165e19219e96 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:50.538943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:50.539152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-930ba928-dac2-4a4c-81f8-ebd3a9564c39 req-9958cb8b-76e8-4288-a473-165e19219e96 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:50.539378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:50.551363 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-930ba928-dac2-4a4c-81f8-ebd3a9564c39 req-9958cb8b-76e8-4288-a473-165e19219e96 service nova] Creating event network-changed:f4224515-3cf1-40fd-883e-91f32eef51e2 for instance d3c74602-5019-43cd-9a68-3036baf9b8b4 on n-h2-zed-1 Oct 28 10:40:50.556491 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-930ba928-dac2-4a4c-81f8-ebd3a9564c39 req-9958cb8b-76e8-4288-a473-165e19219e96 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038104 Oct 28 10:40:50.557606 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3523/7040] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:40:50.567399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:40:50.655554 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d713890-c51c-4330-bf0f-bf3b6a96d4f1 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "DELETE /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 204 len: 0 microversion: 2.1 time: 0.146583 Oct 28 10:40:50.656374 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3518/7041] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:40:50 2022] DELETE /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:40:50.666843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:40:50.668066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:40:50.675523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:50.676117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:50.676633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:50.677484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:50.678453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:50.678959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:50.817171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:40:50.825116 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-34a09c79-237f-4fc1-8bf2-0574c5b543ed tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1670 microversion: 2.1 time: 0.163337 Oct 28 10:40:50.825694 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3524/7042] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:40:50 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1670 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:40:51.850666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:40:51.851529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:40:51.859353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:51.859946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:51.860406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:51.861150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:51.861633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:51.862079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:52.063092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:40:52.070861 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2cd3284f-8214-48cc-9603-da06948b8076 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1670 microversion: 2.1 time: 0.224562 Oct 28 10:40:52.071439 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3519/7043] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:40:51 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1670 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:40:52.888454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ffa52afc-849f-460b-8797-7cb6966c586e req-f910f6c2-e585-4a06-b7b5-efb354a45e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3c74602-5019-43cd-9a68-3036baf9b8b4", "name": "network-vif-deleted", "tag": "f4224515-3cf1-40fd-883e-91f32eef51e2"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:40:52.902770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ffa52afc-849f-460b-8797-7cb6966c586e req-f910f6c2-e585-4a06-b7b5-efb354a45e19 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:52.903264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ffa52afc-849f-460b-8797-7cb6966c586e req-f910f6c2-e585-4a06-b7b5-efb354a45e19 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:52.903709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ffa52afc-849f-460b-8797-7cb6966c586e req-f910f6c2-e585-4a06-b7b5-efb354a45e19 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:52.915874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ffa52afc-849f-460b-8797-7cb6966c586e req-f910f6c2-e585-4a06-b7b5-efb354a45e19 service nova] Creating event network-vif-deleted:f4224515-3cf1-40fd-883e-91f32eef51e2 for instance d3c74602-5019-43cd-9a68-3036baf9b8b4 on n-h2-zed-1 Oct 28 10:40:52.921654 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ffa52afc-849f-460b-8797-7cb6966c586e req-f910f6c2-e585-4a06-b7b5-efb354a45e19 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037197 Oct 28 10:40:52.922859 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3525/7044] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:40:53.095988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:40:53.096794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:40:53.103847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:53.104347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:53.104856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:53.105595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:53.106065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:53.106500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:53.141599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:53.142035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:53.142483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:53.142985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lazy-loading 'fault' on Instance uuid d3c74602-5019-43cd-9a68-3036baf9b8b4 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:40:53.188708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2c2a85ee08f4159afe534bc318b2ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a485e438f2354f7a8debf470aa4175b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:40:53.196876 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6177ad8-99e8-494e-8abd-4387a0de795c tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 200 len: 1338 microversion: 2.1 time: 0.105648 Oct 28 10:40:53.197594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3520/7045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:40:53 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 1338 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:40:54.222237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:40:54.222973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] [instance: d3c74602-5019-43cd-9a68-3036baf9b8b4] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:40:54.229859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:54.230357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:54.230807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:54.231517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:40:54.231985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:40:54.232422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:40:54.249589 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] HTTP exception thrown: Instance d3c74602-5019-43cd-9a68-3036baf9b8b4 could not be found. Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Request method failure captured: Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 HTTP/1.1 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7DeMDHK-289KYzJzsSLsS1EAZhnZziBukf7W7EsRWnU55So4bvXyHFwlE4DNhX4BPAzmKRj-8mSSGI3ROYcOi66Z7xr-LJj_IZ-oV0uc3Nb5AK8M8fyje4vzN4Pu5xJIFzhzK3zAVb7fmVzdCZ_8EC_c_fI0iS6B9kc1BIkWSEXb1w Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: a485e438f2354f7a8debf470aa4175b2 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a485e438f2354f7a8debf470aa4175b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a485e438f2354f7a8debf470aa4175b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a485e438f2354f7a8debf470aa4175b2", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a485e438f2354f7a8debf470aa4175b2"}]}] Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: a485e438f2354f7a8debf470aa4175b2 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkBasicOps-2108387462 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkBasicOps-2108387462-project Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: e2c2a85ee08f4159afe534bc318b2ca4 Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkBasicOps-2108387462-project Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance d3c74602-5019-43cd-9a68-3036baf9b8b4 could not be found. Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'd3c74602-5019-43cd-9a68-3036baf9b8b4'} Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3c74602-5019-43cd-9a68-3036baf9b8b4 could not be found. Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3c74602-5019-43cd-9a68-3036baf9b8b4 could not be found. Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:40:54.251235 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3c74602-5019-43cd-9a68-3036baf9b8b4 could not be found. Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Returning 404 to user: Instance d3c74602-5019-43cd-9a68-3036baf9b8b4 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ccb6805-7c2e-4b1a-8f8a-ee0248fd09ea tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4" status: 404 len: 111 microversion: 2.1 time: 0.035424 Oct 28 10:40:54.255390 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3526/7046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:40:54 2022] GET /compute/v2.1/servers/d3c74602-5019-43cd-9a68-3036baf9b8b4 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:40:54.419096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-674eff35-f59d-443d-85d7-ae3ed6d5dcd0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] Calling method '.version_select at 0x7fca32915e50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:40:54.440274 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-674eff35-f59d-443d-85d7-ae3ed6d5dcd0 tempest-TestNetworkBasicOps-2108387462 tempest-TestNetworkBasicOps-2108387462-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-959794016" status: 202 len: 0 microversion: 2.1 time: 0.025921 Oct 28 10:40:54.440867 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3521/7047] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 10:40:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-959794016 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:41:09.238551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=10 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:09.239293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=16 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:09.384844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:09.386604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:09.387126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:09.387569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:09.388301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:09.388760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:09.389269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:09.414175 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80aa25d2-b46d-46d6-8ba6-5ebbd04709f6 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 603 microversion: 2.1 time: 0.181776 Oct 28 10:41:09.414811 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3527/7048] 10.222.0.16 () {58 vars in 1185 bytes} [Fri Oct 28 10:41:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 603 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:09.513130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:09.513932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:09.518571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-324883421", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "availability_zone": "nova:n-h1-zed-1", "networks": [{"uuid": "c03a17a3-f2dc-4efe-b8d8-ea2a161d2825"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:09.581713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] validate_networks() for [('c03a17a3-f2dc-4efe-b8d8-ea2a161d2825', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:41:09.968135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:41:09.968696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:41:09.969866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:41:09.970394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:41:09.970925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:41:09.980934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:09.981444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:09.981893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:09.982635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:09.983244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:09.983697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:10.002708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Getting quotas for project acebe9d0b4c74401a041401efdf08073. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:41:10.008127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Getting quotas for user b5247768a5ec4196a43c639a479cb97d and project acebe9d0b4c74401a041401efdf08073. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:41:10.021149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:41:10.023507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:41:10.070976 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a69e9f57-cd95-4786-aacc-3233d83b7f64 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.559594 Oct 28 10:41:10.071812 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3522/7049] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:41:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:41:10.083539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1269e8df-bba8-4ce1-8576-249bad779332 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:10.084355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1269e8df-bba8-4ce1-8576-249bad779332 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:10.146514 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1269e8df-bba8-4ce1-8576-249bad779332 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1328 microversion: 2.1 time: 0.066629 Oct 28 10:41:10.148275 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3528/7050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:10 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1328 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:11.170702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:11.171587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:11.178403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:11.178919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:11.179584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:11.180297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:11.180772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:11.181410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:11.261188 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5062b97f-bc41-4000-8eb9-4c986eddfbd8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1409 microversion: 2.1 time: 0.095126 Oct 28 10:41:11.261777 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3523/7051] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:11 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1409 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:12.284385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:12.285061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:12.293658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:12.294528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:12.295329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:12.296785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:12.298335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:12.299392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:12.445331 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec920cee-8f39-43c3-911f-8158fd68b2a4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1457 microversion: 2.1 time: 0.165369 Oct 28 10:41:12.445963 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3529/7052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:12 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1457 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:12.614511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d16824e5-be22-4c25-ac98-ee059670d95d req-50f277b5-0f37-4d11-933f-5c226ed1466e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3371eae4-f35d-4fbc-913e-6e69a67c7c0b", "tag": "4b62afb8-4470-429e-ae0e-ea6d7b85f079"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:12.627277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d16824e5-be22-4c25-ac98-ee059670d95d req-50f277b5-0f37-4d11-933f-5c226ed1466e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:12.628132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d16824e5-be22-4c25-ac98-ee059670d95d req-50f277b5-0f37-4d11-933f-5c226ed1466e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:12.628577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d16824e5-be22-4c25-ac98-ee059670d95d req-50f277b5-0f37-4d11-933f-5c226ed1466e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:12.643831 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d16824e5-be22-4c25-ac98-ee059670d95d req-50f277b5-0f37-4d11-933f-5c226ed1466e service nova] Creating event network-changed:4b62afb8-4470-429e-ae0e-ea6d7b85f079 for instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b on n-h1-zed-1 Oct 28 10:41:12.649392 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d16824e5-be22-4c25-ac98-ee059670d95d req-50f277b5-0f37-4d11-933f-5c226ed1466e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039188 Oct 28 10:41:12.650684 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3524/7053] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:13.468738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:13.469511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:13.476894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:13.477508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:13.477969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:13.478676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:13.479138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:13.479571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:13.604792 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6c30445a-e720-4159-b9fc-093c6745fe66 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1457 microversion: 2.1 time: 0.139647 Oct 28 10:41:13.605333 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3530/7054] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:13 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1457 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:14.629005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:14.629920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:14.636806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:14.637350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:14.637806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:14.638527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:14.639001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:14.639448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:14.776616 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cf54d220-8097-442b-9af0-7ad483a59efd tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1457 microversion: 2.1 time: 0.152607 Oct 28 10:41:14.777239 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3525/7055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:14 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1457 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:15.801491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:15.802697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:15.809680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:15.810180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:15.810772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:15.811491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:15.811956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:15.813325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:15.946937 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ab78c42e-afb5-4b1f-beb8-9ea496520a27 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1457 microversion: 2.1 time: 0.149918 Oct 28 10:41:15.947770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3531/7056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:15 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1457 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:16.970227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:16.970883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:16.977773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:16.978272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:16.978725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:16.979433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:16.979902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:16.980342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:17.110095 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ebc1bc48-2401-4f8a-b885-4bf4205f9185 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1457 microversion: 2.1 time: 0.143098 Oct 28 10:41:17.110685 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3526/7057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:16 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1457 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:17.657270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fd2a0771-5d29-485e-b47e-5d01d2df5f08 req-e490b38c-6ca5-4465-9d79-d93cf33fe583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3371eae4-f35d-4fbc-913e-6e69a67c7c0b", "name": "network-vif-plugged", "status": "completed", "tag": "4b62afb8-4470-429e-ae0e-ea6d7b85f079"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:17.669447 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fd2a0771-5d29-485e-b47e-5d01d2df5f08 req-e490b38c-6ca5-4465-9d79-d93cf33fe583 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:17.670414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fd2a0771-5d29-485e-b47e-5d01d2df5f08 req-e490b38c-6ca5-4465-9d79-d93cf33fe583 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:17.670855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fd2a0771-5d29-485e-b47e-5d01d2df5f08 req-e490b38c-6ca5-4465-9d79-d93cf33fe583 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:17.683940 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fd2a0771-5d29-485e-b47e-5d01d2df5f08 req-e490b38c-6ca5-4465-9d79-d93cf33fe583 service nova] Creating event network-vif-plugged:4b62afb8-4470-429e-ae0e-ea6d7b85f079 for instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b on n-h1-zed-1 Oct 28 10:41:17.689197 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fd2a0771-5d29-485e-b47e-5d01d2df5f08 req-e490b38c-6ca5-4465-9d79-d93cf33fe583 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036155 Oct 28 10:41:17.689795 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3532/7058] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:18.132651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:18.133320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:18.140168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:18.141204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:18.141666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:18.142379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:18.142852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:18.143297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:18.274449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92249bcc-73a8-46cb-bf39-fadd90b31f5d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1457 microversion: 2.1 time: 0.145416 Oct 28 10:41:18.275043 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3527/7059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:18 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1457 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:19.298157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:19.298875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:19.306009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:19.306507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:19.306955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:19.307659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:19.308124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:19.308561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:19.394649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:19.434051 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb55c53e-f15a-46a3-81c2-e3f487d0704d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1643 microversion: 2.1 time: 0.140498 Oct 28 10:41:19.434625 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3533/7060] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:19 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1643 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:19.457074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:19.457735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:19.465296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:19.465798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:19.466258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:19.466966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:19.467439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:19.467919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:19.593006 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-338e1085-5917-42b5-8053-65287983b5b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1643 microversion: 2.1 time: 0.140490 Oct 28 10:41:19.594253 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3528/7061] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:19 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1643 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:19.615256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:19.615879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:19.622040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:19.622536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:19.622983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:19.623683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:19.624145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:19.624581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:19.750493 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fbff2af-624c-48a0-95c1-2ddcb5a7c096 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1643 microversion: 2.1 time: 0.138406 Oct 28 10:41:19.751067 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3534/7062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:19 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1643 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:19.810837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-903287308", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "availability_zone": "nova:n-h2-zed-1", "networks": [{"uuid": "c03a17a3-f2dc-4efe-b8d8-ea2a161d2825"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:19.867837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] validate_networks() for [('c03a17a3-f2dc-4efe-b8d8-ea2a161d2825', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:41:19.989253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:20.015061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:20.211406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:41:20.211853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:41:20.212356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:41:20.212786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:41:20.213361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:41:20.222303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:20.222812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:20.223337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:20.224089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:20.224564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:20.225051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:20.243895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Getting quotas for project acebe9d0b4c74401a041401efdf08073. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:41:20.249212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Getting quotas for user b5247768a5ec4196a43c639a479cb97d and project acebe9d0b4c74401a041401efdf08073. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:41:20.262362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:41:20.264758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:41:20.310165 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-998782d1-9518-477f-818a-64968702c7e5 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.503020 Oct 28 10:41:20.310845 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3529/7063] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:41:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:41:20.322534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-58a30a24-d389-41e8-bff8-03f79a8e260b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:20.323235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-58a30a24-d389-41e8-bff8-03f79a8e260b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:20.325124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:20.410920 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-58a30a24-d389-41e8-bff8-03f79a8e260b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1328 microversion: 2.1 time: 0.091803 Oct 28 10:41:20.411326 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3535/7064] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:20 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:21.166718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:21.167364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:21.170458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-caff68e2-c6f7-4163-b1b4-5e46c4119518 req-c837cd79-7006-4511-8c79-b4d39454b6d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7661d95-f582-4a6a-b6b8-900bf9ff7511", "tag": "3a19fa59-126e-42fc-b2e8-10a36f48daee"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:21.174719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:21.175302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:21.175821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:21.176610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:21.177185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:21.177695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:21.185889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-caff68e2-c6f7-4163-b1b4-5e46c4119518 req-c837cd79-7006-4511-8c79-b4d39454b6d1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:21.186774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-caff68e2-c6f7-4163-b1b4-5e46c4119518 req-c837cd79-7006-4511-8c79-b4d39454b6d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:21.187388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-caff68e2-c6f7-4163-b1b4-5e46c4119518 req-c837cd79-7006-4511-8c79-b4d39454b6d1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:21.199437 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-caff68e2-c6f7-4163-b1b4-5e46c4119518 req-c837cd79-7006-4511-8c79-b4d39454b6d1 service nova] Creating event network-changed:3a19fa59-126e-42fc-b2e8-10a36f48daee for instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 on n-h1-zed-1 Oct 28 10:41:21.203987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:41:21.206985 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-caff68e2-c6f7-4163-b1b4-5e46c4119518 req-c837cd79-7006-4511-8c79-b4d39454b6d1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040635 Oct 28 10:41:21.207956 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3536/7065] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:41:21.291260 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c3c63969-3166-4d16-acd0-62a4756a512d tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 204 len: 0 microversion: 2.1 time: 0.129607 Oct 28 10:41:21.292508 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3530/7066] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:41:21 2022] DELETE /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:41:21.302337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:21.303453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:21.311300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:21.312564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:21.313209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:21.314090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:21.314713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:21.315141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:21.436184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:21.439314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:21.446660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:21.447450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:21.448136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:21.450118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:21.451393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:21.452299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:21.487115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:21.495867 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-565969ed-064b-4f9f-be8b-2aed079c5fa0 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1576 microversion: 2.1 time: 0.197901 Oct 28 10:41:21.496463 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3537/7067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:21 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:21.573904 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-526d4244-98f8-4860-9120-45b3e1cff911 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1417 microversion: 2.1 time: 0.142816 Oct 28 10:41:21.574652 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3531/7068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:21 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1417 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:22.520221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:22.521031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:22.527960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:22.528459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:22.528927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:22.529636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:22.530102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:22.530538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:22.607498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:22.609596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:22.617845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:22.618355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:22.619238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:22.620114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:22.620597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:22.621223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:22.685935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:22.694258 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d3a5f13-7b73-49b6-8326-9841156c48f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1576 microversion: 2.1 time: 0.177914 Oct 28 10:41:22.694850 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3538/7069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:22 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:23.546274 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f0fad7d-c850-4b1e-a9f1-9370d5174dee tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.942874 Oct 28 10:41:23.547281 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3532/7070] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:22 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:23.718442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:23.719342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:23.726550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:23.727052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:23.727754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:23.728459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:23.729297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:23.729746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:23.888469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:23.897449 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb49fc15-2a8f-4685-a6e9-2bf4c39604cb tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1576 microversion: 2.1 time: 0.182875 Oct 28 10:41:23.898437 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3539/7071] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:23 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:24.310653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b7a133de-9f29-4125-bcf1-327949f62e7b req-a6bab6ed-d036-495c-9a65-00251b646f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a0b749b-7c98-4f91-b4ca-c0136aacd0b1", "tag": "ae6f6d49-a8ef-4196-aa58-915f5c7278ef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:24.332527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b7a133de-9f29-4125-bcf1-327949f62e7b req-a6bab6ed-d036-495c-9a65-00251b646f3c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:24.333329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b7a133de-9f29-4125-bcf1-327949f62e7b req-a6bab6ed-d036-495c-9a65-00251b646f3c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:24.334233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b7a133de-9f29-4125-bcf1-327949f62e7b req-a6bab6ed-d036-495c-9a65-00251b646f3c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:24.351181 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b7a133de-9f29-4125-bcf1-327949f62e7b req-a6bab6ed-d036-495c-9a65-00251b646f3c service nova] Creating event network-changed:ae6f6d49-a8ef-4196-aa58-915f5c7278ef for instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 on n-h2-zed-1 Oct 28 10:41:24.357187 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b7a133de-9f29-4125-bcf1-327949f62e7b req-a6bab6ed-d036-495c-9a65-00251b646f3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050574 Oct 28 10:41:24.358190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3533/7072] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:24.571187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:24.571967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:24.579806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:24.580560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:24.581229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:24.582195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:24.582834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:24.583270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:24.743699 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba130167-d701-4aac-8d50-3f62fc770fd4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.177312 Oct 28 10:41:24.759219 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3540/7073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:24 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:24.923001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:24.924023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:24.931097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:24.931820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:24.932454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:24.933360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:24.933982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:24.943846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:25.024807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:25.033614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a48470f-6baa-4ede-baf0-e29d7bedaa7b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1225 microversion: 2.1 time: 0.114897 Oct 28 10:41:25.034185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3534/7074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:24 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1225 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:25.767607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:25.768133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:25.775112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:25.775612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:25.776027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:25.776723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:25.777332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:25.777763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:25.909912 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e76d5b71-0108-4304-be62-f6e01c9d0748 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.146036 Oct 28 10:41:25.910589 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3541/7075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:25 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:26.056362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:26.057024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:26.064502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:26.065044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:26.065510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:26.066233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:26.066711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:26.067163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:26.136571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:26.144826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c11d6c0-348b-4d0c-86a9-1d73045aa8f4 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1225 microversion: 2.1 time: 0.092283 Oct 28 10:41:26.145477 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3535/7076] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:26 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:26.377778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-acd6324f-4a94-47c5-a9a5-ed6b95b89a25 req-7808d8af-0f61-4258-8dab-fe5bbc749b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7661d95-f582-4a6a-b6b8-900bf9ff7511", "name": "network-vif-deleted", "tag": "3a19fa59-126e-42fc-b2e8-10a36f48daee"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:26.387702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-acd6324f-4a94-47c5-a9a5-ed6b95b89a25 req-7808d8af-0f61-4258-8dab-fe5bbc749b65 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:26.388119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-acd6324f-4a94-47c5-a9a5-ed6b95b89a25 req-7808d8af-0f61-4258-8dab-fe5bbc749b65 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:26.388560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-acd6324f-4a94-47c5-a9a5-ed6b95b89a25 req-7808d8af-0f61-4258-8dab-fe5bbc749b65 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:26.400009 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-acd6324f-4a94-47c5-a9a5-ed6b95b89a25 req-7808d8af-0f61-4258-8dab-fe5bbc749b65 service nova] Creating event network-vif-deleted:3a19fa59-126e-42fc-b2e8-10a36f48daee for instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 on n-h1-zed-1 Oct 28 10:41:26.405018 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-acd6324f-4a94-47c5-a9a5-ed6b95b89a25 req-7808d8af-0f61-4258-8dab-fe5bbc749b65 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031409 Oct 28 10:41:26.405814 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3542/7077] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:26.934318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:26.934954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:26.941962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:26.942548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:26.943017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:26.943762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:26.944240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:26.944684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:27.169202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:27.170056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:27.179910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:27.184611 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9bb1995c-104c-44d7-bed4-29302b70241d tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.254134 Oct 28 10:41:27.185652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:27.186200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:27.187059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:27.187625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:27.188162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:27.196984 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3536/7078] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:26 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:27.258794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:27.267480 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7f0ce4cb-212f-4d52-a090-7310597a7cec tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1225 microversion: 2.1 time: 0.103171 Oct 28 10:41:27.268115 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3543/7079] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:27 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:28.210982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:28.211610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:28.218432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:28.218925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:28.219368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:28.220066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:28.220529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:28.220991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:28.291683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:28.292816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:28.300218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:28.301004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:28.301449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:28.302152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:28.302613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:28.303041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:28.354852 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-68fa11ba-e556-4098-9364-fedcde9e29b4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.147444 Oct 28 10:41:28.355452 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3537/7080] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:28 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:28.370494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:28.378687 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6b4fdbe3-ab28-47d3-9078-c5107829aa81 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 200 len: 1225 microversion: 2.1 time: 0.091054 Oct 28 10:41:28.379264 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3544/7081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:28 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:29.378226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:29.378840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:29.385655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:29.386156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:29.386610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:29.387312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:29.387784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:29.388498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:29.402247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:29.402873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c7661d95-f582-4a6a-b6b8-900bf9ff7511] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:29.409979 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:29.410479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:29.410925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:29.411632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:29.412102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:29.412536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:29.426090 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 could not be found. Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 HTTP/1.1 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 could not be found. Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'c7661d95-f582-4a6a-b6b8-900bf9ff7511'} Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 could not be found. Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 could not be found. Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:29.427765 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 could not be found. Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance c7661d95-f582-4a6a-b6b8-900bf9ff7511 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99513280-a095-4341-a16d-3279d3d9c195 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511" status: 404 len: 111 microversion: 2.1 time: 0.030834 Oct 28 10:41:29.431784 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3545/7082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:29 2022] GET /compute/v2.1/servers/c7661d95-f582-4a6a-b6b8-900bf9ff7511 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:41:29.536336 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-756511df-048c-43df-91f8-29534d9f2e11 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.162424 Oct 28 10:41:29.558466 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3538/7083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:29 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:30.559659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:30.561830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:30.569427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:30.572193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:30.573120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:30.574236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:30.575522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:30.576223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:30.577942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:30.679294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ca0cbd79-d7fb-4630-9c03-0f6578ddf3bf req-b09c8118-7b83-4262-a47a-b8611f3b80a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0b749b-7c98-4f91-b4ca-c0136aacd0b1", "name": "network-vif-plugged", "status": "completed", "tag": "ae6f6d49-a8ef-4196-aa58-915f5c7278ef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:30.686972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:30.696133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:30.708401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ca0cbd79-d7fb-4630-9c03-0f6578ddf3bf req-b09c8118-7b83-4262-a47a-b8611f3b80a4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:30.709155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ca0cbd79-d7fb-4630-9c03-0f6578ddf3bf req-b09c8118-7b83-4262-a47a-b8611f3b80a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:30.709763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ca0cbd79-d7fb-4630-9c03-0f6578ddf3bf req-b09c8118-7b83-4262-a47a-b8611f3b80a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:30.725034 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ca0cbd79-d7fb-4630-9c03-0f6578ddf3bf req-b09c8118-7b83-4262-a47a-b8611f3b80a4 service nova] Creating event network-vif-plugged:ae6f6d49-a8ef-4196-aa58-915f5c7278ef for instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 on n-h2-zed-1 Oct 28 10:41:30.740170 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ca0cbd79-d7fb-4630-9c03-0f6578ddf3bf req-b09c8118-7b83-4262-a47a-b8611f3b80a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064429 Oct 28 10:41:30.741367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3539/7084] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:30.801159 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e1aa399e-fd8d-4483-8add-c3d15a726ad4 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.245266 Oct 28 10:41:30.817372 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3546/7085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:30 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:31.827837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:31.828457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:31.835147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:31.835656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:31.836114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:31.836851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:31.837346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:31.837791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:31.841983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:31.971376 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-41404300-4af5-40b0-9b10-9131c41143b8 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1457 microversion: 2.1 time: 0.149317 Oct 28 10:41:31.971949 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3540/7086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:31 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1457 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:32.994506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:32.995712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:33.002783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.003279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.003725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.004433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.004898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.005363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.143670 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d13a3446-d9d7-49ca-842f-f5467372114b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1643 microversion: 2.1 time: 0.152859 Oct 28 10:41:33.144824 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3547/7087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:32 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1643 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:33.166845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:33.168156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:33.176050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.176625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.177325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.178297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.178838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.179350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.312388 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c8f6fe1d-8fe7-4005-a302-5a2fe61a6da0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1643 microversion: 2.1 time: 0.149302 Oct 28 10:41:33.313176 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3541/7088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:33 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1643 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:33.335205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:33.335824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:33.342043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.343247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.343863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.344566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.345077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.345538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.494379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=100 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:33.503932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9354caef-d6e6-4cf4-9b6b-5c6b13247492 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1643 microversion: 2.1 time: 0.172434 Oct 28 10:41:33.505213 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3548/7089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:33 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1643 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:33.526985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:33.527506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:33.534206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.534722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.535173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.535889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.536390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.536840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.561948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:41:33.641567 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87808045-6b3f-40a2-b8a1-8332a6d105a0 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 204 len: 0 microversion: 2.1 time: 0.118047 Oct 28 10:41:33.642500 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3542/7090] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:41:33 2022] DELETE /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:41:33.650891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:33.651759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:33.657808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.658299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.658766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.659469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:33.659933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:33.660363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:33.792634 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-345b64b9-eea1-4c94-bac5-264912b70a43 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1649 microversion: 2.1 time: 0.145707 Oct 28 10:41:33.793249 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3549/7091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:33 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1649 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:34.816140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:34.816852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:34.823789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:34.824230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:34.824684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:34.825427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:34.825901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:34.826346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:35.095385 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9a6e8146-be64-405c-ae38-86af17a4b477 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1649 microversion: 2.1 time: 0.283312 Oct 28 10:41:35.096450 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3543/7092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:34 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1649 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:35.499757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fcc8fd8e-4486-486c-b59d-98c1f15427da req-da9af709-93e8-42e0-aca9-6b993adaad30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a0b749b-7c98-4f91-b4ca-c0136aacd0b1", "name": "network-vif-deleted", "tag": "ae6f6d49-a8ef-4196-aa58-915f5c7278ef"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:35.514007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fcc8fd8e-4486-486c-b59d-98c1f15427da req-da9af709-93e8-42e0-aca9-6b993adaad30 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:35.514871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fcc8fd8e-4486-486c-b59d-98c1f15427da req-da9af709-93e8-42e0-aca9-6b993adaad30 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:35.516144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fcc8fd8e-4486-486c-b59d-98c1f15427da req-da9af709-93e8-42e0-aca9-6b993adaad30 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:35.530602 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fcc8fd8e-4486-486c-b59d-98c1f15427da req-da9af709-93e8-42e0-aca9-6b993adaad30 service nova] Creating event network-vif-deleted:ae6f6d49-a8ef-4196-aa58-915f5c7278ef for instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 on n-h2-zed-1 Oct 28 10:41:35.541192 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fcc8fd8e-4486-486c-b59d-98c1f15427da req-da9af709-93e8-42e0-aca9-6b993adaad30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047315 Oct 28 10:41:35.546572 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3550/7093] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:35.799351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:35.799877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:35.806509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8e871289-fa5d-47d3-a02f-f5801ca7f7ea req-aa843f05-840f-4ac7-81b3-cafe5432705f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c85adddd-047a-4bc9-885a-010eff9accce", "tag": "6cb413d3-a3d7-482a-8018-7404a4a47c5a"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:35.811110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:35.811639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:35.812116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:35.812831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:35.813341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:35.813815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:35.816256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8e871289-fa5d-47d3-a02f-f5801ca7f7ea req-aa843f05-840f-4ac7-81b3-cafe5432705f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:35.816747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8e871289-fa5d-47d3-a02f-f5801ca7f7ea req-aa843f05-840f-4ac7-81b3-cafe5432705f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:35.817216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8e871289-fa5d-47d3-a02f-f5801ca7f7ea req-aa843f05-840f-4ac7-81b3-cafe5432705f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:35.829300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8e871289-fa5d-47d3-a02f-f5801ca7f7ea req-aa843f05-840f-4ac7-81b3-cafe5432705f service nova] Creating event network-changed:6cb413d3-a3d7-482a-8018-7404a4a47c5a for instance c85adddd-047a-4bc9-885a-010eff9accce on n-h2-zed-1 Oct 28 10:41:35.834481 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8e871289-fa5d-47d3-a02f-f5801ca7f7ea req-aa843f05-840f-4ac7-81b3-cafe5432705f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032045 Oct 28 10:41:35.837216 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3551/7094] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:41:35.843736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:41:35.919844 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aab8c6eb-1f51-4613-b594-e5618573304a tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 204 len: 0 microversion: 2.1 time: 0.124435 Oct 28 10:41:35.920695 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3544/7095] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:41:35 2022] DELETE /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:41:35.929546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:35.930263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:35.936454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:35.937602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:35.938054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:35.938756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:35.939249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:35.939685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:36.120243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:36.121404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:36.128044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:36.128806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:36.129352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:36.130146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:36.130695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:36.131205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:36.161794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:36.165783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:36.166778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:36.167236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:36.167725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lazy-loading 'fault' on Instance uuid 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:41:36.180539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:36.189997 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3cc83491-7d7b-421f-840f-a2920802563b tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1576 microversion: 2.1 time: 0.264710 Oct 28 10:41:36.190747 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3552/7096] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:35 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1576 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:36.225122 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4609bc8-d1f9-4d14-866e-d7646c4a476a tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 200 len: 1447 microversion: 2.1 time: 0.108906 Oct 28 10:41:36.225827 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3545/7097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:36 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 1447 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:41:37.214029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:37.214663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:37.222115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.222640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.223091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.223792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.224259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.224696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.249899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:37.251034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:37.258800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.259390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.259914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.260704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.261297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.261810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.276285 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] HTTP exception thrown: Instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 could not be found. Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Request method failure captured: Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 HTTP/1.1 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7HFUKIdY4WFpjSPFwECslvXamTAlAgvwlI8WnmGGIbQPw2CzT8BYDmRtbGfeReJmPuiilqNq5uw11m8gN2HymVHvTLG_mY7x5wHMi1bfh47_WZbjElGhr4gAWHi6HYdbxSC5omfzFJwvoeW19B5WJpbwUapCZcjHzInkmlIfrau9wQ Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: acebe9d0b4c74401a041401efdf08073 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestServerMultinode-2004760311 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acebe9d0b4c74401a041401efdf08073"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acebe9d0b4c74401a041401efdf08073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acebe9d0b4c74401a041401efdf08073", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acebe9d0b4c74401a041401efdf08073"}]}] Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestServerMultinode-2004760311 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: acebe9d0b4c74401a041401efdf08073 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestServerMultinode-2004760311 Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestServerMultinode-2004760311-project-admin Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: b5247768a5ec4196a43c639a479cb97d Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestServerMultinode-2004760311-project-admin Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 could not be found. Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '5a0b749b-7c98-4f91-b4ca-c0136aacd0b1'} Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 could not be found. Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 could not be found. Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:37.278005 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 could not be found. Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Returning 404 to user: Instance 5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eabd02f1-9474-40c4-a813-3179e90a5a3f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1" status: 404 len: 111 microversion: 2.1 time: 0.033566 Oct 28 10:41:37.286245 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3546/7098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:37 2022] GET /compute/v2.1/servers/5a0b749b-7c98-4f91-b4ca-c0136aacd0b1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:41:37.288380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:37.288888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:37.294680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.295173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.295621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.296322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.296784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.297244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.326116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:41:37.368695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:37.377242 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cd06c640-978f-4c09-8ab9-7c0252b3bd4e tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1576 microversion: 2.1 time: 0.167067 Oct 28 10:41:37.377835 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3553/7099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:37 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:37.407127 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f37e1e1-279e-4ebc-8822-2edd8dc49587 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "DELETE /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 204 len: 0 microversion: 2.1 time: 0.121603 Oct 28 10:41:37.408060 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3547/7100] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:41:37 2022] DELETE /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:41:37.416971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:37.417600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:37.423907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.424408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.424855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.425592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:37.426235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:37.426675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:37.555094 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f1b689c-e152-4782-981f-2c7a2de11431 tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1649 microversion: 2.1 time: 0.142121 Oct 28 10:41:37.555874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3554/7101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:37 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1649 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:38.343731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-feebd930-3021-4aa0-92a5-2f84c7ac1580 req-3fc93da7-62c1-4182-9db9-29a269e425f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c85adddd-047a-4bc9-885a-010eff9accce", "name": "network-vif-deleted", "tag": "6cb413d3-a3d7-482a-8018-7404a4a47c5a"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:38.357128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-feebd930-3021-4aa0-92a5-2f84c7ac1580 req-3fc93da7-62c1-4182-9db9-29a269e425f2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:38.357652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-feebd930-3021-4aa0-92a5-2f84c7ac1580 req-3fc93da7-62c1-4182-9db9-29a269e425f2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:38.358112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-feebd930-3021-4aa0-92a5-2f84c7ac1580 req-3fc93da7-62c1-4182-9db9-29a269e425f2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:38.368824 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-feebd930-3021-4aa0-92a5-2f84c7ac1580 req-3fc93da7-62c1-4182-9db9-29a269e425f2 service nova] Creating event network-vif-deleted:6cb413d3-a3d7-482a-8018-7404a4a47c5a for instance c85adddd-047a-4bc9-885a-010eff9accce on n-h2-zed-1 Oct 28 10:41:38.375231 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-feebd930-3021-4aa0-92a5-2f84c7ac1580 req-3fc93da7-62c1-4182-9db9-29a269e425f2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035173 Oct 28 10:41:38.375840 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3548/7102] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:41:38.402125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:38.402859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:38.410273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:38.410847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:38.411300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:38.412007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:38.412472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:38.412933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:38.478027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:38.487052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-885fb958-73e7-4438-9e01-2dec0aea3496 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1224 microversion: 2.1 time: 0.088871 Oct 28 10:41:38.487633 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3555/7103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:38 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:38.579562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:38.580308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:38.587045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:38.587934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:38.588194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:38.588971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:38.589460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:38.589910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:38.741798 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b85c66d1-44d2-4fae-acc5-50c4ebe85cfb tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1649 microversion: 2.1 time: 0.166680 Oct 28 10:41:38.742642 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3549/7104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:38 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1649 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:39.510966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:39.512187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:39.519502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=65 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:39.520937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:39.521700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:39.522361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:39.523164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:39.523788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:39.524293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:39.594421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:39.602571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce7057f8-1108-479d-bc15-3a35e5a95eb5 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1224 microversion: 2.1 time: 0.095561 Oct 28 10:41:39.603160 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3556/7105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:39 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:39.767717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:39.768509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:39.775791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:39.776301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:39.776758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:39.777547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:39.778021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:39.778602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:39.814185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:39.814595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:39.815051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:39.815520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lazy-loading 'fault' on Instance uuid 3371eae4-f35d-4fbc-913e-6e69a67c7c0b {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:41:39.873883 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e0132d3c-562e-46ca-ba6c-1ece1624900f tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 200 len: 1447 microversion: 2.1 time: 0.110122 Oct 28 10:41:39.875673 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3550/7106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:39 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 1447 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:40.390050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6cc2ec83-0225-4022-9be0-74239816f21c req-518921fe-3a31-4fc4-bec1-0a2b819d0162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3371eae4-f35d-4fbc-913e-6e69a67c7c0b", "name": "network-vif-deleted", "tag": "4b62afb8-4470-429e-ae0e-ea6d7b85f079"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:41:40.399539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6cc2ec83-0225-4022-9be0-74239816f21c req-518921fe-3a31-4fc4-bec1-0a2b819d0162 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:40.400019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6cc2ec83-0225-4022-9be0-74239816f21c req-518921fe-3a31-4fc4-bec1-0a2b819d0162 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:40.400448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6cc2ec83-0225-4022-9be0-74239816f21c req-518921fe-3a31-4fc4-bec1-0a2b819d0162 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:40.411718 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6cc2ec83-0225-4022-9be0-74239816f21c req-518921fe-3a31-4fc4-bec1-0a2b819d0162 service nova] Creating event network-vif-deleted:4b62afb8-4470-429e-ae0e-ea6d7b85f079 for instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b on n-h1-zed-1 Oct 28 10:41:40.416564 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6cc2ec83-0225-4022-9be0-74239816f21c req-518921fe-3a31-4fc4-bec1-0a2b819d0162 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030231 Oct 28 10:41:40.417167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3557/7107] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:41:40.625645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:40.626273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:40.632471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:40.632919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:40.633388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:40.634084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:40.634549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:40.634987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:40.700133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:40.708897 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e882e211-d259-45e6-808c-6b723f2c149f tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1224 microversion: 2.1 time: 0.087219 Oct 28 10:41:40.709502 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3551/7108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:40 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:40.900136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:40.900941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] [instance: 3371eae4-f35d-4fbc-913e-6e69a67c7c0b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:40.907933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:40.908428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:40.908878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:40.909612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:40.910078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:40.910518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:40.923883 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] HTTP exception thrown: Instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b could not be found. Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Request method failure captured: Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b HTTP/1.1 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7HFUKIdY4WFpjSPFwECslvXamTAlAgvwlI8WnmGGIbQPw2CzT8BYDmRtbGfeReJmPuiilqNq5uw11m8gN2HymVHvTLG_mY7x5wHMi1bfh47_WZbjElGhr4gAWHi6HYdbxSC5omfzFJwvoeW19B5WJpbwUapCZcjHzInkmlIfrau9wQ Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: acebe9d0b4c74401a041401efdf08073 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestServerMultinode-2004760311 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acebe9d0b4c74401a041401efdf08073"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/acebe9d0b4c74401a041401efdf08073"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_acebe9d0b4c74401a041401efdf08073", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/acebe9d0b4c74401a041401efdf08073"}]}] Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestServerMultinode-2004760311 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: acebe9d0b4c74401a041401efdf08073 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestServerMultinode-2004760311 Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestServerMultinode-2004760311-project-admin Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: b5247768a5ec4196a43c639a479cb97d Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestServerMultinode-2004760311-project-admin Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b could not be found. Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '3371eae4-f35d-4fbc-913e-6e69a67c7c0b'} Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b could not be found. Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b could not be found. Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:40.925568 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b could not be found. Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] Returning 404 to user: Instance 3371eae4-f35d-4fbc-913e-6e69a67c7c0b could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e9fc58ab-3ef1-4089-bf73-224166c1f58b tempest-TestServerMultinode-2004760311 tempest-TestServerMultinode-2004760311-project-admin] 10.222.0.16 "GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b" status: 404 len: 111 microversion: 2.1 time: 0.031971 Oct 28 10:41:40.929336 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3558/7109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:40 2022] GET /compute/v2.1/servers/3371eae4-f35d-4fbc-913e-6e69a67c7c0b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:41:41.734101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:41.734761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:41.741921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:41.742498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:41.743025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:41.743834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:41.744407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:41.744934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:41.765586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:41:41.816807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:41.824826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-71ef62ef-ab16-4920-aafe-6fd3a7cda5b6 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1224 microversion: 2.1 time: 0.095238 Oct 28 10:41:41.825515 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3552/7110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:41 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:42.849664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:42.850885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:42.862940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:42.863736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:42.864358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:42.865341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:42.865997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:42.866443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:42.905932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:42.906433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:42.906885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:42.907349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lazy-loading 'fault' on Instance uuid c85adddd-047a-4bc9-885a-010eff9accce {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:41:42.970328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2ad8fbe36e43358ba644627ebb1d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b98d113d6914d01a909378c1c96e3fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:41:42.981647 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b15ba70-dc69-4807-a757-37d54ced3839 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 200 len: 1229 microversion: 2.1 time: 0.136593 Oct 28 10:41:42.996930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3559/7111] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:42 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 1229 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:41:44.007976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:44.008737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: c85adddd-047a-4bc9-885a-010eff9accce] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:44.017040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:44.018162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:44.018936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:44.020475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:44.022149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:44.023168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:44.041620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance c85adddd-047a-4bc9-885a-010eff9accce could not be found. Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce HTTP/1.1 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance c85adddd-047a-4bc9-885a-010eff9accce could not be found. Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'c85adddd-047a-4bc9-885a-010eff9accce'} Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c85adddd-047a-4bc9-885a-010eff9accce could not be found. Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c85adddd-047a-4bc9-885a-010eff9accce could not be found. Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:44.043408 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c85adddd-047a-4bc9-885a-010eff9accce could not be found. Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:44.047748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance c85adddd-047a-4bc9-885a-010eff9accce could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:41:44.048321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6d56647a-08b7-4b46-98ad-515a00ebbf02 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce" status: 404 len: 111 microversion: 2.1 time: 0.043477 Oct 28 10:41:44.049104 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3553/7112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:44 2022] GET /compute/v2.1/servers/c85adddd-047a-4bc9-885a-010eff9accce => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:41:45.162726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:45.163309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:45.170071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:45.170645 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:45.171721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:45.172494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:45.173060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:45.173583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:45.189950 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 HTTP/1.1 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '9339f0d1-aaee-4726-aed8-5efb32bb1393'} Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:41:45.191650 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c36a77f1-f957-4a4e-8029-389b6022ba16 tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 404 len: 111 microversion: 2.1 time: 0.034731 Oct 28 10:41:45.195800 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3560/7113] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:41:45 2022] DELETE /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:41:45.203093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:45.203844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] [instance: 9339f0d1-aaee-4726-aed8-5efb32bb1393] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:41:45.210881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:45.211464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:45.211991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:45.212797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:41:45.213369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:41:45.213884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:41:45.228490 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] HTTP exception thrown: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Request method failure captured: Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 HTTP/1.1 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW681Tywxz0B8igOME9w0lVbfmz34fwO8iNUyHGtHH4sEWQB8-7Kt_KmYG_KZm5L4uX_WCxXudJeMzyMqUEassTNzCTPg_rKMAxZnAFzbl3L0KN59nEyZl3V-56k-papTIEBO6k21-j20SkDzWHsxNNrRXFogDPxvcJuq80HNPUUQOr8 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7b98d113d6914d01a909378c1c96e3fa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7b98d113d6914d01a909378c1c96e3fa", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7b98d113d6914d01a909378c1c96e3fa"}]}] Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7b98d113d6914d01a909378c1c96e3fa Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestVolumeBootPattern-1870621227 Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 8b2ad8fbe36e43358ba644627ebb1d8b Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestVolumeBootPattern-1870621227-project Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '9339f0d1-aaee-4726-aed8-5efb32bb1393'} Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:41:45.230175 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Returning 404 to user: Instance 9339f0d1-aaee-4726-aed8-5efb32bb1393 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:41:45.234454 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad38629a-0e22-4012-b9bc-151c70ea2efc tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393" status: 404 len: 111 microversion: 2.1 time: 0.035235 Oct 28 10:41:45.235604 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3554/7114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:41:45 2022] GET /compute/v2.1/servers/9339f0d1-aaee-4726-aed8-5efb32bb1393 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:41:48.721386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2e05fabb-5fe3-40c1-ab6e-c66a0f6b1daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] Calling method '.version_select at 0x7fca3b9c0ee0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:41:48.784429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2e05fabb-5fe3-40c1-ab6e-c66a0f6b1daf tempest-TestVolumeBootPattern-1870621227 tempest-TestVolumeBootPattern-1870621227-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-351906278" status: 202 len: 0 microversion: 2.1 time: 0.068454 Oct 28 10:41:48.785716 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3561/7115] 10.222.0.16 () {58 vars in 1260 bytes} [Fri Oct 28 10:41:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-351906278 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:43:49.921962 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 10:43:49.922945 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 10:43:49.923908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:49.924871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:49.926494 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 10:43:49.926722 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 10:43:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.16) !!! Oct 28 10:43:49.932093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-364a84b7-d60a-4a1a-aaad-f4b130c634c8 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Action: 'create', calling method: .version_select at 0x7fca3271ed30>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2140747046", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgQQ7p3i7zTV3TrE9ocbDToqa8l8OvfQ71OZRsskxWnjJ7P8pHIMIQLmM73K6B8TbRD7Yjh/m6h1txOvdcuoFHd7tfbAA28KomrR7VivV50v7lJZVrLjGa6WMOxVFCBPA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:43:49.954129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-364a84b7-d60a-4a1a-aaad-f4b130c634c8 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Getting quotas for project 8bc10bfafe084721b5530999187aead0. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:43:49.959443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-364a84b7-d60a-4a1a-aaad-f4b130c634c8 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Getting quotas for user 5922bd77a54c448ca47ce3b326079efd and project 8bc10bfafe084721b5530999187aead0. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:43:49.985765 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-364a84b7-d60a-4a1a-aaad-f4b130c634c8 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.067520 Oct 28 10:43:49.986372 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3555/7116] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:43:49 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:43:50.930001 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 10:43:50.931185 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 10:43:50.931733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=54 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:50.932589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:43:50.934035 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 10:43:50.934176 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 10:43:50.936315 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:43:50.936432 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 10:43:50.938714 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 10:43:50.938819 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Oct 28 10:43:50.947031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-374175525", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "40c7dd6a-32a3-4fdb-89af-f59f24eb3b6c", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2140747046", "security_groups": [{"name": "tempest-secgroup-smoke-1199681035"}], "networks": [{"uuid": "4034be55-1d46-4673-b165-9c2ef30743fc"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:43:51.067315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] validate_networks() for [('4034be55-1d46-4673-b165-9c2ef30743fc', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:43:51.544349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:43:51.544780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:43:51.545292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:43:51.545709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:43:51.546130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:43:51.555391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:51.555888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:51.556335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:51.557129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:51.557594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:51.558053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:51.576115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Getting quotas for project 8bc10bfafe084721b5530999187aead0. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:43:51.581512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Getting quotas for user 5922bd77a54c448ca47ce3b326079efd and project 8bc10bfafe084721b5530999187aead0. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:43:51.640434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:43:51.642588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='40c7dd6a-32a3-4fdb-89af-f59f24eb3b6c',volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:43:51.771267 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af7c545a-37c0-4ed0-844a-98e9d92e194c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.843060 Oct 28 10:43:51.771930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3562/7117] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:43:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:43:51.790359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f9ca350-f92b-4de6-ae77-04762024383f tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:43:51.790991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f9ca350-f92b-4de6-ae77-04762024383f tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:43:51.806568 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33438. Oct 28 10:43:51.819688 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33436. Oct 28 10:43:51.853648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f9ca350-f92b-4de6-ae77-04762024383f tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:43:51.861320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f9ca350-f92b-4de6-ae77-04762024383f tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1098 microversion: 2.1 time: 0.081579 Oct 28 10:43:51.861890 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3556/7118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:43:51 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1098 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:43:52.884451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:43:52.885147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:43:52.895350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:52.895921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:52.896527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:52.897327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:52.897866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:52.898371 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:52.920950 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33450. Oct 28 10:43:52.924507 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 33452. Oct 28 10:43:52.966777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:43:52.975805 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-09b2c13f-17f4-4900-862a-fa5dddcaa092 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1214 microversion: 2.1 time: 0.096541 Oct 28 10:43:52.976617 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3563/7119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:43:52 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:43:54.000447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:43:54.001189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:43:54.011941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:54.012589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:54.013178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:54.014014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:54.014617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:54.015168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:54.230363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:43:54.238900 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-425e3fe6-9c3d-43a4-b59d-53270ce57897 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1282 microversion: 2.1 time: 0.242600 Oct 28 10:43:54.239596 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3557/7120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:43:53 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1282 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:43:54.552700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-374de6fd-a6d7-4f46-9dcb-5919291ea30e req-acac4770-48cf-49f3-806f-4a359fe7ff1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbcb22a-b3f4-4203-916a-75b46dff5cd8", "tag": "51b0ffd6-98c2-471f-a330-a0e3664ac6af"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:43:54.562314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-374de6fd-a6d7-4f46-9dcb-5919291ea30e req-acac4770-48cf-49f3-806f-4a359fe7ff1a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:54.562806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-374de6fd-a6d7-4f46-9dcb-5919291ea30e req-acac4770-48cf-49f3-806f-4a359fe7ff1a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:54.563246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-374de6fd-a6d7-4f46-9dcb-5919291ea30e req-acac4770-48cf-49f3-806f-4a359fe7ff1a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:54.575329 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-374de6fd-a6d7-4f46-9dcb-5919291ea30e req-acac4770-48cf-49f3-806f-4a359fe7ff1a service nova] Creating event network-changed:51b0ffd6-98c2-471f-a330-a0e3664ac6af for instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 on n-h2-zed-1 Oct 28 10:43:54.586120 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-374de6fd-a6d7-4f46-9dcb-5919291ea30e req-acac4770-48cf-49f3-806f-4a359fe7ff1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206171 Oct 28 10:43:54.587204 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3564/7121] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:43:55.262181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:43:55.262895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:43:55.270251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:55.271133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:55.271691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:55.272599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:55.273109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:55.273561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:55.459840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:43:55.468248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a4add5d-2c6c-4993-bf16-7eb0077ada30 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1282 microversion: 2.1 time: 0.210137 Oct 28 10:43:55.468825 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3558/7122] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:43:55 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1282 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:43:56.494931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:43:56.496291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:43:56.502815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:56.503309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:56.503779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:56.504483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:56.504987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:56.505423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:56.638227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:43:56.646097 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc0ec812-7392-41ef-8518-7b025116ce3b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1282 microversion: 2.1 time: 0.157008 Oct 28 10:43:56.646669 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3565/7123] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:43:56 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:43:57.670280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:43:57.670901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:43:57.677980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:57.678483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:57.678932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:57.679638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:57.680113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:57.680671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:57.817693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:43:57.825894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-309d88b5-badb-414c-889f-83ab7cb30143 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1282 microversion: 2.1 time: 0.160036 Oct 28 10:43:57.826513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3559/7124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:43:57 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:43:58.848987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:43:58.849611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:43:58.856993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:58.857486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:58.857932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:58.858628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:43:58.859090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:43:58.859521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:43:58.995304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:43:59.003691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c1263f4-5d94-41f0-b2fe-b2d36f370a06 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.158641 Oct 28 10:43:59.004266 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3566/7125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:43:58 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:00.027743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:00.028383 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:00.035369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:00.035872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:00.036331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:00.037092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:00.037569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:00.038017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:00.171677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:00.179633 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b2e8f82-7402-411d-aea9-fb211bfcbb64 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.156413 Oct 28 10:44:00.180215 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3560/7126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:00 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:01.202871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:01.203495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:01.210286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:01.210775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:01.211216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:01.211910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:01.212368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:01.213412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:01.344162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:01.351971 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8742fc0-82bd-4d0d-9fe9-9579289e40a9 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.153308 Oct 28 10:44:01.352562 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3567/7127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:01 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:02.374646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:02.375208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:02.377921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:02.383667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:02.384176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:02.385289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:02.386006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:02.386486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:02.386937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:02.520541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:02.529550 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b44d7e0e-333e-4fef-93f8-430c3e986869 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.158986 Oct 28 10:44:02.530117 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3561/7128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:02 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:03.552469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:03.553121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:03.555076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:03.555734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:03.562785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:03.563275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:03.563714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:03.564402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:03.564859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:03.565329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:03.702859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:03.710745 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9eeeb2a2-a239-4249-b7f1-4dd2ff554a25 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.162481 Oct 28 10:44:03.711331 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3568/7129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:03 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:04.734865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:04.735494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:04.742349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:04.742850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:04.743332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:04.744044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:04.744519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:04.745661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:04.874887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:04.882738 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ec4ac089-bb76-413a-baf1-d33368d8445a tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.151796 Oct 28 10:44:04.883311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3562/7130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:04 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:05.904264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:05.904884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:05.911771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:05.912256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:05.912699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:05.913431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:05.913896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:05.914327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:06.044649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:06.052357 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02d7c3fc-3a2b-4e73-bfce-4a2cc0316772 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.152006 Oct 28 10:44:06.052960 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3569/7131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:05 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:07.074985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:07.075660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:07.082557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:07.083065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:07.083522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:07.084236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:07.084709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:07.085184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:07.224346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:07.235284 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5f26a7f4-9970-47ac-82f5-d21f371e7b38 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.163952 Oct 28 10:44:07.236200 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3563/7132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:07 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:08.258996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:08.259628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:08.266622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:08.267121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:08.267571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:08.268277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:08.268744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:08.269206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:08.399141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:08.407583 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ffd74444-7738-4ca5-a0fd-b266a5c9460b tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.152520 Oct 28 10:44:08.408165 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3570/7133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:08 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:09.416568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ff9bdddb-a8da-4b6a-b4f5-7fc60c80a13d req-3b5aa5c4-5d3a-4e6c-80f2-d4aab4d4e4f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbcb22a-b3f4-4203-916a-75b46dff5cd8", "name": "network-vif-plugged", "status": "completed", "tag": "51b0ffd6-98c2-471f-a330-a0e3664ac6af"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:44:09.426170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ff9bdddb-a8da-4b6a-b4f5-7fc60c80a13d req-3b5aa5c4-5d3a-4e6c-80f2-d4aab4d4e4f7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:09.426658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ff9bdddb-a8da-4b6a-b4f5-7fc60c80a13d req-3b5aa5c4-5d3a-4e6c-80f2-d4aab4d4e4f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:09.427099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ff9bdddb-a8da-4b6a-b4f5-7fc60c80a13d req-3b5aa5c4-5d3a-4e6c-80f2-d4aab4d4e4f7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:09.430377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:09.431179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:09.438106 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ff9bdddb-a8da-4b6a-b4f5-7fc60c80a13d req-3b5aa5c4-5d3a-4e6c-80f2-d4aab4d4e4f7 service nova] Creating event network-vif-plugged:51b0ffd6-98c2-471f-a330-a0e3664ac6af for instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 on n-h2-zed-1 Oct 28 10:44:09.438521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:09.439086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:09.439540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:09.440257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:09.440856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:09.441332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:09.443246 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ff9bdddb-a8da-4b6a-b4f5-7fc60c80a13d req-3b5aa5c4-5d3a-4e6c-80f2-d4aab4d4e4f7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097426 Oct 28 10:44:09.443781 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3564/7134] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:44:09.589394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:09.597472 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5de13ad-6e67-40cf-9f87-5b509ebeb619 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.171126 Oct 28 10:44:09.598256 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3571/7135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:09 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:44:10.621640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:10.622349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:10.628552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:10.629092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:10.629546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:10.630249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:10.630720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:10.631162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:10.766164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:10.774181 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a1e28fc8-f4e7-4452-be2c-e728977f1d69 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1270 microversion: 2.1 time: 0.157815 Oct 28 10:44:10.774760 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3565/7136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:10 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:11.797494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:11.798121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:11.805008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:11.805502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:11.805949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:11.806647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:11.807619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:11.808048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:11.938212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:11.946028 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9881b23a-53a9-49f1-ad75-4431ceefb6b0 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1458 microversion: 2.1 time: 0.152452 Oct 28 10:44:11.946613 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3572/7137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:11 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1458 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:11.968801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:11.969472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:11.976285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:11.976785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:11.977270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:11.977981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:11.978451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:11.978894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:12.107576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:12.115410 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bc583165-d916-485b-a262-31ca398f1096 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1458 microversion: 2.1 time: 0.150460 Oct 28 10:44:12.115986 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3566/7138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:11 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1458 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:14.059977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a8c50534-135b-4482-aa44-de0d142242f8 req-4cca2f97-38a4-4093-827a-2b7432726572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbcb22a-b3f4-4203-916a-75b46dff5cd8", "tag": "51b0ffd6-98c2-471f-a330-a0e3664ac6af"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:44:14.076202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a8c50534-135b-4482-aa44-de0d142242f8 req-4cca2f97-38a4-4093-827a-2b7432726572 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:14.076694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a8c50534-135b-4482-aa44-de0d142242f8 req-4cca2f97-38a4-4093-827a-2b7432726572 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:14.077163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a8c50534-135b-4482-aa44-de0d142242f8 req-4cca2f97-38a4-4093-827a-2b7432726572 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:14.088751 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a8c50534-135b-4482-aa44-de0d142242f8 req-4cca2f97-38a4-4093-827a-2b7432726572 service nova] Creating event network-changed:51b0ffd6-98c2-471f-a330-a0e3664ac6af for instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 on n-h2-zed-1 Oct 28 10:44:14.094123 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a8c50534-135b-4482-aa44-de0d142242f8 req-4cca2f97-38a4-4093-827a-2b7432726572 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038394 Oct 28 10:44:14.095035 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3573/7139] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:44:15.022821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-012533c2-98a1-426b-a2d8-0866d7dd2be9 req-4940ed78-4f44-4041-8eea-12a61d24f90a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbcb22a-b3f4-4203-916a-75b46dff5cd8", "tag": "51b0ffd6-98c2-471f-a330-a0e3664ac6af"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:44:15.033893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-012533c2-98a1-426b-a2d8-0866d7dd2be9 req-4940ed78-4f44-4041-8eea-12a61d24f90a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:15.034392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-012533c2-98a1-426b-a2d8-0866d7dd2be9 req-4940ed78-4f44-4041-8eea-12a61d24f90a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:15.034844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-012533c2-98a1-426b-a2d8-0866d7dd2be9 req-4940ed78-4f44-4041-8eea-12a61d24f90a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:15.046854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-012533c2-98a1-426b-a2d8-0866d7dd2be9 req-4940ed78-4f44-4041-8eea-12a61d24f90a service nova] Creating event network-changed:51b0ffd6-98c2-471f-a330-a0e3664ac6af for instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 on n-h2-zed-1 Oct 28 10:44:15.057359 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-012533c2-98a1-426b-a2d8-0866d7dd2be9 req-4940ed78-4f44-4041-8eea-12a61d24f90a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032995 Oct 28 10:44:15.057359 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3567/7140] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:44:17.128425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-be729882-d2be-4639-8f6b-53a09baa2646 req-e303e6cf-3218-4fb4-94d0-e31eba7434f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbcb22a-b3f4-4203-916a-75b46dff5cd8", "tag": "51b0ffd6-98c2-471f-a330-a0e3664ac6af"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:44:17.138060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be729882-d2be-4639-8f6b-53a09baa2646 req-e303e6cf-3218-4fb4-94d0-e31eba7434f6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:17.138542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be729882-d2be-4639-8f6b-53a09baa2646 req-e303e6cf-3218-4fb4-94d0-e31eba7434f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:17.138982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-be729882-d2be-4639-8f6b-53a09baa2646 req-e303e6cf-3218-4fb4-94d0-e31eba7434f6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:17.149591 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-be729882-d2be-4639-8f6b-53a09baa2646 req-e303e6cf-3218-4fb4-94d0-e31eba7434f6 service nova] Creating event network-changed:51b0ffd6-98c2-471f-a330-a0e3664ac6af for instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 on n-h2-zed-1 Oct 28 10:44:17.155174 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-be729882-d2be-4639-8f6b-53a09baa2646 req-e303e6cf-3218-4fb4-94d0-e31eba7434f6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092871 Oct 28 10:44:17.155828 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3574/7141] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:44:44.717284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:44.718081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=62 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:44.718887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:44.719749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:44.722244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3406b6fe-762d-4108-baeb-35ffa7e6a723 req-7a7a90a1-782a-46b5-8f96-5c7fa681ce89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dbcb22a-b3f4-4203-916a-75b46dff5cd8", "tag": "51b0ffd6-98c2-471f-a330-a0e3664ac6af"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:44:44.725970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:44.726640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=58 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:44:44.728207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:44.728711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:44.729197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:44.729926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:44.730399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:44.731001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:44.737224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3406b6fe-762d-4108-baeb-35ffa7e6a723 req-7a7a90a1-782a-46b5-8f96-5c7fa681ce89 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:44.737722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3406b6fe-762d-4108-baeb-35ffa7e6a723 req-7a7a90a1-782a-46b5-8f96-5c7fa681ce89 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:44.738701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3406b6fe-762d-4108-baeb-35ffa7e6a723 req-7a7a90a1-782a-46b5-8f96-5c7fa681ce89 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:44.750578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3406b6fe-762d-4108-baeb-35ffa7e6a723 req-7a7a90a1-782a-46b5-8f96-5c7fa681ce89 service nova] Creating event network-changed:51b0ffd6-98c2-471f-a330-a0e3664ac6af for instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 on n-h2-zed-1 Oct 28 10:44:44.756681 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3406b6fe-762d-4108-baeb-35ffa7e6a723 req-7a7a90a1-782a-46b5-8f96-5c7fa681ce89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041396 Oct 28 10:44:44.757462 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3575/7142] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:44:44.760070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:44:44.859939 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9d0d401e-feb1-4d80-bb7a-683da2067ab6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 204 len: 0 microversion: 2.1 time: 0.146426 Oct 28 10:44:44.860766 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3568/7143] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:44:44 2022] DELETE /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:44:44.870768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:44.871683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:44.878061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:44.878559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:44.879699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:44.880287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:44.880748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:44.881207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:45.021696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:45.029898 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf0688b5-0603-4b7b-a165-6c9a6005aa74 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1582 microversion: 2.1 time: 0.164619 Oct 28 10:44:45.030658 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3576/7144] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:44 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1582 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:44:46.054607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:46.055330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:46.062321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:46.062828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:46.063286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:46.064009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:46.064481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:46.064941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:46.268560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:46.278246 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4946138b-50d4-4b60-8493-e1fff8ec88ad tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1582 microversion: 2.1 time: 0.227821 Oct 28 10:44:46.278857 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3569/7145] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:46 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1582 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:47.289059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e0690584-ba28-4840-aa42-e449bc6ec845 req-7f399cac-ee3c-4c50-827b-e66f2020a3bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dbcb22a-b3f4-4203-916a-75b46dff5cd8", "name": "network-vif-deleted", "tag": "51b0ffd6-98c2-471f-a330-a0e3664ac6af"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:44:47.303190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:47.303820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:47.311405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:47.311606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e0690584-ba28-4840-aa42-e449bc6ec845 req-7f399cac-ee3c-4c50-827b-e66f2020a3bb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:47.311941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e0690584-ba28-4840-aa42-e449bc6ec845 req-7f399cac-ee3c-4c50-827b-e66f2020a3bb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:47.312383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e0690584-ba28-4840-aa42-e449bc6ec845 req-7f399cac-ee3c-4c50-827b-e66f2020a3bb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:47.312599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:47.313347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:47.314083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:47.314559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:47.315274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:47.324786 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e0690584-ba28-4840-aa42-e449bc6ec845 req-7f399cac-ee3c-4c50-827b-e66f2020a3bb service nova] Creating event network-vif-deleted:51b0ffd6-98c2-471f-a330-a0e3664ac6af for instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 on n-h2-zed-1 Oct 28 10:44:47.330463 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e0690584-ba28-4840-aa42-e449bc6ec845 req-7f399cac-ee3c-4c50-827b-e66f2020a3bb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045726 Oct 28 10:44:47.331084 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3577/7146] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:44:47.381343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:47.394168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25e4f9d4-3a0d-4835-b6bb-dff89702d7c6 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1396 microversion: 2.1 time: 0.095378 Oct 28 10:44:47.394770 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3570/7147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:47 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1396 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:44:48.419262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:48.419969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:48.426289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:48.426776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:48.427215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:48.427910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:48.428368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:48.428797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:48.494047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:48.501996 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-96c27893-98ac-42a1-9584-a5a1d1b3b933 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1229 microversion: 2.1 time: 0.087888 Oct 28 10:44:48.502580 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3578/7148] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:48 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:49.526715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:49.527352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:49.534344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:49.535371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:49.535834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:49.536558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:49.537059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:49.537512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:49.601212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:49.609153 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3e230d12-db38-4aad-858e-8ea30b936f7c tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1229 microversion: 2.1 time: 0.086364 Oct 28 10:44:49.609735 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3571/7149] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:49 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1229 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:50.633287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:50.633923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:50.640814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:50.641356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:50.641807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:50.642518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:50.642983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:50.643420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:50.705490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:50.713733 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-07b19730-dadc-4285-8acf-0a2a99ed4441 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1229 microversion: 2.1 time: 0.085118 Oct 28 10:44:50.714461 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3579/7150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:50 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:51.735786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:51.736372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:51.743311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:51.743807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:51.744260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:51.744998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:51.745469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:51.745916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:51.780042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:51.780621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:51.781096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:51.781577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lazy-loading 'fault' on Instance uuid 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:44:51.827577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5922bd77a54c448ca47ce3b326079efd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc10bfafe084721b5530999187aead0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:44:51.836615 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-61bce094-25b9-4846-a0e2-b61ac5ecc677 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 200 len: 1234 microversion: 2.1 time: 0.104861 Oct 28 10:44:51.837306 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3572/7151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:51 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 1234 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:44:52.860261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:52.860807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] [instance: 8dbcb22a-b3f4-4203-916a-75b46dff5cd8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:44:52.867690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:52.868185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:52.868633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:52.869358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:44:52.869824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:44:52.870258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:44:52.883374 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] HTTP exception thrown: Instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 could not be found. Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Request method failure captured: Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 HTTP/1.1 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7HyuvXnDCS0OZMMhJi_bdsrvg3SW52lZX77KAsEtnAHGH_rFS6_k1fwf72ZQCSWHYwtzztx0OvwCdAtXqHbNcWLweC5QaE3VnJZvgO6CRs_IH2t5GC2qO7jGkRA38-Y3OoeO3U4v1ngtXxztihyYfjm3zWiQcq0Dmb2ALiOx6hb6Ac Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 8bc10bfafe084721b5530999187aead0 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestVolumeBackupRestore-779245454 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8bc10bfafe084721b5530999187aead0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/8bc10bfafe084721b5530999187aead0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_8bc10bfafe084721b5530999187aead0", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/8bc10bfafe084721b5530999187aead0"}]}] Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestVolumeBackupRestore-779245454 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 8bc10bfafe084721b5530999187aead0 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestVolumeBackupRestore-779245454 Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestVolumeBackupRestore-779245454-project Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 5922bd77a54c448ca47ce3b326079efd Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestVolumeBackupRestore-779245454-project Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 could not be found. Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '8dbcb22a-b3f4-4203-916a-75b46dff5cd8'} Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 could not be found. Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 could not be found. Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:44:52.885033 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 could not be found. Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Returning 404 to user: Instance 8dbcb22a-b3f4-4203-916a-75b46dff5cd8 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4e4ed5c-3a8b-4a26-91b0-c996c53db6fc tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8" status: 404 len: 111 microversion: 2.1 time: 0.030203 Oct 28 10:44:52.890049 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3580/7152] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:44:52 2022] GET /compute/v2.1/servers/8dbcb22a-b3f4-4203-916a-75b46dff5cd8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:44:53.046747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ae4eb28-2606-4e0b-8a7e-2d0bf5a8d821 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] Calling method '.version_select at 0x7fca33408af0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:44:53.069589 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ae4eb28-2606-4e0b-8a7e-2d0bf5a8d821 tempest-TestVolumeBackupRestore-779245454 tempest-TestVolumeBackupRestore-779245454-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2140747046" status: 202 len: 0 microversion: 2.1 time: 0.026538 Oct 28 10:44:53.071046 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3573/7153] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 10:44:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2140747046 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:45:15.325073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:15.325811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=24 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:15.438012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-258410975", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:15.490590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] validate_networks() for None {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:45:15.763626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:45:15.764059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:45:15.764555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:45:15.765014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:45:15.765438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:45:15.775147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:15.775642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:15.776091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:15.776833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:15.777326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:15.777767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:15.794539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Getting quotas for project 77a86ef86a1c4ac7b35642d8559975e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:45:15.799918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Getting quotas for user baf5f2e04c4c45f9b1e4863fc9a26c16 and project 77a86ef86a1c4ac7b35642d8559975e6. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:45:15.812395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:45:15.814758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:45:15.862554 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5fc5c9c6-9b1d-40c9-978e-2a090a551479 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.542872 Oct 28 10:45:15.863212 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3581/7154] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:45:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:45:15.875578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5700da47-dcd1-47ad-9a72-d708e760a0cb tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:15.876217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5700da47-dcd1-47ad-9a72-d708e760a0cb tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:15.880722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:15.881415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:15.937253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5700da47-dcd1-47ad-9a72-d708e760a0cb tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:15.944736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5700da47-dcd1-47ad-9a72-d708e760a0cb tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1221 microversion: 2.1 time: 0.073017 Oct 28 10:45:15.945356 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3574/7155] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:15 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1221 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:16.968775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:16.969428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:16.977053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:16.977539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:16.977986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:16.978705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:16.979270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:16.979739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:17.045100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:17.053311 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd853798-858c-4be6-b9e7-368619436600 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1281 microversion: 2.1 time: 0.089487 Oct 28 10:45:17.054210 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3582/7156] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:16 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:18.076130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:18.076661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:18.084420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:18.084945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:18.085404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:18.086133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:18.086604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:18.087295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:18.561513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:18.569678 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c1ac1767-1e04-44cc-a5ea-2216e961e2f1 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.497809 Oct 28 10:45:18.570271 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3575/7157] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:18 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:18.946387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8765f9f3-7557-45a4-b160-269f481d66b3 req-6abbd899-738d-4330-80b0-7d7eba46ca3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c688de3-ef20-40b9-a766-70610cb0829d", "tag": "5418d5fd-ab1f-4341-b379-ab33054563ea"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:18.958698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8765f9f3-7557-45a4-b160-269f481d66b3 req-6abbd899-738d-4330-80b0-7d7eba46ca3d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:18.959208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8765f9f3-7557-45a4-b160-269f481d66b3 req-6abbd899-738d-4330-80b0-7d7eba46ca3d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:18.959654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8765f9f3-7557-45a4-b160-269f481d66b3 req-6abbd899-738d-4330-80b0-7d7eba46ca3d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:18.971158 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8765f9f3-7557-45a4-b160-269f481d66b3 req-6abbd899-738d-4330-80b0-7d7eba46ca3d service nova] Creating event network-changed:5418d5fd-ab1f-4341-b379-ab33054563ea for instance 0c688de3-ef20-40b9-a766-70610cb0829d on n-h2-zed-1 Oct 28 10:45:18.976780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8765f9f3-7557-45a4-b160-269f481d66b3 req-6abbd899-738d-4330-80b0-7d7eba46ca3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034187 Oct 28 10:45:18.977451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3583/7158] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:19.593288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:19.596096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:19.603758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:19.604258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:19.604709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:19.605471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:19.605941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:19.606381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:19.740697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:19.748338 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-926197a4-d3bd-42d7-a285-914c239544b7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.158983 Oct 28 10:45:19.748932 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3576/7159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:19 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:20.772596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:20.773347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:20.779629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:20.780135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:20.780583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:20.781317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:20.781786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:20.782224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:20.922514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:20.930571 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bac6aee7-db7e-4f6d-97dc-d3428eb1bc5b tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.163613 Oct 28 10:45:20.931168 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3584/7160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:20 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:21.953406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:21.954037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:21.961320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:21.961834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:21.962291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:21.963019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:21.963489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:21.963938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:22.095568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:22.103371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29673d9c-44bc-445f-8416-1dfb2d128a43 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.153898 Oct 28 10:45:22.103945 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3577/7161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:21 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:23.126446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:23.127258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:23.133952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:23.134453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:23.134903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:23.135605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:23.136067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:23.136505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:23.271244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:23.280201 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a77e716d-1a79-4ea0-9fe5-a63c2aafb2c7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.157988 Oct 28 10:45:23.280786 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3585/7162] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:23 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:24.304297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:24.305060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:24.313582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:24.314088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:24.314543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:24.315259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:24.315730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:24.316170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:24.450190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:24.458545 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ddaa5850-f687-48a9-8d8e-1e32aeea40a6 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.158937 Oct 28 10:45:24.459142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3578/7163] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:24 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:25.481672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:25.482314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:25.489498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:25.489984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:25.490422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:25.491113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:25.491569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:25.491996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:25.626959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:25.635480 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-250b9c60-6068-4f16-9e0a-26226f4b2ba5 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.157672 Oct 28 10:45:25.636177 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3586/7164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:25 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:25.767962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ad965d9d-d6d6-4e2e-bf18-a1291861934f req-e2565d03-570c-4abc-a26f-830fda25a291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c688de3-ef20-40b9-a766-70610cb0829d", "name": "network-vif-plugged", "status": "completed", "tag": "5418d5fd-ab1f-4341-b379-ab33054563ea"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:25.778788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ad965d9d-d6d6-4e2e-bf18-a1291861934f req-e2565d03-570c-4abc-a26f-830fda25a291 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:25.779460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ad965d9d-d6d6-4e2e-bf18-a1291861934f req-e2565d03-570c-4abc-a26f-830fda25a291 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:25.779724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ad965d9d-d6d6-4e2e-bf18-a1291861934f req-e2565d03-570c-4abc-a26f-830fda25a291 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:25.792279 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ad965d9d-d6d6-4e2e-bf18-a1291861934f req-e2565d03-570c-4abc-a26f-830fda25a291 service nova] Creating event network-vif-plugged:5418d5fd-ab1f-4341-b379-ab33054563ea for instance 0c688de3-ef20-40b9-a766-70610cb0829d on n-h2-zed-1 Oct 28 10:45:25.797403 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ad965d9d-d6d6-4e2e-bf18-a1291861934f req-e2565d03-570c-4abc-a26f-830fda25a291 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033197 Oct 28 10:45:25.798023 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3579/7165] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:26.658691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:26.659317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:26.661918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:26.662594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:26.669293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:26.669797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:26.670249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:26.670969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:26.671444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:26.671883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:26.802410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:26.810181 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-65a89b08-a3e2-4889-b963-62a815f1e9d7 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1321 microversion: 2.1 time: 0.155454 Oct 28 10:45:26.810765 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3587/7166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:26 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:27.830268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:27.836002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:27.837296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:27.844319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:27.844820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:27.845308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:27.846021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:27.846494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:27.846942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:27.989700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:27.998672 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dd4d9a1c-4a64-4df3-bc04-61ac57b39c5a tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1471 microversion: 2.1 time: 0.169292 Oct 28 10:45:27.999284 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3580/7167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:27 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:28.073155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dbacdab3-ca50-4a45-b806-e3a9a0c9dbaf tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Calling method '.version_select at 0x7fca3b9c03a0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:28.142716 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dbacdab3-ca50-4a45-b806-e3a9a0c9dbaf tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/3f3a5d752a3d4edb8e01c673027f7b67" status: 200 len: 371 microversion: 2.1 time: 0.123089 Oct 28 10:45:28.143305 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3588/7168] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:45:28 2022] GET /compute/v2.1/os-quota-sets/3f3a5d752a3d4edb8e01c673027f7b67 => generated 371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:28.155620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9905b3a6-fd4e-4f5d-9148-42cf192a04ad tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-112909743", "id": 291715743, "os-flavor-access:is_public": "True"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:28.173826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9905b3a6-fd4e-4f5d-9148-42cf192a04ad tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.022008 Oct 28 10:45:28.174430 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3581/7169] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:45:28 2022] POST /compute/v2.1/flavors => generated 434 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:28.188003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "291715743"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:28.190445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:28.196736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.197525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.197976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.198689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.199206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.199608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.288486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7b426aaea04142e7a9f748f82c4ba3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3a5d752a3d4edb8e01c673027f7b67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:28.294698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-112909743 {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:45:28.301929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.302454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.302926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.303639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.304107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.304568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.326560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Getting quotas for project 77a86ef86a1c4ac7b35642d8559975e6. Resources: {'ram', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:45:28.331633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Getting quotas for user baf5f2e04c4c45f9b1e4863fc9a26c16 and project 77a86ef86a1c4ac7b35642d8559975e6. Resources: {'ram', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:45:28.344116 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.compute.api [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] ram quota exceeded for 3f3a5d752a3d4edb8e01c673027f7b67, tried to resize instance. Oct 28 10:45:28.344593 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Request method failure captured: Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d/action HTTP/1.1 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 38 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7K7lEpgRuay92xwMQeZ5QtBm8YdgRZ1CaZfp7qTzs8isUIB9KCgmXj0SkqYIhUUR3fLo_2vG7kbsV2jGj5fBqz96BZK5-zVLxoEG-fX9Egb8URUc6w0NlFZ_exAXmTfrRdtwvrbTSSWAAQq8nwuC8fG42Lm9DS4hjtQJN7yi1DWzjg Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3f3a5d752a3d4edb8e01c673027f7b67 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1645396207 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Role: admin,member,reader Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: admin,member,reader Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f3a5d752a3d4edb8e01c673027f7b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f3a5d752a3d4edb8e01c673027f7b67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f3a5d752a3d4edb8e01c673027f7b67", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f3a5d752a3d4edb8e01c673027f7b67"}]}] Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1645396207 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3f3a5d752a3d4edb8e01c673027f7b67 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1645396207 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersAdminNegativeTestJSON-1645396207-project-admin Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 7b426aaea04142e7a9f748f82c4ba3a8 Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1645396207-project-admin Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: {"resize": {"flavorRef": "291715743"}} Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0c688de3-ef20-40b9-a766-70610cb0829d', 'body': {'resize': {'flavorRef': '291715743'}}} Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:45:28.346761 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-160ff097-a84c-43e8-968c-2bd4dcb1b08c tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d/action" status: 403 len: 118 microversion: 2.1 time: 0.164701 Oct 28 10:45:28.351994 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3589/7170] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:45:28 2022] POST /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d/action => generated 118 bytes in 166 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:45:28.362055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d3e083d-b08b-49f6-bdd6-4dea4b0ba927 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:28.380932 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d3e083d-b08b-49f6-bdd6-4dea4b0ba927 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/291715743" status: 202 len: 0 microversion: 2.1 time: 0.023365 Oct 28 10:45:28.381488 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3582/7171] 10.222.0.16 () {58 vars in 1158 bytes} [Fri Oct 28 10:45:28 2022] DELETE /compute/v2.1/flavors/291715743 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:45:28.389545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d330d4b0-7a4f-451a-8af6-0dd4fb217add tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:28.410803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d330d4b0-7a4f-451a-8af6-0dd4fb217add tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024356 Oct 28 10:45:28.411384 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3590/7172] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:45:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:28.432592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b189a1e-4e45-41e1-b2ce-fcea13bb9fc1 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Calling method '.version_select at 0x7fca32ae19d0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:28.506591 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b189a1e-4e45-41e1-b2ce-fcea13bb9fc1 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "GET /compute/v2.1/os-quota-sets/3f3a5d752a3d4edb8e01c673027f7b67" status: 200 len: 371 microversion: 2.1 time: 0.077736 Oct 28 10:45:28.507171 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3583/7173] 10.222.0.16 () {58 vars in 1242 bytes} [Fri Oct 28 10:45:28 2022] GET /compute/v2.1/os-quota-sets/3f3a5d752a3d4edb8e01c673027f7b67 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:28.518955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ab6e10d-6b67-45f3-8f2d-4b53a46d1c69 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-484188873", "id": 1395688084, "os-flavor-access:is_public": "True"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:28.536918 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ab6e10d-6b67-45f3-8f2d-4b53a46d1c69 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.021618 Oct 28 10:45:28.537515 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3591/7174] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:45:28 2022] POST /compute/v2.1/flavors => generated 436 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:28.549971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1395688084"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:28.552385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:28.558691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.559194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.559650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.560375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.560852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.561328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.747084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '7b426aaea04142e7a9f748f82c4ba3a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f3a5d752a3d4edb8e01c673027f7b67', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:28.753457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-484188873 {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:45:28.760118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.760614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.761092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.761828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.762321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.762758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.791684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Getting quotas for project 77a86ef86a1c4ac7b35642d8559975e6. Resources: {'ram', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:45:28.796707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Getting quotas for user baf5f2e04c4c45f9b1e4863fc9a26c16 and project 77a86ef86a1c4ac7b35642d8559975e6. Resources: {'ram', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:45:28.811306 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] cores quota exceeded for 3f3a5d752a3d4edb8e01c673027f7b67, tried to resize instance. Oct 28 10:45:28.811674 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Request method failure captured: Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d/action HTTP/1.1 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 39 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7K7lEpgRuay92xwMQeZ5QtBm8YdgRZ1CaZfp7qTzs8isUIB9KCgmXj0SkqYIhUUR3fLo_2vG7kbsV2jGj5fBqz96BZK5-zVLxoEG-fX9Egb8URUc6w0NlFZ_exAXmTfrRdtwvrbTSSWAAQq8nwuC8fG42Lm9DS4hjtQJN7yi1DWzjg Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 3f3a5d752a3d4edb8e01c673027f7b67 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1645396207 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Role: admin,member,reader Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: admin,member,reader Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f3a5d752a3d4edb8e01c673027f7b67"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3f3a5d752a3d4edb8e01c673027f7b67"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3f3a5d752a3d4edb8e01c673027f7b67", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3f3a5d752a3d4edb8e01c673027f7b67"}]}] Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1645396207 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 3f3a5d752a3d4edb8e01c673027f7b67 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1645396207 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersAdminNegativeTestJSON-1645396207-project-admin Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 7b426aaea04142e7a9f748f82c4ba3a8 Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1645396207-project-admin Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: {"resize": {"flavorRef": "1395688084"}} Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '0c688de3-ef20-40b9-a766-70610cb0829d', 'body': {'resize': {'flavorRef': '1395688084'}}} Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:45:28.814326 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-95399962-181c-472d-984e-43f7ecda7539 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "POST /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d/action" status: 403 len: 113 microversion: 2.1 time: 0.270089 Oct 28 10:45:28.818826 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3584/7175] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:45:28 2022] POST /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d/action => generated 113 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:45:28.826307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7ba40022-7c1a-446e-ae6e-fc351e7f9a25 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:28.843545 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7ba40022-7c1a-446e-ae6e-fc351e7f9a25 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "DELETE /compute/v2.1/flavors/1395688084" status: 202 len: 0 microversion: 2.1 time: 0.021633 Oct 28 10:45:28.844381 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3592/7176] 10.222.0.16 () {58 vars in 1161 bytes} [Fri Oct 28 10:45:28 2022] DELETE /compute/v2.1/flavors/1395688084 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:45:28.852486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e56ab5d8-c802-4711-a06a-e98801170454 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:28.876641 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e56ab5d8-c802-4711-a06a-e98801170454 tempest-ServersAdminNegativeTestJSON-1645396207 tempest-ServersAdminNegativeTestJSON-1645396207-project-admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027746 Oct 28 10:45:28.877329 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3585/7177] 10.222.0.16 () {58 vars in 1146 bytes} [Fri Oct 28 10:45:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:28.898677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:28.899207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:28.905186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.905672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.906112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.906801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:28.907259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:28.907690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:28.934098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:45:29.014464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f28fe38-6a1e-40ae-9222-19bd184fb221 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 204 len: 0 microversion: 2.1 time: 0.120292 Oct 28 10:45:29.015204 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3593/7178] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:45:28 2022] DELETE /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:45:29.023937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:29.024671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:29.030743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:29.031247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:29.031701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:29.032410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:29.032879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:29.033344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:29.167964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:29.175993 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c11e9345-4cea-4c50-a003-e7c34cc2543d tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1477 microversion: 2.1 time: 0.156538 Oct 28 10:45:29.176566 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3586/7179] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:29 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:45:30.199569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:30.200288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:30.207758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:30.208256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:30.208709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:30.209444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:30.209921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:30.210361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:30.339365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:30.347297 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45fa5c90-6168-47ec-807c-dd79689f3313 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1477 microversion: 2.1 time: 0.152247 Oct 28 10:45:30.348463 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3594/7180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:30 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:31.039930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5f9fa2c6-ab13-4942-860f-c5683714c24f req-4e5e2f80-1028-4b95-9695-5c537f6a6aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c688de3-ef20-40b9-a766-70610cb0829d", "name": "network-vif-deleted", "tag": "5418d5fd-ab1f-4341-b379-ab33054563ea"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:31.046073 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:45:31.046295 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 10:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 10:45:31.054578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f9fa2c6-ab13-4942-860f-c5683714c24f req-4e5e2f80-1028-4b95-9695-5c537f6a6aba service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:31.055122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f9fa2c6-ab13-4942-860f-c5683714c24f req-4e5e2f80-1028-4b95-9695-5c537f6a6aba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:31.055671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5f9fa2c6-ab13-4942-860f-c5683714c24f req-4e5e2f80-1028-4b95-9695-5c537f6a6aba service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:31.068719 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5f9fa2c6-ab13-4942-860f-c5683714c24f req-4e5e2f80-1028-4b95-9695-5c537f6a6aba service nova] Creating event network-vif-deleted:5418d5fd-ab1f-4341-b379-ab33054563ea for instance 0c688de3-ef20-40b9-a766-70610cb0829d on n-h2-zed-1 Oct 28 10:45:31.074428 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5f9fa2c6-ab13-4942-860f-c5683714c24f req-4e5e2f80-1028-4b95-9695-5c537f6a6aba service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038167 Oct 28 10:45:31.075054 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3587/7181] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:31.370757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:31.371375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:31.379301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:31.379784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:31.380230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:31.380938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:31.381406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:31.381835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:31.412838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:31.413355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:31.413792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:31.414239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lazy-loading 'fault' on Instance uuid 0c688de3-ef20-40b9-a766-70610cb0829d {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:45:31.457790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'baf5f2e04c4c45f9b1e4863fc9a26c16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77a86ef86a1c4ac7b35642d8559975e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:31.466075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9c982491-f545-4ee5-9827-bbcd5935007f tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 200 len: 1311 microversion: 2.1 time: 0.099159 Oct 28 10:45:31.466677 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3595/7182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:31 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:32.489976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:32.490730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] [instance: 0c688de3-ef20-40b9-a766-70610cb0829d] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:32.497116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:32.497621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:32.498078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:32.498790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:32.499264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:32.499711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:32.513144 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] HTTP exception thrown: Instance 0c688de3-ef20-40b9-a766-70610cb0829d could not be found. Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Request method failure captured: Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d HTTP/1.1 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7K6hWHAJzq9viYyr7umtmqeZC2up-4qjHhzyMGaZyJcsVXeAU2V4nv7e4eU9CceN4B8CgSkZZPK7o-kgmy01tJS29GWEXSwfw9p0lQWYYbYO-WhVE_oTqY72auESSXmuf-8uzQy2PYTOxZ0hN8CDLfWF-dd-KTsyK2-uuCa-qIjhvo Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 77a86ef86a1c4ac7b35642d8559975e6 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-873609935 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77a86ef86a1c4ac7b35642d8559975e6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/77a86ef86a1c4ac7b35642d8559975e6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_77a86ef86a1c4ac7b35642d8559975e6", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/77a86ef86a1c4ac7b35642d8559975e6"}]}] Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersAdminNegativeTestJSON-873609935 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 77a86ef86a1c4ac7b35642d8559975e6 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-873609935 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersAdminNegativeTestJSON-873609935-project Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: baf5f2e04c4c45f9b1e4863fc9a26c16 Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersAdminNegativeTestJSON-873609935-project Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 0c688de3-ef20-40b9-a766-70610cb0829d could not be found. Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '0c688de3-ef20-40b9-a766-70610cb0829d'} Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c688de3-ef20-40b9-a766-70610cb0829d could not be found. Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c688de3-ef20-40b9-a766-70610cb0829d could not be found. Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:32.514771 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c688de3-ef20-40b9-a766-70610cb0829d could not be found. Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] Returning 404 to user: Instance 0c688de3-ef20-40b9-a766-70610cb0829d could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-106c998d-857d-459c-98e1-28906dc5bb97 tempest-ServersAdminNegativeTestJSON-873609935 tempest-ServersAdminNegativeTestJSON-873609935-project] 10.222.0.16 "GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d" status: 404 len: 111 microversion: 2.1 time: 0.031458 Oct 28 10:45:32.518876 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3588/7183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:32 2022] GET /compute/v2.1/servers/0c688de3-ef20-40b9-a766-70610cb0829d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:45:38.502990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:38.504780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:38.631775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1210641716", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "f5842598-03cd-4dbc-ac81-fc1898625ed6"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:38.689319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] validate_networks() for [('f5842598-03cd-4dbc-ac81-fc1898625ed6', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:45:39.065332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:45:39.065787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:45:39.066312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:45:39.066738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:45:39.067196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:45:39.076606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:39.077225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:39.077682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:39.078426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:39.078891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:39.079330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:39.096128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Getting quotas for project dedc9e2dcf3346fe8ca2e46cc4a504de. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:45:39.101920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Getting quotas for user 34ff19be87414c8583e3bacb352400c3 and project dedc9e2dcf3346fe8ca2e46cc4a504de. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:45:39.115174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:45:39.117511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:45:39.162073 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0e81c760-0af7-46b2-ab52-cb554cb955eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664756 Oct 28 10:45:39.162738 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3596/7184] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:45:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:45:39.174206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e6050f58-d5e5-4641-b56d-dc8cfd686544 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:39.174842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e6050f58-d5e5-4641-b56d-dc8cfd686544 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:39.179392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:39.180145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:39.239429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e6050f58-d5e5-4641-b56d-dc8cfd686544 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:39.253056 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e6050f58-d5e5-4641-b56d-dc8cfd686544 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1215 microversion: 2.1 time: 0.082511 Oct 28 10:45:39.264926 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3589/7185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:39 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1215 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:40.278035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:40.278674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:40.286685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:40.287192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:40.287639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:40.288351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:40.288815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:40.289288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:40.369295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:40.377564 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c7814aa5-a60d-447d-bf8a-7e7175945d80 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1267 microversion: 2.1 time: 0.103569 Oct 28 10:45:40.393491 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3597/7186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:40 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1267 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:41.399754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:41.400380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:41.414916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:41.415621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:41.416346 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:41.417175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:41.418221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:41.418881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:41.965770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:41.980276 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16f6324c-bcfd-4418-a70a-efde336bed01 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1315 microversion: 2.1 time: 0.584372 Oct 28 10:45:42.005699 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3590/7187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:41 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1315 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:42.251336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4af709e1-ad7f-4f35-bde1-a05db340993b req-7f440b2c-e9de-434b-8fa4-63dfe8a24faa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c", "tag": "da54b3eb-a247-4168-b710-be9a511efb1b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:42.270785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4af709e1-ad7f-4f35-bde1-a05db340993b req-7f440b2c-e9de-434b-8fa4-63dfe8a24faa service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:42.271269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4af709e1-ad7f-4f35-bde1-a05db340993b req-7f440b2c-e9de-434b-8fa4-63dfe8a24faa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:42.271700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4af709e1-ad7f-4f35-bde1-a05db340993b req-7f440b2c-e9de-434b-8fa4-63dfe8a24faa service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:42.288070 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4af709e1-ad7f-4f35-bde1-a05db340993b req-7f440b2c-e9de-434b-8fa4-63dfe8a24faa service nova] Creating event network-changed:da54b3eb-a247-4168-b710-be9a511efb1b for instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c on n-h2-zed-1 Oct 28 10:45:42.293483 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4af709e1-ad7f-4f35-bde1-a05db340993b req-7f440b2c-e9de-434b-8fa4-63dfe8a24faa service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051644 Oct 28 10:45:42.294604 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3598/7188] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:45:43.009393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:43.009952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:43.016825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:43.017397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:43.017856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:43.018569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:43.019043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:43.019489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:43.145821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:43.153498 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dba1abab-4654-47f5-ac0d-aa11efb9952d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1315 microversion: 2.1 time: 0.148177 Oct 28 10:45:43.154080 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3591/7189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:43 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:44.176668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:44.177431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:44.184568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:44.185106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:44.185556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:44.186256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:44.186721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:44.187157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:44.317240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:44.325172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2833ce74-5407-4ea2-8e77-2be72ffed753 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1315 microversion: 2.1 time: 0.152993 Oct 28 10:45:44.325749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3599/7190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:44 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:45.348415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:45.349073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:45.355964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:45.356467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:45.356948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:45.357731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:45.358200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:45.358637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:45.491496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:45.499276 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a72a054d-ccca-436e-8755-35c8bf0312c0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1315 microversion: 2.1 time: 0.154804 Oct 28 10:45:45.499897 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3592/7191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:45 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:46.521684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:46.522306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:46.525130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:46.530461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:46.530954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:46.531402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:46.532107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:46.532572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:46.533049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:46.536848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:46.668357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:46.676711 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1f2cf1a5-5f17-456d-a23d-de8b50c9a161 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1315 microversion: 2.1 time: 0.158945 Oct 28 10:45:46.677323 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3600/7192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:46 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:47.698868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:47.699497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:47.703235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:47.707278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:47.707794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:47.708325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:47.708983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:47.709479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:47.709909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:47.713188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=74 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:47.833856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-60015dbc-d420-4d7a-919f-47e43bb8c4f6 req-b9b3a116-b767-4c69-94cc-01b800b7f86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c", "name": "network-vif-plugged", "status": "completed", "tag": "da54b3eb-a247-4168-b710-be9a511efb1b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:47.844834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-60015dbc-d420-4d7a-919f-47e43bb8c4f6 req-b9b3a116-b767-4c69-94cc-01b800b7f86f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:47.845379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-60015dbc-d420-4d7a-919f-47e43bb8c4f6 req-b9b3a116-b767-4c69-94cc-01b800b7f86f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:47.845816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-60015dbc-d420-4d7a-919f-47e43bb8c4f6 req-b9b3a116-b767-4c69-94cc-01b800b7f86f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:47.849363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:47.858260 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-60015dbc-d420-4d7a-919f-47e43bb8c4f6 req-b9b3a116-b767-4c69-94cc-01b800b7f86f service nova] Creating event network-vif-plugged:da54b3eb-a247-4168-b710-be9a511efb1b for instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c on n-h2-zed-1 Oct 28 10:45:47.858643 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a36ab57-81e3-46a0-88fc-3a7deb7e8cbb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1315 microversion: 2.1 time: 0.163661 Oct 28 10:45:47.872963 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3593/7193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:47 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:47.875398 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-60015dbc-d420-4d7a-919f-47e43bb8c4f6 req-b9b3a116-b767-4c69-94cc-01b800b7f86f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045882 Oct 28 10:45:47.876238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3601/7194] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:45:48.883591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:48.884176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:48.891087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:48.891585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:48.892041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:48.892751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:48.893266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:48.893713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:49.025270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:49.033078 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2602479f-9d70-4dce-a7e6-fec90f43d66d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1315 microversion: 2.1 time: 0.153521 Oct 28 10:45:49.033660 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3594/7195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:48 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:50.053872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:50.054792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:50.059390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:50.060143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:50.067932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:50.068431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:50.068880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:50.069607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:50.070075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:50.070513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:50.200476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:50.208335 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf949562-e7d4-4719-8bd8-9b662b6480d3 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1502 microversion: 2.1 time: 0.156287 Oct 28 10:45:50.208928 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3602/7196] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:50 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:50.231033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:45:50.233336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:50.235289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:45:50.242409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:50.242907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:50.243358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:50.244063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:50.244525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:50.244994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:50.272468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:50.277771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:45:50.284113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:45:50.285041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:45:50.285613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:45:50.286034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:45:50.286453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:45:50.348440 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d59697af-3b56-4b89-b751-556ae0348dd4 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "POST /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c/action" status: 202 len: 0 microversion: 2.1 time: 0.121547 Oct 28 10:45:50.349136 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3595/7197] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:45:50 2022] POST /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:45:50.357171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:50.357787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:50.364341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:50.364861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:50.365328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:50.366027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:50.366484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:50.366913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:50.537220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:50.545660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c72d556a-2b45-4c39-8e0c-9d15dc6c7822 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1511 microversion: 2.1 time: 0.192257 Oct 28 10:45:50.546431 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3603/7198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:50 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:45:51.570117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:51.570745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:51.577907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:51.579075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:51.579634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:51.580391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:51.580887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:51.581381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:51.714866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:51.722753 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2e7b8a0c-5384-44d1-8dde-70890f963995 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1511 microversion: 2.1 time: 0.157996 Oct 28 10:45:51.723331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3596/7199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:51 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:52.745387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:52.746049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:52.752841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:52.753359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:52.753799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:52.754488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:52.754946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:52.755376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:52.884465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:52.892128 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99729269-68d3-4e86-ac1e-18a382eb89bf tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.150606 Oct 28 10:45:52.892699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3604/7200] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:52 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:53.915548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:53.916182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:53.922390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:53.922892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:53.923351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:53.924061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:53.924533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:53.925021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:54.060824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:54.068520 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-57f10089-5dcd-4157-8c82-5e9cc933c00d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.157067 Oct 28 10:45:54.069130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3597/7201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:53 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:55.092354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:55.100853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:55.102943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:55.103439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:55.103890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:55.104598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:55.105104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:55.105537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:55.240623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:55.248437 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-db5e78d0-c045-4de8-aa74-65ca4fbe17b2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.160677 Oct 28 10:45:55.249052 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3605/7202] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:55 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:56.272310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:56.272848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:56.279815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:56.280299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:56.280756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:56.281498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:56.281973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:56.282421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:56.414029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:56.421787 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7081250-f6ec-4c68-991a-fc5f7526bffe tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.153574 Oct 28 10:45:56.422386 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3598/7203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:56 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:57.447395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:57.448005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:57.454833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:57.455318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:57.455753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:57.456434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:57.456889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:57.457346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:57.585301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:57.593071 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c15e15d2-4d86-48e7-9b69-15989001a975 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.149801 Oct 28 10:45:57.593649 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3606/7204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:57 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:58.617434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:58.618065 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:58.624889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:58.625421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:58.625879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:58.626578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:58.627045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:58.627484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:58.755280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:58.764181 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f730fc49-0597-4554-aeb6-309d42591899 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.151266 Oct 28 10:45:58.764758 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3599/7205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:58 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:45:59.788082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:45:59.788741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:45:59.795781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:59.796276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:59.796722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:59.797446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:45:59.797928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:45:59.798346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:45:59.930968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:45:59.938712 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3573983a-ef5c-412c-8525-1e7a1e55af0e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.155088 Oct 28 10:45:59.939296 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3607/7206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:45:59 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:00.962756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:00.963397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:00.970401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:00.970901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:00.971354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:00.972061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:00.972529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:00.973067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:01.105819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:01.113454 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19f3958b-8223-4edd-881d-17a0e5dd46f8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.155250 Oct 28 10:46:01.114016 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3600/7207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:00 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:02.140560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:02.140560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:02.144785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:02.145296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:02.146413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:02.147115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:02.147572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:02.147995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:02.276785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:02.284797 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f02900a-a6a3-4234-a7b3-fc47b2442be2 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.151786 Oct 28 10:46:02.285477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3608/7208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:02 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:03.308252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:03.308875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:03.315716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:03.316212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:03.316660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:03.317387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:03.317853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:03.318293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:03.451819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:03.460927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-717bf97c-6caf-4871-8895-d95fd151ed73 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.156477 Oct 28 10:46:03.461523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3601/7209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:03 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:04.484612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:04.485297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:04.493053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:04.493559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:04.494017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:04.494738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:04.495227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:04.495643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:04.633244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:04.641891 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f08059d2-1f32-413e-a6bb-346db351fef8 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.161258 Oct 28 10:46:04.642477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3609/7210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:04 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:05.665405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:05.666041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:05.672928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:05.673431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:05.673888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:05.674598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:05.675076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:05.675519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:05.809419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:05.817178 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2dff22da-1376-41db-bf13-d0aee16ff745 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.155664 Oct 28 10:46:05.817747 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3602/7211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:05 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:06.840344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:06.840894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:06.847845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:06.848346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:06.848796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:06.849531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:06.850002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:06.850441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:06.979270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:06.987095 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-250c6e87-561c-4d41-bde9-d030ffe468eb tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.150751 Oct 28 10:46:06.987679 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3610/7212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:06 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:08.011101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:08.011733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:08.019014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:08.019514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:08.019968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:08.020676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:08.021457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:08.022597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:08.154554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:08.162608 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d995f56b-d64a-4fb2-8afa-3dca6d84383d tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.155459 Oct 28 10:46:08.163190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3603/7213] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:08 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:09.185533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:09.186169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:09.193125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:09.193621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:09.194067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:09.194771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:09.195236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:09.195672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:09.327838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:09.336178 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfbd68eb-8125-4029-b11d-687f2a7b4cd0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.154622 Oct 28 10:46:09.336782 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3611/7214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:09 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:10.359603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:10.360303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:10.368649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:10.369255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:10.369775 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:10.370554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:10.371117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:10.371714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:10.508944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:10.516614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8b1cb982-21fe-4de6-b60c-4bfc6f6c5015 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.160979 Oct 28 10:46:10.517213 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3604/7215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:10 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:11.539776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:11.540415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:11.547237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:11.547723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:11.548162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:11.548844 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:11.549332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:11.549759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:11.681796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:11.689447 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d0ac79a8-99e9-45ad-822d-0be05b757018 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.153616 Oct 28 10:46:11.690027 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3612/7216] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:11 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:12.712696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:12.713389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:12.720392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:12.720891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:12.721374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:12.722083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:12.722557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:12.722997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:12.855862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:12.863712 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8aa2a291-a103-49da-9646-226081e15132 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.155014 Oct 28 10:46:12.864296 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3605/7217] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:12 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:13.887205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:13.887855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:13.894904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:13.895393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:13.895837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:13.896527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:13.897017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:13.897453 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:14.026695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:14.034421 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a4eec7d-6003-47ab-b28e-1f1148e2bd2f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.151147 Oct 28 10:46:14.035000 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3613/7218] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:13 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:15.058518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:15.059153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:15.066118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:15.066622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:15.067076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:15.067791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:15.068269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:15.068714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:15.196293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:15.204419 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-497083bf-3127-41f5-b9da-4e8f7d4ddba0 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.149846 Oct 28 10:46:15.205019 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3606/7219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:15 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:16.228452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:16.229036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:16.235903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:16.236392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:16.236834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:16.237550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:16.238010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:16.238439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:16.371191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:16.378898 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9616721a-5527-4f1c-ae97-e0ec0cd30e4c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.154946 Oct 28 10:46:16.379480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3614/7220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:16 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:17.401910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:17.402575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:17.409668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:17.410173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:17.410629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:17.411336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:17.411814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:17.412259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:17.547125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:17.555447 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5ed5bc3e-e859-4c26-be57-593bbfd99620 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.157544 Oct 28 10:46:17.556028 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3607/7221] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:17 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:18.579426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:18.580055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:18.582816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=30 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:18.589115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:18.589638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:18.590110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:18.590825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:18.591283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:18.591712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:18.596022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=86 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:18.722704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:18.730667 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-666e6327-0510-4fb7-a6b3-131addddc9b6 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1516 microversion: 2.1 time: 0.155164 Oct 28 10:46:18.731246 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3615/7222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:18 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:19.753891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:19.754446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:19.757231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=34 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:19.762646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:19.763210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:19.763702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:19.764427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:19.764919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:19.765372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:19.770777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:19.987930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:19.995793 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d6eb655-acb5-4e33-a86d-1cbed3ed3265 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1515 microversion: 2.1 time: 0.245996 Oct 28 10:46:19.996505 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3608/7223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:19 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:20.219494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-14b9ddcc-9485-4d55-9210-bbb5ba9bdb25 req-f1a50673-23c9-4ae1-a0ee-34847a4736e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c", "name": "network-vif-unplugged", "status": "completed", "tag": "da54b3eb-a247-4168-b710-be9a511efb1b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:20.230861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-14b9ddcc-9485-4d55-9210-bbb5ba9bdb25 req-f1a50673-23c9-4ae1-a0ee-34847a4736e0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:20.231353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-14b9ddcc-9485-4d55-9210-bbb5ba9bdb25 req-f1a50673-23c9-4ae1-a0ee-34847a4736e0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:20.231794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-14b9ddcc-9485-4d55-9210-bbb5ba9bdb25 req-f1a50673-23c9-4ae1-a0ee-34847a4736e0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:20.244256 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-14b9ddcc-9485-4d55-9210-bbb5ba9bdb25 req-f1a50673-23c9-4ae1-a0ee-34847a4736e0 service nova] Creating event network-vif-unplugged:da54b3eb-a247-4168-b710-be9a511efb1b for instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c on n-h1-zed-1 Oct 28 10:46:20.249855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-14b9ddcc-9485-4d55-9210-bbb5ba9bdb25 req-f1a50673-23c9-4ae1-a0ee-34847a4736e0 service nova] Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:46:20.262357 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-14b9ddcc-9485-4d55-9210-bbb5ba9bdb25 req-f1a50673-23c9-4ae1-a0ee-34847a4736e0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046660 Oct 28 10:46:20.263165 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3616/7224] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:46:21.019710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:21.020347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:21.027544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:21.028051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:21.028505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:21.029309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:21.029778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:21.030236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:21.169406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:21.177209 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9d683de8-736a-46f8-968e-eda6439f4f58 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1515 microversion: 2.1 time: 0.161411 Oct 28 10:46:21.177790 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3609/7225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:21 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:22.201959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:22.202670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:22.209825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:22.210320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:22.210771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:22.211477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:22.211947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:22.212383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:22.291545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c8544042-9a43-45e2-b143-3be055131c31 req-dba1049f-2840-49e3-84af-f66fef8869fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c", "tag": "da54b3eb-a247-4168-b710-be9a511efb1b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:22.301412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c8544042-9a43-45e2-b143-3be055131c31 req-dba1049f-2840-49e3-84af-f66fef8869fb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:22.301909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c8544042-9a43-45e2-b143-3be055131c31 req-dba1049f-2840-49e3-84af-f66fef8869fb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:22.302359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c8544042-9a43-45e2-b143-3be055131c31 req-dba1049f-2840-49e3-84af-f66fef8869fb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:22.314607 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c8544042-9a43-45e2-b143-3be055131c31 req-dba1049f-2840-49e3-84af-f66fef8869fb service nova] Creating event network-changed:da54b3eb-a247-4168-b710-be9a511efb1b for instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c on n-h1-zed-1 Oct 28 10:46:22.320000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-c8544042-9a43-45e2-b143-3be055131c31 req-dba1049f-2840-49e3-84af-f66fef8869fb service nova] Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:46:22.331368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c8544042-9a43-45e2-b143-3be055131c31 req-dba1049f-2840-49e3-84af-f66fef8869fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044018 Oct 28 10:46:22.332018 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3610/7226] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:46:22.342811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:22.351099 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-23e7500a-2512-412f-acde-42ef3dcc1891 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1513 microversion: 2.1 time: 0.153465 Oct 28 10:46:22.351670 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3617/7227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:22 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:23.376575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:23.377600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:23.384832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:23.385353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:23.385803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:23.386512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:23.386980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:23.387828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:23.531215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:23.539422 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76517e61-6947-43ad-809d-256422f4485e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1510 microversion: 2.1 time: 0.168079 Oct 28 10:46:23.540019 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3611/7228] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:23 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:23.563134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:23.563672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:23.570543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:23.571038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:23.571740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:23.572444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:23.572922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:23.573490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:23.603818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:46:23.656578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.compute.api [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Found an unconfirmed migration during delete, id: 16, status: finished Oct 28 10:46:25.510982 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-72a1c196-63e5-44db-a24a-c5cd7b0fcaac tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 204 len: 0 microversion: 2.1 time: 1.951820 Oct 28 10:46:25.511894 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3618/7229] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:46:23 2022] DELETE /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 0 bytes in 1954 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:46:25.519923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:25.520560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:25.528129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:25.528630 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:25.529120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:25.529827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:25.530299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:25.530739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:25.662665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:25.670597 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ab7bcb3b-2eaa-4588-8d5c-0ff588daf7da tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1502 microversion: 2.1 time: 0.154544 Oct 28 10:46:25.671178 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3612/7230] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:25 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:26.694519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:26.695271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:26.702399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:26.702890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:26.703333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:26.704028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:26.704490 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:26.704935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:26.843090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34ff19be87414c8583e3bacb352400c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dedc9e2dcf3346fe8ca2e46cc4a504de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:26.851026 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-49316ddf-2bcf-4fb4-afd6-36e220cc1936 tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 200 len: 1502 microversion: 2.1 time: 0.160778 Oct 28 10:46:26.851613 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3619/7231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:26 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:27.016974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4683b2da-6b78-48c1-a948-2e59d05a17f8 req-44bcbfcb-5210-4276-ad6f-e476e9d1176d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c", "name": "network-vif-plugged", "status": "completed", "tag": "da54b3eb-a247-4168-b710-be9a511efb1b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:27.029492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4683b2da-6b78-48c1-a948-2e59d05a17f8 req-44bcbfcb-5210-4276-ad6f-e476e9d1176d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.030052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4683b2da-6b78-48c1-a948-2e59d05a17f8 req-44bcbfcb-5210-4276-ad6f-e476e9d1176d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.030434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4683b2da-6b78-48c1-a948-2e59d05a17f8 req-44bcbfcb-5210-4276-ad6f-e476e9d1176d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.041951 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4683b2da-6b78-48c1-a948-2e59d05a17f8 req-44bcbfcb-5210-4276-ad6f-e476e9d1176d service nova] Creating event network-vif-plugged:da54b3eb-a247-4168-b710-be9a511efb1b for instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c on n-h1-zed-1 Oct 28 10:46:27.047002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4683b2da-6b78-48c1-a948-2e59d05a17f8 req-44bcbfcb-5210-4276-ad6f-e476e9d1176d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033966 Oct 28 10:46:27.047611 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3613/7232] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:46:27.423837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1ffdfd9e-16b4-455e-93c8-1f82437b8717 req-74d71fd4-a63c-4dbb-a617-c03557760605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c", "name": "network-vif-deleted", "tag": "da54b3eb-a247-4168-b710-be9a511efb1b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:27.435423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1ffdfd9e-16b4-455e-93c8-1f82437b8717 req-74d71fd4-a63c-4dbb-a617-c03557760605 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.436023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1ffdfd9e-16b4-455e-93c8-1f82437b8717 req-74d71fd4-a63c-4dbb-a617-c03557760605 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.436603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1ffdfd9e-16b4-455e-93c8-1f82437b8717 req-74d71fd4-a63c-4dbb-a617-c03557760605 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.451271 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1ffdfd9e-16b4-455e-93c8-1f82437b8717 req-74d71fd4-a63c-4dbb-a617-c03557760605 service nova] Creating event network-vif-deleted:da54b3eb-a247-4168-b710-be9a511efb1b for instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c on n-h1-zed-1 Oct 28 10:46:27.456409 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1ffdfd9e-16b4-455e-93c8-1f82437b8717 req-74d71fd4-a63c-4dbb-a617-c03557760605 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036846 Oct 28 10:46:27.457194 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3620/7233] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:46:27.874592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:27.875307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:27.881554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.882045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.882491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.883183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.883645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.884079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.897771 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] HTTP exception thrown: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Request method failure captured: Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c HTTP/1.1 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7LSPzVAL3XF9ZkddOiO4TAeNFsS4QQEEsnVl4nQew0xkzDHZtttQewVFUNP9lsil7-Enx4UWGyvrVK56u12OElbAonIM0FBFcedSB69Nk1uFaZJgqQAiP1yXhrPap3KBg0SCxhHrjKydeuzsyGVm-HdP6xFzVQDrFxQcIPml7mh4lI Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: dedc9e2dcf3346fe8ca2e46cc4a504de Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dedc9e2dcf3346fe8ca2e46cc4a504de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}] Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: dedc9e2dcf3346fe8ca2e46cc4a504de Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1998455109-project Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 34ff19be87414c8583e3bacb352400c3 Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1998455109-project Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c'} Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:46:27.899361 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Returning 404 to user: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a5cce58e-2a5f-481d-ab78-40c403b18a5e tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 404 len: 111 microversion: 2.1 time: 0.030499 Oct 28 10:46:27.904423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3614/7234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:27 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:46:27.917576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:27.918234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:27.924841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.925383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.925830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.926574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.927029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.927469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.940852 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] HTTP exception thrown: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Request method failure captured: Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c HTTP/1.1 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7LSPzVAL3XF9ZkddOiO4TAeNFsS4QQEEsnVl4nQew0xkzDHZtttQewVFUNP9lsil7-Enx4UWGyvrVK56u12OElbAonIM0FBFcedSB69Nk1uFaZJgqQAiP1yXhrPap3KBg0SCxhHrjKydeuzsyGVm-HdP6xFzVQDrFxQcIPml7mh4lI Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: dedc9e2dcf3346fe8ca2e46cc4a504de Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dedc9e2dcf3346fe8ca2e46cc4a504de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}] Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: dedc9e2dcf3346fe8ca2e46cc4a504de Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-DeleteServersTestJSON-1998455109-project Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 34ff19be87414c8583e3bacb352400c3 Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-DeleteServersTestJSON-1998455109-project Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c'} Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:46:27.942520 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Returning 404 to user: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d00e3a67-3dfc-4547-bbe6-96a68bd3541f tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 404 len: 111 microversion: 2.1 time: 0.032118 Oct 28 10:46:27.947225 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3621/7235] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:46:27 2022] DELETE /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:46:27.952714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:27.953377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] [instance: 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:27.959365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.960364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.960811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.961555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:27.962022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:27.962453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:27.976411 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] HTTP exception thrown: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Request method failure captured: Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c HTTP/1.1 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7LSPzVAL3XF9ZkddOiO4TAeNFsS4QQEEsnVl4nQew0xkzDHZtttQewVFUNP9lsil7-Enx4UWGyvrVK56u12OElbAonIM0FBFcedSB69Nk1uFaZJgqQAiP1yXhrPap3KBg0SCxhHrjKydeuzsyGVm-HdP6xFzVQDrFxQcIPml7mh4lI Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: dedc9e2dcf3346fe8ca2e46cc4a504de Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_dedc9e2dcf3346fe8ca2e46cc4a504de", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/dedc9e2dcf3346fe8ca2e46cc4a504de"}]}] Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: dedc9e2dcf3346fe8ca2e46cc4a504de Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-DeleteServersTestJSON-1998455109 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-DeleteServersTestJSON-1998455109-project Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 34ff19be87414c8583e3bacb352400c3 Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-DeleteServersTestJSON-1998455109-project Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c'} Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:46:27.977976 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] Returning 404 to user: Instance 97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8bb33381-fb10-4174-a556-c2039a1ecf6c tempest-DeleteServersTestJSON-1998455109 tempest-DeleteServersTestJSON-1998455109-project] 10.222.0.16 "GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c" status: 404 len: 111 microversion: 2.1 time: 0.030607 Oct 28 10:46:27.982695 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3615/7236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:27 2022] GET /compute/v2.1/servers/97ea6a66-49b7-4fd5-8e5e-cbd8fa27e47c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:46:36.651064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-547096713", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "021c9f00-3894-4200-b289-70e4f53d5837"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:36.831527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] validate_networks() for [('021c9f00-3894-4200-b289-70e4f53d5837', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:46:37.202600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:46:37.203025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:46:37.203504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:46:37.203915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:46:37.204331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:46:37.213796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:37.214280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:37.214722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:37.215448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:37.215905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:37.216332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:37.233995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Getting quotas for project 08bbd521938347f79f6d57235c246c5e. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:46:37.239492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Getting quotas for user fcc4e920a6784b02bbddf74e01158db5 and project 08bbd521938347f79f6d57235c246c5e. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:46:37.252226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:46:37.254579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:46:37.300895 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-698c01d8-2a54-43d8-8297-ac77c72af862 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780212 Oct 28 10:46:37.305069 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3622/7237] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:46:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:46:37.312697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b598ff17-8612-4580-88fb-88a1ff6a0263 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:37.313344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b598ff17-8612-4580-88fb-88a1ff6a0263 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:37.455925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b598ff17-8612-4580-88fb-88a1ff6a0263 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:37.463345 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b598ff17-8612-4580-88fb-88a1ff6a0263 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1217 microversion: 2.1 time: 0.154454 Oct 28 10:46:37.468393 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3616/7238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:37 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:38.490131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:38.490782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:38.500776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:38.501983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:38.502591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:38.503480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:38.504311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:38.505280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:38.577843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:38.589172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dad19684-e99e-46aa-abcf-ce0df204bfb4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1287 microversion: 2.1 time: 0.104079 Oct 28 10:46:38.597390 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3623/7239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:38 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:39.614870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:39.616960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:39.621161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=33 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:39.627992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:39.628598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:39.629337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:39.630308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:39.630785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:39.631569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:39.818599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:39.828416 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5bc39bd-a287-44b6-b257-f6e37d4c2c5c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1317 microversion: 2.1 time: 0.218904 Oct 28 10:46:39.829080 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3617/7240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:39 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:39.906866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fc3619a3-f9a9-4171-8e91-b51ad71c3758 req-7f04b0d1-2222-4d10-bdde-b1e6173136a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db740500-94d2-4a04-9abc-aea3b0685965", "tag": "7c7dcf8c-183d-4a43-b1de-e3060c6ceed3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:39.922764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fc3619a3-f9a9-4171-8e91-b51ad71c3758 req-7f04b0d1-2222-4d10-bdde-b1e6173136a4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:39.923421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fc3619a3-f9a9-4171-8e91-b51ad71c3758 req-7f04b0d1-2222-4d10-bdde-b1e6173136a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:39.923947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fc3619a3-f9a9-4171-8e91-b51ad71c3758 req-7f04b0d1-2222-4d10-bdde-b1e6173136a4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:39.937036 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fc3619a3-f9a9-4171-8e91-b51ad71c3758 req-7f04b0d1-2222-4d10-bdde-b1e6173136a4 service nova] Creating event network-changed:7c7dcf8c-183d-4a43-b1de-e3060c6ceed3 for instance db740500-94d2-4a04-9abc-aea3b0685965 on n-h1-zed-1 Oct 28 10:46:39.953315 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fc3619a3-f9a9-4171-8e91-b51ad71c3758 req-7f04b0d1-2222-4d10-bdde-b1e6173136a4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052088 Oct 28 10:46:39.954632 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3624/7241] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:46:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:46:40.851633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:40.852521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:40.859654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:40.860152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:40.860597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:40.861323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:40.861787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:40.862225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:40.995803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:41.003426 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4d7a28ac-0f47-462c-a6fa-03ae19c29faf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1317 microversion: 2.1 time: 0.155732 Oct 28 10:46:41.003994 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3618/7242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:40 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:42.026401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:42.027117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:42.033366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:42.033862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:42.034317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:42.035025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:42.035491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:42.035925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:42.172247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:42.180057 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7ab9a4c6-dbe1-43bf-9bcc-54c2c93e0e2d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1317 microversion: 2.1 time: 0.158827 Oct 28 10:46:42.180644 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3625/7243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:42 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:43.205508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:43.206082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:43.212949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:43.213458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:43.213909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:43.214620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:43.215092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:43.215533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:43.353599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:43.361312 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad39ceb3-25c6-41b5-b6de-8d2fb1990b65 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1317 microversion: 2.1 time: 0.159788 Oct 28 10:46:43.361883 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3619/7244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:43 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:44.385592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:44.386136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:44.393029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:44.393520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:44.393965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:44.394660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:44.395130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:44.395565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:44.528414 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:44.536127 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd919ce8-9d96-427d-90b1-5df84b830b09 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1317 microversion: 2.1 time: 0.155189 Oct 28 10:46:44.536701 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3626/7245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:44 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:45.110328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-05420f3a-de39-4f0b-bdb8-62470c68dae0 req-c2825bb5-7de0-49eb-a580-a4f98b82aac5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db740500-94d2-4a04-9abc-aea3b0685965", "name": "network-vif-plugged", "status": "completed", "tag": "7c7dcf8c-183d-4a43-b1de-e3060c6ceed3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:45.120895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-05420f3a-de39-4f0b-bdb8-62470c68dae0 req-c2825bb5-7de0-49eb-a580-a4f98b82aac5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:45.121401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-05420f3a-de39-4f0b-bdb8-62470c68dae0 req-c2825bb5-7de0-49eb-a580-a4f98b82aac5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:45.121853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-05420f3a-de39-4f0b-bdb8-62470c68dae0 req-c2825bb5-7de0-49eb-a580-a4f98b82aac5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:45.133084 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-05420f3a-de39-4f0b-bdb8-62470c68dae0 req-c2825bb5-7de0-49eb-a580-a4f98b82aac5 service nova] Creating event network-vif-plugged:7c7dcf8c-183d-4a43-b1de-e3060c6ceed3 for instance db740500-94d2-4a04-9abc-aea3b0685965 on n-h1-zed-1 Oct 28 10:46:45.138085 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-05420f3a-de39-4f0b-bdb8-62470c68dae0 req-c2825bb5-7de0-49eb-a580-a4f98b82aac5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031568 Oct 28 10:46:45.138694 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3620/7246] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:46:45.559318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:45.559934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:45.566757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:45.567242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:45.567681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:45.568397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:45.568850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:45.569303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:45.697154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:45.705187 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d058940d-9941-4e6c-8caa-f6562bad52a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1317 microversion: 2.1 time: 0.149716 Oct 28 10:46:45.705781 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3627/7247] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:45 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:46.729820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:46.730543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:46.736826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:46.737350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:46.737798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:46.738494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:46.738958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:46.739393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:46.868581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:46.876422 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7f899c6f-1eb6-4b00-b9a6-df7aeeaf6c76 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1508 microversion: 2.1 time: 0.152402 Oct 28 10:46:46.877010 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3621/7248] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:46 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:46.900112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:46.900867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:46.907809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:46.908301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:46.908749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:46.909479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:46.909948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:46.910390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.045027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:47.052714 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2aa5b273-0a0d-468f-b5e7-97fb9ac85721 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1508 microversion: 2.1 time: 0.157008 Oct 28 10:46:47.053325 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3628/7249] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:46 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:47.075316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:47.077797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:47.083696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.084816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.085325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.086029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.086495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.086932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.148563 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ee3ff54d-5b00-49ab-aca6-b82476c55dd3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "PUT /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1080 microversion: 2.1 time: 0.077387 Oct 28 10:46:47.149510 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3622/7250] 10.222.0.16 () {60 vars in 1256 bytes} [Fri Oct 28 10:46:47 2022] PUT /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1080 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:47.167415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:47.168042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:47.174743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.175251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.175702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.176405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.176874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.177334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.225271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:47.246118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:47.306628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:47.314293 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a26fef7a-66fa-482b-9adf-bb8d9509db41 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1506 microversion: 2.1 time: 0.150737 Oct 28 10:46:47.314862 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3629/7251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:47 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:47.337238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:47.337869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:47.343861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.344356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.344807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.345593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.346061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.346498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.460607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:47.477243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:47.485066 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-689c7e30-3972-47d1-94e8-68cc07d3a32a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1506 microversion: 2.1 time: 0.152397 Oct 28 10:46:47.485648 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3623/7252] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:47 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:47.508556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:46:47.510803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:47.516759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.517280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.517722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.518409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.518866 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.519292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.546532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:47.551901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Old instance type m1.heat2, new instance type m1.heat {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:46:47.558813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:46:47.559237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:46:47.559712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:46:47.560120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:46:47.560530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:46:47.624219 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e04c0c11-635c-4194-bf7c-5d0b545e806f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "POST /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965/action" status: 202 len: 0 microversion: 2.1 time: 0.120258 Oct 28 10:46:47.625065 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3630/7253] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:46:47 2022] POST /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:46:47.633883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:47.634574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:47.640527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.641540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.642076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.642862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:47.643345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:47.643791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:47.784054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:47.792950 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-99742257-c1bb-4fa0-b62b-c751a04de226 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1517 microversion: 2.1 time: 0.163810 Oct 28 10:46:47.793832 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3624/7254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:47 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:48.820334 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:48.821225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:48.832004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:48.834178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:48.835403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:48.835859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:48.836581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:48.837259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:48.837917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:48.841610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:48.981728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:48.991062 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1d7de7c3-bbc4-490f-b6bf-191201b1fcb0 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1517 microversion: 2.1 time: 0.177318 Oct 28 10:46:48.991646 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3631/7255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:48 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1517 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:50.014323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:50.014944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:50.017659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:46:50.024104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:50.024622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:50.025109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:50.025825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:50.026291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:50.026726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:50.155579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:50.163325 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d1ca760-d550-4167-8b36-134a1cb4e809 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.152968 Oct 28 10:46:50.163891 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3625/7256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:50 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:51.186581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:51.187203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:51.194086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:51.194577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:51.195016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:51.195710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:51.196428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:51.196860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:51.324820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:51.332633 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f42b8c6-8cb9-4eaa-b8f3-d3ffade9e871 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.150298 Oct 28 10:46:51.333241 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3632/7257] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:51 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:52.357185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:52.357752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:52.363796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:52.364296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:52.364751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:52.366141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:52.366619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:52.367062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:52.496507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:52.504300 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5de2661-0411-4036-a92d-c86ae1e6e1ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.151491 Oct 28 10:46:52.504877 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3626/7258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:52 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:53.528369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:53.528933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:53.535557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:53.536051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:53.536499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:53.537823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:53.538283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:53.538722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:53.669904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:53.678036 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a55cc9b-3aa5-4d6a-b6eb-d7ae9bced737 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.153524 Oct 28 10:46:53.678353 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3633/7259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:53 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:54.701236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:54.701865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:54.708679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:54.709832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:54.710289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:54.710992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:54.711466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:54.711907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:54.842843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:54.850607 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e05c1715-e0b2-4a23-995a-746a790e2a90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.153395 Oct 28 10:46:54.851178 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3627/7260] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:54 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:55.874150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:55.874690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:55.881855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:55.882350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:55.882799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:55.883507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:55.884001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:55.884464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:56.015163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:56.023824 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dcd04f5a-a9db-4274-8329-bdefff293518 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.153689 Oct 28 10:46:56.024416 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3634/7261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:55 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:46:57.045917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:57.046540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:57.053381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:57.053872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:57.054313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:57.055006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:57.055467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:57.055902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:57.184640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:57.192359 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb9c1be3-2ed2-4e30-8e87-6b10f720b118 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.150383 Oct 28 10:46:57.192943 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3628/7262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:57 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:58.216926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:58.217623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:58.224631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:58.225154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:58.225596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:58.226279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:58.226735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:58.227163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:58.362445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:58.370255 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2b3f754e-29e2-4176-8ae7-9cd41bdea50a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.157908 Oct 28 10:46:58.370826 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3635/7263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:58 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:46:59.393241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:46:59.393874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:46:59.401397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:59.401899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:59.402356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:59.403066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:46:59.403535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:46:59.403977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:46:59.533408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:46:59.542029 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-89afc898-c769-4a33-be26-e69eb843ca8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.152789 Oct 28 10:46:59.542604 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3629/7264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:46:59 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:00.564795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:00.565439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:00.573221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:00.573711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:00.574157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:00.574853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:00.575315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:00.575747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:00.705827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:00.714572 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2a45c01-e648-48b6-b2fd-9ef58a940e6c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.153605 Oct 28 10:47:00.715163 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3636/7265] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:00 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:01.737508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:01.738052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:01.745026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:01.745528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:01.745981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:01.746689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:01.747191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:01.747636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:01.879349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:01.887112 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b0514b4e-5d08-498a-96f7-1035099c5ffd tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.153609 Oct 28 10:47:01.887698 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3630/7266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:01 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:02.910639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:02.911263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:02.918665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:02.919152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:02.919592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:02.920290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:02.920750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:02.921217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:03.053240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:03.060966 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ff20808e-a284-4fc4-8b55-92eedeca163b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.154251 Oct 28 10:47:03.061547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3637/7267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:02 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:04.084641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:04.085224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:04.092090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:04.092596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:04.093086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:04.093801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:04.094275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:04.094723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:04.221940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:04.229543 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b2e166c-cea0-4592-a35f-62ff40d8f505 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.149435 Oct 28 10:47:04.230118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3631/7268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:04 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:05.254021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:05.254580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:05.261621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:05.262118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:05.262571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:05.263278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:05.263779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:05.264217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:05.397017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:05.404757 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7674792-3e88-442b-ac67-0b199fa947cb tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.154807 Oct 28 10:47:05.405360 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3638/7269] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:05 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:06.428778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:06.429443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:06.436345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:06.436847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:06.437330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:06.438041 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:06.438513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:06.438956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:06.573510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:06.581212 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d63b5629-41a0-4a0d-b8f2-c6acdd509c8a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.156925 Oct 28 10:47:06.581797 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3632/7270] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:06 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:07.604841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:07.605502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:07.612363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:07.612856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:07.613338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:07.614043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:07.614511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:07.614953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:07.743489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:07.751359 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6165f78d-753c-4a23-85ce-2ffb9bc3fe14 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.150681 Oct 28 10:47:07.751953 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3639/7271] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:07 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:08.775112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:08.775746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:08.782597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:08.783097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:08.783553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:08.784638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:08.785148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:08.785598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:08.803591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:08.916017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:08.923937 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-359319eb-1b08-4300-bf87-641c07f035af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.153382 Oct 28 10:47:08.924523 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3633/7272] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:08 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:09.946519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:09.947141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:09.953897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:09.954389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:09.954833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:09.955531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:09.955990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:09.956423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:10.090592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:10.098433 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8c194b7e-58e7-4716-b1b7-668030d08b24 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.156082 Oct 28 10:47:10.099005 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3640/7273] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:09 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:11.122710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:11.123339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:11.131149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:11.131647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:11.132100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:11.132802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:11.133300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:11.133742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:11.266984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:11.274936 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-df2f8ae7-aa14-49fe-b20a-688c7821c2ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.156121 Oct 28 10:47:11.275513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3634/7274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:11 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:12.298417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:12.298972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:12.302136 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:47:12.302267 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:47:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 (ip 10.222.0.16) !!! Oct 28 10:47:12.313240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:12.313737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:12.314180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:12.314886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:12.315348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:12.315778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:12.446647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:12.454378 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b7d0de53-cce8-4532-a666-efc047f552f4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.159954 Oct 28 10:47:12.454961 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3641/7275] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:12 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:13.477377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:13.478010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:13.484804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:13.485413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:13.485868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:13.486581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:13.487057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:13.487509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:13.615260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:13.623443 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ed9e450d-2f4f-4556-8fb2-d52205528708 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.150028 Oct 28 10:47:13.624006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3635/7276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:13 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:14.647424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:14.648158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:14.655372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:14.655871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:14.656322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:14.657064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:14.657534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:14.657969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:14.787974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:14.796061 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4779e24e-cbf8-4db1-93c0-dcb43c55c292 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.153555 Oct 28 10:47:14.796642 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3642/7277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:14 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:15.819086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:15.819751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:15.826995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:15.827495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:15.827947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:15.828653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:15.829160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:15.829604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:15.959084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:15.967355 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-28cdabcb-bb8d-45e2-83e8-c919bdc1abcc tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.152175 Oct 28 10:47:15.967927 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3636/7278] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:15 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:16.992263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:16.992951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:16.999800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:17.000290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:17.000733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:17.001462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:17.001919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:17.002349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:17.137651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:17.145356 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-17ab90fd-817c-4d08-8568-7b8a980777a3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.157701 Oct 28 10:47:17.145935 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3643/7279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:16 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:18.168450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:18.169109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:18.175987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:18.176486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:18.176969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:18.177679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:18.178653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:18.179098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:18.308596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:18.316389 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6de6def4-f2c4-4c90-b480-87a232ed13b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.151872 Oct 28 10:47:18.316985 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3637/7280] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:18 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:19.341116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:19.341742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:19.344493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=26 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:19.350164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:19.350659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:19.351107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:19.351808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:19.352273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:19.352710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:19.355287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=78 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:19.482220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:19.490090 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-02a31036-bd24-48dc-bbc1-e010c142584b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.152876 Oct 28 10:47:19.490673 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3644/7281] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:19 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:20.513422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:20.514083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:20.517017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=26 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:20.522303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:20.522804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:20.523258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:20.523967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:20.524437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:20.524880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:20.656777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:20.665001 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-246ceadd-7efc-493b-81a2-b9636e2d2b5e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1522 microversion: 2.1 time: 0.155489 Oct 28 10:47:20.665587 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3638/7282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:20 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:21.687816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:21.688437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:21.696663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:21.697181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:21.697629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:21.698332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:21.698795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:21.699228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:21.834898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:21.842705 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e74e6622-a8a2-4594-bcf4-4af6c35358e6 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1521 microversion: 2.1 time: 0.158845 Oct 28 10:47:21.843292 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3645/7283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:21 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:21.908313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d4d54cae-446b-451e-a934-3068417f0bfc req-9462b7a7-f048-404b-a7bd-39d48542c503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db740500-94d2-4a04-9abc-aea3b0685965", "name": "network-vif-unplugged", "status": "completed", "tag": "7c7dcf8c-183d-4a43-b1de-e3060c6ceed3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:21.918660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d4d54cae-446b-451e-a934-3068417f0bfc req-9462b7a7-f048-404b-a7bd-39d48542c503 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:21.919154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d4d54cae-446b-451e-a934-3068417f0bfc req-9462b7a7-f048-404b-a7bd-39d48542c503 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:21.919598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d4d54cae-446b-451e-a934-3068417f0bfc req-9462b7a7-f048-404b-a7bd-39d48542c503 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:21.932135 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d4d54cae-446b-451e-a934-3068417f0bfc req-9462b7a7-f048-404b-a7bd-39d48542c503 service nova] Creating event network-vif-unplugged:7c7dcf8c-183d-4a43-b1de-e3060c6ceed3 for instance db740500-94d2-4a04-9abc-aea3b0685965 on n-h2-zed-1 Oct 28 10:47:21.937596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-d4d54cae-446b-451e-a934-3068417f0bfc req-9462b7a7-f048-404b-a7bd-39d48542c503 service nova] Instance db740500-94d2-4a04-9abc-aea3b0685965 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:47:21.949425 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d4d54cae-446b-451e-a934-3068417f0bfc req-9462b7a7-f048-404b-a7bd-39d48542c503 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045437 Oct 28 10:47:21.950203 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3639/7284] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:47:22.866011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:22.866625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:22.873571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:22.874064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:22.874499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:22.875192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:22.876316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:22.876316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:23.009492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:23.017274 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10fbc4fb-15ad-4289-b0ac-a31393dcf84c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1519 microversion: 2.1 time: 0.155241 Oct 28 10:47:23.017864 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3646/7285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:22 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:23.975214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-811cb2e2-7602-4c6c-8f1a-17c1c700ef84 req-07b06302-2677-4800-86c8-dba6a771d4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db740500-94d2-4a04-9abc-aea3b0685965", "tag": "7c7dcf8c-183d-4a43-b1de-e3060c6ceed3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:23.985947 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-811cb2e2-7602-4c6c-8f1a-17c1c700ef84 req-07b06302-2677-4800-86c8-dba6a771d4b4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:23.986442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-811cb2e2-7602-4c6c-8f1a-17c1c700ef84 req-07b06302-2677-4800-86c8-dba6a771d4b4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:23.986891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-811cb2e2-7602-4c6c-8f1a-17c1c700ef84 req-07b06302-2677-4800-86c8-dba6a771d4b4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:23.999171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-811cb2e2-7602-4c6c-8f1a-17c1c700ef84 req-07b06302-2677-4800-86c8-dba6a771d4b4 service nova] Creating event network-changed:7c7dcf8c-183d-4a43-b1de-e3060c6ceed3 for instance db740500-94d2-4a04-9abc-aea3b0685965 on n-h2-zed-1 Oct 28 10:47:24.004547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-811cb2e2-7602-4c6c-8f1a-17c1c700ef84 req-07b06302-2677-4800-86c8-dba6a771d4b4 service nova] Instance db740500-94d2-4a04-9abc-aea3b0685965 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:47:24.015705 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-811cb2e2-7602-4c6c-8f1a-17c1c700ef84 req-07b06302-2677-4800-86c8-dba6a771d4b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045464 Oct 28 10:47:24.016305 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3640/7286] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:47:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:47:24.044392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:24.045930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:24.053652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:24.054269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:24.054816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:24.056057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:24.056595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:24.057295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:24.198890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:24.208103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8642fd5f-ec41-4ec2-8014-94482b5852ff tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1519 microversion: 2.1 time: 0.168381 Oct 28 10:47:24.208692 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3647/7287] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:24 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:25.233451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:25.234160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:25.240298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:25.240797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:25.241587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:25.242297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:25.242763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:25.243248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:25.387389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:25.395382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a707f3f5-61bf-4045-a66d-3b21a41f8a9f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1519 microversion: 2.1 time: 0.167431 Oct 28 10:47:25.395971 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3641/7288] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:25 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:26.418853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:26.419476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:26.426459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:26.426888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:26.427329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:26.428023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:26.428481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:26.428935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:26.559544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:26.567339 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-75af15bf-4d9a-4e5b-bfe0-02f0ce294b43 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1516 microversion: 2.1 time: 0.152547 Oct 28 10:47:26.567945 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3648/7289] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:26 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:26.591176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:26.591730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:26.598721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:26.599221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:26.599675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:26.600386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:26.600856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:26.601320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:26.658990 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ca48c54f-c498-4a50-adae-013911259b36 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "POST /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965/action" status: 204 len: 0 microversion: 2.1 time: 0.072129 Oct 28 10:47:26.659645 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3642/7290] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:47:26 2022] POST /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:47:26.667810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:26.668672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:26.674761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:26.675246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:26.675713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:26.676404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:26.676991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:26.677337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:26.816319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:26.825550 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-af441ad6-dfbf-4b7f-a059-630be1fe127e tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1516 microversion: 2.1 time: 0.161560 Oct 28 10:47:26.826550 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3649/7291] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:26 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:27.851091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:27.851758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:27.859980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:27.860456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:27.860918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:27.861620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:27.862726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:27.863176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:28.004014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:28.012754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81c14e2a-df35-4aab-b778-74963a960f0f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1508 microversion: 2.1 time: 0.166848 Oct 28 10:47:28.013367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3643/7292] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:27 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:28.035619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:28.036298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:28.043792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:28.044296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:28.044720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:28.045509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:28.045969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:28.046397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:28.180911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:28.188998 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4d3ddc32-9990-47d5-b5cb-5dd88c5f34f1 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1508 microversion: 2.1 time: 0.157322 Oct 28 10:47:28.189589 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3650/7293] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:28 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:28.215415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ecb4b733-9d2a-4a55-a070-4a0b1ac623a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'create', calling method: .version_select at 0x7fca33be2430>, body: {"keypair": {"name": "tempest-keypair-1509234896", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfDSMhSAwNgrcT0Yqe+watOPrZ3S0U6dp5qeaRzxJDS9rvNBT9dpv+KTVNbwJ6NPICBotn1VsJdDW/V2SxMoY0CyUxhynOFifEetxO1SR1XeCMAHFJcDcDjJb5pT+CpiA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:28.230658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ecb4b733-9d2a-4a55-a070-4a0b1ac623a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Getting quotas for project 08bbd521938347f79f6d57235c246c5e. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:47:28.235971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ecb4b733-9d2a-4a55-a070-4a0b1ac623a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Getting quotas for user fcc4e920a6784b02bbddf74e01158db5 and project 08bbd521938347f79f6d57235c246c5e. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:47:28.261545 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ecb4b733-9d2a-4a55-a070-4a0b1ac623a9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050434 Oct 28 10:47:28.262434 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3644/7294] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:47:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:47:28.275088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-db9b7e77-e21b-4d1e-bce7-abc027a907ee req-57dbab31-aa13-4388-bb3f-af7b18720f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db740500-94d2-4a04-9abc-aea3b0685965", "name": "network-vif-plugged", "status": "completed", "tag": "7c7dcf8c-183d-4a43-b1de-e3060c6ceed3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:28.286967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db9b7e77-e21b-4d1e-bce7-abc027a907ee req-57dbab31-aa13-4388-bb3f-af7b18720f06 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:28.287470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db9b7e77-e21b-4d1e-bce7-abc027a907ee req-57dbab31-aa13-4388-bb3f-af7b18720f06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:28.288257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db9b7e77-e21b-4d1e-bce7-abc027a907ee req-57dbab31-aa13-4388-bb3f-af7b18720f06 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:28.301509 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-db9b7e77-e21b-4d1e-bce7-abc027a907ee req-57dbab31-aa13-4388-bb3f-af7b18720f06 service nova] Creating event network-vif-plugged:7c7dcf8c-183d-4a43-b1de-e3060c6ceed3 for instance db740500-94d2-4a04-9abc-aea3b0685965 on n-h2-zed-1 Oct 28 10:47:28.307806 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-db9b7e77-e21b-4d1e-bce7-abc027a907ee req-57dbab31-aa13-4388-bb3f-af7b18720f06 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036725 Oct 28 10:47:28.309009 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3651/7295] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:47:29.433634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:29.434268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:29.440858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:29.441386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:29.441835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:29.442540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:29.443023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:29.443462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:29.574569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:29.582404 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-21a1d9a6-30ab-4aab-956a-1600dc568fd2 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 200 len: 1508 microversion: 2.1 time: 0.153990 Oct 28 10:47:29.582911 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3645/7296] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:29 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:29.606900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:29.607495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:29.613791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:29.614282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:29.614728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:29.615429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:29.615900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:29.616329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:29.641735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:47:29.715378 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c717759e-8991-4718-a264-b091ced962af tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 204 len: 0 microversion: 2.1 time: 0.113899 Oct 28 10:47:29.716029 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3652/7297] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:47:29 2022] DELETE /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:47:29.774585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-977560549", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "021c9f00-3894-4200-b289-70e4f53d5837"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:29.828158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] validate_networks() for [('021c9f00-3894-4200-b289-70e4f53d5837', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:47:30.202306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:47:30.202750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:47:30.203238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:47:30.203661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:47:30.204087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:47:30.212972 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:30.213976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:30.214428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:30.215170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:30.215637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:30.216076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:30.233178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Getting quotas for project 08bbd521938347f79f6d57235c246c5e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:47:30.238394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Getting quotas for user fcc4e920a6784b02bbddf74e01158db5 and project 08bbd521938347f79f6d57235c246c5e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:47:30.251530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:47:30.253868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:47:30.299081 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e203f92a-d0a6-447e-87cc-6f46c4b5572a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528399 Oct 28 10:47:30.299753 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3646/7298] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:47:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:47:30.311271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a4e36c7-6e1f-4e91-8c22-54c5de752231 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:30.312006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a4e36c7-6e1f-4e91-8c22-54c5de752231 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:30.368000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a4e36c7-6e1f-4e91-8c22-54c5de752231 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:30.374946 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a4e36c7-6e1f-4e91-8c22-54c5de752231 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1217 microversion: 2.1 time: 0.067837 Oct 28 10:47:30.375879 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3653/7299] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:30 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:31.398820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:31.399459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:31.409205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:31.409712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:31.410199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:31.410918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:31.411420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:31.411871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:31.481780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:31.489371 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-46192bec-a49f-4c0e-bc70-bcb92c3ca1ed tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1269 microversion: 2.1 time: 0.095299 Oct 28 10:47:31.489971 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3647/7300] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:31 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1269 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:31.826870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-44a93bf6-4ae3-45d6-9f10-617e7f74e031 req-8723b57a-8ab4-4b93-8490-89fb02a10c10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db740500-94d2-4a04-9abc-aea3b0685965", "name": "network-vif-deleted", "tag": "7c7dcf8c-183d-4a43-b1de-e3060c6ceed3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:31.840381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-44a93bf6-4ae3-45d6-9f10-617e7f74e031 req-8723b57a-8ab4-4b93-8490-89fb02a10c10 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:31.840795 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-44a93bf6-4ae3-45d6-9f10-617e7f74e031 req-8723b57a-8ab4-4b93-8490-89fb02a10c10 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:31.841265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-44a93bf6-4ae3-45d6-9f10-617e7f74e031 req-8723b57a-8ab4-4b93-8490-89fb02a10c10 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:31.858369 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-44a93bf6-4ae3-45d6-9f10-617e7f74e031 req-8723b57a-8ab4-4b93-8490-89fb02a10c10 service nova] Creating event network-vif-deleted:7c7dcf8c-183d-4a43-b1de-e3060c6ceed3 for instance db740500-94d2-4a04-9abc-aea3b0685965 on n-h2-zed-1 Oct 28 10:47:31.863691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-44a93bf6-4ae3-45d6-9f10-617e7f74e031 req-8723b57a-8ab4-4b93-8490-89fb02a10c10 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040922 Oct 28 10:47:31.864525 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3654/7301] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:47:32.513262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:32.514048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:32.523294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:32.523865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:32.524384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:32.525252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:32.526743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:32.527260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:32.736856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:32.745088 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-972e07f3-50b7-438f-a95c-3b7c12d5b78c tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1317 microversion: 2.1 time: 0.236396 Oct 28 10:47:32.745673 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3648/7302] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:32 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:33.769148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:33.769773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:33.775992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:33.776483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:33.776955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:33.777662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:33.778123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:33.778555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:33.881150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1abfa582-1aa4-4a64-892b-b58baa172ff6 req-1757b83f-c4dc-47c5-872f-5e837c47691f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4148c7-9a87-465f-ad2b-d3b693009602", "tag": "f6a889eb-501d-46c9-83ee-00331e584cb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:33.891533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1abfa582-1aa4-4a64-892b-b58baa172ff6 req-1757b83f-c4dc-47c5-872f-5e837c47691f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:33.892024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1abfa582-1aa4-4a64-892b-b58baa172ff6 req-1757b83f-c4dc-47c5-872f-5e837c47691f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:33.892464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1abfa582-1aa4-4a64-892b-b58baa172ff6 req-1757b83f-c4dc-47c5-872f-5e837c47691f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:33.903650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1abfa582-1aa4-4a64-892b-b58baa172ff6 req-1757b83f-c4dc-47c5-872f-5e837c47691f service nova] Creating event network-changed:f6a889eb-501d-46c9-83ee-00331e584cb5 for instance 1f4148c7-9a87-465f-ad2b-d3b693009602 on n-h2-zed-1 Oct 28 10:47:33.908674 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1abfa582-1aa4-4a64-892b-b58baa172ff6 req-1757b83f-c4dc-47c5-872f-5e837c47691f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031380 Oct 28 10:47:33.909617 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3649/7303] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:47:33.913038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:33.922536 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-decd7ee3-1461-48af-aeab-8d5a02fee686 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1317 microversion: 2.1 time: 0.158554 Oct 28 10:47:33.923213 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3655/7304] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:33 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:34.947697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:34.948416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:34.954718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:34.955220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:34.955671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:34.956372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:34.956842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:34.957307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:35.091074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:35.098753 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7653e527-c780-4556-b1da-2bfc85ea8460 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1317 microversion: 2.1 time: 0.156395 Oct 28 10:47:35.099328 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3650/7305] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:34 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:36.122711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:36.123397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:36.130316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:36.130753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:36.131205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:36.131909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:36.132373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:36.132809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:36.267300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:36.275202 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fc1e13fe-b714-4786-8992-c39f68a99480 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1317 microversion: 2.1 time: 0.156975 Oct 28 10:47:36.275792 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3656/7306] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:36 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:37.298573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:37.299204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:37.306124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:37.306623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:37.307075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:37.307780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:37.308258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:37.308701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:37.439845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:37.447833 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9a806332-9085-4965-80ee-7a98743b1d6a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1317 microversion: 2.1 time: 0.153176 Oct 28 10:47:37.448405 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3651/7307] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:37 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:38.470825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:38.471439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:38.478305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:38.478836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:38.479200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:38.479882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:38.480340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:38.480767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:38.488895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-95226c3b-daeb-4a73-a5c5-b0b41c82d0eb req-64cca0bf-ae7a-4dd1-8321-1b0dca804d89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4148c7-9a87-465f-ad2b-d3b693009602", "name": "network-vif-plugged", "status": "completed", "tag": "f6a889eb-501d-46c9-83ee-00331e584cb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:38.502527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-95226c3b-daeb-4a73-a5c5-b0b41c82d0eb req-64cca0bf-ae7a-4dd1-8321-1b0dca804d89 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:38.503267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-95226c3b-daeb-4a73-a5c5-b0b41c82d0eb req-64cca0bf-ae7a-4dd1-8321-1b0dca804d89 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:38.503719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-95226c3b-daeb-4a73-a5c5-b0b41c82d0eb req-64cca0bf-ae7a-4dd1-8321-1b0dca804d89 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:38.507838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:38.516929 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-95226c3b-daeb-4a73-a5c5-b0b41c82d0eb req-64cca0bf-ae7a-4dd1-8321-1b0dca804d89 service nova] Creating event network-vif-plugged:f6a889eb-501d-46c9-83ee-00331e584cb5 for instance 1f4148c7-9a87-465f-ad2b-d3b693009602 on n-h2-zed-1 Oct 28 10:47:38.522627 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-95226c3b-daeb-4a73-a5c5-b0b41c82d0eb req-64cca0bf-ae7a-4dd1-8321-1b0dca804d89 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037576 Oct 28 10:47:38.523553 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3652/7308] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:47:38.626212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:38.634144 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-17968c80-f967-488f-99ea-2ba11da566ea tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1317 microversion: 2.1 time: 0.167168 Oct 28 10:47:38.634729 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3657/7309] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:38 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:39.659856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:39.660573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:39.668887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:39.669403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:39.669853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:39.670557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:39.671028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:39.671489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:39.804515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:39.812302 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd88e984-4f02-4129-a54e-396645af2598 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1317 microversion: 2.1 time: 0.157846 Oct 28 10:47:39.812876 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3653/7310] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:39 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:40.835759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:40.836377 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:40.839240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:40.844609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:40.845133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:40.845580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:40.846274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:40.846735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:40.847170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:40.974431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:40.982780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-03e67bf0-ecdc-4395-aa70-8fa59862b88f tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1508 microversion: 2.1 time: 0.151004 Oct 28 10:47:40.983362 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3658/7311] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:40 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:41.005166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:41.005794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:41.007816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:41.008505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=10 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:41.015164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:41.015662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:41.016116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:41.016826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:41.017336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:41.017782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:41.147841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:41.156213 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39f3a46f-9f03-4cce-bf8f-e23a2dee29c5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1508 microversion: 2.1 time: 0.155006 Oct 28 10:47:41.156804 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3654/7312] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:41 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:41.178600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:47:41.180933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:41.186935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:41.187423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:41.187864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:41.188564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:41.189056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:41.189492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:41.217653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:41.223081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Old instance type m1.heat2, new instance type m1.heat {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:47:41.230083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:47:41.230506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:47:41.230993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:47:41.231406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:47:41.231821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:47:41.295001 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca50c242-1132-4430-9b20-22b5233b68d5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "POST /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602/action" status: 202 len: 0 microversion: 2.1 time: 0.120226 Oct 28 10:47:41.295714 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3659/7313] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:47:41 2022] POST /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:47:41.303704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:41.304337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:41.310303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:41.310806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:41.311272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:41.311984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:41.312459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:41.312919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:41.448513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:41.456419 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6bbfeac-83b0-4842-822a-3456350d05e8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1515 microversion: 2.1 time: 0.156590 Oct 28 10:47:41.457017 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3655/7314] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:41 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:42.480601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:42.481289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:42.488756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:42.488966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:42.489389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:42.490094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:42.490649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:42.490978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:42.496867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:42.629365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:42.637768 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c82c92c8-2e4d-497c-a225-0e8eb9f77412 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1515 microversion: 2.1 time: 0.162307 Oct 28 10:47:42.638344 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3660/7315] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:42 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:43.660632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:43.661297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:43.668154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:43.668653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:43.669145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:43.669854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:43.670350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:43.670796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:43.804088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:43.811964 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e52604a-7cf9-4076-a80b-0f0ce23ca11b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.155157 Oct 28 10:47:43.812554 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3656/7316] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:43 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:44.835973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:44.836601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:44.844118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:44.844537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:44.845081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:44.845780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:44.846235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:44.846661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:44.973183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:44.981576 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ed3342b-9061-4298-a27d-0f60ee464e15 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.149519 Oct 28 10:47:44.982167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3661/7317] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:44 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:46.004051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:46.004682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:46.011608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:46.012112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:46.012567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:46.013297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:46.013777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:46.014217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:46.142076 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:46.149781 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f72552c0-3ae8-42a3-8757-99e6ed22e8b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.149698 Oct 28 10:47:46.150361 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3657/7318] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:45 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:47.173327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:47.173953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:47.180846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:47.181357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:47.181801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:47.182996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:47.183452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:47.183883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:47.318693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:47.326871 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-97b65242-d86d-45f9-9e57-b3a103dbe46d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.157466 Oct 28 10:47:47.327489 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3662/7319] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:47 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:48.348958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:48.349527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:48.356354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:48.356842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:48.357322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:48.358047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:48.358533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:48.358966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:48.494440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:48.502754 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d29af450-8243-4b0d-9640-953ce5816f4a tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.157803 Oct 28 10:47:48.503339 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3658/7320] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:48 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:49.526806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:49.527418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:49.530266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:49.535655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:49.536136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:49.536573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:49.537288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:49.537742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:49.538170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:49.668428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:49.676383 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1df97e47-5fa5-4134-b168-9e0c77a16d90 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.154036 Oct 28 10:47:49.676995 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3663/7321] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:49 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:50.699855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:50.700479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:50.703209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:47:50.709162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:50.709656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:50.710100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:50.710796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:50.711261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:50.711695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:50.840892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:50.848592 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-86f9fa10-20d6-4d1f-9bb0-05d1cd3034f5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.152862 Oct 28 10:47:50.849189 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3659/7322] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:50 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:51.873272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:51.873947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:51.880923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:51.881427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:51.881878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:51.882574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:51.883040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:51.883473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:52.018401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:52.026169 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2a08f4a8-9014-4819-9f3a-4b4f8ad98c23 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.157538 Oct 28 10:47:52.026751 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3664/7323] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:51 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:53.049361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:53.049983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:53.056223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:53.056715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:53.057750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:53.058446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:53.058916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:53.059349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:53.189006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:53.197088 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34cebd8c-e584-401d-8523-f4a0f2b84d29 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.151749 Oct 28 10:47:53.197735 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3660/7324] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:53 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:54.220004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:54.220559 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:54.226933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:54.227428 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:54.227878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:54.228574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:54.229070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:54.229508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:54.358648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:54.366511 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50ed4cff-92a8-4f46-98b9-a89c9e30c919 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.150697 Oct 28 10:47:54.367092 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3665/7325] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:54 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:55.390989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:55.391686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:55.398937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:55.399439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:55.399895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:55.400607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:55.401116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:55.401561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:55.534360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:55.542098 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8c35ca59-eba1-4d1a-876f-a5663bcb5881 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.155603 Oct 28 10:47:55.542671 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3661/7326] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:55 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:56.565566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:56.566216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:56.573346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:56.573831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:56.574270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:56.574957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:56.575413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:56.575838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:56.704469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:56.712264 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-19480e2e-809c-4cd4-ba2a-fd78a1f16d82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.150605 Oct 28 10:47:56.712850 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3666/7327] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:56 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:57.736109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:57.736724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:57.743590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:57.744082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:57.744530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:57.745261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:57.745733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:57.746784 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:57.874185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:57.882057 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-869af344-a4e5-4784-9c14-859b0bac0503 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.149893 Oct 28 10:47:57.882636 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3662/7328] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:57 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:47:58.904982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:47:58.905610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:47:58.912472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:58.913108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:58.913563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:58.914421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:47:58.914726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:47:58.915551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:47:59.047665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:47:59.055368 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4014a5dd-9cc6-4441-9d68-55b6ed05d7a8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.154766 Oct 28 10:47:59.055947 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3667/7329] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:47:58 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:00.078750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:00.079391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:00.086355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:00.086860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:00.087318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:00.088030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:00.088502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:00.088967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:00.220238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:00.228091 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af9fc09e-1f73-4990-bf4c-8cf10fd2b036 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.153324 Oct 28 10:48:00.228606 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3663/7330] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:00 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:01.250071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:01.250692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:01.257687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:01.258180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:01.258626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:01.259327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:01.259787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:01.260223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:01.387038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:01.394796 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c8ffd52-301e-4adc-aad7-2689902687ef tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.148612 Oct 28 10:48:01.395373 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3668/7331] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:01 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:02.419029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:02.419694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:02.426729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:02.427234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:02.427687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:02.428404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:02.428875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:02.429344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:02.560840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:02.568757 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c58dc15b-6a14-4950-a664-acf8c3a97476 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.154212 Oct 28 10:48:02.569363 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3664/7332] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:02 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:03.591993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:03.592644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:03.599967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:03.600458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:03.600929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:03.601620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:03.602082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:03.602518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:03.737219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:03.745124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a8acf669-78d7-4259-b7e3-aca67f046c82 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.156986 Oct 28 10:48:03.745745 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3669/7333] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:03 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:04.768993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:04.769520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:04.776768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:04.777306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:04.777760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:04.779048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:04.779518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:04.779959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:04.906510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:04.914350 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-65f2f8c5-bc4a-4fac-aaa7-419fc20fd410 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.149447 Oct 28 10:48:04.914928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3665/7334] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:04 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:05.937582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:05.938233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:05.945137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:05.945879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:05.946322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:05.947015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:05.947475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:05.947905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:06.076046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:06.083740 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-76a59d69-dc55-46d7-9502-48af66e18659 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.150116 Oct 28 10:48:06.084315 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3670/7335] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:05 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:07.108153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:07.108798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:07.115629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:07.116119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:07.116563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:07.117283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:07.117749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:07.118187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:07.583101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:07.591496 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-609b8f27-191d-45d7-8e5f-134129c083ad tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.487834 Oct 28 10:48:07.592079 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3666/7336] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:07 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:08.614412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:08.615044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:08.622078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:08.622574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:08.623024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:08.623726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:08.624195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:08.624631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:08.812986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:08.821154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-759a1715-f90f-40e9-bde7-32aced37e6bf tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.210616 Oct 28 10:48:08.821955 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3671/7337] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:08 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:09.844399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:09.844945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:09.851867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:09.852365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:09.852817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:09.853552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:09.854023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:09.854472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:09.857045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=86 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:09.982532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:09.991157 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0f9d364e-4ccb-4a27-aee8-ea46176ea8a4 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1520 microversion: 2.1 time: 0.151342 Oct 28 10:48:09.991741 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3667/7338] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:09 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:10.761200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e6ac9528-e4d1-4e2c-8bc1-6b0f57371752 req-f8837675-94fb-4d8b-8861-5a96131e60af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4148c7-9a87-465f-ad2b-d3b693009602", "name": "network-vif-unplugged", "status": "completed", "tag": "f6a889eb-501d-46c9-83ee-00331e584cb5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:10.771838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e6ac9528-e4d1-4e2c-8bc1-6b0f57371752 req-f8837675-94fb-4d8b-8861-5a96131e60af service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:10.772331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e6ac9528-e4d1-4e2c-8bc1-6b0f57371752 req-f8837675-94fb-4d8b-8861-5a96131e60af service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:10.772774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e6ac9528-e4d1-4e2c-8bc1-6b0f57371752 req-f8837675-94fb-4d8b-8861-5a96131e60af service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:10.785514 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e6ac9528-e4d1-4e2c-8bc1-6b0f57371752 req-f8837675-94fb-4d8b-8861-5a96131e60af service nova] Creating event network-vif-unplugged:f6a889eb-501d-46c9-83ee-00331e584cb5 for instance 1f4148c7-9a87-465f-ad2b-d3b693009602 on n-h1-zed-1 Oct 28 10:48:10.790970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-e6ac9528-e4d1-4e2c-8bc1-6b0f57371752 req-f8837675-94fb-4d8b-8861-5a96131e60af service nova] Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:48:10.802457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e6ac9528-e4d1-4e2c-8bc1-6b0f57371752 req-f8837675-94fb-4d8b-8861-5a96131e60af service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044826 Oct 28 10:48:10.803069 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3672/7339] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:11.014869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:11.015399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:11.022329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:11.022830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:11.023285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:11.023992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:11.024464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:11.024950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:11.283211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:11.291113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-81d83979-d4c8-41fa-98dd-cfa18e870a92 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1519 microversion: 2.1 time: 0.280771 Oct 28 10:48:11.291558 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3668/7340] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:11 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:12.316986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:12.317688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:12.324120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:12.325199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:12.325640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:12.326390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:12.326846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:12.327274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:12.551887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:12.554274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=80 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:12.561619 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f16e01f-d245-461e-91f1-2cfdc549ea48 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1517 microversion: 2.1 time: 0.250406 Oct 28 10:48:12.562204 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3673/7341] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:12 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1517 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:12.830968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-28396f8b-7eb8-420b-91db-87ad588be4b1 req-51bf9121-af71-4c5d-bc32-ae11805f85b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4148c7-9a87-465f-ad2b-d3b693009602", "tag": "f6a889eb-501d-46c9-83ee-00331e584cb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:12.841310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-28396f8b-7eb8-420b-91db-87ad588be4b1 req-51bf9121-af71-4c5d-bc32-ae11805f85b1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:12.841744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-28396f8b-7eb8-420b-91db-87ad588be4b1 req-51bf9121-af71-4c5d-bc32-ae11805f85b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:12.842190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-28396f8b-7eb8-420b-91db-87ad588be4b1 req-51bf9121-af71-4c5d-bc32-ae11805f85b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:12.854083 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-28396f8b-7eb8-420b-91db-87ad588be4b1 req-51bf9121-af71-4c5d-bc32-ae11805f85b1 service nova] Creating event network-changed:f6a889eb-501d-46c9-83ee-00331e584cb5 for instance 1f4148c7-9a87-465f-ad2b-d3b693009602 on n-h1-zed-1 Oct 28 10:48:12.859836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-28396f8b-7eb8-420b-91db-87ad588be4b1 req-51bf9121-af71-4c5d-bc32-ae11805f85b1 service nova] Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:48:12.870734 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-28396f8b-7eb8-420b-91db-87ad588be4b1 req-51bf9121-af71-4c5d-bc32-ae11805f85b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043449 Oct 28 10:48:12.871357 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3669/7342] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:48:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:13.585773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:13.587043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:13.594986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:13.595707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:13.596147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:13.597060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:13.597512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:13.598108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:13.731300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:13.739489 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a02863e-add0-4cbe-9b98-27b4e3b6f947 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1514 microversion: 2.1 time: 0.157695 Oct 28 10:48:13.740071 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3674/7343] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:13 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:13.764385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:13.765083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:13.771384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:13.771880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:13.772532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:13.773282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:13.773751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:13.774191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:13.832779 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5c6c88c-08e7-447a-8671-e4d38eff433b tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "POST /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602/action" status: 204 len: 0 microversion: 2.1 time: 0.072630 Oct 28 10:48:13.833480 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3670/7344] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:48:13 2022] POST /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:48:13.842279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:13.842991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:13.849168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:13.849686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:13.850132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:13.850964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:13.851430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:13.851864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:14.261692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:14.270014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b49ff3d1-ded7-4799-ba0f-bc43b4cf5024 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1514 microversion: 2.1 time: 0.432178 Oct 28 10:48:14.270591 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3675/7345] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:13 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1514 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:15.295608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:15.296320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:15.302483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.302981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.303435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.304188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.304603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.305074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.515657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:15.523535 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a587533a-505b-4e58-afbe-44921003ee85 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1506 microversion: 2.1 time: 0.233628 Oct 28 10:48:15.524117 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3671/7346] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:15 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1506 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:15.548811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:15.549479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:15.556227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.556752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.557233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.557940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.558403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.558837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.692202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:15.700800 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30128a0a-a2f7-4877-9068-611bf9d8afa3 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1506 microversion: 2.1 time: 0.155843 Oct 28 10:48:15.701394 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3676/7347] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:15 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:15.723244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:15.723872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:15.730014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.730513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.730993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.731701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.732175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.732623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.858815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:15.866554 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de9b6ff8-e221-437e-821f-4fddfe352545 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1506 microversion: 2.1 time: 0.147194 Oct 28 10:48:15.867131 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3672/7348] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:15 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1506 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:48:15.888964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:15.889474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:15.895463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.895955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.896398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.897162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:15.897622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:15.898052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:15.923627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:48:16.001849 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f8f6dd1a-eb04-47e3-b997-4bb49a1bbae8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 204 len: 0 microversion: 2.1 time: 0.117011 Oct 28 10:48:16.002472 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3677/7349] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:48:15 2022] DELETE /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:48:16.020435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:16.020980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:16.027007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:16.027569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:16.028524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:16.029283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:16.029759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:16.030205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:16.059366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:48:16.103680 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.compute.api [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Instance is already in deleting state, ignoring this request Oct 28 10:48:16.104522 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-310ae554-c4e5-4a5c-8f15-631dcef5f81d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 204 len: 0 microversion: 2.1 time: 0.089254 Oct 28 10:48:16.105122 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3673/7350] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:48:16 2022] DELETE /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:48:16.113675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:16.114381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:16.120271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:16.120760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:16.121780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:16.122475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:16.122933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:16.123363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:16.254739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:16.263156 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea62229d-eb83-46b9-9cda-3e41904e9fa5 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1512 microversion: 2.1 time: 0.153654 Oct 28 10:48:16.263728 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3678/7351] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:16 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:17.285406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:17.286038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:17.292853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:17.293382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:17.293835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:17.294543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:17.295019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:17.295461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:17.467719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fcc4e920a6784b02bbddf74e01158db5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08bbd521938347f79f6d57235c246c5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:17.477257 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14108695-8205-4b02-9595-dd7c2072a71d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 200 len: 1512 microversion: 2.1 time: 0.195653 Oct 28 10:48:17.478074 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3674/7352] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:17 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 1512 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:17.609381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-26e3d110-a00c-4644-8261-153f8abb2169 req-685c02db-42df-49e2-9402-6807519d911f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4148c7-9a87-465f-ad2b-d3b693009602", "name": "network-vif-plugged", "status": "completed", "tag": "f6a889eb-501d-46c9-83ee-00331e584cb5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:17.620397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-26e3d110-a00c-4644-8261-153f8abb2169 req-685c02db-42df-49e2-9402-6807519d911f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:17.620934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-26e3d110-a00c-4644-8261-153f8abb2169 req-685c02db-42df-49e2-9402-6807519d911f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:17.621910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-26e3d110-a00c-4644-8261-153f8abb2169 req-685c02db-42df-49e2-9402-6807519d911f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:17.634166 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-26e3d110-a00c-4644-8261-153f8abb2169 req-685c02db-42df-49e2-9402-6807519d911f service nova] Creating event network-vif-plugged:f6a889eb-501d-46c9-83ee-00331e584cb5 for instance 1f4148c7-9a87-465f-ad2b-d3b693009602 on n-h1-zed-1 Oct 28 10:48:17.639748 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-26e3d110-a00c-4644-8261-153f8abb2169 req-685c02db-42df-49e2-9402-6807519d911f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034035 Oct 28 10:48:17.640696 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3679/7353] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:17.883655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-30e4c8e4-429b-44a6-abc4-4cc80fc15981 req-c991e4cc-231b-4ef2-9321-134c3dc33fad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4148c7-9a87-465f-ad2b-d3b693009602", "name": "network-vif-deleted", "tag": "f6a889eb-501d-46c9-83ee-00331e584cb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:17.896337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30e4c8e4-429b-44a6-abc4-4cc80fc15981 req-c991e4cc-231b-4ef2-9321-134c3dc33fad service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:17.896938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30e4c8e4-429b-44a6-abc4-4cc80fc15981 req-c991e4cc-231b-4ef2-9321-134c3dc33fad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:17.897397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30e4c8e4-429b-44a6-abc4-4cc80fc15981 req-c991e4cc-231b-4ef2-9321-134c3dc33fad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:17.910062 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-30e4c8e4-429b-44a6-abc4-4cc80fc15981 req-c991e4cc-231b-4ef2-9321-134c3dc33fad service nova] Creating event network-vif-deleted:f6a889eb-501d-46c9-83ee-00331e584cb5 for instance 1f4148c7-9a87-465f-ad2b-d3b693009602 on n-h1-zed-1 Oct 28 10:48:17.917804 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-30e4c8e4-429b-44a6-abc4-4cc80fc15981 req-c991e4cc-231b-4ef2-9321-134c3dc33fad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036409 Oct 28 10:48:17.918861 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3675/7354] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:18.500639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:18.501370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: 1f4148c7-9a87-465f-ad2b-d3b693009602] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:18.507611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:18.508102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:18.508547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:18.509275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:18.509740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:18.510175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:18.524093 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] HTTP exception thrown: Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 could not be found. Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Request method failure captured: Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 HTTP/1.1 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7MMkx5g8eM0ISvSA2ULC9WRhtgtCLsIHq1zlZO3kNopbRzJ5Oh6pvl6EUc0t8BwHNLpxbJ2eYW8BOi8L7YXS8o5oT9ddOhhtj5LuDmt4LZBcoLVLTiSV-rocxZkk_HZ0U4bwwzxLKPYJ0dBh9TO-CqFWbAeIV18MAkeqv7iAAKZFAY Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 08bbd521938347f79f6d57235c246c5e Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bbd521938347f79f6d57235c246c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bbd521938347f79f6d57235c246c5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08bbd521938347f79f6d57235c246c5e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08bbd521938347f79f6d57235c246c5e"}]}] Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 08bbd521938347f79f6d57235c246c5e Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiskConfigTestJSON-1279422026-project Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: fcc4e920a6784b02bbddf74e01158db5 Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiskConfigTestJSON-1279422026-project Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 could not be found. Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '1f4148c7-9a87-465f-ad2b-d3b693009602'} Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 could not be found. Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 could not be found. Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:48:18.525786 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 could not be found. Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Returning 404 to user: Instance 1f4148c7-9a87-465f-ad2b-d3b693009602 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6565afbc-9826-424b-8b6c-f9cdccf4265d tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602" status: 404 len: 111 microversion: 2.1 time: 0.030867 Oct 28 10:48:18.531167 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3680/7355] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:18 2022] GET /compute/v2.1/servers/1f4148c7-9a87-465f-ad2b-d3b693009602 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:48:18.536889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ac364013-e3ba-498a-ab4d-537a1cdfe2f9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '.version_select at 0x7fca32b528b0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:18.557901 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ac364013-e3ba-498a-ab4d-537a1cdfe2f9 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509234896" status: 202 len: 0 microversion: 2.1 time: 0.025017 Oct 28 10:48:18.558476 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3676/7356] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:48:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509234896 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:48:19.149720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:19.150218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:19.157077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:19.157570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:19.158014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:19.158712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:19.159172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:19.159605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:19.172974 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] HTTP exception thrown: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Request method failure captured: Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 HTTP/1.1 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7MMkx5g8eM0ISvSA2ULC9WRhtgtCLsIHq1zlZO3kNopbRzJ5Oh6pvl6EUc0t8BwHNLpxbJ2eYW8BOi8L7YXS8o5oT9ddOhhtj5LuDmt4LZBcoLVLTiSV-rocxZkk_HZ0U4bwwzxLKPYJ0dBh9TO-CqFWbAeIV18MAkeqv7iAAKZFAY Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 08bbd521938347f79f6d57235c246c5e Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bbd521938347f79f6d57235c246c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bbd521938347f79f6d57235c246c5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08bbd521938347f79f6d57235c246c5e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08bbd521938347f79f6d57235c246c5e"}]}] Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 08bbd521938347f79f6d57235c246c5e Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerDiskConfigTestJSON-1279422026-project Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: fcc4e920a6784b02bbddf74e01158db5 Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerDiskConfigTestJSON-1279422026-project Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'db740500-94d2-4a04-9abc-aea3b0685965'} Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:48:19.174530 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Returning 404 to user: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b46d9491-8221-4798-9b1b-a36e49c81d37 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "DELETE /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 404 len: 111 microversion: 2.1 time: 0.030103 Oct 28 10:48:19.178671 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3681/7357] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:48:19 2022] DELETE /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:48:19.185219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:19.185971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] [instance: db740500-94d2-4a04-9abc-aea3b0685965] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:19.192699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:19.193232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:19.193689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:19.194398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:19.194868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:19.195563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:19.209260 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] HTTP exception thrown: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Request method failure captured: Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 HTTP/1.1 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7MMkx5g8eM0ISvSA2ULC9WRhtgtCLsIHq1zlZO3kNopbRzJ5Oh6pvl6EUc0t8BwHNLpxbJ2eYW8BOi8L7YXS8o5oT9ddOhhtj5LuDmt4LZBcoLVLTiSV-rocxZkk_HZ0U4bwwzxLKPYJ0dBh9TO-CqFWbAeIV18MAkeqv7iAAKZFAY Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 08bbd521938347f79f6d57235c246c5e Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bbd521938347f79f6d57235c246c5e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/08bbd521938347f79f6d57235c246c5e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_08bbd521938347f79f6d57235c246c5e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/08bbd521938347f79f6d57235c246c5e"}]}] Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 08bbd521938347f79f6d57235c246c5e Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1279422026 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerDiskConfigTestJSON-1279422026-project Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: fcc4e920a6784b02bbddf74e01158db5 Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerDiskConfigTestJSON-1279422026-project Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'db740500-94d2-4a04-9abc-aea3b0685965'} Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:48:19.210911 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] Returning 404 to user: Instance db740500-94d2-4a04-9abc-aea3b0685965 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-891bc826-d605-4e11-9c2a-d12a1e6b31b8 tempest-ServerDiskConfigTestJSON-1279422026 tempest-ServerDiskConfigTestJSON-1279422026-project] 10.222.0.16 "GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965" status: 404 len: 111 microversion: 2.1 time: 0.031586 Oct 28 10:48:19.215577 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3677/7358] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:19 2022] GET /compute/v2.1/servers/db740500-94d2-4a04-9abc-aea3b0685965 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:48:27.602252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-88f34427-185e-46ac-99ee-c7dae6da1d28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'create', calling method: .version_select at 0x7fca32e56040>, body: {"keypair": {"name": "tempest-keypair-1449957640", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNVgZ4q7itPWV67kTP9y9AzfkUwh9eW6iDsY7NidJS/pTaaxTVJdQkBhMJjUedR+EfJn6zuKiQXVaRA2em53AH5W66uBUIsGIWl0lQVnjbJiFdwNlciHCt94G2HBeV7Tg=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:27.607851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:27.620116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-88f34427-185e-46ac-99ee-c7dae6da1d28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for project 09f3883c8434405bb79bf4b18afab549. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:48:27.625969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-88f34427-185e-46ac-99ee-c7dae6da1d28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for user a84e8b5b3cc84489aa387be5a69b8670 and project 09f3883c8434405bb79bf4b18afab549. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:48:27.660302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-88f34427-185e-46ac-99ee-c7dae6da1d28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.173964 Oct 28 10:48:27.660859 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3682/7359] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:48:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:29.314124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1417154984", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "afa20cbe-6157-4e68-83e7-f55666418e90"}], "security_groups": [{"name": "tempest-securitygroup--1697048266"}], "key_name": "tempest-keypair-1449957640", "user_data": "}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:29.323178 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:29.323849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:29.424485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] validate_networks() for [('afa20cbe-6157-4e68-83e7-f55666418e90', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:48:29.806550 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:48:29.807071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:48:29.807663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:48:29.808217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:48:29.808702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:48:29.817771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:29.818343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:29.818901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:29.819716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:29.820520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:29.821090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:29.838279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:48:29.844349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for user a84e8b5b3cc84489aa387be5a69b8670 and project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:48:29.857447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:48:29.859802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:48:29.911252 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-928fd144-8f6c-415a-8809-386ba7faf557 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.602233 Oct 28 10:48:29.912303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3678/7360] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:48:29 2022] POST /compute/v2.1/servers => generated 409 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:48:29.921956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:29.926199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a41fae7a-d0b7-45f2-90a8-eabe8c886685 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:29.927069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a41fae7a-d0b7-45f2-90a8-eabe8c886685 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:29.997343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a41fae7a-d0b7-45f2-90a8-eabe8c886685 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:30.014660 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a41fae7a-d0b7-45f2-90a8-eabe8c886685 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1239 microversion: 2.1 time: 0.094347 Oct 28 10:48:30.015444 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3683/7361] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:29 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:31.045770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:31.046410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:31.053939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:31.054440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:31.055079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:31.055798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:31.056320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:31.056764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:31.169682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:31.185036 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d4f0fb9-d3b5-4315-b9cc-89acc91e9af7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1299 microversion: 2.1 time: 0.144998 Oct 28 10:48:31.187423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3679/7362] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:31 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:32.210560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:32.211331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:32.218668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:32.219157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:32.219611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:32.220322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:32.220984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:32.221562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:32.369604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:32.378744 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48fc4187-8edf-4a44-b8bf-a274c594dc62 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1365 microversion: 2.1 time: 0.172385 Oct 28 10:48:32.379642 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3684/7363] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:32 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:32.812093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-bade75e3-f461-4617-a8e2-ba85823f7def req-8c779056-70b4-4a7d-a5f0-a0b2f4caf298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bffc6f9-f624-49ee-8c40-1803e2d0ac68", "tag": "025e22c4-b431-4ed0-9e75-7363a31282c6"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:32.822053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bade75e3-f461-4617-a8e2-ba85823f7def req-8c779056-70b4-4a7d-a5f0-a0b2f4caf298 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:32.822629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bade75e3-f461-4617-a8e2-ba85823f7def req-8c779056-70b4-4a7d-a5f0-a0b2f4caf298 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:32.823142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-bade75e3-f461-4617-a8e2-ba85823f7def req-8c779056-70b4-4a7d-a5f0-a0b2f4caf298 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:32.834319 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-bade75e3-f461-4617-a8e2-ba85823f7def req-8c779056-70b4-4a7d-a5f0-a0b2f4caf298 service nova] Creating event network-changed:025e22c4-b431-4ed0-9e75-7363a31282c6 for instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 on n-h2-zed-1 Oct 28 10:48:32.840012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-bade75e3-f461-4617-a8e2-ba85823f7def req-8c779056-70b4-4a7d-a5f0-a0b2f4caf298 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091981 Oct 28 10:48:32.840654 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3680/7364] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:48:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:33.402017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:33.402628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:33.409581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:33.410066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:33.410504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:33.411192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:33.411644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:33.412068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:33.541885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:33.549580 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1fe1f749-90e9-4d82-9389-5001e80c5ddf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1365 microversion: 2.1 time: 0.151464 Oct 28 10:48:33.550156 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3685/7365] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:33 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:34.574983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:34.575701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:34.583816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:34.584700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:34.585213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:34.585935 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:34.586407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:34.586853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:34.725112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:34.732822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-02472284-c538-4932-87f9-12d0f0d487b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1365 microversion: 2.1 time: 0.163984 Oct 28 10:48:34.733425 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3681/7366] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:34 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:35.755463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:35.756078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:35.762957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:35.763451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:35.763895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:35.764595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:35.765097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:35.765545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:35.895605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:35.903876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1b00e2af-3856-4ad4-ba14-17dfac8febec tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1365 microversion: 2.1 time: 0.152368 Oct 28 10:48:35.904450 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3686/7367] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:35 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:36.927015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:36.927633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:36.935053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:36.935551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:36.935993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:36.936685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:36.937175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:36.937609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:37.069172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:37.077145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-841b22f5-4bf5-4a5c-a48a-59d084fc2686 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1365 microversion: 2.1 time: 0.153947 Oct 28 10:48:37.077708 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3682/7368] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:36 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:38.099700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:38.100327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:38.107957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:38.108454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:38.108929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:38.109667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:38.110133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:38.110567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:38.239136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:38.247074 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee16e532-c64e-44c1-b675-c7005c6518bd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1365 microversion: 2.1 time: 0.151256 Oct 28 10:48:38.247594 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3687/7369] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:38 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:38.534763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ee67e766-6ad4-4507-88e9-499b8d8dcf93 req-a635b077-5ffb-4f8e-a860-814721458604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bffc6f9-f624-49ee-8c40-1803e2d0ac68", "name": "network-vif-plugged", "status": "completed", "tag": "025e22c4-b431-4ed0-9e75-7363a31282c6"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:38.545185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ee67e766-6ad4-4507-88e9-499b8d8dcf93 req-a635b077-5ffb-4f8e-a860-814721458604 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:38.545692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ee67e766-6ad4-4507-88e9-499b8d8dcf93 req-a635b077-5ffb-4f8e-a860-814721458604 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:38.546137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ee67e766-6ad4-4507-88e9-499b8d8dcf93 req-a635b077-5ffb-4f8e-a860-814721458604 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:38.557332 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ee67e766-6ad4-4507-88e9-499b8d8dcf93 req-a635b077-5ffb-4f8e-a860-814721458604 service nova] Creating event network-vif-plugged:025e22c4-b431-4ed0-9e75-7363a31282c6 for instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 on n-h2-zed-1 Oct 28 10:48:38.562841 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ee67e766-6ad4-4507-88e9-499b8d8dcf93 req-a635b077-5ffb-4f8e-a860-814721458604 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031839 Oct 28 10:48:38.563601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3683/7370] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:39.270150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:39.270764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:39.277657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:39.278137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:39.278572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:39.279260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:39.279713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:39.280140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:39.408328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:39.415953 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f4c461aa-200c-40ed-b039-918d7ded3905 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1365 microversion: 2.1 time: 0.149732 Oct 28 10:48:39.416521 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3688/7371] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:39 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:40.438279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:40.439114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:40.443544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:40.444250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:40.451538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:40.452032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:40.452477 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:40.453199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:40.453664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:40.454100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:40.581500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:48:40.589343 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ac921845-3eaf-44ce-9561-153d0c709c15 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1553 microversion: 2.1 time: 0.152846 Oct 28 10:48:40.590498 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3684/7372] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:48:40 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:48:40.612336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:48:40.612818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:48:40.614703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:48:40.620983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:40.621471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:40.621916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:40.622711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:40.623173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:40.623920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:40.706782 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f1dad2fb-407d-4d20-a116-3a1869dcb87c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098345 Oct 28 10:48:40.707674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3689/7373] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:48:40 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:48:41.719591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-306df971-2b9d-4bcd-af09-a7225dfd2cd5 req-60e7a0b6-a54c-43ab-a659-ccd60efdd913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bffc6f9-f624-49ee-8c40-1803e2d0ac68", "tag": "025e22c4-b431-4ed0-9e75-7363a31282c6"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:48:41.729489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-306df971-2b9d-4bcd-af09-a7225dfd2cd5 req-60e7a0b6-a54c-43ab-a659-ccd60efdd913 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:48:41.729921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-306df971-2b9d-4bcd-af09-a7225dfd2cd5 req-60e7a0b6-a54c-43ab-a659-ccd60efdd913 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:48:41.730361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-306df971-2b9d-4bcd-af09-a7225dfd2cd5 req-60e7a0b6-a54c-43ab-a659-ccd60efdd913 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:48:41.741426 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-306df971-2b9d-4bcd-af09-a7225dfd2cd5 req-60e7a0b6-a54c-43ab-a659-ccd60efdd913 service nova] Creating event network-changed:025e22c4-b431-4ed0-9e75-7363a31282c6 for instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 on n-h2-zed-1 Oct 28 10:48:41.747096 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-306df971-2b9d-4bcd-af09-a7225dfd2cd5 req-60e7a0b6-a54c-43ab-a659-ccd60efdd913 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081868 Oct 28 10:48:41.747878 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3685/7374] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:49:46.069657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:46.070744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=34 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:46.077220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:46.077832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:46.085058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.085549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.085990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.086682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.087142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.087572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.227554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:46.236131 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30da3304-3ccd-4306-b8db-fc2da58cf9d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1672 microversion: 2.1 time: 0.168452 Oct 28 10:49:46.236732 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3690/7375] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:46 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:46.257966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:46.258730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=32 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:49:46.262794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:46.263515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:46.271528 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.272030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.272485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.273232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.273753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.274151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.405207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:46.413578 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8278f25e-df9f-4045-9008-bbaaa7819ebe tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1672 microversion: 2.1 time: 0.158592 Oct 28 10:49:46.414161 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3686/7376] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:46 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:46.435599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:46.436221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:46.444481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.445273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.445723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.446422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.446885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.447317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.573509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:46.581818 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63260bdb-7874-41bb-8eba-5277970a04e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1672 microversion: 2.1 time: 0.150138 Oct 28 10:49:46.582408 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3691/7377] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:46 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:46.604455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:49:46.606834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:46.612856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.613390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.613846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.614549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.615024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.615468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.644036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:46.649625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Old instance type m1.heat2, new instance type m1.heat {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:49:46.656329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:49:46.656769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:49:46.657329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:49:46.657761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:49:46.658190 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:49:46.722692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4250226-e103-46ba-b525-36a6e6b977d4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68/action" status: 202 len: 0 microversion: 2.1 time: 0.122070 Oct 28 10:49:46.723319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3687/7378] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:49:46 2022] POST /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:49:46.731615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:46.732259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:46.738409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.738986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.739514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.740234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:46.740705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:46.741167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:46.879651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:46.887581 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ed05a247-b544-411b-bebd-a86001200b19 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1681 microversion: 2.1 time: 0.159927 Oct 28 10:49:46.888173 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3692/7379] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:46 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:49:47.912920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:47.913540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:47.923011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:47.923507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:47.923959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:47.924658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:47.925148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:47.925584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:48.058690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:48.066564 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c5ca146-01ca-4fc8-943a-dbcd02c69619 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1681 microversion: 2.1 time: 0.159145 Oct 28 10:49:48.067145 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3688/7380] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:47 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:49.090699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:49.091270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:49.098657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:49.099154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:49.099602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:49.100312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:49.100778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:49.101254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:49.231959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:49.240327 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9c37efb4-7696-4e99-8e5b-9a527b11de04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.153682 Oct 28 10:49:49.240940 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3693/7381] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:49 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:50.263610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:50.264241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:50.271168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:50.271673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:50.272128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:50.272837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:50.273339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:50.273791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:50.405324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:50.413106 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d074baa5-5ec3-404f-857c-9801ea6f4516 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.153377 Oct 28 10:49:50.413679 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3689/7382] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:50 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:51.437207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:51.437822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:51.444647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:51.445441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:51.445885 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:51.446581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:51.447040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:51.447470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:51.576114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:51.584732 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-474a25a2-7924-44a6-bf67-3d344ba7c6c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.151446 Oct 28 10:49:51.585477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3694/7383] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:51 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:52.608295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:52.608954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:52.615586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:52.616085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:52.616545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:52.617278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:52.617752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:52.618195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:52.745487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:52.753293 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1001fcdb-8288-4411-a9dc-acf5fcb8c811 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.149179 Oct 28 10:49:52.753874 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3690/7384] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:52 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:53.777164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:53.777789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:53.784096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:53.784586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:53.785063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:53.785763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:53.786222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:53.786660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:53.919767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:53.927582 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-710a299a-081e-4b7b-ad43-5b9fe2ae937a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.154475 Oct 28 10:49:53.928166 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3695/7385] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:53 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:54.950967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:54.951589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:54.958933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:54.959426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:54.959875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:54.960577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:54.961069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:54.961507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:55.095939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:55.103841 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5483236d-ce37-4d7f-b453-a25ede0d5594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.156713 Oct 28 10:49:55.104573 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3691/7386] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:54 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:56.126751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:56.127405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:56.134441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:56.134940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:56.135386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:56.136093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:56.136554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:56.137160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:56.264884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:56.272653 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-358a8514-29db-495e-863c-0bb154b063ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.149837 Oct 28 10:49:56.273276 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3696/7387] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:56 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:57.295496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:57.296135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:57.303868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:57.304371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:57.304828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:57.305562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:57.306037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:57.306484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:57.434347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:57.442981 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc6cceb0-8bbf-4197-9195-c82621a65172 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.151383 Oct 28 10:49:57.443566 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3692/7388] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:57 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:58.466686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:58.467323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:58.475419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:58.475916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:58.476365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:58.477183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:58.477652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:58.478090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:58.611170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:58.619033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4cb2e4a-bf17-4668-8756-4cf3e8e77370 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.156332 Oct 28 10:49:58.619619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3697/7389] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:58 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:49:59.643573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:49:59.644133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:49:59.651050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:59.651548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:59.652000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:59.652707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:49:59.653206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:49:59.653649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:49:59.781405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:49:59.789186 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-56b25533-11b7-4f0b-91b0-bd683aae71bf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1686 microversion: 2.1 time: 0.150046 Oct 28 10:49:59.789767 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3693/7390] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:49:59 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1686 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:00.814505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:00.815203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:00.823399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:00.823887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:00.824329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:00.825058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:00.825518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:00.825948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:00.970241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:00.979889 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2bfe3254-2a9b-4508-8191-a55d12e604e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1685 microversion: 2.1 time: 0.170729 Oct 28 10:50:00.980476 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3698/7391] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:00 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:01.924160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-2dba2e3a-6e09-4604-87e7-a4422a7031a7 req-533fa373-56c8-4598-b43a-0a1078f73255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bffc6f9-f624-49ee-8c40-1803e2d0ac68", "name": "network-vif-unplugged", "status": "completed", "tag": "025e22c4-b431-4ed0-9e75-7363a31282c6"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:01.934858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2dba2e3a-6e09-4604-87e7-a4422a7031a7 req-533fa373-56c8-4598-b43a-0a1078f73255 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:01.935356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2dba2e3a-6e09-4604-87e7-a4422a7031a7 req-533fa373-56c8-4598-b43a-0a1078f73255 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:01.935803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2dba2e3a-6e09-4604-87e7-a4422a7031a7 req-533fa373-56c8-4598-b43a-0a1078f73255 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:01.948803 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-2dba2e3a-6e09-4604-87e7-a4422a7031a7 req-533fa373-56c8-4598-b43a-0a1078f73255 service nova] Creating event network-vif-unplugged:025e22c4-b431-4ed0-9e75-7363a31282c6 for instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 on n-h1-zed-1 Oct 28 10:50:01.955853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-2dba2e3a-6e09-4604-87e7-a4422a7031a7 req-533fa373-56c8-4598-b43a-0a1078f73255 service nova] Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:50:01.967888 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-2dba2e3a-6e09-4604-87e7-a4422a7031a7 req-533fa373-56c8-4598-b43a-0a1078f73255 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047467 Oct 28 10:50:01.968504 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3694/7392] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:50:02.004067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:02.004820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:02.011983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:02.012483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:02.012952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:02.013662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:02.014130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:02.014595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:02.147082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:02.154988 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1e79700-8868-495f-bb15-e315a14325fc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1685 microversion: 2.1 time: 0.155259 Oct 28 10:50:02.155570 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3699/7393] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:01 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:03.178590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:03.179425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:03.186586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:03.187085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:03.187542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:03.188249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:03.188720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:03.189219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:03.321686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:03.329924 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b9360f09-259b-41b2-a860-03dc8c037a06 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1683 microversion: 2.1 time: 0.155784 Oct 28 10:50:03.330515 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3695/7394] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:03 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:04.003279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4015e2d3-0e85-4e00-8cfc-849f4a59dbd8 req-8b636541-99da-4b1f-80ef-41ebd1e44588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bffc6f9-f624-49ee-8c40-1803e2d0ac68", "tag": "025e22c4-b431-4ed0-9e75-7363a31282c6"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:04.013536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4015e2d3-0e85-4e00-8cfc-849f4a59dbd8 req-8b636541-99da-4b1f-80ef-41ebd1e44588 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:04.014017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4015e2d3-0e85-4e00-8cfc-849f4a59dbd8 req-8b636541-99da-4b1f-80ef-41ebd1e44588 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:04.014448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4015e2d3-0e85-4e00-8cfc-849f4a59dbd8 req-8b636541-99da-4b1f-80ef-41ebd1e44588 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:04.025831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4015e2d3-0e85-4e00-8cfc-849f4a59dbd8 req-8b636541-99da-4b1f-80ef-41ebd1e44588 service nova] Creating event network-changed:025e22c4-b431-4ed0-9e75-7363a31282c6 for instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 on n-h1-zed-1 Oct 28 10:50:04.031187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-4015e2d3-0e85-4e00-8cfc-849f4a59dbd8 req-8b636541-99da-4b1f-80ef-41ebd1e44588 service nova] Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:50:04.042124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4015e2d3-0e85-4e00-8cfc-849f4a59dbd8 req-8b636541-99da-4b1f-80ef-41ebd1e44588 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043282 Oct 28 10:50:04.042711 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3700/7395] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:50:04.354104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:04.354717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:04.361295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:04.361801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:04.362254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:04.363351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:04.363581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:04.364051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:04.695593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:04.705894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-abf87256-c671-44e1-82d1-24a7bbc18693 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1683 microversion: 2.1 time: 0.356382 Oct 28 10:50:04.711576 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3696/7396] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:04 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1683 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:05.732101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:05.732833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:05.739584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:05.740079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:05.740519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:05.741250 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:05.741709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:05.742142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:05.876471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:05.884391 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d90e818-9197-4264-8ee2-1a06c2b86439 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1680 microversion: 2.1 time: 0.157451 Oct 28 10:50:05.884984 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3701/7397] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:05 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:05.906787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:05.907869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:05.915101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:05.915601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:05.916053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:05.916768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:05.917270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:05.917714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:05.975283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6e615f49-82be-4d36-97ea-fd7b5a56c64e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68/action" status: 204 len: 0 microversion: 2.1 time: 0.072287 Oct 28 10:50:05.975974 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3697/7398] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:50:05 2022] POST /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 28 10:50:05.984307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:05.984973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:05.991589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:05.992083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:05.992567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:05.993550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:05.994131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:05.994610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:06.130179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:06.138891 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8720a6d7-82ea-481e-bf26-1a7812bd9af6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1680 microversion: 2.1 time: 0.158545 Oct 28 10:50:06.139804 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3702/7399] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:05 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:07.164586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:07.165308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:07.173690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:07.174202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:07.174655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:07.175368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:07.175837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:07.176282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:07.310553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:07.318644 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-19d1d556-a0f4-4344-b8d6-1fcb305f69fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1680 microversion: 2.1 time: 0.158811 Oct 28 10:50:07.319214 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3698/7400] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:07 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:08.317673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-eacad8ce-2855-4a72-a319-64014ecf061f req-c60c9f7b-2c2a-4cec-b939-c4307926feac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bffc6f9-f624-49ee-8c40-1803e2d0ac68", "name": "network-vif-plugged", "status": "completed", "tag": "025e22c4-b431-4ed0-9e75-7363a31282c6"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:08.327194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-eacad8ce-2855-4a72-a319-64014ecf061f req-c60c9f7b-2c2a-4cec-b939-c4307926feac service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.327669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-eacad8ce-2855-4a72-a319-64014ecf061f req-c60c9f7b-2c2a-4cec-b939-c4307926feac service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.328099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-eacad8ce-2855-4a72-a319-64014ecf061f req-c60c9f7b-2c2a-4cec-b939-c4307926feac service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.339689 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-eacad8ce-2855-4a72-a319-64014ecf061f req-c60c9f7b-2c2a-4cec-b939-c4307926feac service nova] Creating event network-vif-plugged:025e22c4-b431-4ed0-9e75-7363a31282c6 for instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 on n-h1-zed-1 Oct 28 10:50:08.342202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:08.342842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:08.344821 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-eacad8ce-2855-4a72-a319-64014ecf061f req-c60c9f7b-2c2a-4cec-b939-c4307926feac service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082603 Oct 28 10:50:08.345451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3703/7401] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:50:08.349939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.350444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.350904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.351618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.352094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.352535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.482586 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:08.490929 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-76ab5d79-41a1-4001-9a35-6ffce75b42f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1672 microversion: 2.1 time: 0.152610 Oct 28 10:50:08.491531 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3699/7402] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:08 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:50:08.514728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:08.515424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:08.521683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.522169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.522606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.523293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.523751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.524181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.655168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:08.663095 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d48e3fd3-32f8-4c56-a51b-bf78fd5154c3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1672 microversion: 2.1 time: 0.152534 Oct 28 10:50:08.663667 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3704/7403] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:08 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:08.685392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:08.686028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:08.692634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.693173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.693632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.694341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.694814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.695514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.710377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:08.829219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:08.837113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3d6782ae-87dd-4a2b-955a-0ce63391a333 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1672 microversion: 2.1 time: 0.155440 Oct 28 10:50:08.837917 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3700/7404] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:08 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:08.859940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:08.861192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:08.867595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.868089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.868531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.869257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.869720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.870156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.894684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:50:08.944201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:08.975802 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-677f0e13-b29e-48f1-b673-fe50bd90afa7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 204 len: 0 microversion: 2.1 time: 0.119374 Oct 28 10:50:08.976462 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3705/7405] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:50:08 2022] DELETE /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:50:08.984591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:08.985880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:08.991771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.992249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.992692 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:08.993443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:08.993926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:08.994394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:09.126036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:09.133721 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e2ec0b43-5c53-4375-805a-d2a31a72bf41 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1678 microversion: 2.1 time: 0.152958 Oct 28 10:50:09.134321 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3701/7406] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:08 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:10.158199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:10.158909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:10.165765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:10.166264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:10.166714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:10.167416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:10.167914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:10.168352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:10.302422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:10.310171 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9473adc6-1c0c-45af-a89e-ad787a421013 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1678 microversion: 2.1 time: 0.156332 Oct 28 10:50:10.310762 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3706/7407] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:10 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:11.335105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:11.335858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:11.343733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:11.344246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:11.344814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:11.345588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:11.346057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:11.346526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:11.613991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:11.624309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-667436d9-e252-4131-bd1e-43c2175824ac req-c4d4adb6-e962-4c4d-83dd-66f814886b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bffc6f9-f624-49ee-8c40-1803e2d0ac68", "name": "network-vif-deleted", "tag": "025e22c4-b431-4ed0-9e75-7363a31282c6"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:11.632935 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01f09694-2188-4504-b8a0-2a3faf13804c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 200 len: 1610 microversion: 2.1 time: 0.301978 Oct 28 10:50:11.636947 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3702/7408] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:11 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 1610 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:11.637099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-667436d9-e252-4131-bd1e-43c2175824ac req-c4d4adb6-e962-4c4d-83dd-66f814886b8c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:11.637099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-667436d9-e252-4131-bd1e-43c2175824ac req-c4d4adb6-e962-4c4d-83dd-66f814886b8c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:11.637099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-667436d9-e252-4131-bd1e-43c2175824ac req-c4d4adb6-e962-4c4d-83dd-66f814886b8c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:11.656858 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-667436d9-e252-4131-bd1e-43c2175824ac req-c4d4adb6-e962-4c4d-83dd-66f814886b8c service nova] Creating event network-vif-deleted:025e22c4-b431-4ed0-9e75-7363a31282c6 for instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 on n-h1-zed-1 Oct 28 10:50:11.662404 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-667436d9-e252-4131-bd1e-43c2175824ac req-c4d4adb6-e962-4c4d-83dd-66f814886b8c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041974 Oct 28 10:50:11.663030 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3707/7409] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:50:12.656435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:12.657093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:12.664003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:12.664531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:12.665011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:12.665719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:12.666185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:12.666627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:12.680116 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 HTTP/1.1 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '6bffc6f9-f624-49ee-8c40-1803e2d0ac68'} Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:50:12.681785 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9262d85a-a858-465f-9208-e2588ccdbfd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 404 len: 111 microversion: 2.1 time: 0.030857 Oct 28 10:50:12.686988 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3703/7410] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:12 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:50:12.696247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:12.696963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:12.704581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:12.705096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:12.705533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:12.706309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:12.706788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:12.707213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:12.721193 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 HTTP/1.1 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '6bffc6f9-f624-49ee-8c40-1803e2d0ac68'} Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:50:12.722968 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f94a67f9-8ec4-42e1-9079-b19074fa2251 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 404 len: 111 microversion: 2.1 time: 0.034502 Oct 28 10:50:12.729949 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3708/7411] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:12 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:50:12.776193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-30836516", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa20cbe-6157-4e68-83e7-f55666418e90"}], "security_groups": [{"name": "tempest-securitygroup--1697048266"}], "key_name": "tempest-keypair-1449957640", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:12.881812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] validate_networks() for [('afa20cbe-6157-4e68-83e7-f55666418e90', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:50:13.319536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:50:13.320247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:50:13.320744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:50:13.321224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:50:13.321657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:50:13.333044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:13.333548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:13.334007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:13.334758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:13.335234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:13.335681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:13.355381 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:50:13.361442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for user a84e8b5b3cc84489aa387be5a69b8670 and project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:50:13.373900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:50:13.376244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:50:13.422486 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb3009a3-e923-4b0d-b102-cb339771ee3d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.650105 Oct 28 10:50:13.423126 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3704/7412] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:50:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:50:13.436259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7dc532c-47f0-4b86-8084-34a2cd33fd37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:13.437163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7dc532c-47f0-4b86-8084-34a2cd33fd37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:13.492991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7dc532c-47f0-4b86-8084-34a2cd33fd37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:13.502612 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7dc532c-47f0-4b86-8084-34a2cd33fd37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1237 microversion: 2.1 time: 0.071439 Oct 28 10:50:13.503190 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3709/7413] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:13 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:14.526847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:14.527660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:14.534742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:14.535325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:14.535856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:14.536675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:14.537263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:14.537800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:14.612440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:14.620545 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39dbac35-7639-4485-93c5-26423c048fd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1307 microversion: 2.1 time: 0.098458 Oct 28 10:50:14.621177 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3705/7414] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:14 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1307 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:15.644240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:15.644617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:15.654342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:15.655054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:15.655506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:15.656216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:15.657220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:15.657665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:15.795236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:15.803727 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-09f899f9-118b-4d8a-b4a8-266e720c71e0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.163914 Oct 28 10:50:15.804391 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3710/7415] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:15 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:15.965720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-ec901b4e-2f12-4d2c-bd9f-9fc71fc8faa9 req-f5431327-2fc7-494e-995b-b69f7542924e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a19385-891b-40e6-bb4a-d50d66420866", "tag": "874bfcee-8fba-4c0b-b108-b5ba778641ef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:15.979056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec901b4e-2f12-4d2c-bd9f-9fc71fc8faa9 req-f5431327-2fc7-494e-995b-b69f7542924e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:15.979555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec901b4e-2f12-4d2c-bd9f-9fc71fc8faa9 req-f5431327-2fc7-494e-995b-b69f7542924e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:15.980000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-ec901b4e-2f12-4d2c-bd9f-9fc71fc8faa9 req-f5431327-2fc7-494e-995b-b69f7542924e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:15.991166 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-ec901b4e-2f12-4d2c-bd9f-9fc71fc8faa9 req-f5431327-2fc7-494e-995b-b69f7542924e service nova] Creating event network-changed:874bfcee-8fba-4c0b-b108-b5ba778641ef for instance 59a19385-891b-40e6-bb4a-d50d66420866 on n-h2-zed-1 Oct 28 10:50:15.997686 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-ec901b4e-2f12-4d2c-bd9f-9fc71fc8faa9 req-f5431327-2fc7-494e-995b-b69f7542924e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035315 Oct 28 10:50:15.998304 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3706/7416] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:50:16.827385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:16.828009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:16.833248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:16.838738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:16.839159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:16.839609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:16.840320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:16.840786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:16.841248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:16.970901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:16.978769 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee12abb2-ff10-44f6-aba6-5a369aa30005 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.155281 Oct 28 10:50:16.979362 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3711/7417] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:16 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:18.003653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:18.004378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:18.007268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:18.013407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:18.013912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:18.014556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:18.015280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:18.015755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:18.016209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:18.147727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:18.155638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3cb8c118-7c02-4f6c-8852-ab6343cdecb2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.156578 Oct 28 10:50:18.156222 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3707/7418] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:17 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:19.179448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:19.180072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:19.189226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:19.189717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:19.190160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:19.190858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:19.191318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:19.191751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:19.325030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:19.333248 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-edf38558-3bd7-40b4-b7ba-075eb22a2eae tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.157680 Oct 28 10:50:19.333831 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3712/7419] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:19 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:20.355750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:20.356297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:20.365808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:20.366312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:20.366769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:20.367481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:20.368004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:20.368449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:20.502512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:20.510389 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0ca455e-f6d1-4547-bebe-b5cff18e97a6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.158565 Oct 28 10:50:20.511006 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3708/7420] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:20 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:21.534049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:21.534661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:21.541493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:21.541996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:21.542442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:21.543152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:21.543621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:21.544057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:21.679328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:21.687089 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7871446f-621b-4f05-bdb7-619c23f1deac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.157140 Oct 28 10:50:21.687671 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3713/7421] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:21 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:22.710468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:22.711095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:22.717360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:22.717863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:22.718320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:22.719020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:22.719492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:22.719930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:22.856258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:22.864499 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-837d2a04-cf8c-436b-868a-ee64d5faeead tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.158055 Oct 28 10:50:22.865100 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3709/7422] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:22 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:23.055963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0782ac58-f9c7-4e26-b646-834a87b3f2b6 req-30e76ca2-e2f9-4b7f-9b27-d5c4dbab4d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a19385-891b-40e6-bb4a-d50d66420866", "name": "network-vif-plugged", "status": "completed", "tag": "874bfcee-8fba-4c0b-b108-b5ba778641ef"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:23.069193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0782ac58-f9c7-4e26-b646-834a87b3f2b6 req-30e76ca2-e2f9-4b7f-9b27-d5c4dbab4d54 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:23.069682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0782ac58-f9c7-4e26-b646-834a87b3f2b6 req-30e76ca2-e2f9-4b7f-9b27-d5c4dbab4d54 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:23.070380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0782ac58-f9c7-4e26-b646-834a87b3f2b6 req-30e76ca2-e2f9-4b7f-9b27-d5c4dbab4d54 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:23.081885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0782ac58-f9c7-4e26-b646-834a87b3f2b6 req-30e76ca2-e2f9-4b7f-9b27-d5c4dbab4d54 service nova] Creating event network-vif-plugged:874bfcee-8fba-4c0b-b108-b5ba778641ef for instance 59a19385-891b-40e6-bb4a-d50d66420866 on n-h2-zed-1 Oct 28 10:50:23.087221 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0782ac58-f9c7-4e26-b646-834a87b3f2b6 req-30e76ca2-e2f9-4b7f-9b27-d5c4dbab4d54 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035161 Oct 28 10:50:23.087835 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3714/7423] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:50:23.889126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:23.889758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:23.892398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:23.893129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:23.900141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:23.900653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:23.901137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:23.901861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:23.902336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:23.902780 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:24.035668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:24.043576 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cbbdd3b1-3132-4f00-b101-5813d4225fc9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1363 microversion: 2.1 time: 0.158496 Oct 28 10:50:24.056924 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3710/7424] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:23 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:25.064982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:50:25.070482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:25.071196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:25.077627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:25.078120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:25.078566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:25.079776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:25.080240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:25.080685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:25.209331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:50:25.217049 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-99e51069-83dd-4a7d-8aee-8fa92f2f6e38 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1551 microversion: 2.1 time: 0.153029 Oct 28 10:50:25.217625 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3715/7425] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:50:25 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:50:25.240569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:50:25.241114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:50:25.248055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:25.248559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:25.249056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:25.249767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:25.250233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:25.250678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:25.326784 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fa3967f0-02d6-4594-b603-14dac5a6fe7a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090129 Oct 28 10:50:25.327404 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3711/7426] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:50:25 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:50:26.241883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-58a511b2-d3c5-4e78-a54b-60e69fef4ae6 req-2360a884-fa31-44cf-89b9-e3fdb1f70d39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a19385-891b-40e6-bb4a-d50d66420866", "tag": "874bfcee-8fba-4c0b-b108-b5ba778641ef"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:50:26.252662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-58a511b2-d3c5-4e78-a54b-60e69fef4ae6 req-2360a884-fa31-44cf-89b9-e3fdb1f70d39 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:50:26.253175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-58a511b2-d3c5-4e78-a54b-60e69fef4ae6 req-2360a884-fa31-44cf-89b9-e3fdb1f70d39 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:50:26.253619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-58a511b2-d3c5-4e78-a54b-60e69fef4ae6 req-2360a884-fa31-44cf-89b9-e3fdb1f70d39 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:50:26.264792 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-58a511b2-d3c5-4e78-a54b-60e69fef4ae6 req-2360a884-fa31-44cf-89b9-e3fdb1f70d39 service nova] Creating event network-changed:874bfcee-8fba-4c0b-b108-b5ba778641ef for instance 59a19385-891b-40e6-bb4a-d50d66420866 on n-h2-zed-1 Oct 28 10:50:26.270468 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-58a511b2-d3c5-4e78-a54b-60e69fef4ae6 req-2360a884-fa31-44cf-89b9-e3fdb1f70d39 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032309 Oct 28 10:50:26.271089 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3716/7427] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:51:38.273309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=9 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:38.274081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=55 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:38.275632 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:51:38.275791 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 10:51:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action (ip 10.222.0.16) !!! Oct 28 10:51:38.281757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-70fbc9c9-0b76-4d91-8b65-71d6f0f8fc17 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:51:38.289815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fbc9c9-0b76-4d91-8b65-71d6f0f8fc17 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:38.290310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fbc9c9-0b76-4d91-8b65-71d6f0f8fc17 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:38.290753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-70fbc9c9-0b76-4d91-8b65-71d6f0f8fc17 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:38.313686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-70fbc9c9-0b76-4d91-8b65-71d6f0f8fc17 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Going to try to stop instance {{(pid=128748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 10:51:38.354866 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-70fbc9c9-0b76-4d91-8b65-71d6f0f8fc17 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action" status: 202 len: 0 microversion: 2.1 time: 0.083735 Oct 28 10:51:38.355391 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3712/7428] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:51:38 2022] POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:51:38.362673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=11 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:38.363985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=44 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:51:38.365360 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:51:38.365509 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:51:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 (ip 10.222.0.16) !!! Oct 28 10:51:38.367224 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:51:38.367342 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:51:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 (ip 10.222.0.16) !!! Oct 28 10:51:38.373646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:38.374451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:38.383988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:38.384484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:38.384951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:38.385657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:38.386119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:38.386551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:38.527529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:38.535847 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6096ed4c-90d3-4010-9571-0c2944856a47 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.175482 Oct 28 10:51:38.536421 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3717/7429] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:38 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:39.561373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:39.562097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:39.568929 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:39.569441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:39.570158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:39.570894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:39.571364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:39.571807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:39.706524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:39.714454 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d3b20cf4-ad6c-457b-93bd-3e342b7082d6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.158471 Oct 28 10:51:39.715051 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3713/7430] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:39 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:40.739627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:40.740251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:40.747187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:40.747677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:40.748122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:40.748818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:40.749306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:40.749740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:40.884438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:40.892154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6a2d5ade-625a-415d-8789-bd7edca54c7d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.156485 Oct 28 10:51:40.892727 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3718/7431] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:40 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:41.915073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:41.915710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:41.922587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:41.923075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:41.923529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:41.924237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:41.924712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:41.925187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:42.052423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:42.060239 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7fc34a07-b8f9-4b37-af3e-1b8d251f6a78 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.149104 Oct 28 10:51:42.060824 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3714/7432] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:41 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:43.084091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:43.084779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:43.091661 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:43.092157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:43.092607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:43.093337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:43.093804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:43.094239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:43.231450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:43.239427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e3e5c22d-f56f-4dde-a629-4bec40b3911b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.159236 Oct 28 10:51:43.240021 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3719/7433] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:43 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:44.262669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:44.263240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:44.270748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:44.271249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:44.271704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:44.272444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:44.272934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:44.273382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:44.400301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:44.408026 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-25f0b66e-b048-465d-a144-cd86fafcde8b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.149372 Oct 28 10:51:44.408605 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3715/7434] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:44 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:45.430883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:45.431502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:45.438303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:45.438792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:45.439234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:45.439926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:45.440388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:45.440831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:45.569249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:45.577266 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fa94e087-0803-42c4-8f76-42491111035e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.150270 Oct 28 10:51:45.577849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3720/7435] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:45 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:46.601672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:46.602303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:46.609162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:46.609717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:46.610174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:46.610883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:46.611354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:46.611797 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:46.744373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:46.752222 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-007f01ab-12da-4620-8843-b023ecbe0c6f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.155044 Oct 28 10:51:46.752815 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3716/7436] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:46 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:47.774538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:47.775161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:47.781967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:47.782459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:47.782900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:47.783602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:47.784064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:47.784497 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:47.912928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:47.920714 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7ceda347-f17a-4393-9578-1234e69ef2b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.150073 Oct 28 10:51:47.921330 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3721/7437] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:47 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:48.944175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:48.945124 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:48.952191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:48.952566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:48.953051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:48.953771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:48.954242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:48.954684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:49.081685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:49.090014 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8332b7d3-1801-44a1-a572-f0509103e9b6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1657 microversion: 2.1 time: 0.150285 Oct 28 10:51:49.090594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3717/7438] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:48 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:49.112872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:51:49.115702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:49.122570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:49.123058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:49.123495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:49.124187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:49.124643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:49.125104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:49.153512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:49.159071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Old instance type m1.heat2, new instance type m1.heat {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:51:49.165713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:51:49.166138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:51:49.166615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:51:49.167024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:51:49.167435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:51:49.232168 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef13bf93-b6bf-4cd4-9e84-09ad6a22be1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action" status: 202 len: 0 microversion: 2.1 time: 0.121128 Oct 28 10:51:49.232815 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3722/7439] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:51:49 2022] POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:51:49.241370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:49.242025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:49.248029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:49.248539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:49.249027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:49.249751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:49.250224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:49.250670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:49.388870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:49.396798 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a731fc60-d452-433a-a813-32aa97d4b07e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.159813 Oct 28 10:51:49.397416 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3718/7440] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:49 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:50.419811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:50.420432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:50.429269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:50.429861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:50.430365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:50.431101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:50.431564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:50.432002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:50.562798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:50.570868 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6732c343-cba2-426f-9478-8e1880dd7cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.155073 Oct 28 10:51:50.571449 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3723/7441] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:50 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:51.594108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:51.594862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:51.602304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:51.602936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:51.603460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:51.604250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:51.604788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:51.605315 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:51.739766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:51.747847 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-068c7133-eed6-46e2-ace7-8a6f70c84039 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1680 microversion: 2.1 time: 0.157631 Oct 28 10:51:51.748538 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3719/7442] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:51 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:52.771680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:52.772295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:52.779179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:52.779667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:52.780103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:52.780794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:52.781360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:52.781786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:52.914077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:52.922159 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e6a0d140-d589-418c-8e97-9fe7e782f7ad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1685 microversion: 2.1 time: 0.154476 Oct 28 10:51:52.922726 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3724/7443] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:52 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:53.945893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:53.946560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:53.952655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:53.953186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:53.953648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:53.954365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:53.954844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:53.955293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:54.169691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:54.177421 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-04829113-0d57-4c9a-aca6-b34875ddaf63 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1684 microversion: 2.1 time: 0.236179 Oct 28 10:51:54.178001 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3720/7444] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:53 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1684 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:54.252487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e56934bc-7281-47c2-87a1-0c3e3af39c63 req-95d26e40-13a1-44f5-b21d-3c37d0b05c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a19385-891b-40e6-bb4a-d50d66420866", "name": "network-vif-unplugged", "status": "completed", "tag": "874bfcee-8fba-4c0b-b108-b5ba778641ef"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:51:54.262563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e56934bc-7281-47c2-87a1-0c3e3af39c63 req-95d26e40-13a1-44f5-b21d-3c37d0b05c50 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:54.263152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e56934bc-7281-47c2-87a1-0c3e3af39c63 req-95d26e40-13a1-44f5-b21d-3c37d0b05c50 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:54.263663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e56934bc-7281-47c2-87a1-0c3e3af39c63 req-95d26e40-13a1-44f5-b21d-3c37d0b05c50 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:54.279561 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e56934bc-7281-47c2-87a1-0c3e3af39c63 req-95d26e40-13a1-44f5-b21d-3c37d0b05c50 service nova] Creating event network-vif-unplugged:874bfcee-8fba-4c0b-b108-b5ba778641ef for instance 59a19385-891b-40e6-bb4a-d50d66420866 on n-h1-zed-1 Oct 28 10:51:54.285133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-e56934bc-7281-47c2-87a1-0c3e3af39c63 req-95d26e40-13a1-44f5-b21d-3c37d0b05c50 service nova] Instance 59a19385-891b-40e6-bb4a-d50d66420866 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:51:54.297642 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e56934bc-7281-47c2-87a1-0c3e3af39c63 req-95d26e40-13a1-44f5-b21d-3c37d0b05c50 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048776 Oct 28 10:51:54.298369 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3725/7445] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:51:55.201094 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:55.201726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:55.209225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:55.209732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:55.210194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:55.210904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:55.211376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:55.211821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:55.358188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:55.366222 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f89f6ba5-fe89-434c-bef5-d650c94c38ba tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1684 microversion: 2.1 time: 0.169177 Oct 28 10:51:55.366787 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3721/7446] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:55 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:56.337641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e4cb6795-9130-4661-a807-064641f10343 req-befb70c1-51d5-41fd-a710-71875293ebef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59a19385-891b-40e6-bb4a-d50d66420866", "tag": "874bfcee-8fba-4c0b-b108-b5ba778641ef"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:51:56.348003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e4cb6795-9130-4661-a807-064641f10343 req-befb70c1-51d5-41fd-a710-71875293ebef service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:56.348441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e4cb6795-9130-4661-a807-064641f10343 req-befb70c1-51d5-41fd-a710-71875293ebef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:56.349408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e4cb6795-9130-4661-a807-064641f10343 req-befb70c1-51d5-41fd-a710-71875293ebef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:56.360766 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e4cb6795-9130-4661-a807-064641f10343 req-befb70c1-51d5-41fd-a710-71875293ebef service nova] Creating event network-changed:874bfcee-8fba-4c0b-b108-b5ba778641ef for instance 59a19385-891b-40e6-bb4a-d50d66420866 on n-h1-zed-1 Oct 28 10:51:56.366657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-e4cb6795-9130-4661-a807-064641f10343 req-befb70c1-51d5-41fd-a710-71875293ebef service nova] Instance 59a19385-891b-40e6-bb4a-d50d66420866 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:51:56.377512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e4cb6795-9130-4661-a807-064641f10343 req-befb70c1-51d5-41fd-a710-71875293ebef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044246 Oct 28 10:51:56.378125 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3726/7447] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:51:56.389142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:56.389777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:56.396610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:56.397217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:56.397672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:56.398375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:56.398847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:56.399290 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:56.660204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:56.668769 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fc6a053d-a19d-4a93-be61-40b2fa9473e2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1682 microversion: 2.1 time: 0.283498 Oct 28 10:51:56.669392 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3722/7448] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:56 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1682 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:57.694721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:57.695677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:57.701959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:57.702456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:57.702901 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:57.703599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:57.704065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:57.704500 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:57.838680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:57.846395 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cb79fbf2-cdaa-49db-8dab-e9735d4975fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1678 microversion: 2.1 time: 0.157419 Oct 28 10:51:57.846971 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3727/7449] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:57 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:57.869375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:51:57.869902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:57.876544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:57.877070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:57.877516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:57.878212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:57.878675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:57.879115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:57.937735 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f3541e0e-10ff-45f0-8e51-a7a2eb5350d8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action" status: 204 len: 0 microversion: 2.1 time: 0.072123 Oct 28 10:51:57.938365 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3723/7450] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:51:57 2022] POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:51:57.947355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:57.947973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:57.954035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:57.954713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:57.955198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:57.956151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:57.956871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:57.957326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:58.094937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:58.107226 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-479335ed-b46d-4239-baf7-6b9b828938e9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1678 microversion: 2.1 time: 0.164402 Oct 28 10:51:58.108238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3728/7451] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:57 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:51:59.134169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:51:59.134954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:51:59.141436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:59.141992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:59.142453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:59.143171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:51:59.143828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:51:59.144271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:51:59.279471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:51:59.287816 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0eca8e1-90ee-4ead-a5f6-49e410238fe4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1678 microversion: 2.1 time: 0.159694 Oct 28 10:51:59.288391 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3724/7452] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:51:59 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:00.312047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:00.312669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:00.319655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.320409 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.320858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.321586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.322053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.322492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.449833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:00.457672 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64514a69-a0d1-45a2-b074-76e2346a10cc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1657 microversion: 2.1 time: 0.149516 Oct 28 10:52:00.458253 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3729/7453] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:00 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1657 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:00.479822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:00.480442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:00.487264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.487750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.488197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.488896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.489922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.490361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.625823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:00.634508 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-67785690-8903-4f47-973a-18adc050f725 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1657 microversion: 2.1 time: 0.158461 Oct 28 10:52:00.635094 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3725/7454] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:00 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1657 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:00.656792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a61aa1b2-1e1f-4753-b27a-b21ad6db9429 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:52:00.662847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61aa1b2-1e1f-4753-b27a-b21ad6db9429 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.663354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61aa1b2-1e1f-4753-b27a-b21ad6db9429 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.663806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a61aa1b2-1e1f-4753-b27a-b21ad6db9429 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.686759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a61aa1b2-1e1f-4753-b27a-b21ad6db9429 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Going to try to start instance {{(pid=128747) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 10:52:00.719253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-40f7a4be-ae6d-4594-9af2-764a0e91fe10 req-4abfd36d-5644-4c49-890a-1fe1a991d19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a19385-891b-40e6-bb4a-d50d66420866", "name": "network-vif-plugged", "status": "completed", "tag": "874bfcee-8fba-4c0b-b108-b5ba778641ef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:52:00.729348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-40f7a4be-ae6d-4594-9af2-764a0e91fe10 req-4abfd36d-5644-4c49-890a-1fe1a991d19f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.729844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-40f7a4be-ae6d-4594-9af2-764a0e91fe10 req-4abfd36d-5644-4c49-890a-1fe1a991d19f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.730291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-40f7a4be-ae6d-4594-9af2-764a0e91fe10 req-4abfd36d-5644-4c49-890a-1fe1a991d19f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.737694 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a61aa1b2-1e1f-4753-b27a-b21ad6db9429 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action" status: 202 len: 0 microversion: 2.1 time: 0.084630 Oct 28 10:52:00.738349 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3730/7455] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:52:00 2022] POST /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:52:00.746094 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-40f7a4be-ae6d-4594-9af2-764a0e91fe10 req-4abfd36d-5644-4c49-890a-1fe1a991d19f service nova] Creating event network-vif-plugged:874bfcee-8fba-4c0b-b108-b5ba778641ef for instance 59a19385-891b-40e6-bb4a-d50d66420866 on n-h1-zed-1 Oct 28 10:52:00.747798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:00.748508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:00.752102 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-40f7a4be-ae6d-4594-9af2-764a0e91fe10 req-4abfd36d-5644-4c49-890a-1fe1a991d19f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036563 Oct 28 10:52:00.752953 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3726/7456] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:52:00.755519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.756056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.756973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.757960 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:00.761714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:00.762457 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:00.904449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:00.908163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:00.913862 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9559835b-7bcc-4d4a-8c65-4217011016d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1666 microversion: 2.1 time: 0.170407 Oct 28 10:52:00.914666 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3731/7457] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:00 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1666 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:01.939216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:01.940702 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:01.947319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:01.947826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:01.948289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:01.949042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:01.949525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:01.949974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:01.952836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:02.082523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:02.090834 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7eb0d303-c82d-4974-b992-5584f92793f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1670 microversion: 2.1 time: 0.157043 Oct 28 10:52:02.091408 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3727/7458] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:01 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:02.113939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:02.114444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:02.122344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:02.122836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:02.123281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:02.123982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:02.124445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:02.124878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:02.154305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:52:02.227124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ee3747b-665e-4471-b995-ae6c1ec1db75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 204 len: 0 microversion: 2.1 time: 0.116662 Oct 28 10:52:02.227621 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3732/7459] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:52:02 2022] DELETE /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:52:02.235968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:02.236730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:02.242697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:02.243204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:02.243664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:02.244373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:02.244847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:02.245321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:02.375817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:02.384158 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cdd502bf-4858-4f28-abb6-4df75ede0512 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1676 microversion: 2.1 time: 0.151954 Oct 28 10:52:02.384728 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3728/7460] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:02 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:52:03.409179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:03.410235 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:03.417707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:03.418212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:03.418656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:03.419362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:03.419824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:03.420257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:03.558783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:03.566800 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2434b86d-3a7b-4d93-b896-ea4feaa826e3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1676 microversion: 2.1 time: 0.162915 Oct 28 10:52:03.567382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3733/7461] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:03 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:04.495198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e556f86e-46bd-4664-9feb-36e587e79651 req-132f00eb-6ad0-4af9-b8a0-d1806200e9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59a19385-891b-40e6-bb4a-d50d66420866", "name": "network-vif-deleted", "tag": "874bfcee-8fba-4c0b-b108-b5ba778641ef"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:52:04.504989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e556f86e-46bd-4664-9feb-36e587e79651 req-132f00eb-6ad0-4af9-b8a0-d1806200e9b1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:04.505496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e556f86e-46bd-4664-9feb-36e587e79651 req-132f00eb-6ad0-4af9-b8a0-d1806200e9b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:04.505945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e556f86e-46bd-4664-9feb-36e587e79651 req-132f00eb-6ad0-4af9-b8a0-d1806200e9b1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:04.518176 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e556f86e-46bd-4664-9feb-36e587e79651 req-132f00eb-6ad0-4af9-b8a0-d1806200e9b1 service nova] Creating event network-vif-deleted:874bfcee-8fba-4c0b-b108-b5ba778641ef for instance 59a19385-891b-40e6-bb4a-d50d66420866 on n-h1-zed-1 Oct 28 10:52:04.523214 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e556f86e-46bd-4664-9feb-36e587e79651 req-132f00eb-6ad0-4af9-b8a0-d1806200e9b1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033470 Oct 28 10:52:04.523866 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3729/7462] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:52:04.593046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:04.594552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:04.602932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:04.603592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:04.604108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:04.605103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:04.605573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:04.606009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:04.643341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:04.643853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:04.644518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:04.645013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lazy-loading 'fault' on Instance uuid 59a19385-891b-40e6-bb4a-d50d66420866 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:52:04.692223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:04.703396 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a569547d-0caf-46a1-ba77-3ee83fa479f6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 200 len: 1327 microversion: 2.1 time: 0.115563 Oct 28 10:52:04.704008 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3734/7463] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:04 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 1327 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:05.728566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:05.729318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:05.735532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:05.736028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:05.736481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:05.737214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:05.737690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:05.738136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:05.751894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 HTTP/1.1 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '59a19385-891b-40e6-bb4a-d50d66420866'} Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:52:05.753536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2881f260-bfe9-40de-b25e-b5c3a3b7e832 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 404 len: 111 microversion: 2.1 time: 0.032146 Oct 28 10:52:05.758602 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3730/7464] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:05 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:52:05.772936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:05.773688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:05.779614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:05.780100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:05.780540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:05.781303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:05.781762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:05.782221 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:05.795365 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 HTTP/1.1 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '59a19385-891b-40e6-bb4a-d50d66420866'} Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:52:05.797021 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3bdfcec-e5fc-4e0e-b204-259629e364b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 404 len: 111 microversion: 2.1 time: 0.030463 Oct 28 10:52:05.801482 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3735/7465] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:05 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 10:52:05.846392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-794812482", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa20cbe-6157-4e68-83e7-f55666418e90"}], "security_groups": [{"name": "tempest-securitygroup--1697048266"}], "key_name": "tempest-keypair-1449957640", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:52:05.952645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] validate_networks() for [('afa20cbe-6157-4e68-83e7-f55666418e90', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:52:06.314397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:52:06.314839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:52:06.315334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:52:06.315768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:52:06.316200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:52:06.325337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:06.325840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:06.326295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:06.327046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:06.327521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:06.327966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:06.345197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:52:06.350987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for user a84e8b5b3cc84489aa387be5a69b8670 and project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:52:06.363204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:52:06.365522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:52:06.410743 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d62bc32-372a-44fb-b4d1-a448380dcdd5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.568103 Oct 28 10:52:06.411403 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3731/7466] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:52:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:52:06.423389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ee6b199d-8f58-4c41-add1-9b286497fe37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:06.424201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ee6b199d-8f58-4c41-add1-9b286497fe37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:06.478154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ee6b199d-8f58-4c41-add1-9b286497fe37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:06.484814 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ee6b199d-8f58-4c41-add1-9b286497fe37 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1238 microversion: 2.1 time: 0.065323 Oct 28 10:52:06.485416 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3736/7467] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:06 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1238 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:07.510370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:07.511297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:07.518728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:07.519359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:07.520047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:07.521046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:07.521601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:07.522113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:07.606468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:07.615084 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c5983f21-2ba5-4981-ba7a-8a79aa820c6a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1298 microversion: 2.1 time: 0.110286 Oct 28 10:52:07.616529 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3732/7468] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:07 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1298 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:08.639980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:08.640569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:08.644304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:08.651323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:08.652071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:08.652520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:08.653276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:08.653746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:08.654207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:08.794452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:08.802464 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1739151e-3dfc-4e4b-9598-0d2648cc8e3c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.166524 Oct 28 10:52:08.803193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3737/7469] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:08 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:09.308629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7c4a49d0-2add-4139-b2b1-b7e9c0ca8e85 req-850ccb23-015b-4472-af76-a2e37f1fea69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:52:09.316325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:09.322757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c4a49d0-2add-4139-b2b1-b7e9c0ca8e85 req-850ccb23-015b-4472-af76-a2e37f1fea69 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:09.323345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c4a49d0-2add-4139-b2b1-b7e9c0ca8e85 req-850ccb23-015b-4472-af76-a2e37f1fea69 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:09.323883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c4a49d0-2add-4139-b2b1-b7e9c0ca8e85 req-850ccb23-015b-4472-af76-a2e37f1fea69 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:09.337449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7c4a49d0-2add-4139-b2b1-b7e9c0ca8e85 req-850ccb23-015b-4472-af76-a2e37f1fea69 service nova] Creating event network-changed:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h2-zed-1 Oct 28 10:52:09.342892 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7c4a49d0-2add-4139-b2b1-b7e9c0ca8e85 req-850ccb23-015b-4472-af76-a2e37f1fea69 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037972 Oct 28 10:52:09.343861 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3733/7470] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:52:09.826856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:09.827394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:09.834138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:09.834628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:09.835072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:09.835770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:09.836233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:09.836669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:09.964402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:09.972457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2aa1b9b6-e216-43ca-9bfc-861038137845 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.149714 Oct 28 10:52:09.973065 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3738/7471] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:09 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:10.997693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:10.998410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:11.005055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:11.005656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:11.006116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:11.007405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:11.007882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:11.008328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:11.139976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:11.147708 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e57d9455-98be-4c8b-93de-a50ed73bd315 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.155228 Oct 28 10:52:11.148289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3734/7472] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:10 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:52:12.171518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:12.172130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:12.179175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:12.179674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:12.180124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:12.180833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:12.181325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:12.181788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:12.322097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:12.329878 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fdafc54b-5bb8-4c64-8588-283ffede4c53 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.162328 Oct 28 10:52:12.330465 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3739/7473] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:12 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:13.354050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:13.354844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:13.362932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:13.363443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:13.363902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:13.364629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:13.365133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:13.365581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:13.500155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:13.508394 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b0df6af-fc12-41d6-bdcf-fecf2e1b2ea3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.159932 Oct 28 10:52:13.508989 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3735/7474] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:13 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:14.531577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:14.532205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:14.539676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:14.540164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:14.540605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:14.541329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:14.541789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:14.542219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:14.672073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:14.680193 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6c9a2aad-0da2-44c2-b6d3-f86865200c7c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.152493 Oct 28 10:52:14.680769 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3740/7475] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:14 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:15.574636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8a288a1c-c8b5-4bf4-a73a-c30205d0d658 req-15e7fca2-ac72-4ff6-a148-c4614df21549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "name": "network-vif-plugged", "status": "completed", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:52:15.586204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a288a1c-c8b5-4bf4-a73a-c30205d0d658 req-15e7fca2-ac72-4ff6-a148-c4614df21549 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:15.586705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a288a1c-c8b5-4bf4-a73a-c30205d0d658 req-15e7fca2-ac72-4ff6-a148-c4614df21549 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:15.587151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8a288a1c-c8b5-4bf4-a73a-c30205d0d658 req-15e7fca2-ac72-4ff6-a148-c4614df21549 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:15.600405 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8a288a1c-c8b5-4bf4-a73a-c30205d0d658 req-15e7fca2-ac72-4ff6-a148-c4614df21549 service nova] Creating event network-vif-plugged:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h2-zed-1 Oct 28 10:52:15.615244 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8a288a1c-c8b5-4bf4-a73a-c30205d0d658 req-15e7fca2-ac72-4ff6-a148-c4614df21549 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045014 Oct 28 10:52:15.615865 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3736/7476] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:52:15.704234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:15.704895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:15.712527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:15.713060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:15.713509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:15.714210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:15.714690 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:15.715102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:15.844686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:15.853030 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfdb6c2d-5c19-4a25-ba96-5a6a49f35932 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.153250 Oct 28 10:52:15.853613 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3741/7477] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:15 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:16.874320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:16.875115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:16.880113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:16.880819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:16.888466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:16.888980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:16.889427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:16.890116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:16.890578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:16.891010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:17.023344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:17.031096 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e046bb81-de7e-4ab3-9964-6775f83968c6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1364 microversion: 2.1 time: 0.157796 Oct 28 10:52:17.031679 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3737/7478] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:16 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:18.054420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:18.055044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:18.056981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:52:18.063178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:18.063677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:18.064166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:18.064878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:18.065367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:18.065804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:18.198202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:52:18.205854 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1dcefe32-3f22-4db5-9664-a9f1af6b0d0f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1551 microversion: 2.1 time: 0.155423 Oct 28 10:52:18.206424 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3742/7479] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:52:18 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:52:18.229258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:52:18.229803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:52:18.236641 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:18.237180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:18.237635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:18.238342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:18.238812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:18.239256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:18.316082 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3fc975a5-33d4-4795-966d-d1660e3f4f0e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090703 Oct 28 10:52:18.316693 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3738/7480] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:52:18 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:52:19.241069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-8c199b17-5592-4d36-9378-98e1845b63e3 req-a6dba918-52e4-413c-a331-dcb21d9e1c25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:52:19.251481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8c199b17-5592-4d36-9378-98e1845b63e3 req-a6dba918-52e4-413c-a331-dcb21d9e1c25 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:52:19.252077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8c199b17-5592-4d36-9378-98e1845b63e3 req-a6dba918-52e4-413c-a331-dcb21d9e1c25 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:52:19.252593 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-8c199b17-5592-4d36-9378-98e1845b63e3 req-a6dba918-52e4-413c-a331-dcb21d9e1c25 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:52:19.264144 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-8c199b17-5592-4d36-9378-98e1845b63e3 req-a6dba918-52e4-413c-a331-dcb21d9e1c25 service nova] Creating event network-changed:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h2-zed-1 Oct 28 10:52:19.269390 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-8c199b17-5592-4d36-9378-98e1845b63e3 req-a6dba918-52e4-413c-a331-dcb21d9e1c25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032042 Oct 28 10:52:19.270195 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3743/7481] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:53:33.556877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=11 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:33.557700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=49 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:33.610452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:53:33.612807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:33.622460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:33.622964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:33.623422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:33.624131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:33.624605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:33.625082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:33.657299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:33.662946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Old instance type m1.heat2, new instance type m1.heat {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:53:33.673056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:53:33.673494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:53:33.673987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:53:33.674417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:53:33.674842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:53:33.737971 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-452dd195-e90b-46ce-839e-199533c7bec4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111/action" status: 202 len: 0 microversion: 2.1 time: 0.183511 Oct 28 10:53:33.738767 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3739/7482] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:53:33 2022] POST /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 10:53:33.745699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=13 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:33.746392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:33.751328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:33.752438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:33.765813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:33.766758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:33.767732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:33.768800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:33.769697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:33.770475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:34.011938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:34.020565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45ae60cc-f4bb-4c94-93eb-d177c263787e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1679 microversion: 2.1 time: 0.277331 Oct 28 10:53:34.034296 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3744/7483] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:33 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1679 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:35.047578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:35.048300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:35.054993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:35.055716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:35.056180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:35.056896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:35.057404 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:35.058176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:35.331772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:35.340260 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a7c49767-06b8-4198-a0b8-7ab560639bad tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1679 microversion: 2.1 time: 0.297571 Oct 28 10:53:35.341301 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3740/7484] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:35 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1679 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:36.363781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:36.364403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:36.371468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:36.371961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:36.372410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:36.373138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:36.373606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:36.374042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:36.501293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:36.509039 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1f7bfd23-acbe-47a4-8574-d64377635100 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.149135 Oct 28 10:53:36.509622 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3745/7485] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:36 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:37.532374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:37.533034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:37.540546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:37.541080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:37.541542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:37.542251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:37.542723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:37.543168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:37.672785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:37.681086 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e5849b2-388c-449f-9427-acd6a009c1a5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.152089 Oct 28 10:53:37.681676 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3741/7486] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:37 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:38.705027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:38.705666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:38.713124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:38.713615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:38.714054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:38.714780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:38.715239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:38.715666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:38.851230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:38.858969 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9a80dfa5-148b-44e2-aacb-5c1a286b3cfb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.158030 Oct 28 10:53:38.859773 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3746/7487] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:38 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:39.882606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:39.883145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:39.890396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:39.890883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:39.891326 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:39.892019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:39.892482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:39.892933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:40.020446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:40.028320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b9661de5-2f22-4c81-991b-53aebba39c1b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.149662 Oct 28 10:53:40.028898 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3742/7488] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:39 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:41.051473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:41.052094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:41.058837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:41.059328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:41.059778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:41.060471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:41.061137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:41.061382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:41.188839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:41.197346 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2a2dde94-8ca9-4d02-ae1e-6b45c75be6b8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.149791 Oct 28 10:53:41.197920 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3747/7489] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:41 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:42.220754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:42.221437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:42.228226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:42.228723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:42.229200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:42.229896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:42.230357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:42.230790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:42.361291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:42.369480 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a6a63371-1714-4cd2-9423-6ee84e9ae809 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.152714 Oct 28 10:53:42.370053 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3743/7490] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:42 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:43.393340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:43.393989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:43.400770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:43.401313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:43.401760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:43.402458 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:43.402925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:43.403361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:43.532302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:43.540684 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-87aadd90-43aa-4ba6-9268-886c6f11a330 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.150852 Oct 28 10:53:43.541301 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3748/7491] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:43 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:44.563774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:44.564358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:44.571672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:44.572166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:44.572617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:44.573345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:44.573814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:44.574249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:44.707010 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:44.715453 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-890612e9-f6cb-4483-aa0a-f9b46fd95b9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.155620 Oct 28 10:53:44.716028 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3744/7492] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:44 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:45.738868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:45.739485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:45.747467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:45.747965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:45.748411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:45.749152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:45.749617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:45.750062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:46.139832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:46.147584 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b860674b-455e-4fa8-bf79-17996f116989 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.412678 Oct 28 10:53:46.148164 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3749/7493] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:45 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:47.171782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:47.172411 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:47.179195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:47.179706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:47.180139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:47.181432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:47.181901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:47.182340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:47.312694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:47.320701 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a32f21a-50f3-4eb7-a093-867d2ce02788 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1684 microversion: 2.1 time: 0.152582 Oct 28 10:53:47.321317 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3745/7494] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:47 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:48.306201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fc279f91-7ae5-4dbb-b8c2-e36cf524ddf7 req-35904f2d-d6c7-4c72-a463-1ec61701a083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "name": "network-vif-unplugged", "status": "completed", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:53:48.315954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fc279f91-7ae5-4dbb-b8c2-e36cf524ddf7 req-35904f2d-d6c7-4c72-a463-1ec61701a083 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:48.316446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fc279f91-7ae5-4dbb-b8c2-e36cf524ddf7 req-35904f2d-d6c7-4c72-a463-1ec61701a083 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:48.316889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fc279f91-7ae5-4dbb-b8c2-e36cf524ddf7 req-35904f2d-d6c7-4c72-a463-1ec61701a083 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:48.330395 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fc279f91-7ae5-4dbb-b8c2-e36cf524ddf7 req-35904f2d-d6c7-4c72-a463-1ec61701a083 service nova] Creating event network-vif-unplugged:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h1-zed-1 Oct 28 10:53:48.336290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-fc279f91-7ae5-4dbb-b8c2-e36cf524ddf7 req-35904f2d-d6c7-4c72-a463-1ec61701a083 service nova] Instance 97543449-9151-4c5c-a125-64ad59c19111 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:53:48.343660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:48.344433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:48.347823 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fc279f91-7ae5-4dbb-b8c2-e36cf524ddf7 req-35904f2d-d6c7-4c72-a463-1ec61701a083 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096638 Oct 28 10:53:48.348601 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3750/7495] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:53:48.352298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:48.352878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:48.353459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:48.354184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:48.354648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:48.355085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:48.861976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:48.871328 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0052047b-1094-4356-b7df-4b8c3a182f14 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1683 microversion: 2.1 time: 0.531375 Oct 28 10:53:48.884973 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3746/7496] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:48 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1683 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:53:49.896243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:49.896963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:49.903642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:49.904726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:49.905208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:49.905908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:49.906370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:49.906805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:50.035814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:50.044140 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfe613a9-fa95-43fc-8dca-78851829235f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1681 microversion: 2.1 time: 0.152969 Oct 28 10:53:50.044713 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3751/7497] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:49 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:50.677430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a6293398-9ac7-47ad-aa68-6482f638001f req-f39804b4-3417-4cf8-b6d3-c2ef257e1443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:53:50.688167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a6293398-9ac7-47ad-aa68-6482f638001f req-f39804b4-3417-4cf8-b6d3-c2ef257e1443 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:50.688659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a6293398-9ac7-47ad-aa68-6482f638001f req-f39804b4-3417-4cf8-b6d3-c2ef257e1443 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:50.689143 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a6293398-9ac7-47ad-aa68-6482f638001f req-f39804b4-3417-4cf8-b6d3-c2ef257e1443 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:50.701583 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a6293398-9ac7-47ad-aa68-6482f638001f req-f39804b4-3417-4cf8-b6d3-c2ef257e1443 service nova] Creating event network-changed:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h1-zed-1 Oct 28 10:53:50.706892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-a6293398-9ac7-47ad-aa68-6482f638001f req-f39804b4-3417-4cf8-b6d3-c2ef257e1443 service nova] Instance 97543449-9151-4c5c-a125-64ad59c19111 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:53:50.717662 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a6293398-9ac7-47ad-aa68-6482f638001f req-f39804b4-3417-4cf8-b6d3-c2ef257e1443 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043995 Oct 28 10:53:50.718257 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3747/7498] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:53:51.067454 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:51.068867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:51.076946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:51.077520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:51.077968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:51.078707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:51.079170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:51.079604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:51.222550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:51.233442 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ef625278-b187-4d53-9830-2847c426715d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1681 microversion: 2.1 time: 0.168895 Oct 28 10:53:51.248787 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3752/7499] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:51 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:52.259455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:52.260221 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:52.266425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.266923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.267378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.268119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.268587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.269063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.402208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:52.409916 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-08cda41e-b075-4136-8120-f1d897b49f28 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1678 microversion: 2.1 time: 0.155657 Oct 28 10:53:52.410495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3748/7500] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:52 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:52.432274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:53:52.432779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:52.439577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.440060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.440498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.441216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.441688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.442112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.479331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.479807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.480239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.480975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.481433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.481858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.504460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:53:52.511100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for user a84e8b5b3cc84489aa387be5a69b8670 and project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:53:52.611663 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9ef2391b-d613-4c00-a53b-0945cd3640f5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111/action" status: 202 len: 0 microversion: 2.1 time: 0.183124 Oct 28 10:53:52.612659 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3753/7501] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:53:52 2022] POST /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:53:52.620834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:52.621556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:52.627596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.628093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.628540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.629267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:52.629734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:52.630162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:52.827117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:52.834953 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea66bc37-f03e-41e0-996c-7a21d5e694b1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1677 microversion: 2.1 time: 0.218117 Oct 28 10:53:52.835540 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3749/7502] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:52 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1677 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:53.859438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:53.860062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:53.866642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:53.867135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:53.867581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:53.868277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:53.868739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:53.869198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:53.998087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:54.005905 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7ddaebc7-69d0-486c-bbff-5cd8f2730195 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1677 microversion: 2.1 time: 0.150837 Oct 28 10:53:54.006503 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3754/7503] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:53 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:55.029599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:55.030233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:55.037172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:55.037677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:55.038133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:55.038844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:55.039316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:55.040351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:55.175955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:55.186286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-17d4e18b-4420-41cd-a276-a628d9d8ca67 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1677 microversion: 2.1 time: 0.160344 Oct 28 10:53:55.197175 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3750/7504] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:55 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:55.212617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-db491b2b-3af2-4f25-9f7f-488802e0bf15 req-5379a8c3-0509-47be-94b3-c28f6fb100ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "name": "network-vif-plugged", "status": "completed", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:53:55.225149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db491b2b-3af2-4f25-9f7f-488802e0bf15 req-5379a8c3-0509-47be-94b3-c28f6fb100ea service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:55.225868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db491b2b-3af2-4f25-9f7f-488802e0bf15 req-5379a8c3-0509-47be-94b3-c28f6fb100ea service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:55.226314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-db491b2b-3af2-4f25-9f7f-488802e0bf15 req-5379a8c3-0509-47be-94b3-c28f6fb100ea service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:55.238863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-db491b2b-3af2-4f25-9f7f-488802e0bf15 req-5379a8c3-0509-47be-94b3-c28f6fb100ea service nova] Creating event network-vif-plugged:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h1-zed-1 Oct 28 10:53:55.245426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-db491b2b-3af2-4f25-9f7f-488802e0bf15 req-5379a8c3-0509-47be-94b3-c28f6fb100ea service nova] Instance 97543449-9151-4c5c-a125-64ad59c19111 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:53:55.256797 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-db491b2b-3af2-4f25-9f7f-488802e0bf15 req-5379a8c3-0509-47be-94b3-c28f6fb100ea service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048339 Oct 28 10:53:55.257511 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3755/7505] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:53:55.874943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-208c06de-91ee-4761-8b92-e09d3eb95ac1 req-307ab45e-cfeb-445d-9e7f-a7e97f15924a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "name": "network-vif-unplugged", "status": "completed", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:53:55.884874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-208c06de-91ee-4761-8b92-e09d3eb95ac1 req-307ab45e-cfeb-445d-9e7f-a7e97f15924a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:55.885390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-208c06de-91ee-4761-8b92-e09d3eb95ac1 req-307ab45e-cfeb-445d-9e7f-a7e97f15924a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:55.885838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-208c06de-91ee-4761-8b92-e09d3eb95ac1 req-307ab45e-cfeb-445d-9e7f-a7e97f15924a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:55.901133 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-208c06de-91ee-4761-8b92-e09d3eb95ac1 req-307ab45e-cfeb-445d-9e7f-a7e97f15924a service nova] Creating event network-vif-unplugged:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h2-zed-1 Oct 28 10:53:55.906886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-208c06de-91ee-4761-8b92-e09d3eb95ac1 req-307ab45e-cfeb-445d-9e7f-a7e97f15924a service nova] Instance 97543449-9151-4c5c-a125-64ad59c19111 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:53:55.918263 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-208c06de-91ee-4761-8b92-e09d3eb95ac1 req-307ab45e-cfeb-445d-9e7f-a7e97f15924a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046991 Oct 28 10:53:55.918887 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3751/7506] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:53:56.212111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:56.212883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:56.219101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:56.219596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:56.220040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:56.220779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:56.221271 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:56.221707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:56.371204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:56.379100 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6012479-9d89-4657-b504-e6a752bcc76b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1677 microversion: 2.1 time: 0.171333 Oct 28 10:53:56.380200 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3756/7507] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:56 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:57.404729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:57.405462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:57.411541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:57.412039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:57.412482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:57.413209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:57.413671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:57.414107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:57.547271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:57.555011 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f00b99e8-dd0f-4638-8cbf-9afdd5cdf7fa tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1677 microversion: 2.1 time: 0.155337 Oct 28 10:53:57.555593 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3752/7508] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:57 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:57.933898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-87b71cd5-5e88-4f9e-8a88-e7edf16be564 req-c219dcdf-facc-45d5-b4f4-0e015b97ddcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:53:57.944582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-87b71cd5-5e88-4f9e-8a88-e7edf16be564 req-c219dcdf-facc-45d5-b4f4-0e015b97ddcd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:57.945383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-87b71cd5-5e88-4f9e-8a88-e7edf16be564 req-c219dcdf-facc-45d5-b4f4-0e015b97ddcd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:57.945822 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-87b71cd5-5e88-4f9e-8a88-e7edf16be564 req-c219dcdf-facc-45d5-b4f4-0e015b97ddcd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:57.957252 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-87b71cd5-5e88-4f9e-8a88-e7edf16be564 req-c219dcdf-facc-45d5-b4f4-0e015b97ddcd service nova] Creating event network-changed:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h2-zed-1 Oct 28 10:53:57.963482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-87b71cd5-5e88-4f9e-8a88-e7edf16be564 req-c219dcdf-facc-45d5-b4f4-0e015b97ddcd service nova] Instance 97543449-9151-4c5c-a125-64ad59c19111 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:53:57.974916 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-87b71cd5-5e88-4f9e-8a88-e7edf16be564 req-c219dcdf-facc-45d5-b4f4-0e015b97ddcd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045311 Oct 28 10:53:57.975505 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3757/7509] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:53:58.578914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:58.579569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:58.587082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:58.587976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:58.588088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:58.588690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:58.589184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:58.589621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:58.718525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:58.726321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2d827d6d-34c6-47e6-98ad-ff0eb9e1f515 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1677 microversion: 2.1 time: 0.151321 Oct 28 10:53:58.727482 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3753/7510] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:58 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:53:59.751205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:53:59.751907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:53:59.760047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:59.761041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:59.761790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:59.762558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:53:59.763026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:53:59.763455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:53:59.785100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:53:59.918569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:53:59.926850 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc5b3a50-c68c-4fff-a1a6-4327a4ac77e7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1677 microversion: 2.1 time: 0.180692 Oct 28 10:53:59.927458 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3758/7511] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:53:59 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:00.950767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:00.951399 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:00.958257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:00.958759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:00.959212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:00.959919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:00.960385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:00.960821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.098393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:01.102250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:01.107650 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b439c87f-836d-4434-a934-2c54b52ad2f1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1670 microversion: 2.1 time: 0.160780 Oct 28 10:54:01.108227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3754/7512] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:00 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:01.130171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:01.130791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:01.138299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.138791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.139231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.139923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.140382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.140811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.271484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:01.279195 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9fd9c34-137f-49ce-af62-052bbe3dda8c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1670 microversion: 2.1 time: 0.152869 Oct 28 10:54:01.279777 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3759/7513] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:01 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:01.303592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:01.304219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:01.311259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.311757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.312213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.312940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.313412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.313856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.439507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:01.447972 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6cd6aadb-d8eb-4e4c-8dd5-8d200f63aa22 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1670 microversion: 2.1 time: 0.148821 Oct 28 10:54:01.448548 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3755/7514] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:01 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1670 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:01.470118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:01.470550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:01.476439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.477448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.477887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.478568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.479020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.479442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.504737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:54:01.578338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-97ae19ac-206e-4958-ac35-cec3d496587e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 204 len: 0 microversion: 2.1 time: 0.111852 Oct 28 10:54:01.582013 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3760/7515] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:54:01 2022] DELETE /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:54:01.589182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:01.590092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:01.596400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.596924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.597390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.598127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:01.598579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:01.599023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:01.731541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:01.739391 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7087748c-e127-4011-9cfe-067d95a286d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1676 microversion: 2.1 time: 0.155139 Oct 28 10:54:01.739969 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3756/7516] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:01 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:02.766496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:02.767111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:02.769946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:02.775242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:02.775734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:02.776179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:02.776877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:02.777360 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:02.777794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:02.911627 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:02.920041 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6a047a20-d3e6-4dcd-8fa1-d1634de953d9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1676 microversion: 2.1 time: 0.157889 Oct 28 10:54:02.920650 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3761/7517] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:02 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:03.943807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:03.944458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:03.948003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=41 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:03.953729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:03.954515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:03.954965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:03.955893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:03.956314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:03.956752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:04.060924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:04.071323 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-00874463-198a-4c7d-af50-d53c906c2d1e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 200 len: 1608 microversion: 2.1 time: 0.130407 Oct 28 10:54:04.072011 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3757/7518] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:03 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 1608 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:04.188465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-43d466ab-ccec-4c68-ae6c-2e0f30a11a61 req-74bb02ca-ad79-41d6-a0db-db0076a39f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97543449-9151-4c5c-a125-64ad59c19111", "name": "network-vif-deleted", "tag": "d1021a7b-85ef-4d1c-b77e-76c59bc74eb5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:54:04.196942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:04.204046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-43d466ab-ccec-4c68-ae6c-2e0f30a11a61 req-74bb02ca-ad79-41d6-a0db-db0076a39f5c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:04.204542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-43d466ab-ccec-4c68-ae6c-2e0f30a11a61 req-74bb02ca-ad79-41d6-a0db-db0076a39f5c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:04.205209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-43d466ab-ccec-4c68-ae6c-2e0f30a11a61 req-74bb02ca-ad79-41d6-a0db-db0076a39f5c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:04.218989 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-43d466ab-ccec-4c68-ae6c-2e0f30a11a61 req-74bb02ca-ad79-41d6-a0db-db0076a39f5c service nova] Creating event network-vif-deleted:d1021a7b-85ef-4d1c-b77e-76c59bc74eb5 for instance 97543449-9151-4c5c-a125-64ad59c19111 on n-h2-zed-1 Oct 28 10:54:04.224056 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-43d466ab-ccec-4c68-ae6c-2e0f30a11a61 req-74bb02ca-ad79-41d6-a0db-db0076a39f5c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039467 Oct 28 10:54:04.224674 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3762/7519] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:54:05.094611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:05.095337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:05.103103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:05.103619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:05.104077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:05.104806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:05.105317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:05.105765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:05.120747 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 HTTP/1.1 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '97543449-9151-4c5c-a125-64ad59c19111'} Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:54:05.122463 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-00a7a5c2-e8cd-418d-83a5-b9dd7375ce46 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 404 len: 111 microversion: 2.1 time: 0.033575 Oct 28 10:54:05.127274 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3758/7520] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:05 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:54:05.139875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:05.140602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:05.147174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:05.147678 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:05.148125 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:05.148845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:05.149398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:05.149835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:05.165063 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 HTTP/1.1 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '97543449-9151-4c5c-a125-64ad59c19111'} Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:54:05.166745 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:54:05.171499 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-aea8aa40-1e85-4001-aa91-8d174676f5ce tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 404 len: 111 microversion: 2.1 time: 0.033135 Oct 28 10:54:05.172766 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3763/7521] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:05 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:54:05.218457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1730427312", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "afa20cbe-6157-4e68-83e7-f55666418e90"}], "security_groups": [{"name": "tempest-securitygroup--1697048266"}], "key_name": "tempest-keypair-1449957640", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:54:05.329970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] validate_networks() for [('afa20cbe-6157-4e68-83e7-f55666418e90', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:54:05.703200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:54:05.703638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:54:05.704126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:54:05.704602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:54:05.705035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:54:05.714891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:05.715394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:05.715848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:05.716591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:05.717191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:05.717639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:05.734609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:54:05.740132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for user a84e8b5b3cc84489aa387be5a69b8670 and project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:54:05.753292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:54:05.755595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:54:05.803983 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8bb3c5fe-c064-43b6-85f5-6fcf8076a9d1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.589445 Oct 28 10:54:05.804676 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3759/7522] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:54:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:54:05.822277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6cf84c1e-4dbd-456c-89ff-5653aa55952f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:05.823025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6cf84c1e-4dbd-456c-89ff-5653aa55952f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:05.878351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6cf84c1e-4dbd-456c-89ff-5653aa55952f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:05.887631 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6cf84c1e-4dbd-456c-89ff-5653aa55952f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1239 microversion: 2.1 time: 0.071097 Oct 28 10:54:05.888211 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3764/7523] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:05 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:06.911083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:06.911804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:06.918832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:06.919338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:06.919793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:06.920707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:06.921212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:06.921660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:07.000419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:07.008986 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ecba0171-eed7-42b0-a89b-aa6b61a59ea8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1309 microversion: 2.1 time: 0.102221 Oct 28 10:54:07.009574 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3760/7524] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:06 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:54:08.033241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:08.033880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:08.042431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:08.043691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:08.043814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:08.044455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:08.044946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:08.045397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:08.179854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:08.187636 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc628adf-2a68-4c3f-a246-40d83a006d1c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1365 microversion: 2.1 time: 0.158988 Oct 28 10:54:08.188300 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3765/7525] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:08 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:08.254710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8212b44a-75b5-4c19-a8b8-666d57d3683e req-95c1b2c9-6aed-4e85-bb41-bb97752d693c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:54:08.265772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8212b44a-75b5-4c19-a8b8-666d57d3683e req-95c1b2c9-6aed-4e85-bb41-bb97752d693c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:08.266269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8212b44a-75b5-4c19-a8b8-666d57d3683e req-95c1b2c9-6aed-4e85-bb41-bb97752d693c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:08.266711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8212b44a-75b5-4c19-a8b8-666d57d3683e req-95c1b2c9-6aed-4e85-bb41-bb97752d693c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:08.277922 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8212b44a-75b5-4c19-a8b8-666d57d3683e req-95c1b2c9-6aed-4e85-bb41-bb97752d693c service nova] Creating event network-changed:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h2-zed-1 Oct 28 10:54:08.283289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8212b44a-75b5-4c19-a8b8-666d57d3683e req-95c1b2c9-6aed-4e85-bb41-bb97752d693c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032199 Oct 28 10:54:08.284395 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3761/7526] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:54:09.212601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:09.213257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:09.220062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:09.220549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:09.221017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:09.221710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:09.222162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:09.222587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:09.353258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:09.360932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cebebd2f-563d-4c67-8e6a-005230a817cf tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1365 microversion: 2.1 time: 0.152724 Oct 28 10:54:09.361573 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3766/7527] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:09 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:10.385589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:10.386304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:10.392557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:10.393086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:10.393540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:10.394239 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:10.394709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:10.395148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:10.525635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:10.533296 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1e279e3-4c50-471c-980e-f190b4a881b3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1365 microversion: 2.1 time: 0.152770 Oct 28 10:54:10.533869 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3762/7528] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:10 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:11.557433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:11.558007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:11.564775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:11.565309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:11.565761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:11.566459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:11.566924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:11.567363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:11.696311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:11.704809 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e2939c3-fc02-49fd-97ac-fe7e65ce1488 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1365 microversion: 2.1 time: 0.151047 Oct 28 10:54:11.705787 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3767/7529] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:11 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:12.728850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:12.729494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:12.736237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:12.736728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:12.737207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:12.737906 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:12.738366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:12.738832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:12.867552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:12.875283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-59bb127e-0499-4721-ba4b-a5a0677cf9f8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1365 microversion: 2.1 time: 0.150424 Oct 28 10:54:12.875858 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3763/7530] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:12 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:13.900085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:13.900705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:13.907570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:13.908056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:13.908506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:13.909240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:13.909701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:13.910137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:14.045355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:14.053230 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-786da4fd-3c96-4417-b58c-21d160a78cdb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1365 microversion: 2.1 time: 0.157484 Oct 28 10:54:14.053817 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3768/7531] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:13 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:14.160440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-294a4fa4-33cb-4da0-99fe-937c4dd972d0 req-fb6fbeae-93ce-4838-869e-4deb223b2fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "name": "network-vif-plugged", "status": "completed", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:54:14.171520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-294a4fa4-33cb-4da0-99fe-937c4dd972d0 req-fb6fbeae-93ce-4838-869e-4deb223b2fb0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:14.173825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-294a4fa4-33cb-4da0-99fe-937c4dd972d0 req-fb6fbeae-93ce-4838-869e-4deb223b2fb0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:14.173825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-294a4fa4-33cb-4da0-99fe-937c4dd972d0 req-fb6fbeae-93ce-4838-869e-4deb223b2fb0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:14.183825 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-294a4fa4-33cb-4da0-99fe-937c4dd972d0 req-fb6fbeae-93ce-4838-869e-4deb223b2fb0 service nova] Creating event network-vif-plugged:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h2-zed-1 Oct 28 10:54:14.189189 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-294a4fa4-33cb-4da0-99fe-937c4dd972d0 req-fb6fbeae-93ce-4838-869e-4deb223b2fb0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 Oct 28 10:54:14.189802 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3764/7532] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:54:15.077412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:15.078032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:15.084807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:15.085327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:15.085767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:15.087153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:15.087610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:15.088039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:15.215116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:15.222691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3ba7b3f-7950-4adc-8638-7d27dc0c260c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1365 microversion: 2.1 time: 0.149148 Oct 28 10:54:15.223265 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3769/7533] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:15 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:16.244376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:16.245240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:16.249798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:16.250541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:16.257549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:16.258050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:16.258498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:16.259199 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:16.259666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:16.260104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:16.392033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:54:16.401489 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9f99c6ac-c80f-4ddb-a1b3-608e5e3bc9ac tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1553 microversion: 2.1 time: 0.158911 Oct 28 10:54:16.402065 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3765/7534] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:54:16 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:54:16.424438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:54:16.424990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:54:16.426931 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:54:16.433140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:16.433634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:16.434082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:16.434787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:16.435249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:16.435689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:16.512883 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd75260f-0c28-4f9a-8089-0341d934b91a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092514 Oct 28 10:54:16.513555 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3770/7535] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:54:16 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:54:17.492849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-2f482f65-f4f2-4ea8-9ae9-76bb4c69cd88 req-1688dea7-dc67-4d2b-99ec-e65b978a822b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:54:17.502229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2f482f65-f4f2-4ea8-9ae9-76bb4c69cd88 req-1688dea7-dc67-4d2b-99ec-e65b978a822b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:54:17.502744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2f482f65-f4f2-4ea8-9ae9-76bb4c69cd88 req-1688dea7-dc67-4d2b-99ec-e65b978a822b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:54:17.503391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2f482f65-f4f2-4ea8-9ae9-76bb4c69cd88 req-1688dea7-dc67-4d2b-99ec-e65b978a822b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:54:17.515104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-2f482f65-f4f2-4ea8-9ae9-76bb4c69cd88 req-1688dea7-dc67-4d2b-99ec-e65b978a822b service nova] Creating event network-changed:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h2-zed-1 Oct 28 10:54:17.520702 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-2f482f65-f4f2-4ea8-9ae9-76bb4c69cd88 req-1688dea7-dc67-4d2b-99ec-e65b978a822b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079616 Oct 28 10:54:17.521350 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3766/7536] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:55:29.876061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=19 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:29.876825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:29.878127 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:55:29.878294 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c (ip 10.222.0.16) !!! Oct 28 10:55:29.880235 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:55:29.880373 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 10:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c (ip 10.222.0.16) !!! Oct 28 10:55:29.886803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:29.887418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:29.905202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:29.905692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:29.906134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:29.906829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:29.907285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:29.907715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:30.043106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:30.050806 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8170d64b-6959-4fae-af23-58dd13414877 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1672 microversion: 2.1 time: 0.177893 Oct 28 10:55:30.051391 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3771/7537] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:29 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:30.071917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:30.072645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=52 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:30.074052 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 10:55:30.074188 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 10:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-volume_attachments (ip 10.222.0.16) !!! Oct 28 10:55:30.078727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c41fb437-1980-4e59-9035-6f95d6dc0f18"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:55:30.081166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:30.096783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:30.097354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:30.097816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:30.098538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:30.099013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:30.099458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:30.357459 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-057cfbf0-bb8b-4394-8497-31ee5a210d03 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287873 Oct 28 10:55:30.358130 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3767/7538] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:55:30 2022] POST /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:55:41.073596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:55:41.075838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:41.078623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:41.079285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:41.085085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:41.085584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:41.086027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:41.086722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:41.087686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:41.088122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:41.240974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:41.247145 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Old instance type m1.heat2, new instance type m1.heat {{(pid=128747) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 10:55:41.254710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:55:41.255166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:55:41.255644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:55:41.256062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:55:41.256479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:55:41.320262 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5efa2f8c-f11d-4232-97c6-7f337d2f52c1 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/action" status: 202 len: 0 microversion: 2.1 time: 0.251930 Oct 28 10:55:41.321497 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3772/7539] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:55:41 2022] POST /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:55:41.328255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:41.329173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:55:41.333737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:41.334172 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:41.342000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:41.342511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:41.342991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:41.343689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:41.344198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:41.344653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:41.478157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:41.486474 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-872eda62-3d3b-4a9c-84d1-4d23977ace92 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1727 microversion: 2.1 time: 0.160315 Oct 28 10:55:41.487218 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3768/7540] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:41 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:42.510712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:42.511333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:42.518333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:42.518827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:42.519272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:42.519973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:42.520469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:42.520934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:42.660336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:42.669636 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-150a023e-a41a-4587-bca1-0d66dd64f8d3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1727 microversion: 2.1 time: 0.163630 Oct 28 10:55:42.670221 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3773/7541] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:42 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:43.693050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:43.693732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:43.701536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:43.702040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:43.702496 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:43.703204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:43.703676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:43.704119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:43.835040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:43.843323 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2ae2af5-3e4f-4531-9360-30b9521031b0 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.154217 Oct 28 10:55:43.843910 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3769/7542] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:43 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:44.867093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:44.867637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:44.874442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:44.874929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:44.875372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:44.876064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:44.876521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:44.876992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:45.004255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:45.013351 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7190987a-8ed0-43c8-9fbb-6c8cc7cc4099 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.150236 Oct 28 10:55:45.013924 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3774/7543] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:44 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:46.038232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:46.038866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:46.046317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:46.046815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:46.047269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:46.047974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:46.048451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:46.048895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:46.176952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:46.185349 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4eb7dcc3-2813-4450-a12d-9ddc601e8dda tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.151028 Oct 28 10:55:46.185931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3770/7544] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:46 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:47.209092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:47.209707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:47.216527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:47.217042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:47.217485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:47.218173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:47.218630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:47.219061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:47.347106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:47.355830 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a55bb9cf-f099-464f-8fdb-e83db0323cb3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.150675 Oct 28 10:55:47.356416 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3775/7545] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:47 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:48.379249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:48.379868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:48.387569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:48.388071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:48.388523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:48.389270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:48.389741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:48.390181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:48.519255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:48.527608 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-baf15013-798c-449d-9207-dfe940b2bc04 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.152218 Oct 28 10:55:48.528185 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3771/7546] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:48 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:49.551656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:49.552274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:49.559258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:49.559752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:49.560196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:49.560922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:49.561386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:49.561818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:49.694376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:49.703618 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e1b1e9f-bb30-4796-af23-439d6b246836 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.155844 Oct 28 10:55:49.704203 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3776/7547] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:49 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:50.726858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:50.727588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:50.735064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:50.735566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:50.736019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:50.736729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:50.737227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:50.737670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:50.864583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:50.873190 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-155ab540-cb5b-4b5b-ac7b-5b886660fa75 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.150209 Oct 28 10:55:50.873776 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3772/7548] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:50 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:51.897216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:51.897840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:51.905344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:51.905833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:51.906280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:51.906975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:51.907433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:51.907862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:52.036037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:52.044857 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddcd1a86-ee02-4946-945e-758d16c376fb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.151589 Oct 28 10:55:52.045456 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3777/7549] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:51 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:53.068171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:53.068844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:53.075811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:53.076312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:53.076767 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:53.077507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:53.077981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:53.078428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:53.208340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:53.216752 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-767ad7af-69f7-4e5f-a44a-be7d62f19c3a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.152645 Oct 28 10:55:53.217367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3773/7550] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:53 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:54.239597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:54.240219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:54.246562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:54.247067 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:54.247492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:54.248190 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:54.248651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:54.249116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:54.382041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:54.390343 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-de563d4c-0eb9-475e-9493-a6a18c707691 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.154681 Oct 28 10:55:54.390923 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3778/7551] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:54 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:55.413944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:55.414627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:55.421930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:55.422426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:55.422883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:55.423582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:55.424054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:55.424491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:55.560098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:55.568359 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-22e63f9d-3481-468e-99ac-f5da0295aeca tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.158366 Oct 28 10:55:55.568952 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3774/7552] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:55 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:56.591908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:56.592512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:56.599502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:56.599984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:56.600418 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:56.601144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:56.601598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:56.602022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:56.731101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:56.739314 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4f81407-3a1e-4aaa-8860-ac899c429c12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.151330 Oct 28 10:55:56.739886 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3779/7553] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:56 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:57.762366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:57.763000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:57.769940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:57.770442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:57.770899 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:57.771604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:57.772077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:57.772522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:57.899351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:57.908641 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aa376b73-e2d9-4914-9cb3-7b7c524ab14a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.150243 Oct 28 10:55:57.909246 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3775/7554] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:57 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:55:58.932095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:55:58.933242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:55:58.940045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:58.940538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:58.941003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:58.941701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:55:58.942167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:55:58.942598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:55:59.075342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:55:59.083691 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b8fa037-cdf4-4596-9ef6-74bfa6773148 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.155563 Oct 28 10:55:59.084274 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3780/7555] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:55:58 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:00.107559 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:00.108170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:00.115120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:00.115617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:00.116071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:00.116771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:00.117285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:00.117720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:00.248322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:00.256619 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-43d0c61e-8af2-44d6-9343-1a77688e569b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.153614 Oct 28 10:56:00.257447 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3776/7556] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:00 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:01.279520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:01.280133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:01.286946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:01.287429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:01.287870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:01.288556 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:01.289042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:01.289466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:01.416547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:01.425621 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0ef99ef9-b77c-4d03-949d-85d4dd61fb9e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.149986 Oct 28 10:56:01.426193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3781/7557] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:01 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:02.451828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:02.452469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:02.459334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:02.459846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:02.460304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:02.461050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:02.461526 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:02.462024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:02.592506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:02.600923 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edcbdac1-1cef-4924-9eb1-52c2c7f5e097 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.155123 Oct 28 10:56:02.601496 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3777/7558] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:02 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:03.623653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:03.624270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:03.631248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:03.631748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:03.632189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:03.632887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:03.633372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:03.633803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:03.762820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:03.771021 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5d600572-9fcc-4ee6-9b98-961637a7d622 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.151331 Oct 28 10:56:03.771599 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3782/7559] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:03 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:04.794639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:04.795262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:04.802181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:04.802673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:04.803120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:04.803819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:04.804284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:04.804718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:04.934556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:04.942822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6d26c57-a7e0-4cf5-b3d4-be1b0f75e992 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.152101 Oct 28 10:56:04.943400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3778/7560] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:04 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:05.967311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:05.968097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:05.974908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:05.975391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:05.975828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:05.976515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:05.976994 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:05.977426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:06.112124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:06.121279 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ad8fc11-4dcd-405c-8153-770ec0004dd3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.157859 Oct 28 10:56:06.121851 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3783/7561] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:05 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:07.145347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:07.145995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:07.152843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:07.153387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:07.153841 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:07.154558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:07.155023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:07.155461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:07.325017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:07.334565 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e58a1e1e-2ce7-4ab0-adbf-8c5899683536 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1732 microversion: 2.1 time: 0.193529 Oct 28 10:56:07.335725 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3779/7562] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:07 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1732 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:08.226832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-35e9a668-d6a0-4e1d-8a9c-a9b0c9f1da95 req-cda55f11-51d6-46a8-b531-76eb7d038e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "name": "network-vif-unplugged", "status": "completed", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:56:08.237328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-35e9a668-d6a0-4e1d-8a9c-a9b0c9f1da95 req-cda55f11-51d6-46a8-b531-76eb7d038e03 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:08.237819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-35e9a668-d6a0-4e1d-8a9c-a9b0c9f1da95 req-cda55f11-51d6-46a8-b531-76eb7d038e03 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:08.238258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-35e9a668-d6a0-4e1d-8a9c-a9b0c9f1da95 req-cda55f11-51d6-46a8-b531-76eb7d038e03 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:08.250478 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-35e9a668-d6a0-4e1d-8a9c-a9b0c9f1da95 req-cda55f11-51d6-46a8-b531-76eb7d038e03 service nova] Creating event network-vif-unplugged:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h1-zed-1 Oct 28 10:56:08.255933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-35e9a668-d6a0-4e1d-8a9c-a9b0c9f1da95 req-cda55f11-51d6-46a8-b531-76eb7d038e03 service nova] Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:56:08.267430 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-35e9a668-d6a0-4e1d-8a9c-a9b0c9f1da95 req-cda55f11-51d6-46a8-b531-76eb7d038e03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044472 Oct 28 10:56:08.268079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3784/7563] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:56:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:56:08.359216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:08.359851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:08.366716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:08.367225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:08.367683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:08.368430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:08.368919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:08.369366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:08.571394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:08.581111 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2a2b6793-c17b-4973-a15f-f6dc30bbd7ab tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1731 microversion: 2.1 time: 0.225835 Oct 28 10:56:08.581708 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3780/7564] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:08 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1731 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:09.607971 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:09.608847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:09.616130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:09.616740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:09.617302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:09.618135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:09.618686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:09.619277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:09.761512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:09.769890 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2380cfff-7909-429a-ab21-288155307fa3 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.167603 Oct 28 10:56:09.785689 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3785/7565] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:09 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:10.282422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-eafd66a9-3130-455e-abdd-0c6d75aca958 req-bccee758-e4d0-40e8-86bd-4773d3ca577b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:56:10.293285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-eafd66a9-3130-455e-abdd-0c6d75aca958 req-bccee758-e4d0-40e8-86bd-4773d3ca577b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:10.293711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-eafd66a9-3130-455e-abdd-0c6d75aca958 req-bccee758-e4d0-40e8-86bd-4773d3ca577b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:10.294156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-eafd66a9-3130-455e-abdd-0c6d75aca958 req-bccee758-e4d0-40e8-86bd-4773d3ca577b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:10.305880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-eafd66a9-3130-455e-abdd-0c6d75aca958 req-bccee758-e4d0-40e8-86bd-4773d3ca577b service nova] Creating event network-changed:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h1-zed-1 Oct 28 10:56:10.311981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-eafd66a9-3130-455e-abdd-0c6d75aca958 req-bccee758-e4d0-40e8-86bd-4773d3ca577b service nova] Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:56:10.322916 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-eafd66a9-3130-455e-abdd-0c6d75aca958 req-bccee758-e4d0-40e8-86bd-4773d3ca577b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044281 Oct 28 10:56:10.323514 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3781/7566] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:56:10.795608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:10.796473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:10.803648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:10.803978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:10.804425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:10.805170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:10.805832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:10.806398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:10.956154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:10.965518 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e4cc842e-ecba-46ba-b344-6b586f78a0b2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.174599 Oct 28 10:56:10.977644 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3786/7567] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:10 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:11.990748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:11.991582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:11.993610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=29 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:12.000114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:12.000619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:12.001138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:12.001891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:12.002321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:12.002924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:12.005624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=83 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:12.135712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:12.144212 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dcb7397e-5f92-4438-a142-6285e9bc5af8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.158586 Oct 28 10:56:12.144795 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3782/7568] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:11 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:13.167668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:13.168295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:13.171214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=35 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:13.176869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:13.177392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:13.177838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:13.178549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:13.179010 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:13.179441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:13.182846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:13.330883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:13.339653 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c85d6b2e-4a52-4873-a579-eadec2268770 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.175843 Oct 28 10:56:13.340244 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3787/7569] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:13 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:14.363577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:14.364210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:14.371042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:14.371544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:14.372002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:14.372706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:14.373209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:14.373654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:14.500225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:14.508502 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-afbd13e0-59a3-4306-aa8c-60a630750937 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.148823 Oct 28 10:56:14.509109 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3783/7570] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:14 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:15.531608 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:15.532234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:15.539283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:15.539774 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:15.540224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:15.540940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:15.541408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:15.541843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:15.672264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:15.680605 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08949c10-47d9-4b64-b682-9f41a0b4395a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.152916 Oct 28 10:56:15.681213 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3788/7571] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:15 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:16.704753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:16.705417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:16.712344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:16.712838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:16.713317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:16.714666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:16.715468 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:16.716148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:16.848675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:16.857561 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-39523e64-4fbb-4fd8-9573-e3094e0ac6dc tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.156760 Oct 28 10:56:16.858140 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3784/7572] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:16 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:17.881028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:17.881546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:17.888343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:17.888824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:17.889292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:17.889975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:17.890426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:17.890850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:18.022525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:18.030803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd47d61e-a57a-4f89-acc9-39f7dd2807e4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.153731 Oct 28 10:56:18.031421 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3789/7573] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:17 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:19.054731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:19.055357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:19.062732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:19.063229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:19.063697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:19.064385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:19.064851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:19.065318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:19.195444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:19.204547 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0aa952fd-2af9-4832-ac79-7dbcc74acbb4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.153713 Oct 28 10:56:19.205165 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3785/7574] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:19 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:20.227894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:20.228511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:20.235389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:20.235882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:20.236326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:20.237055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:20.237518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:20.237952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:20.372845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:20.381092 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-92d83a9b-31e0-4471-878a-d74ffb32e554 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.157087 Oct 28 10:56:20.381676 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3790/7575] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:20 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:21.405365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:21.405997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:21.412787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:21.413318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:21.413772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:21.414479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:21.414950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:21.415388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:21.551996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:21.560857 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53f0f6fd-0d9f-4644-892b-46545f7fe9c2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1729 microversion: 2.1 time: 0.159671 Oct 28 10:56:21.561474 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3786/7576] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:21 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:22.584281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:22.584812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:22.592306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.592792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.593270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:22.593972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.594425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.594851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:22.731914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:22.740298 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e508ebf5-b78f-42f1-945e-a7bc45d46ab4 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1726 microversion: 2.1 time: 0.160034 Oct 28 10:56:22.740884 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3791/7577] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:22 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:22.764036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:56:22.764628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:22.770803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.771305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.771760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:22.772469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.772958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.773403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:22.809855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.810359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.810813 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:22.811555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.812028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.812534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:22.833772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:56:22.839066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Getting quotas for user a84e8b5b3cc84489aa387be5a69b8670 and project 09f3883c8434405bb79bf4b18afab549. Resources: {'ram', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:56:22.939278 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85a88ee1-508f-446b-857b-cd7a37abd8b9 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "POST /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/action" status: 202 len: 0 microversion: 2.1 time: 0.179863 Oct 28 10:56:22.940297 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3787/7578] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:56:22 2022] POST /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:56:22.949824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:22.950553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:22.956531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.957101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.957512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:22.958219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:22.958689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:22.959118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:23.090738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:23.099150 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85d2a5f0-50d8-4fb3-899f-d486cc160551 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.154333 Oct 28 10:56:23.099738 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3792/7579] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:22 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:24.123506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:24.124256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:24.131665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:24.132166 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:24.132650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:24.133393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:24.133863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:24.134308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:24.276087 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:24.285111 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5a6f265e-8285-4730-9ead-957b8bf30271 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.166537 Oct 28 10:56:24.285692 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3788/7580] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:24 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:25.308201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:25.308864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:25.316088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:25.316607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:25.317075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:25.317887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:25.318214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:25.318647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:25.455897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:25.465040 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-13e5825b-f579-4b9d-a9b2-394417afa3b7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.161302 Oct 28 10:56:25.465775 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3793/7581] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:25 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:26.073886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-3e7d1567-6464-4751-9e28-7fe6a842f1e0 req-7db16cdd-19e9-4466-90e5-cad1c7bc20b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "name": "network-vif-plugged", "status": "completed", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:56:26.084027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3e7d1567-6464-4751-9e28-7fe6a842f1e0 req-7db16cdd-19e9-4466-90e5-cad1c7bc20b9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:26.084582 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3e7d1567-6464-4751-9e28-7fe6a842f1e0 req-7db16cdd-19e9-4466-90e5-cad1c7bc20b9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:26.085270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-3e7d1567-6464-4751-9e28-7fe6a842f1e0 req-7db16cdd-19e9-4466-90e5-cad1c7bc20b9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:26.098411 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-3e7d1567-6464-4751-9e28-7fe6a842f1e0 req-7db16cdd-19e9-4466-90e5-cad1c7bc20b9 service nova] Creating event network-vif-plugged:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h1-zed-1 Oct 28 10:56:26.103974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-3e7d1567-6464-4751-9e28-7fe6a842f1e0 req-7db16cdd-19e9-4466-90e5-cad1c7bc20b9 service nova] Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:56:26.114873 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-3e7d1567-6464-4751-9e28-7fe6a842f1e0 req-7db16cdd-19e9-4466-90e5-cad1c7bc20b9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105103 Oct 28 10:56:26.115491 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3789/7582] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:56:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:56:26.490284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:26.490837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:26.498343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:26.498779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:26.499214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:26.499902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:26.500363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:26.500792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:26.632228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:26.641269 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-94d73303-190c-48ed-a735-a05bb6a9a0c8 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.154944 Oct 28 10:56:26.641857 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3794/7583] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:26 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:27.664936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:27.665660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:27.672274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:27.672803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:27.673297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:27.674092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:27.674563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:27.675103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:27.843924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:27.852492 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9be6a8fb-b720-4595-aa17-0fc12df22594 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.192703 Oct 28 10:56:27.853190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3790/7584] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:27 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:28.129642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-dd8b987b-2f12-4cda-b3f1-479adc9460db req-1bc8cd5f-d64e-40b4-8faa-efb47753c710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "name": "network-vif-unplugged", "status": "completed", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:56:28.140129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dd8b987b-2f12-4cda-b3f1-479adc9460db req-1bc8cd5f-d64e-40b4-8faa-efb47753c710 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:28.140619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dd8b987b-2f12-4cda-b3f1-479adc9460db req-1bc8cd5f-d64e-40b4-8faa-efb47753c710 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:28.141086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-dd8b987b-2f12-4cda-b3f1-479adc9460db req-1bc8cd5f-d64e-40b4-8faa-efb47753c710 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:28.153515 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-dd8b987b-2f12-4cda-b3f1-479adc9460db req-1bc8cd5f-d64e-40b4-8faa-efb47753c710 service nova] Creating event network-vif-unplugged:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h2-zed-1 Oct 28 10:56:28.158796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-dd8b987b-2f12-4cda-b3f1-479adc9460db req-1bc8cd5f-d64e-40b4-8faa-efb47753c710 service nova] Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:56:28.170771 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-dd8b987b-2f12-4cda-b3f1-479adc9460db req-1bc8cd5f-d64e-40b4-8faa-efb47753c710 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044855 Oct 28 10:56:28.171397 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3795/7585] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:56:28.621807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b0bc022f-c292-4d07-a43f-90cd5aceedb5 req-b66d645d-1714-4904-bbd8-2bf4bd6b2cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:56:28.631387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b0bc022f-c292-4d07-a43f-90cd5aceedb5 req-b66d645d-1714-4904-bbd8-2bf4bd6b2cd8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:28.631958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b0bc022f-c292-4d07-a43f-90cd5aceedb5 req-b66d645d-1714-4904-bbd8-2bf4bd6b2cd8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:28.632469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b0bc022f-c292-4d07-a43f-90cd5aceedb5 req-b66d645d-1714-4904-bbd8-2bf4bd6b2cd8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:28.645139 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b0bc022f-c292-4d07-a43f-90cd5aceedb5 req-b66d645d-1714-4904-bbd8-2bf4bd6b2cd8 service nova] Creating event network-changed:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h2-zed-1 Oct 28 10:56:28.650597 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-b0bc022f-c292-4d07-a43f-90cd5aceedb5 req-b66d645d-1714-4904-bbd8-2bf4bd6b2cd8 service nova] Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 10:56:28.661321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b0bc022f-c292-4d07-a43f-90cd5aceedb5 req-b66d645d-1714-4904-bbd8-2bf4bd6b2cd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043766 Oct 28 10:56:28.662091 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3791/7586] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:56:28.878469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:28.879191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:28.886796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:28.887432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:28.888020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:28.888980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:28.889440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:28.890039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:29.030809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:29.039627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63d90857-d816-4cf5-8b2c-c491d337d2cb tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.166121 Oct 28 10:56:29.040229 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3796/7587] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:28 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:30.065565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:30.066278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:30.072795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:30.074005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:30.074466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:30.075175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:30.075639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:30.076079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:30.279575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:30.288049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-665ec056-4459-44ee-b8a6-62809ea0cd2b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.228110 Oct 28 10:56:30.288704 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3792/7588] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:30 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:31.312309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:31.313100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:31.320048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:31.320551 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:31.321284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:31.321985 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:31.322444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:31.323048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:31.459254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:31.467894 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6943a5c-000d-4e06-9156-66318c18579b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.159996 Oct 28 10:56:31.468479 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3797/7589] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:31 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:32.492400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:32.493047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:32.500623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:32.501159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:32.501606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:32.502341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:32.502800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:32.503233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:32.638647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:32.647393 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-962dea3d-2330-4f86-a383-2ed478576601 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.158885 Oct 28 10:56:32.648068 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3793/7590] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:32 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:33.670951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:33.671565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:33.678513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:33.679004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:33.679450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:33.680144 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:33.680606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:33.681070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:33.812720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:33.821451 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3c7d07f3-b873-4b0a-9eb6-1fc0b1196a12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.154684 Oct 28 10:56:33.822031 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3798/7591] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:33 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:34.844872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:34.845519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:34.847505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:34.853673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:34.854177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:34.854624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:34.855327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:34.855795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:34.856231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:34.991324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:35.000581 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-dcf494fa-b8e7-4dee-9ea8-cabfbe15b0e5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.159536 Oct 28 10:56:35.001203 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3794/7592] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:34 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:36.078957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:36.079616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:36.086436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:36.086954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:36.087405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:36.088126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:36.089245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:36.089685 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:36.222748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:36.231103 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-418c9eca-146d-4f90-aa22-a077aadeafdd tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.156063 Oct 28 10:56:36.231693 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3799/7593] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:36 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:37.254883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:37.255662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:37.262953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:37.263483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:37.263938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:37.264636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:37.265140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:37.265605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:37.393271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:37.402149 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-96cc71c5-c4e6-43bc-b094-d702d6042609 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.151170 Oct 28 10:56:37.402721 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3795/7594] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:37 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:38.425295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:38.425905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:38.433362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:38.433849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:38.434288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:38.434972 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:38.435426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:38.435849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:38.564251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:38.573578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3aacfd4d-e42f-43b0-b646-feb58024c485 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.151479 Oct 28 10:56:38.574168 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3800/7595] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:38 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:39.597066 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:39.597699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:39.605205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:39.605734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:39.606184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:39.606892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:39.607363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:39.607799 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:39.623147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:39.743717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:39.752653 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a91c13a9-456a-49a2-a697-661af7f5478a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.159575 Oct 28 10:56:39.753268 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3796/7596] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:39 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:40.775476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:40.776605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:40.783415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:40.783900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:40.784338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:40.785057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:40.785514 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:40.785945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:40.913804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:40.922833 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-10f24ac4-ed8d-4e9e-971f-e8c66b6f1f12 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.151185 Oct 28 10:56:40.923417 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3801/7597] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:40 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:41.946879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:41.947510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:41.954434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:41.954934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:41.955382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:41.956084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:41.956553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:41.957018 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:42.084932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:42.093759 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b34154e8-7c59-4bbe-9c0b-047d97c6081d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1725 microversion: 2.1 time: 0.151060 Oct 28 10:56:42.094338 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3797/7598] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:41 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:43.118992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:43.120180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:43.127506 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.128139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.128602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.129344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.129805 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.130238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.267920 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:43.270292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=92 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:43.277680 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df2a9314-8202-4e5c-b7d3-3731cd948ea5 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1718 microversion: 2.1 time: 0.162845 Oct 28 10:56:43.278279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3802/7599] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:43 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1718 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:43.300590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:43.301269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:43.304014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:43.309873 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.310379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.310837 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.311548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.312022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.312469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.441685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:43.450294 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-59c47e98-3547-40df-ab04-e141090bc79b tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1718 microversion: 2.1 time: 0.153599 Oct 28 10:56:43.450882 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3798/7600] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:43 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:43.472386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:43.472966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:43.474991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=32 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:56:43.480675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.481192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.481643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.482344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.482808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.483244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.620129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:43.628390 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e3489c49-09dd-4f41-abf4-efb6397a580d tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1718 microversion: 2.1 time: 0.159945 Oct 28 10:56:43.629046 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3803/7601] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:43 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1718 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:43.650479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:43.651506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:43.657500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.658005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.658463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.659167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.659640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.660085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.687893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:56:43.762835 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a93e1ebe-c461-428e-a7c9-914de964ddc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 204 len: 0 microversion: 2.1 time: 0.115844 Oct 28 10:56:43.763353 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3799/7602] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:56:43 2022] DELETE /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:56:43.771620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:43.772262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:43.778710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.779194 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.779630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.780318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:43.780772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:43.781220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:43.911442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:43.920299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-945f0e60-bd02-4336-a872-6caa87c30930 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1724 microversion: 2.1 time: 0.152566 Oct 28 10:56:43.920884 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3804/7603] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:43 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:44.946394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:44.947108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:44.954634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:44.955144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:44.956122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:44.956313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:44.956781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:44.957250 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:45.093819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:45.102217 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-488207e2-652c-4ae4-a5b1-aff0cb0323d2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1724 microversion: 2.1 time: 0.161773 Oct 28 10:56:45.102735 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3800/7604] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:44 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:46.127768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:46.128340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:46.134679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:46.135021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:46.136124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:46.137012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:46.137357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:46.137818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:46.276041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:46.285592 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d52aae1d-7269-4154-812e-6dd9d621bd56 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1724 microversion: 2.1 time: 0.162836 Oct 28 10:56:46.286452 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3805/7605] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:46 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:46.503715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-85f7d8e1-9bfa-48de-b7ee-bb9348a8ebbf req-2b163c15-ed7d-486e-8ff7-3c9007d28209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab9edc5-73b5-4bae-bdec-e56f777d075c", "name": "network-vif-deleted", "tag": "263c787e-c8bf-40f6-b1e9-039542dcbd1c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:56:46.517391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-85f7d8e1-9bfa-48de-b7ee-bb9348a8ebbf req-2b163c15-ed7d-486e-8ff7-3c9007d28209 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:46.517934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-85f7d8e1-9bfa-48de-b7ee-bb9348a8ebbf req-2b163c15-ed7d-486e-8ff7-3c9007d28209 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:46.518568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-85f7d8e1-9bfa-48de-b7ee-bb9348a8ebbf req-2b163c15-ed7d-486e-8ff7-3c9007d28209 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:46.532262 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-85f7d8e1-9bfa-48de-b7ee-bb9348a8ebbf req-2b163c15-ed7d-486e-8ff7-3c9007d28209 service nova] Creating event network-vif-deleted:263c787e-c8bf-40f6-b1e9-039542dcbd1c for instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c on n-h2-zed-1 Oct 28 10:56:46.538676 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-85f7d8e1-9bfa-48de-b7ee-bb9348a8ebbf req-2b163c15-ed7d-486e-8ff7-3c9007d28209 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038947 Oct 28 10:56:46.539286 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3801/7606] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:56:47.311565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:47.312195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:47.319815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:47.320320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:47.320770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:47.321784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:47.322253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:47.322695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:47.392548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:47.401979 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f043fb0c-31bd-42e6-a254-ff71a1087bd2 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1370 microversion: 2.1 time: 0.095464 Oct 28 10:56:47.403609 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3806/7607] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:47 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1370 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:48.426103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:48.426721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:48.434407 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:48.434909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:48.435380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:48.436098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:48.436569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:48.437040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:48.503680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:48.512599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e06e4d1d-e14a-443b-bd57-5d63d7d1fd26 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1370 microversion: 2.1 time: 0.090826 Oct 28 10:56:48.513212 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3802/7608] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:48 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:49.535752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:49.536382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:49.557942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:49.558448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:49.558892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:49.559638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:49.560103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:49.560532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:49.628570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:49.636964 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0910219b-04d8-45d4-9018-74b4b5080c05 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1370 microversion: 2.1 time: 0.105158 Oct 28 10:56:49.637533 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3807/7609] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:49 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:50.660625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:50.661339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:50.668483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:50.669210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:50.669677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:50.670391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:50.670860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:50.671302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:50.703836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:50.704360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:50.704808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:50.706481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lazy-loading 'fault' on Instance uuid 4ab9edc5-73b5-4bae-bdec-e56f777d075c {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:56:50.748724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a84e8b5b3cc84489aa387be5a69b8670', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09f3883c8434405bb79bf4b18afab549', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:56:50.756325 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a19d3375-b6bb-4351-b24e-813e3c31fb5c tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 200 len: 1329 microversion: 2.1 time: 0.099640 Oct 28 10:56:50.756889 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3803/7610] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:50 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:56:51.779628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:51.780237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:51.787123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:51.787604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:51.788036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:51.788723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:51.789218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:51.789644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:51.802777 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c HTTP/1.1 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4ab9edc5-73b5-4bae-bdec-e56f777d075c'} Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:51.804399 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74eaaec0-45d2-4984-bad9-490a6c61e82f tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 404 len: 111 microversion: 2.1 time: 0.030661 Oct 28 10:56:51.809043 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3808/7611] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:51 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:51.867109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:51.869366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:51.875874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:51.876363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:51.876808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:51.877530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:51.877991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:51.878425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:51.891523 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-volume_attachments HTTP/1.1 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '4ab9edc5-73b5-4bae-bdec-e56f777d075c'} Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:51.893188 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6bf123fb-5510-4a8c-ae1b-a19acd769c08 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031645 Oct 28 10:56:51.898154 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3804/7612] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:56:51 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.215919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.216492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.223282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.223782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.224230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.224976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.225448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.225887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.240751 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c HTTP/1.1 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '4ab9edc5-73b5-4bae-bdec-e56f777d075c'} Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.242400 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5c547970-70cc-480a-b770-55f6f9e5ed57 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 404 len: 111 microversion: 2.1 time: 0.032692 Oct 28 10:56:55.246730 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3809/7613] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:56:55 2022] DELETE /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.253025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.253680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 4ab9edc5-73b5-4bae-bdec-e56f777d075c] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.261510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.262012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.262460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.263200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.263663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.264096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.279039 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c HTTP/1.1 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '4ab9edc5-73b5-4bae-bdec-e56f777d075c'} Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.280647 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 4ab9edc5-73b5-4bae-bdec-e56f777d075c could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c7ab3b65-0097-4101-aa01-70d6208a4695 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c" status: 404 len: 111 microversion: 2.1 time: 0.033165 Oct 28 10:56:55.284580 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3805/7614] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:55 2022] GET /compute/v2.1/servers/4ab9edc5-73b5-4bae-bdec-e56f777d075c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.291064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.291566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.297847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.298354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.298799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.299496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.299957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.300416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.314514 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 HTTP/1.1 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '97543449-9151-4c5c-a125-64ad59c19111'} Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.316064 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.321378 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7396b5e1-f316-4e70-97fb-aa2d909a1053 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 404 len: 111 microversion: 2.1 time: 0.030450 Oct 28 10:56:55.322861 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3810/7615] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:56:55 2022] DELETE /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.326669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.327300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 97543449-9151-4c5c-a125-64ad59c19111] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.333301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.333794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.334237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.334932 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.335393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.335827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.350368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 HTTP/1.1 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '97543449-9151-4c5c-a125-64ad59c19111'} Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.351978 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 97543449-9151-4c5c-a125-64ad59c19111 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4ddf6f7f-8738-4765-92c5-3a47d754d508 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111" status: 404 len: 111 microversion: 2.1 time: 0.032507 Oct 28 10:56:55.357111 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3806/7616] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:55 2022] GET /compute/v2.1/servers/97543449-9151-4c5c-a125-64ad59c19111 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.364696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.365314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.371482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.372047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.372564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.373368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.373913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.374412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.388659 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 HTTP/1.1 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '59a19385-891b-40e6-bb4a-d50d66420866'} Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.390310 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.394957 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e56c7509-e8f5-47d4-b8b8-dbf2a74ecbc6 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 404 len: 111 microversion: 2.1 time: 0.032382 Oct 28 10:56:55.395887 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3811/7617] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:56:55 2022] DELETE /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.403758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.404419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 59a19385-891b-40e6-bb4a-d50d66420866] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.410345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.410838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.411283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.411978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.412441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.412872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.429063 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 HTTP/1.1 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '59a19385-891b-40e6-bb4a-d50d66420866'} Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.430590 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 59a19385-891b-40e6-bb4a-d50d66420866 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.435378 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f037f6d-60ad-4b71-89cb-dec76fe5009a tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866" status: 404 len: 111 microversion: 2.1 time: 0.032841 Oct 28 10:56:55.436049 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3807/7618] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:55 2022] GET /compute/v2.1/servers/59a19385-891b-40e6-bb4a-d50d66420866 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.441348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.441798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.448639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.449172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.449610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.450304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.450765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.451198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.467629 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 HTTP/1.1 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '6bffc6f9-f624-49ee-8c40-1803e2d0ac68'} Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.469352 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bc1ad0f3-58cb-4edd-90a4-0a048f4a29c7 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 404 len: 111 microversion: 2.1 time: 0.033317 Oct 28 10:56:55.473863 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3812/7619] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:56:55 2022] DELETE /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.479742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.480448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] [instance: 6bffc6f9-f624-49ee-8c40-1803e2d0ac68] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:56:55.486580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.487151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.487677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.488430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:56:55.488989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:56:55.489493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:56:55.503125 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] HTTP exception thrown: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Request method failure captured: Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 HTTP/1.1 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7N7VH_SvcjFaghD0Ha4x1V9V0qpRt97lAeC1JYRvzeMqwgM1CHJf6JZlRRv-APF38zLs45Mekad_RdLFyIioeBf1nOQqGnB5_GOCzPx-MSBWmGhF3JI2N1N7FUaQpsX4kI-LZptUTtzok1buNJIiNMPNlysG4Pl8WCdULsqGUHO3rk Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/09f3883c8434405bb79bf4b18afab549"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_09f3883c8434405bb79bf4b18afab549", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/09f3883c8434405bb79bf4b18afab549"}]}] Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 09f3883c8434405bb79bf4b18afab549 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServerActionsTestJSON-632830226 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: a84e8b5b3cc84489aa387be5a69b8670 Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServerActionsTestJSON-632830226-project Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '6bffc6f9-f624-49ee-8c40-1803e2d0ac68'} Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:56:55.504768 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Returning 404 to user: Instance 6bffc6f9-f624-49ee-8c40-1803e2d0ac68 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ce869a0e-14e7-4259-8612-960f8b17b743 tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68" status: 404 len: 111 microversion: 2.1 time: 0.031697 Oct 28 10:56:55.509634 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3808/7620] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:56:55 2022] GET /compute/v2.1/servers/6bffc6f9-f624-49ee-8c40-1803e2d0ac68 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:56:55.518167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9c7b9708-4a51-4806-9b13-84fc7d20d10e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] Calling method '.version_select at 0x7fca3b9a39d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:56:55.541689 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9c7b9708-4a51-4806-9b13-84fc7d20d10e tempest-ServerActionsTestJSON-632830226 tempest-ServerActionsTestJSON-632830226-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449957640" status: 202 len: 0 microversion: 2.1 time: 0.027484 Oct 28 10:56:55.542271 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3813/7621] 10.222.0.16 () {58 vars in 1221 bytes} [Fri Oct 28 10:56:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1449957640 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:57:04.632536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-13270035", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "4a87f76f-55f3-415c-8fcd-ff5f54425346"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:04.692736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] validate_networks() for [('4a87f76f-55f3-415c-8fcd-ff5f54425346', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:57:05.142794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:57:05.143237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:57:05.143795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:57:05.144225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:57:05.144680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:57:05.153971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:05.154479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:05.154942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:05.155749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:05.156232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:05.156678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:05.175253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Getting quotas for project d2e93db79a4c47e2af4be2f269c21c7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:57:05.180628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Getting quotas for user 521e21daa5d34a06ac28c7e09ddbeaf8 and project d2e93db79a4c47e2af4be2f269c21c7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:57:05.193659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:57:05.196252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:57:05.238473 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [d1df3681-c805-43c0-98f8-5fe994109871] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 10:57:06.247646 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [d1df3681-c805-43c0-98f8-5fe994109871] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 35954. Oct 28 10:57:06.252205 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4416166e-7e6e-4763-a3c4-e1471f5e8d13 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.768263 Oct 28 10:57:06.252856 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3809/7622] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:57:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 10:57:06.263319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=41 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:06.264637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:06.269655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0f9feb5b-a5ba-4537-a02b-911c66da3058 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:06.270296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0f9feb5b-a5ba-4537-a02b-911c66da3058 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:06.345803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0f9feb5b-a5ba-4537-a02b-911c66da3058 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:06.354227 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0f9feb5b-a5ba-4537-a02b-911c66da3058 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1215 microversion: 2.1 time: 0.093681 Oct 28 10:57:06.355309 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3814/7623] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:06 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:07.378554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:07.379930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:07.387167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:07.387908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:07.388467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:07.389331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:07.389904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:07.390579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:07.471714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:07.481818 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a8a0ccc1-3b74-49e4-9b47-96c3c49e7161 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1267 microversion: 2.1 time: 0.108314 Oct 28 10:57:07.483254 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3810/7624] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:07 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:08.507493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:08.508381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:08.516109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:08.516602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:08.517079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:08.517830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:08.519275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:08.520507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:08.669038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:08.676970 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-afc9ba2b-e733-419f-a75f-133e7d5d721c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1315 microversion: 2.1 time: 0.173499 Oct 28 10:57:08.677876 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3815/7625] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:08 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:09.281126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d5421a24-8a19-432a-adcc-1d74ad2fb704 req-7e477469-25a0-409a-9f71-1237a2b48349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a757a111-164f-4745-8acb-15724c5cdb54", "tag": "a637f5a7-550b-4c9d-9d9f-07b5606261a5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:09.293705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5421a24-8a19-432a-adcc-1d74ad2fb704 req-7e477469-25a0-409a-9f71-1237a2b48349 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:09.294193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5421a24-8a19-432a-adcc-1d74ad2fb704 req-7e477469-25a0-409a-9f71-1237a2b48349 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:09.294632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d5421a24-8a19-432a-adcc-1d74ad2fb704 req-7e477469-25a0-409a-9f71-1237a2b48349 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:09.305930 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d5421a24-8a19-432a-adcc-1d74ad2fb704 req-7e477469-25a0-409a-9f71-1237a2b48349 service nova] Creating event network-changed:a637f5a7-550b-4c9d-9d9f-07b5606261a5 for instance a757a111-164f-4745-8acb-15724c5cdb54 on n-h1-zed-1 Oct 28 10:57:09.312429 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d5421a24-8a19-432a-adcc-1d74ad2fb704 req-7e477469-25a0-409a-9f71-1237a2b48349 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041687 Oct 28 10:57:09.313064 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3811/7626] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:57:09.700081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:09.700845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:09.707763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:09.708261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:09.708710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:09.709477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:09.709943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:09.710381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:09.843393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:09.851303 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fcf7f345-f9f6-447b-bd21-7c19573a0f48 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1315 microversion: 2.1 time: 0.155483 Oct 28 10:57:09.851917 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3816/7627] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:09 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:10.876750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:10.877503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:10.884052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:10.884739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:10.885216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:10.885946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:10.886595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:10.887195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:10.892512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:11.080388 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:11.088232 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d754eda-e284-46e7-b139-da93707c2cec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1315 microversion: 2.1 time: 0.217280 Oct 28 10:57:11.089578 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3812/7628] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:10 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:12.111589 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:12.112202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:12.120168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:12.120657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:12.121116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:12.122345 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:12.122803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:12.123226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:12.253510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:12.261773 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50515ae3-5e58-4c02-96cd-f6b59f9e4c62 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1315 microversion: 2.1 time: 0.154038 Oct 28 10:57:12.262341 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3817/7629] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:12 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:13.283554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:13.284171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:13.290945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:13.291437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:13.292386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:13.293120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:13.293609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:13.294042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:13.425058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:13.433414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5e55f4de-9a13-4d93-afbd-22209936e251 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1315 microversion: 2.1 time: 0.153736 Oct 28 10:57:13.433982 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3813/7630] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:13 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:14.048652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-17c5db23-caf7-4c6b-a2a0-4c61f3fb49ee req-6ac006b1-f4fc-485a-9d2f-77b5e966f65a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a757a111-164f-4745-8acb-15724c5cdb54", "name": "network-vif-plugged", "status": "completed", "tag": "a637f5a7-550b-4c9d-9d9f-07b5606261a5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:14.059150 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-17c5db23-caf7-4c6b-a2a0-4c61f3fb49ee req-6ac006b1-f4fc-485a-9d2f-77b5e966f65a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:14.059640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-17c5db23-caf7-4c6b-a2a0-4c61f3fb49ee req-6ac006b1-f4fc-485a-9d2f-77b5e966f65a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:14.060081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-17c5db23-caf7-4c6b-a2a0-4c61f3fb49ee req-6ac006b1-f4fc-485a-9d2f-77b5e966f65a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:14.071658 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-17c5db23-caf7-4c6b-a2a0-4c61f3fb49ee req-6ac006b1-f4fc-485a-9d2f-77b5e966f65a service nova] Creating event network-vif-plugged:a637f5a7-550b-4c9d-9d9f-07b5606261a5 for instance a757a111-164f-4745-8acb-15724c5cdb54 on n-h1-zed-1 Oct 28 10:57:14.077349 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-17c5db23-caf7-4c6b-a2a0-4c61f3fb49ee req-6ac006b1-f4fc-485a-9d2f-77b5e966f65a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032496 Oct 28 10:57:14.077982 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3818/7631] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:57:14.456228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:14.456898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:14.459629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:14.465035 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:14.465558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:14.466324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:14.467302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:14.467894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:14.468360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:14.605994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:14.613899 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6fa99bd8-0255-43c1-b9b8-5018543b9e9c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1315 microversion: 2.1 time: 0.161643 Oct 28 10:57:14.614483 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3814/7632] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:14 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:15.638406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:15.639109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:15.645546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:15.646045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:15.646524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:15.647222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:15.647689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:15.648124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:16.040397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:16.048692 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a2f311b-8a7e-4ef9-8cd6-06bf0f906b26 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1505 microversion: 2.1 time: 0.415422 Oct 28 10:57:16.049297 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3819/7633] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:15 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1505 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:16.109863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1817820832", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "4a87f76f-55f3-415c-8fcd-ff5f54425346"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:16.118133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:16.118805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:16.164353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] validate_networks() for [('4a87f76f-55f3-415c-8fcd-ff5f54425346', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:57:16.530998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:57:16.531440 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:57:16.531953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:57:16.532361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:57:16.532826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:57:16.542307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:16.542805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:16.543260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:16.544009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:16.544479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:16.544944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:16.562000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Getting quotas for project d2e93db79a4c47e2af4be2f269c21c7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:57:16.567255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Getting quotas for user 521e21daa5d34a06ac28c7e09ddbeaf8 and project d2e93db79a4c47e2af4be2f269c21c7e. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:57:16.579795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:57:16.582161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:57:16.628707 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f85922e4-437a-44fc-ad38-610142e778eb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522597 Oct 28 10:57:16.629383 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3815/7634] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:57:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:57:16.640574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80d65f6f-6ff9-4f8e-acca-4eda96e09fd7 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:16.641472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-80d65f6f-6ff9-4f8e-acca-4eda96e09fd7 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:16.643624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:16.698935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-80d65f6f-6ff9-4f8e-acca-4eda96e09fd7 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:16.706855 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80d65f6f-6ff9-4f8e-acca-4eda96e09fd7 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1217 microversion: 2.1 time: 0.070230 Oct 28 10:57:16.707569 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3820/7635] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:16 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1217 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:17.730624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:17.731944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:17.739019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:17.739921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:17.740563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:17.741652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:17.742099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:17.742969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:17.831367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:17.841550 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5fbb0109-2a5c-4324-b24b-7093430a8339 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1277 microversion: 2.1 time: 0.115761 Oct 28 10:57:17.847618 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3816/7636] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:17 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1277 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:18.865089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:18.865757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:18.873302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:18.873834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:18.874281 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:18.875016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:18.875477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:18.875914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:19.018147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:19.026175 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3e89ca14-fe4c-45e1-958a-e887395901ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1317 microversion: 2.1 time: 0.165264 Oct 28 10:57:19.026997 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3821/7637] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:18 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:19.205945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-f8e729be-55b5-4867-af4f-90a0894e730a req-9efcbb9c-d13a-46bc-9d0c-6a2a703bfe07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06f3bc05-b3be-4346-8995-ca39c0486055", "tag": "6d4ecd3b-1194-4d46-8bbd-73482370d280"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:19.216149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f8e729be-55b5-4867-af4f-90a0894e730a req-9efcbb9c-d13a-46bc-9d0c-6a2a703bfe07 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:19.216642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f8e729be-55b5-4867-af4f-90a0894e730a req-9efcbb9c-d13a-46bc-9d0c-6a2a703bfe07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:19.217120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-f8e729be-55b5-4867-af4f-90a0894e730a req-9efcbb9c-d13a-46bc-9d0c-6a2a703bfe07 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:19.231588 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-f8e729be-55b5-4867-af4f-90a0894e730a req-9efcbb9c-d13a-46bc-9d0c-6a2a703bfe07 service nova] Creating event network-changed:6d4ecd3b-1194-4d46-8bbd-73482370d280 for instance 06f3bc05-b3be-4346-8995-ca39c0486055 on n-h2-zed-1 Oct 28 10:57:19.237086 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-f8e729be-55b5-4867-af4f-90a0894e730a req-9efcbb9c-d13a-46bc-9d0c-6a2a703bfe07 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034844 Oct 28 10:57:19.237857 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3817/7638] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:57:20.049981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:20.050587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:20.057296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:20.057781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:20.058218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:20.058902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:20.059355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:20.059784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:20.187988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:20.195657 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-566910b5-a4f2-4b00-b2a8-4f654255ca5d tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1317 microversion: 2.1 time: 0.149520 Oct 28 10:57:20.196489 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3822/7639] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:20 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:21.218722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:21.219445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:21.226536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:21.227043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:21.227497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:21.228206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:21.228681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:21.229193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:21.361343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:21.369113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9677931d-740c-4868-9db1-be40a3cbb16b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1317 microversion: 2.1 time: 0.154620 Oct 28 10:57:21.370194 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3818/7640] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:21 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:22.392354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:22.393002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:22.399872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:22.400369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:22.401459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:22.402165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:22.402632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:22.403070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:22.534355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:22.541986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55cbf196-3aed-4ed7-9791-3facf7c4ad06 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1317 microversion: 2.1 time: 0.153599 Oct 28 10:57:22.542547 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3823/7641] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:22 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:23.564686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:23.565269 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:23.572015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:23.572518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:23.573596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:23.574403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:23.574926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:23.575439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:23.710423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:23.718408 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-edaef95a-1748-4426-af3d-2cf23f4c0db6 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1317 microversion: 2.1 time: 0.157762 Oct 28 10:57:23.718973 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3819/7642] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:23 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:24.742112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:24.742765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:24.748808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:24.749402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:24.749849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:24.750546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:24.751007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:24.751441 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:24.896876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:24.908874 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5f020d66-f1ce-4e0a-85f6-667ac44ac105 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1317 microversion: 2.1 time: 0.170799 Oct 28 10:57:24.910026 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3824/7643] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:24 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:25.004969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-2b10fc8c-eb59-47ee-8364-9a2d19ae40a5 req-1b7cbedb-4f54-4f0d-8945-b76a22e4d7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f3bc05-b3be-4346-8995-ca39c0486055", "name": "network-vif-plugged", "status": "completed", "tag": "6d4ecd3b-1194-4d46-8bbd-73482370d280"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:25.017698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2b10fc8c-eb59-47ee-8364-9a2d19ae40a5 req-1b7cbedb-4f54-4f0d-8945-b76a22e4d7fb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:25.018194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2b10fc8c-eb59-47ee-8364-9a2d19ae40a5 req-1b7cbedb-4f54-4f0d-8945-b76a22e4d7fb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:25.018635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-2b10fc8c-eb59-47ee-8364-9a2d19ae40a5 req-1b7cbedb-4f54-4f0d-8945-b76a22e4d7fb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:25.030743 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-2b10fc8c-eb59-47ee-8364-9a2d19ae40a5 req-1b7cbedb-4f54-4f0d-8945-b76a22e4d7fb service nova] Creating event network-vif-plugged:6d4ecd3b-1194-4d46-8bbd-73482370d280 for instance 06f3bc05-b3be-4346-8995-ca39c0486055 on n-h2-zed-1 Oct 28 10:57:25.035704 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-2b10fc8c-eb59-47ee-8364-9a2d19ae40a5 req-1b7cbedb-4f54-4f0d-8945-b76a22e4d7fb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034435 Oct 28 10:57:25.036301 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3820/7644] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:57:25.931848 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:25.932480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:25.939346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:25.939831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:25.940274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:25.940984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:25.941446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:25.941877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:26.074498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:26.082209 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ffbc7fb5-e6a9-448a-a8e4-4114a0285ca8 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1317 microversion: 2.1 time: 0.154237 Oct 28 10:57:26.082790 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3825/7645] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:25 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:27.107215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:27.108515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:27.115760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:27.117117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:27.128433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:27.129359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:27.130097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:27.130820 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:27.131297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:27.131734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:27.267991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:27.276414 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14ab9082-f456-46ec-bd99-1682c1eed9bf tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1506 microversion: 2.1 time: 0.172600 Oct 28 10:57:27.277012 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3821/7646] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:27 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:27.299318 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:27.299858 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:27.301727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:27.308028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:27.308522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:27.308998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:27.309699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:27.310168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:27.310606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:27.336505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:57:27.421494 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2458d36-793e-427a-ad50-3e7c796bd09b tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 204 len: 0 microversion: 2.1 time: 0.125710 Oct 28 10:57:27.424833 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3826/7647] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:57:27 2022] DELETE /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:57:27.430686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:27.431349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:27.437547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:27.438046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:27.438495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:27.439205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:27.439673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:27.440115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:27.567308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:27.575797 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a5feb8d4-d79b-4804-b577-b5e2f21509ce tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1512 microversion: 2.1 time: 0.149096 Oct 28 10:57:27.576380 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3822/7648] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:27 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:28.599364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:28.600071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:28.607590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:28.608081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:28.608524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:28.609245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:28.609704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:28.610136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:28.747769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:28.755620 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c3aef503-70a2-41d7-915e-b7b382555ad3 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1512 microversion: 2.1 time: 0.160467 Oct 28 10:57:28.759008 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3827/7649] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:28 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:29.457333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d0bff15f-2f3b-418b-b12f-0d0e88131a91 req-72c69719-d592-4861-b7f1-19e19a1128ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06f3bc05-b3be-4346-8995-ca39c0486055", "name": "network-vif-deleted", "tag": "6d4ecd3b-1194-4d46-8bbd-73482370d280"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:29.472623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d0bff15f-2f3b-418b-b12f-0d0e88131a91 req-72c69719-d592-4861-b7f1-19e19a1128ce service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:29.473071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d0bff15f-2f3b-418b-b12f-0d0e88131a91 req-72c69719-d592-4861-b7f1-19e19a1128ce service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:29.473523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d0bff15f-2f3b-418b-b12f-0d0e88131a91 req-72c69719-d592-4861-b7f1-19e19a1128ce service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:29.495267 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d0bff15f-2f3b-418b-b12f-0d0e88131a91 req-72c69719-d592-4861-b7f1-19e19a1128ce service nova] Creating event network-vif-deleted:6d4ecd3b-1194-4d46-8bbd-73482370d280 for instance 06f3bc05-b3be-4346-8995-ca39c0486055 on n-h2-zed-1 Oct 28 10:57:29.500786 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d0bff15f-2f3b-418b-b12f-0d0e88131a91 req-72c69719-d592-4861-b7f1-19e19a1128ce service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050791 Oct 28 10:57:29.504541 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3823/7650] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:57:29.778573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:29.779118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:29.785980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:29.786465 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:29.786904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:29.787594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:29.788051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:29.788481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:29.820060 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:29.820544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:29.821019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:29.821720 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lazy-loading 'fault' on Instance uuid 06f3bc05-b3be-4346-8995-ca39c0486055 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:57:29.861508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:29.869232 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c2c65cd8-f98f-4fe9-934c-7eaac0d42c5a tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 200 len: 1307 microversion: 2.1 time: 0.094606 Oct 28 10:57:29.870405 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3828/7651] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:29 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:30.894109 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:30.894751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:30.900945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:30.901449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:30.901901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:30.902610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:30.903079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:30.903521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:30.916801 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] HTTP exception thrown: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Request method failure captured: Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 HTTP/1.1 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7WAm5MwTt89HN_r8nNt7pntNwaFWJJi8KECE3r-Lq8Lj76TMOryJiWK9zojX6kR7sh0iFeL1JFayHSKR196N8kirC8MFG-Z4UtBP_ZY4dqwyMVoQexz-pEZb5iDiIJ09U3zhQlHyvpJ2TzKWrmKPE8sW6fMRd303cYgRVbuxgg7HXc Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d2e93db79a4c47e2af4be2f269c21c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d2e93db79a4c47e2af4be2f269c21c7e"}]}] Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 521e21daa5d34a06ac28c7e09ddbeaf8 Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '06f3bc05-b3be-4346-8995-ca39c0486055'} Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:30.918418 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Returning 404 to user: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c064445a-b8d9-4bdc-b82f-6b7b2ffea4e5 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 404 len: 111 microversion: 2.1 time: 0.030955 Oct 28 10:57:30.923821 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3824/7652] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:30 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:57:30.928757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:30.929411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:30.937164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:30.937656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:30.938102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:30.938801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:30.939263 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:30.939700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.066996 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:31.075518 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-edbece62-dfb0-4eda-9e54-46bc626dffe1 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1505 microversion: 2.1 time: 0.150604 Oct 28 10:57:31.076092 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3829/7653] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:30 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:31.097531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b7f47bf-80a5-4d93-bf44-6b157e7cbafb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:31.099763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b7f47bf-80a5-4d93-bf44-6b157e7cbafb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 4374e5ca-77f9-409d-9836-feab79131993] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:31.105610 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-7b7f47bf-80a5-4d93-bf44-6b157e7cbafb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] HTTP exception thrown: Instance 4374e5ca-77f9-409d-9836-feab79131993 could not be found. Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b7f47bf-80a5-4d93-bf44-6b157e7cbafb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Request method failure captured: Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/4374e5ca-77f9-409d-9836-feab79131993/action HTTP/1.1 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 32 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7WAm5MwTt89HN_r8nNt7pntNwaFWJJi8KECE3r-Lq8Lj76TMOryJiWK9zojX6kR7sh0iFeL1JFayHSKR196N8kirC8MFG-Z4UtBP_ZY4dqwyMVoQexz-pEZb5iDiIJ09U3zhQlHyvpJ2TzKWrmKPE8sW6fMRd303cYgRVbuxgg7HXc Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d2e93db79a4c47e2af4be2f269c21c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d2e93db79a4c47e2af4be2f269c21c7e"}]}] Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 521e21daa5d34a06ac28c7e09ddbeaf8 Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: {"resize": {"flavorRef": "452"}} Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 4374e5ca-77f9-409d-9836-feab79131993 could not be found. Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '4374e5ca-77f9-409d-9836-feab79131993', 'body': {'resize': {'flavorRef': '452'}}} Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4374e5ca-77f9-409d-9836-feab79131993 could not be found. Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:57:31.107160 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4374e5ca-77f9-409d-9836-feab79131993 could not be found. Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4374e5ca-77f9-409d-9836-feab79131993 could not be found. Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b7f47bf-80a5-4d93-bf44-6b157e7cbafb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Returning 404 to user: Instance 4374e5ca-77f9-409d-9836-feab79131993 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b7f47bf-80a5-4d93-bf44-6b157e7cbafb tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "POST /compute/v2.1/servers/4374e5ca-77f9-409d-9836-feab79131993/action" status: 404 len: 111 microversion: 2.1 time: 0.014934 Oct 28 10:57:31.112227 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3825/7654] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:57:31 2022] POST /compute/v2.1/servers/4374e5ca-77f9-409d-9836-feab79131993/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:57:31.116852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:31.117493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:31.124052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.124571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.125072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.125776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.126244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.126680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.256829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:31.264754 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fb17b91e-e68e-49b9-adfd-2642910649dd tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1505 microversion: 2.1 time: 0.151670 Oct 28 10:57:31.265403 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3830/7655] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:31 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:31.287248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:31.287867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:31.295227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.295720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.296169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.296864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.297395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.297834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.427785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:31.436231 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4a218257-90e3-4595-b8d0-4dde6e9c4297 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1505 microversion: 2.1 time: 0.152746 Oct 28 10:57:31.436804 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3826/7656] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:31 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:31.458862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "eaad2935-7c73-4509-a048-52baae60fadb"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:31.461052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:31.466970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.467451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.467884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.468565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.469049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.469476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.473663 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:31.501007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:31.506157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] HTTP exception thrown: Flavor eaad2935-7c73-4509-a048-52baae60fadb could not be found. Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Request method failure captured: Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: request: POST /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54/action HTTP/1.1 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 65 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7WAm5MwTt89HN_r8nNt7pntNwaFWJJi8KECE3r-Lq8Lj76TMOryJiWK9zojX6kR7sh0iFeL1JFayHSKR196N8kirC8MFG-Z4UtBP_ZY4dqwyMVoQexz-pEZb5iDiIJ09U3zhQlHyvpJ2TzKWrmKPE8sW6fMRd303cYgRVbuxgg7HXc Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d2e93db79a4c47e2af4be2f269c21c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d2e93db79a4c47e2af4be2f269c21c7e"}]}] Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 521e21daa5d34a06ac28c7e09ddbeaf8 Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: {"resize": {"flavorRef": "eaad2935-7c73-4509-a048-52baae60fadb"}} Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: exception: Flavor eaad2935-7c73-4509-a048-52baae60fadb could not be found. Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a757a111-164f-4745-8acb-15724c5cdb54', 'body': {'resize': {'flavorRef': 'eaad2935-7c73-4509-a048-52baae60fadb'}}} Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:31.515446 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor eaad2935-7c73-4509-a048-52baae60fadb could not be found. Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor eaad2935-7c73-4509-a048-52baae60fadb could not be found. Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor eaad2935-7c73-4509-a048-52baae60fadb could not be found. Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Returning 400 to user: Flavor eaad2935-7c73-4509-a048-52baae60fadb could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a623dcc-169f-49de-8b84-f539b0936a3c tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "POST /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54/action" status: 400 len: 107 microversion: 2.1 time: 0.062044 Oct 28 10:57:31.520339 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3831/7657] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:57:31 2022] POST /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54/action => generated 107 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:57:31.525751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:31.526380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:31.532265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.532762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.533310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.534014 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.534483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.534922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.675073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:31.682819 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2e59cad-e3f0-4085-9d7d-f74772bf79ec tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1505 microversion: 2.1 time: 0.160976 Oct 28 10:57:31.683396 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3827/7658] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:31 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:31.705907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:31.706530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:31.712609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.713584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.714034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.714765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.715223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.715657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.843802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:31.851604 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-40c11dee-45b6-41c0-9aac-275756bf0d9e tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1505 microversion: 2.1 time: 0.149657 Oct 28 10:57:31.852180 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3832/7659] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:31 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:31.875053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b7985bf-eed7-446f-bf5c-71b3889b7a0f tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b7985bf-eed7-446f-bf5c-71b3889b7a0f tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Request method failure captured: Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: request: POST /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54/action HTTP/1.1 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 29 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7WAm5MwTt89HN_r8nNt7pntNwaFWJJi8KECE3r-Lq8Lj76TMOryJiWK9zojX6kR7sh0iFeL1JFayHSKR196N8kirC8MFG-Z4UtBP_ZY4dqwyMVoQexz-pEZb5iDiIJ09U3zhQlHyvpJ2TzKWrmKPE8sW6fMRd303cYgRVbuxgg7HXc Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d2e93db79a4c47e2af4be2f269c21c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d2e93db79a4c47e2af4be2f269c21c7e"}]}] Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 521e21daa5d34a06ac28c7e09ddbeaf8 Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: {"resize": {"flavorRef": ""}} Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'a757a111-164f-4745-8acb-15724c5cdb54', 'body': {'resize': {'flavorRef': ''}}} Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise error Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi '' Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.878669 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b7985bf-eed7-446f-bf5c-71b3889b7a0f tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b7985bf-eed7-446f-bf5c-71b3889b7a0f tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "POST /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54/action" status: 400 len: 113 microversion: 2.1 time: 0.009470 Oct 28 10:57:31.883955 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3828/7660] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 10:57:31 2022] POST /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 28 10:57:31.888671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:31.889319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:31.895347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.895841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.896288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:31.897009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:31.897474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:31.897910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.035119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:32.042951 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0deccfe2-82d0-4ebc-9e2d-542c8803cd02 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1505 microversion: 2.1 time: 0.158051 Oct 28 10:57:32.043528 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3833/7661] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:31 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:32.068967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:32.069524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:32.077212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.077709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.078154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.078849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.079310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.079746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.093471 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] HTTP exception thrown: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Request method failure captured: Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 HTTP/1.1 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7WAm5MwTt89HN_r8nNt7pntNwaFWJJi8KECE3r-Lq8Lj76TMOryJiWK9zojX6kR7sh0iFeL1JFayHSKR196N8kirC8MFG-Z4UtBP_ZY4dqwyMVoQexz-pEZb5iDiIJ09U3zhQlHyvpJ2TzKWrmKPE8sW6fMRd303cYgRVbuxgg7HXc Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d2e93db79a4c47e2af4be2f269c21c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d2e93db79a4c47e2af4be2f269c21c7e"}]}] Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 521e21daa5d34a06ac28c7e09ddbeaf8 Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '06f3bc05-b3be-4346-8995-ca39c0486055'} Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:57:32.095021 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Returning 404 to user: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5b9af377-7418-4bd3-a64f-ed65b59d3124 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "DELETE /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 404 len: 111 microversion: 2.1 time: 0.032122 Oct 28 10:57:32.099358 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3829/7662] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:57:32 2022] DELETE /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:57:32.104732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:32.105366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: 06f3bc05-b3be-4346-8995-ca39c0486055] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:32.111324 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.111806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.112259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.112963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.113392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.113815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.127243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] HTTP exception thrown: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Request method failure captured: Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 HTTP/1.1 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7WAm5MwTt89HN_r8nNt7pntNwaFWJJi8KECE3r-Lq8Lj76TMOryJiWK9zojX6kR7sh0iFeL1JFayHSKR196N8kirC8MFG-Z4UtBP_ZY4dqwyMVoQexz-pEZb5iDiIJ09U3zhQlHyvpJ2TzKWrmKPE8sW6fMRd303cYgRVbuxgg7HXc Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d2e93db79a4c47e2af4be2f269c21c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d2e93db79a4c47e2af4be2f269c21c7e"}]}] Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 521e21daa5d34a06ac28c7e09ddbeaf8 Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '06f3bc05-b3be-4346-8995-ca39c0486055'} Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:32.128725 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Returning 404 to user: Instance 06f3bc05-b3be-4346-8995-ca39c0486055 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a2ab455d-299f-4a0b-8eff-b022d949ddda tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055" status: 404 len: 111 microversion: 2.1 time: 0.029160 Oct 28 10:57:32.133814 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3834/7663] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:32 2022] GET /compute/v2.1/servers/06f3bc05-b3be-4346-8995-ca39c0486055 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:57:32.138745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:32.139253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:32.145163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.145656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.146098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.146788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.147248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.147679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.173102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:57:32.247156 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b48e27a-691d-47f2-b827-d129854b9310 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 204 len: 0 microversion: 2.1 time: 0.112123 Oct 28 10:57:32.247816 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3830/7664] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:57:32 2022] DELETE /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:57:32.257241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:32.257855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:32.264244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.264731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.265207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.265895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:32.266354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:32.266791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:32.394535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:32.402362 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bfbece51-8fe4-4f1a-bfc4-2cb328a9f376 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1511 microversion: 2.1 time: 0.149889 Oct 28 10:57:32.402934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3835/7665] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:32 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:33.425622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:33.426368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:33.433240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:33.433740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:33.434191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:33.434900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:33.435368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:33.435808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:33.569890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:33.578667 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aa82a4ed-6b8a-4076-848d-b0b80adbe250 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1511 microversion: 2.1 time: 0.157402 Oct 28 10:57:33.579235 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3831/7666] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:33 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:34.161279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-68be943d-57d2-4da9-8337-1ab53af916f6 req-e70e5fb3-fc1e-4551-8295-3c6c966a364e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a757a111-164f-4745-8acb-15724c5cdb54", "name": "network-vif-deleted", "tag": "a637f5a7-550b-4c9d-9d9f-07b5606261a5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:57:34.172143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-68be943d-57d2-4da9-8337-1ab53af916f6 req-e70e5fb3-fc1e-4551-8295-3c6c966a364e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:34.172739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-68be943d-57d2-4da9-8337-1ab53af916f6 req-e70e5fb3-fc1e-4551-8295-3c6c966a364e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:34.173351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-68be943d-57d2-4da9-8337-1ab53af916f6 req-e70e5fb3-fc1e-4551-8295-3c6c966a364e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:34.186337 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-68be943d-57d2-4da9-8337-1ab53af916f6 req-e70e5fb3-fc1e-4551-8295-3c6c966a364e service nova] Creating event network-vif-deleted:a637f5a7-550b-4c9d-9d9f-07b5606261a5 for instance a757a111-164f-4745-8acb-15724c5cdb54 on n-h1-zed-1 Oct 28 10:57:34.191698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-68be943d-57d2-4da9-8337-1ab53af916f6 req-e70e5fb3-fc1e-4551-8295-3c6c966a364e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034225 Oct 28 10:57:34.192341 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3836/7667] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:57:34.601897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:34.602533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:34.610543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:34.611273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:34.611731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:34.612449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:34.612941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:34.613389 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:34.651273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:34.651781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:34.652236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:34.652703 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lazy-loading 'fault' on Instance uuid a757a111-164f-4745-8acb-15724c5cdb54 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:57:34.697169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '521e21daa5d34a06ac28c7e09ddbeaf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2e93db79a4c47e2af4be2f269c21c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:57:34.699851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:57:34.707927 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06bd8ef5-ccaa-4e48-b100-12b2b3880452 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 200 len: 1305 microversion: 2.1 time: 0.109747 Oct 28 10:57:34.708838 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3832/7668] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:34 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:57:35.733180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:57:35.733892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] [instance: a757a111-164f-4745-8acb-15724c5cdb54] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:57:35.740089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:35.740578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:35.741053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:35.741752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:57:35.742212 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:57:35.742649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:57:35.755991 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] HTTP exception thrown: Instance a757a111-164f-4745-8acb-15724c5cdb54 could not be found. Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Request method failure captured: Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 HTTP/1.1 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7WAm5MwTt89HN_r8nNt7pntNwaFWJJi8KECE3r-Lq8Lj76TMOryJiWK9zojX6kR7sh0iFeL1JFayHSKR196N8kirC8MFG-Z4UtBP_ZY4dqwyMVoQexz-pEZb5iDiIJ09U3zhQlHyvpJ2TzKWrmKPE8sW6fMRd303cYgRVbuxgg7HXc Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d2e93db79a4c47e2af4be2f269c21c7e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d2e93db79a4c47e2af4be2f269c21c7e", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d2e93db79a4c47e2af4be2f269c21c7e"}]}] Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: d2e93db79a4c47e2af4be2f269c21c7e Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-ServersNegativeTestJSON-566386782 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 521e21daa5d34a06ac28c7e09ddbeaf8 Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-ServersNegativeTestJSON-566386782-project Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance a757a111-164f-4745-8acb-15724c5cdb54 could not be found. Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'a757a111-164f-4745-8acb-15724c5cdb54'} Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a757a111-164f-4745-8acb-15724c5cdb54 could not be found. Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a757a111-164f-4745-8acb-15724c5cdb54 could not be found. Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:57:35.757620 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a757a111-164f-4745-8acb-15724c5cdb54 could not be found. Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] Returning 404 to user: Instance a757a111-164f-4745-8acb-15724c5cdb54 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9da712ea-14ab-4a58-86fa-5f37f5bfade0 tempest-ServersNegativeTestJSON-566386782 tempest-ServersNegativeTestJSON-566386782-project] 10.222.0.16 "GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54" status: 404 len: 111 microversion: 2.1 time: 0.031030 Oct 28 10:57:35.763089 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3837/7669] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:57:35 2022] GET /compute/v2.1/servers/a757a111-164f-4745-8acb-15724c5cdb54 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:58:06.365268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:06.541364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4b99b051-0933-4257-81a5-8461db22a42e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: .version_select at 0x7fca32748dc0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-2106165978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo8X3MeCLVflencCJt8nz6Q8KpRd/AfCEI8eMwI5ckYU1q8bYMhZUr4+5qbeTOsoPFaw/klGPMcXdGXC+eLUzmdF9Zkm0+pK9PXw/nG7iUJ7WhEV2n9nNF0kFILodzSfw=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:06.558801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4b99b051-0933-4257-81a5-8461db22a42e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for project 7d38e856f240411a9e040be046e4bbae. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:58:06.564382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-4b99b051-0933-4257-81a5-8461db22a42e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for user c7c3887f21264885b5e50be86d97e5cb and project 7d38e856f240411a9e040be046e4bbae. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:58:06.600206 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4b99b051-0933-4257-81a5-8461db22a42e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.240845 Oct 28 10:58:06.600990 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3833/7670] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:58:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:06.655109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1971516809", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-2106165978", "networks": [{"uuid": "3c1a6a5a-5d92-491a-b06f-e75b6843e1ba"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:06.677798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:06.679285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=26 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:06.720770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] validate_networks() for [('3c1a6a5a-5d92-491a-b06f-e75b6843e1ba', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:58:07.177406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:58:07.177833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:58:07.178312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:58:07.178721 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:58:07.179207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:58:07.188505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:07.189098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:07.189541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:07.190270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:07.190728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:07.191158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:07.209280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for project 7d38e856f240411a9e040be046e4bbae. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:58:07.216806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for user c7c3887f21264885b5e50be86d97e5cb and project 7d38e856f240411a9e040be046e4bbae. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:58:07.229939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:58:07.232814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:58:07.283111 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-adb63f75-802a-43ec-b0bf-19da0713bc8b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634054 Oct 28 10:58:07.283768 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3838/7671] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:58:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:58:07.295132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9c205fe-5e1f-41a5-82d7-45b7f256cccd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:07.295963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a9c205fe-5e1f-41a5-82d7-45b7f256cccd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:07.351736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9c205fe-5e1f-41a5-82d7-45b7f256cccd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:07.358922 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a9c205fe-5e1f-41a5-82d7-45b7f256cccd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1263 microversion: 2.1 time: 0.067964 Oct 28 10:58:07.359495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3834/7672] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:07 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:08.384515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:08.385361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:08.395230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:08.396093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:08.396785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:08.397900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:08.398691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:08.399249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:08.481945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:08.491035 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e7212bab-2c24-4201-8cf3-8b7bd2256041 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1323 microversion: 2.1 time: 0.112434 Oct 28 10:58:08.495371 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3839/7673] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:08 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1323 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:09.517961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:09.518654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:09.529072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:09.529910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:09.530732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:09.531514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:09.532043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:09.532443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:09.764394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:09.772431 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3ecca1c8-6fc9-4d57-83b5-e45a4e1603dc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.258781 Oct 28 10:58:09.773238 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3835/7674] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:09 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:10.134746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-2f3d9e1d-14bd-400d-8e9a-29c2478219d6 req-632c5fb2-a674-433e-94b9-b3574c980cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ced28c84-aa80-4577-abfe-0885fdfad5a9", "tag": "217303e3-f106-4d3a-a53e-86ec3f60c38b"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:10.147609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2f3d9e1d-14bd-400d-8e9a-29c2478219d6 req-632c5fb2-a674-433e-94b9-b3574c980cad service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:10.148592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2f3d9e1d-14bd-400d-8e9a-29c2478219d6 req-632c5fb2-a674-433e-94b9-b3574c980cad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:10.150006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-2f3d9e1d-14bd-400d-8e9a-29c2478219d6 req-632c5fb2-a674-433e-94b9-b3574c980cad service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:10.162474 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-2f3d9e1d-14bd-400d-8e9a-29c2478219d6 req-632c5fb2-a674-433e-94b9-b3574c980cad service nova] Creating event network-changed:217303e3-f106-4d3a-a53e-86ec3f60c38b for instance ced28c84-aa80-4577-abfe-0885fdfad5a9 on n-h2-zed-1 Oct 28 10:58:10.167736 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-2f3d9e1d-14bd-400d-8e9a-29c2478219d6 req-632c5fb2-a674-433e-94b9-b3574c980cad service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038053 Oct 28 10:58:10.168492 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3840/7675] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:10.796358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:10.797530 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:10.804254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:10.804750 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:10.805233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:10.805958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:10.806423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:10.806861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:10.940156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:10.949199 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7444810d-f71b-4f84-8234-fe1da815c6d7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.156673 Oct 28 10:58:10.949774 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3836/7676] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:10 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:11.972456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:11.973596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:11.981174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:11.981658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:11.982126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:11.982819 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:11.983279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:11.983705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:12.117379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:12.125307 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d0e47a31-1fbc-4ece-b2c6-73cf304bbded tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.156952 Oct 28 10:58:12.125891 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3841/7677] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:11 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:13.147660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:13.148292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:13.155691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:13.156191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:13.156647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:13.157390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:13.157875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:13.158308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:13.285376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:13.293130 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-63fa84e2-05c3-4091-93cd-495b96766517 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.149369 Oct 28 10:58:13.293702 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3837/7678] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:13 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:14.316058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:14.316688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:14.324171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:14.324833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:14.325299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:14.325998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:14.326455 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:14.326921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:14.466020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:14.473771 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7181bd0-9cba-4933-9637-96451ae26e83 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.161590 Oct 28 10:58:14.474354 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3842/7679] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:14 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:15.497210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:15.497844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:15.505042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:15.505552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:15.506043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:15.506760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:15.507236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:15.507684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:15.638152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:15.645856 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-51aa5892-8f15-4594-a174-66936fcf556d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.152592 Oct 28 10:58:15.646436 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3838/7680] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:15 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:16.669443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:16.670063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:16.677143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:16.677630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:16.678386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:16.679091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:16.679549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:16.679978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:16.810320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:16.818011 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb04ced5-8fb1-4625-882c-04987f32372b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.153084 Oct 28 10:58:16.818591 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3843/7681] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:16 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:17.188429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-30c60bd2-f940-4bb8-8bb3-64e4b7920399 req-30fbc4c2-e575-4b3c-bc0d-6c6c16c5d38f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced28c84-aa80-4577-abfe-0885fdfad5a9", "name": "network-vif-plugged", "status": "completed", "tag": "217303e3-f106-4d3a-a53e-86ec3f60c38b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:17.200573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30c60bd2-f940-4bb8-8bb3-64e4b7920399 req-30fbc4c2-e575-4b3c-bc0d-6c6c16c5d38f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:17.201205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30c60bd2-f940-4bb8-8bb3-64e4b7920399 req-30fbc4c2-e575-4b3c-bc0d-6c6c16c5d38f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:17.201728 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-30c60bd2-f940-4bb8-8bb3-64e4b7920399 req-30fbc4c2-e575-4b3c-bc0d-6c6c16c5d38f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:17.213884 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-30c60bd2-f940-4bb8-8bb3-64e4b7920399 req-30fbc4c2-e575-4b3c-bc0d-6c6c16c5d38f service nova] Creating event network-vif-plugged:217303e3-f106-4d3a-a53e-86ec3f60c38b for instance ced28c84-aa80-4577-abfe-0885fdfad5a9 on n-h2-zed-1 Oct 28 10:58:17.218896 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-30c60bd2-f940-4bb8-8bb3-64e4b7920399 req-30fbc4c2-e575-4b3c-bc0d-6c6c16c5d38f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034384 Oct 28 10:58:17.219494 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3839/7682] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:17.841438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:17.842058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:17.844059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:17.844750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:17.851438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:17.851930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:17.852375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:17.853615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:17.854077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:17.854509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:17.983287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:17.990886 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-39ea20bd-719d-46f6-a8d1-7d13bd056446 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1363 microversion: 2.1 time: 0.153478 Oct 28 10:58:17.991456 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3844/7683] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:17 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:19.012133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:19.017361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:19.018084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:19.024655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:19.025187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:19.025644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:19.026353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:19.026826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:19.027272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:19.158928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:19.166752 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c45a98f8-2c8f-4a28-b67a-6b3acaacb631 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1554 microversion: 2.1 time: 0.155603 Oct 28 10:58:19.167349 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3840/7684] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:19 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:19.189152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:19.189768 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:19.197133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:19.197615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:19.198051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:19.198734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:19.199186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:19.199611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:19.330800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:19.338517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a4aac0b8-2a2c-4dd1-b9e8-dc1d6dc151de tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1554 microversion: 2.1 time: 0.153204 Oct 28 10:58:19.339114 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3845/7685] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:19 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:21.001321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e61323c0-de8d-4950-9665-de0bf38f5ef7"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:21.003645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:21.010498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:21.011002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:21.011457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:21.012193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:21.012664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:21.013133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:21.275147 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e4e5b31c-8ae8-422c-a7f1-417ed68f9987 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276877 Oct 28 10:58:21.275796 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3841/7686] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:58:20 2022] POST /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:31.982286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:31.982798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:31.985288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:31.985959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:31.991761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:31.992254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:31.992703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:31.994079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:31.994543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:31.994973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:32.075755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lazy-loading 'services' on Instance uuid ced28c84-aa80-4577-abfe-0885fdfad5a9 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:58:32.146642 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-22710592-2a53-4d29-9ca6-fe0d5bc7f289 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments/e61323c0-de8d-4950-9665-de0bf38f5ef7" status: 202 len: 0 microversion: 2.1 time: 0.168110 Oct 28 10:58:32.147271 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3846/7687] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:58:31 2022] DELETE /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments/e61323c0-de8d-4950-9665-de0bf38f5ef7 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:58:32.156119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:32.158506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:32.161309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:32.162022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:32.169013 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:32.169522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:32.169981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:32.170700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:32.171171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:32.171617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:32.203431 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-093ff3cc-e931-4d12-919a-c4810a658775 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051624 Oct 28 10:58:32.204010 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3842/7688] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:58:32 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:33.217174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:33.219602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:33.226370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:33.226867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:33.227316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:33.228031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:33.228495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:33.228945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:33.260167 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f2ec9e80-5f14-4f9d-aa0d-5646d4c3f3a6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048225 Oct 28 10:58:33.260749 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3847/7689] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:58:33 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:34.273398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:34.275668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:34.283458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:34.283965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:34.284426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:34.285186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:34.285665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:34.286111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:34.318311 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-92a635c3-0794-4163-8b9b-f79518f19060 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048965 Oct 28 10:58:34.319142 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3843/7690] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:58:34 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:35.331107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:35.333303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:35.340713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:35.341172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:35.341617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:35.342607 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:35.342802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:35.343322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:35.377134 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7b6e61cf-58e7-4551-affe-789937820c64 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050069 Oct 28 10:58:35.377708 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3848/7691] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:58:35 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:36.390783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:36.393007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:36.399944 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:36.400445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:36.400897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:36.401663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:36.402128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:36.402567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:36.432710 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5794c85a-bf1d-4f2f-a0b3-685ab0925331 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046435 Oct 28 10:58:36.433848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3844/7692] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:58:36 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:58:37.445408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:37.447888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:37.454693 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:37.455176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:37.455616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:37.456310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:37.456766 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:37.457220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:37.486666 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b97f405c-9f6b-4a7f-8158-d16a2b894b63 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045329 Oct 28 10:58:37.487226 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3849/7693] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:58:37 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:58:37.498385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:37.498902 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:37.505647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:37.506146 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:37.506618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:37.507303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:37.507773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:37.508213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:37.701020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] HTTP exception thrown: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 is not attached to volume e61323c0-de8d-4950-9665-de0bf38f5ef7 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Request method failure captured: Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments/e61323c0-de8d-4950-9665-de0bf38f5ef7 HTTP/1.1 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7W5A7LCoxPs9irkuF1-jK4xbRoijcn1BKmQDnvPWy7GS90ZM-IeLzmOD3s-8qMP2fXhfEgleoTo-bnb8zs6vb_LAnEUAOXuzKrd9uhuVXyrhBhQAoMexLaR9mjghy2f6Jm_aZXb4aNOOQCi0MfTHd9oysDshL982ULZ4tTKsG0Xc6I Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d38e856f240411a9e040be046e4bbae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d38e856f240411a9e040be046e4bbae"}]}] Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c7c3887f21264885b5e50be86d97e5cb Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 is not attached to volume e61323c0-de8d-4950-9665-de0bf38f5ef7 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': 'ced28c84-aa80-4577-abfe-0885fdfad5a9', 'id': 'e61323c0-de8d-4950-9665-de0bf38f5ef7'} Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e61323c0-de8d-4950-9665-de0bf38f5ef7. Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 is not attached to volume e61323c0-de8d-4950-9665-de0bf38f5ef7 Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:58:37.714877 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:58:37.720028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:58:37.720028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:58:37.720028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 is not attached to volume e61323c0-de8d-4950-9665-de0bf38f5ef7 Oct 28 10:58:37.720028 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:37.720028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Returning 404 to user: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 is not attached to volume e61323c0-de8d-4950-9665-de0bf38f5ef7 {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:58:37.720028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c9d3432-9baa-4b60-8def-87c94bd95af3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments/e61323c0-de8d-4950-9665-de0bf38f5ef7" status: 404 len: 154 microversion: 2.1 time: 0.222601 Oct 28 10:58:37.720028 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3845/7694] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:58:37 2022] DELETE /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9/os-volume_attachments/e61323c0-de8d-4950-9665-de0bf38f5ef7 => generated 154 bytes in 224 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:58:41.061899 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:41.062509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:41.069869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:41.070476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:41.070993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:41.072050 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:41.072541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:41.073003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:41.100043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:58:41.176708 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-327da61b-8511-4ae8-a07f-f3db6a5f48f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 204 len: 0 microversion: 2.1 time: 0.118760 Oct 28 10:58:41.180036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3850/7695] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:58:41 2022] DELETE /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:58:41.186230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:41.187460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:41.195088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:41.195503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:41.196133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:41.197232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:41.197696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:41.198128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:41.334420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:41.343051 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1aeb212-476d-4e55-ab34-5ed7a3f49b7b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1560 microversion: 2.1 time: 0.161479 Oct 28 10:58:41.343771 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3846/7696] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:41 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:42.367231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:42.367934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:42.375367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:42.375854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:42.376295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:42.377015 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:42.377477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:42.377908 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:42.604002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:42.612249 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f6122060-8e1b-4c56-a745-f194a36ceac5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1560 microversion: 2.1 time: 0.249278 Oct 28 10:58:42.612827 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3851/7697] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:42 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1560 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:43.485376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-065fc97f-238a-4215-a457-edb9c91a4099 req-704eda78-cc65-4230-bf61-7890c7d69189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ced28c84-aa80-4577-abfe-0885fdfad5a9", "name": "network-vif-deleted", "tag": "217303e3-f106-4d3a-a53e-86ec3f60c38b"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:43.497614 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-065fc97f-238a-4215-a457-edb9c91a4099 req-704eda78-cc65-4230-bf61-7890c7d69189 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:43.498817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-065fc97f-238a-4215-a457-edb9c91a4099 req-704eda78-cc65-4230-bf61-7890c7d69189 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:43.499707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-065fc97f-238a-4215-a457-edb9c91a4099 req-704eda78-cc65-4230-bf61-7890c7d69189 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:43.518467 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-065fc97f-238a-4215-a457-edb9c91a4099 req-704eda78-cc65-4230-bf61-7890c7d69189 service nova] Creating event network-vif-deleted:217303e3-f106-4d3a-a53e-86ec3f60c38b for instance ced28c84-aa80-4577-abfe-0885fdfad5a9 on n-h2-zed-1 Oct 28 10:58:43.525511 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-065fc97f-238a-4215-a457-edb9c91a4099 req-704eda78-cc65-4230-bf61-7890c7d69189 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043799 Oct 28 10:58:43.526269 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3847/7698] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:43.638052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:43.638959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:43.646018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:43.646512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:43.646956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:43.647667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:43.648130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:43.648571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:43.681443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:43.681871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:43.682319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:43.683304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lazy-loading 'fault' on Instance uuid ced28c84-aa80-4577-abfe-0885fdfad5a9 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:58:43.724629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:43.733533 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5e2c8db8-a769-4cd9-a56e-988600a3205a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 200 len: 1353 microversion: 2.1 time: 0.101099 Oct 28 10:58:43.734151 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3852/7699] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:43 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 1353 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:44.758534 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:44.759242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ced28c84-aa80-4577-abfe-0885fdfad5a9] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:44.766169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:44.766663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:44.767114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:44.767817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:44.768287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:44.768721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:44.782661 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] HTTP exception thrown: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 could not be found. Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Request method failure captured: Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 HTTP/1.1 Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7W5A7LCoxPs9irkuF1-jK4xbRoijcn1BKmQDnvPWy7GS90ZM-IeLzmOD3s-8qMP2fXhfEgleoTo-bnb8zs6vb_LAnEUAOXuzKrd9uhuVXyrhBhQAoMexLaR9mjghy2f6Jm_aZXb4aNOOQCi0MfTHd9oysDshL982ULZ4tTKsG0Xc6I Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d38e856f240411a9e040be046e4bbae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d38e856f240411a9e040be046e4bbae"}]}] Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c7c3887f21264885b5e50be86d97e5cb Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 could not be found. Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ced28c84-aa80-4577-abfe-0885fdfad5a9'} Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 could not be found. Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 could not be found. Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:44.784296 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 could not be found. Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Returning 404 to user: Instance ced28c84-aa80-4577-abfe-0885fdfad5a9 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6367e4f2-cda9-44ac-9c44-5fe49450414f tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9" status: 404 len: 111 microversion: 2.1 time: 0.032403 Oct 28 10:58:44.788766 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3848/7700] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:44 2022] GET /compute/v2.1/servers/ced28c84-aa80-4577-abfe-0885fdfad5a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:58:44.794350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-88fac798-ec0c-4c66-a151-e57e3b633406 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '.version_select at 0x7fca3232b700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:44.817843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-88fac798-ec0c-4c66-a151-e57e3b633406 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2106165978" status: 202 len: 0 microversion: 2.1 time: 0.027198 Oct 28 10:58:44.818653 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3853/7701] 10.222.0.16 () {58 vars in 1278 bytes} [Fri Oct 28 10:58:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-2106165978 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:58:44.838033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e55834b2-c2ce-4f7b-bf77-e43dc4b71a27 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: .version_select at 0x7fca3204f160>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-212145995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3mOiS3SWMjO25nILgJ2P9hLXP9V4INH6AZbuiEudJFIlPE93Je5TTEW6m/mcjjzBvY9a44PkGCy/yyApeYs6ecq6ja+Uu+AkEMc6sOkGvMhoy3pt/tF1VVubZfXHdjeQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:44.854189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e55834b2-c2ce-4f7b-bf77-e43dc4b71a27 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for project 7d38e856f240411a9e040be046e4bbae. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:58:44.859282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e55834b2-c2ce-4f7b-bf77-e43dc4b71a27 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for user c7c3887f21264885b5e50be86d97e5cb and project 7d38e856f240411a9e040be046e4bbae. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:58:44.883810 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e55834b2-c2ce-4f7b-bf77-e43dc4b71a27 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.049724 Oct 28 10:58:44.884396 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3849/7702] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:58:44 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:58:44.934781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-909309850", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-212145995", "networks": [{"uuid": "3c1a6a5a-5d92-491a-b06f-e75b6843e1ba"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:44.991351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] validate_networks() for [('3c1a6a5a-5d92-491a-b06f-e75b6843e1ba', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:58:45.362103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:58:45.362541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:58:45.363025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:58:45.363439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:58:45.363861 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:58:45.373316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:45.373801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:45.374244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:45.374978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:45.375466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:45.375904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:45.397742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for project 7d38e856f240411a9e040be046e4bbae. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:58:45.402987 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for user c7c3887f21264885b5e50be86d97e5cb and project 7d38e856f240411a9e040be046e4bbae. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:58:45.415156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:58:45.418039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:58:45.463497 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fc9d9119-15c9-43cc-9231-d0ca1366a54d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.532531 Oct 28 10:58:45.464203 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3854/7703] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:58:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:58:45.475659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-11675650-5c4e-4f01-b545-5f45b176ca02 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:45.476285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-11675650-5c4e-4f01-b545-5f45b176ca02 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:45.533478 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-11675650-5c4e-4f01-b545-5f45b176ca02 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:45.541818 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-11675650-5c4e-4f01-b545-5f45b176ca02 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1261 microversion: 2.1 time: 0.069978 Oct 28 10:58:45.542710 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3850/7704] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:45 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1261 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:46.566239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:46.566879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:46.573279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:46.573779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:46.574223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:46.574930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:46.575970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:46.576406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:46.640620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:46.648429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-89d5b431-2b47-433e-af96-ffb3b1be7a13 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1331 microversion: 2.1 time: 0.086916 Oct 28 10:58:46.649040 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3855/7705] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:46 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1331 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:47.672342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:47.673006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:47.680571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:47.681249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:47.681768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:47.682508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:47.682977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:47.683419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:47.923015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:47.931325 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de389eeb-7122-4837-ac69-4d406b9ffe72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.262943 Oct 28 10:58:47.931912 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3851/7706] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:47 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:48.254315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-de5b9229-7636-4f04-aab1-017c8aea6f63 req-611ce74e-84d4-4a43-8c2e-5d2cfd5247e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae46f2d0-0083-4fd6-988f-b6da2908f9a8", "tag": "80e66472-34b3-49b5-bef6-4d69a1a02c23"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:48.265386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de5b9229-7636-4f04-aab1-017c8aea6f63 req-611ce74e-84d4-4a43-8c2e-5d2cfd5247e1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:48.265869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de5b9229-7636-4f04-aab1-017c8aea6f63 req-611ce74e-84d4-4a43-8c2e-5d2cfd5247e1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:48.266307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-de5b9229-7636-4f04-aab1-017c8aea6f63 req-611ce74e-84d4-4a43-8c2e-5d2cfd5247e1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:48.277753 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-de5b9229-7636-4f04-aab1-017c8aea6f63 req-611ce74e-84d4-4a43-8c2e-5d2cfd5247e1 service nova] Creating event network-changed:80e66472-34b3-49b5-bef6-4d69a1a02c23 for instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 on n-h2-zed-1 Oct 28 10:58:48.282707 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-de5b9229-7636-4f04-aab1-017c8aea6f63 req-611ce74e-84d4-4a43-8c2e-5d2cfd5247e1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096328 Oct 28 10:58:48.283317 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3856/7707] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:48.955357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:48.955971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:48.962808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:48.963298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:48.963741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:48.964434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:48.964897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:48.965359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:49.094161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:49.101873 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eb7b5f06-b9d2-4b78-b940-efa4d757d89b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.150364 Oct 28 10:58:49.102441 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3852/7708] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:48 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:50.126955 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:50.127658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:50.134089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:50.134575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:50.135011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:50.135732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:50.136183 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:50.136605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:50.264970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:50.272578 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b1066cf0-6681-41cc-bf63-e5f74e6e12b7 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.151336 Oct 28 10:58:50.273170 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3857/7709] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:50 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:51.295963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:51.296585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:51.304002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:51.304497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:51.304970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:51.305671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:51.306134 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:51.306573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:51.434153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:51.442458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16195f4b-95e3-4f2e-b929-2a045aee42cd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.150967 Oct 28 10:58:51.443026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3853/7710] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:51 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:52.464230 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:52.464852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:52.472837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:52.473347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:52.473793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:52.474488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:52.474950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:52.475383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:52.608367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:52.616160 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb718781-f757-430e-933d-f943887cd165 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.155791 Oct 28 10:58:52.616744 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3858/7711] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:52 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:53.640029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:53.640656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:53.647019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:53.647505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:53.647955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:53.648658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:53.649153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:53.649592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:53.782054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:53.789748 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9c967d4e-dde1-4153-aa9b-22df865fe5f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.154282 Oct 28 10:58:53.790316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3854/7712] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:53 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:54.814134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:54.814754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:54.820783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:54.821319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:54.822031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:54.822729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:54.823192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:54.823631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:54.955786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:54.963442 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2404f604-1f50-4b1b-86f1-75e35ae7fce5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.154094 Oct 28 10:58:54.964028 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3859/7713] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:54 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:55.404036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c844b5f7-b0ad-444f-abdf-bdf371474dfd req-66269d92-9226-4e81-9564-16838a57657f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae46f2d0-0083-4fd6-988f-b6da2908f9a8", "name": "network-vif-plugged", "status": "completed", "tag": "80e66472-34b3-49b5-bef6-4d69a1a02c23"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:55.414565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c844b5f7-b0ad-444f-abdf-bdf371474dfd req-66269d92-9226-4e81-9564-16838a57657f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:55.415070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c844b5f7-b0ad-444f-abdf-bdf371474dfd req-66269d92-9226-4e81-9564-16838a57657f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:55.415595 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c844b5f7-b0ad-444f-abdf-bdf371474dfd req-66269d92-9226-4e81-9564-16838a57657f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:55.430926 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c844b5f7-b0ad-444f-abdf-bdf371474dfd req-66269d92-9226-4e81-9564-16838a57657f service nova] Creating event network-vif-plugged:80e66472-34b3-49b5-bef6-4d69a1a02c23 for instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 on n-h2-zed-1 Oct 28 10:58:55.436465 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c844b5f7-b0ad-444f-abdf-bdf371474dfd req-66269d92-9226-4e81-9564-16838a57657f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036882 Oct 28 10:58:55.437113 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3855/7714] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:58:55.987568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:55.988178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:55.990182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:55.990968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:55.998248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:55.998732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:55.999170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:55.999856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:56.000310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:56.000733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:56.128892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:56.136662 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e5ef015f-af0d-4542-9bf3-8ef9753a2bea tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1361 microversion: 2.1 time: 0.153013 Oct 28 10:58:56.137261 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3860/7715] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:55 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:57.156470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:58:57.161471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:57.162183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:57.168663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:57.169219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:57.169682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:57.170398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:57.170871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:57.171310 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:57.303179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:57.311405 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f05ed3d5-0885-4f26-b6ba-c67877fff79a tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1553 microversion: 2.1 time: 0.155878 Oct 28 10:58:57.311981 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3856/7716] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:57 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:57.334262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:58:57.334912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:57.342074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:57.342566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:57.343012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:57.343714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:57.344181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:57.344615 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:57.479875 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:58:57.488216 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-683dd2c8-8ea0-4aa6-b5fd-94233ab4ef72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1553 microversion: 2.1 time: 0.157939 Oct 28 10:58:57.488809 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3861/7717] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:58:57 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:58:58.984760 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfb16486-694a-483e-ad2d-f683fc141202"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:58:58.987164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:58:58.994619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:58.995117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:58.995562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:58.996253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:58:58.996714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:58:58.997177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:58:59.260620 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7924bee-42d4-487d-8c83-c19fd47fabad tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280044 Oct 28 10:58:59.261309 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3857/7718] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:58:58 2022] POST /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:09.983228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:09.983810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:09.986633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:09.987469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:09.993853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:09.994394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:09.994942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:09.995665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:09.996127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:09.997106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:10.081185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lazy-loading 'services' on Instance uuid ae46f2d0-0083-4fd6-988f-b6da2908f9a8 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:59:10.150332 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f9d825e3-9773-4966-a59c-e47f7e377b67 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments/cfb16486-694a-483e-ad2d-f683fc141202" status: 202 len: 0 microversion: 2.1 time: 0.170984 Oct 28 10:59:10.151385 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3862/7719] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:59:09 2022] DELETE /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments/cfb16486-694a-483e-ad2d-f683fc141202 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:59:10.157907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:10.158709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:10.163001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:10.165372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:10.173901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:10.174386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:10.174849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:10.175560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:10.176031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:10.176476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:10.208709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-aabba5fd-2167-46a2-8a65-e7a67e13d8b8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052640 Oct 28 10:59:10.209291 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3858/7720] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:10 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:11.222584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:11.225033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:11.233086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:11.233579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:11.234030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:11.234738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:11.235198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:11.236210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:11.266971 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0bd4fb9e-6c97-47ff-809c-8e1f86456bfb tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048700 Oct 28 10:59:11.267546 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3863/7721] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:11 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:12.279322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:12.281587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:12.289258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:12.289924 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:12.290227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:12.290950 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:12.291429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:12.291870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:12.325857 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-af79a464-9ce3-48d5-851d-12a8d575c2ae tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049788 Oct 28 10:59:12.326479 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3859/7722] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:12 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:59:13.338483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:13.340792 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:13.347775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:13.348266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:13.348709 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:13.349427 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:13.349895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:13.350325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:13.381359 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30c7074e-694f-45ea-b27e-dc4a66960b72 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046960 Oct 28 10:59:13.382121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3864/7723] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:13 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:14.393860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:14.396167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:14.403645 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:14.404344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:14.404803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:14.405552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:14.406025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:14.406469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:14.436750 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1ee7db00-62dd-46dd-9a3e-1d740f795e6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046836 Oct 28 10:59:14.437352 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3860/7724] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:14 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:15.449367 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:15.452288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:15.459151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:15.459637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:15.460085 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:15.460799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:15.461269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:15.461695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:15.490848 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e87a2477-0de0-4ab9-a7e9-6f5ec22c1437 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045765 Oct 28 10:59:15.491407 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3865/7725] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:15 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:59:15.502953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:15.503435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:15.510210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:15.510697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:15.511138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:15.511828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:15.512313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:15.512746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:15.591345 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] HTTP exception thrown: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 is not attached to volume cfb16486-694a-483e-ad2d-f683fc141202 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Request method failure captured: Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments/cfb16486-694a-483e-ad2d-f683fc141202 HTTP/1.1 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7W5A7LCoxPs9irkuF1-jK4xbRoijcn1BKmQDnvPWy7GS90ZM-IeLzmOD3s-8qMP2fXhfEgleoTo-bnb8zs6vb_LAnEUAOXuzKrd9uhuVXyrhBhQAoMexLaR9mjghy2f6Jm_aZXb4aNOOQCi0MfTHd9oysDshL982ULZ4tTKsG0Xc6I Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d38e856f240411a9e040be046e4bbae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d38e856f240411a9e040be046e4bbae"}]}] Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c7c3887f21264885b5e50be86d97e5cb Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 is not attached to volume cfb16486-694a-483e-ad2d-f683fc141202 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': 'ae46f2d0-0083-4fd6-988f-b6da2908f9a8', 'id': 'cfb16486-694a-483e-ad2d-f683fc141202'} Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cfb16486-694a-483e-ad2d-f683fc141202. Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 is not attached to volume cfb16486-694a-483e-ad2d-f683fc141202 Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:15.593084 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:15.597401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:59:15.597401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:59:15.597401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 is not attached to volume cfb16486-694a-483e-ad2d-f683fc141202 Oct 28 10:59:15.597401 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:15.597401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Returning 404 to user: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 is not attached to volume cfb16486-694a-483e-ad2d-f683fc141202 {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:59:15.597401 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a38561ba-7a76-461b-bbfa-892af98e74e9 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments/cfb16486-694a-483e-ad2d-f683fc141202" status: 404 len: 154 microversion: 2.1 time: 0.095645 Oct 28 10:59:15.597401 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3861/7726] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:59:15 2022] DELETE /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8/os-volume_attachments/cfb16486-694a-483e-ad2d-f683fc141202 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:59:18.986702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:18.987257 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:18.994095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:18.994579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:18.995021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:18.995724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:18.996713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:18.997149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:19.022910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:59:19.102764 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b199fcd9-d6f8-45dc-995d-9b200a914553 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 204 len: 0 microversion: 2.1 time: 0.119710 Oct 28 10:59:19.107946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3866/7727] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:59:18 2022] DELETE /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:59:19.112294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:19.113507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:19.120517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:19.121040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:19.122059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:19.122766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:19.123235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:19.123671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:19.253812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:19.261729 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d742ca61-4c53-413b-9277-635bd8bdd1d3 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1559 microversion: 2.1 time: 0.153271 Oct 28 10:59:19.262802 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3862/7728] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:19 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:59:20.286657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:20.287393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:20.294351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:20.294851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:20.295301 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:20.296001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:20.296463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:20.296921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:20.429696 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:20.437392 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d35159ae-1775-4826-a315-aed4570e00d1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1559 microversion: 2.1 time: 0.155071 Oct 28 10:59:20.437975 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3867/7729] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:20 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:21.411506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-5180819e-7838-4d2f-88f5-59582c7570ae req-1fa89e2d-dc94-4274-8abb-c4dec2983f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae46f2d0-0083-4fd6-988f-b6da2908f9a8", "name": "network-vif-deleted", "tag": "80e66472-34b3-49b5-bef6-4d69a1a02c23"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:59:21.423719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5180819e-7838-4d2f-88f5-59582c7570ae req-1fa89e2d-dc94-4274-8abb-c4dec2983f72 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:21.424352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5180819e-7838-4d2f-88f5-59582c7570ae req-1fa89e2d-dc94-4274-8abb-c4dec2983f72 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:21.425100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-5180819e-7838-4d2f-88f5-59582c7570ae req-1fa89e2d-dc94-4274-8abb-c4dec2983f72 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:21.441817 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-5180819e-7838-4d2f-88f5-59582c7570ae req-1fa89e2d-dc94-4274-8abb-c4dec2983f72 service nova] Creating event network-vif-deleted:80e66472-34b3-49b5-bef6-4d69a1a02c23 for instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 on n-h2-zed-1 Oct 28 10:59:21.447447 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-5180819e-7838-4d2f-88f5-59582c7570ae req-1fa89e2d-dc94-4274-8abb-c4dec2983f72 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039868 Oct 28 10:59:21.448057 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3863/7730] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:21.460595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:21.461266 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:21.469003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:21.469499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:21.469935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:21.470637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:21.471090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:21.471515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:21.542119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:21.550718 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-77889c2a-dfe2-42bb-8787-6522fd663c53 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 200 len: 1346 microversion: 2.1 time: 0.093784 Oct 28 10:59:21.551233 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3868/7731] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:21 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:22.576444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:22.577193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: ae46f2d0-0083-4fd6-988f-b6da2908f9a8] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:22.583651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:22.584152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:22.584608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:22.585373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:22.585840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:22.586281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:22.600015 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] HTTP exception thrown: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 could not be found. Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Request method failure captured: Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 HTTP/1.1 Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7W5A7LCoxPs9irkuF1-jK4xbRoijcn1BKmQDnvPWy7GS90ZM-IeLzmOD3s-8qMP2fXhfEgleoTo-bnb8zs6vb_LAnEUAOXuzKrd9uhuVXyrhBhQAoMexLaR9mjghy2f6Jm_aZXb4aNOOQCi0MfTHd9oysDshL982ULZ4tTKsG0Xc6I Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d38e856f240411a9e040be046e4bbae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d38e856f240411a9e040be046e4bbae"}]}] Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c7c3887f21264885b5e50be86d97e5cb Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 could not be found. Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'ae46f2d0-0083-4fd6-988f-b6da2908f9a8'} Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 could not be found. Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 could not be found. Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:22.601616 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 could not be found. Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Returning 404 to user: Instance ae46f2d0-0083-4fd6-988f-b6da2908f9a8 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4fdbf9c5-3708-430b-8c80-9638be0d95f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8" status: 404 len: 111 microversion: 2.1 time: 0.032616 Oct 28 10:59:22.606536 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3864/7732] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:22 2022] GET /compute/v2.1/servers/ae46f2d0-0083-4fd6-988f-b6da2908f9a8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:59:22.612591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0d2786f6-74ac-4257-862c-7a2096ccbc6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '.version_select at 0x7fca326039d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:22.632727 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0d2786f6-74ac-4257-862c-7a2096ccbc6d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-212145995" status: 202 len: 0 microversion: 2.1 time: 0.024028 Oct 28 10:59:22.633340 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3869/7733] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-212145995 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:59:22.651137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-113c8a44-8545-4d03-bbe4-bcf4ef17cc8d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: .version_select at 0x7fca320389d0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-583802503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO9KuDEAex6CqbPaqgeiY3BMgmjjr8AbnLWbRYAqIhMquSobdsFI3XVwMoL4UrnTaJhfk5f9PXcuD5+/mt6LixjK60aIfxjKZrAeIn8KykSEcl3yi4byH3VD6xaTsR5wFg=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:59:22.666293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-113c8a44-8545-4d03-bbe4-bcf4ef17cc8d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for project 7d38e856f240411a9e040be046e4bbae. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:59:22.671397 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-113c8a44-8545-4d03-bbe4-bcf4ef17cc8d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for user c7c3887f21264885b5e50be86d97e5cb and project 7d38e856f240411a9e040be046e4bbae. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:59:22.695570 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-113c8a44-8545-4d03-bbe4-bcf4ef17cc8d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.048212 Oct 28 10:59:22.696188 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3865/7734] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 10:59:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:22.745677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-976754885", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-583802503", "networks": [{"uuid": "3c1a6a5a-5d92-491a-b06f-e75b6843e1ba"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:59:22.798827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] validate_networks() for [('3c1a6a5a-5d92-491a-b06f-e75b6843e1ba', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 10:59:23.175397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 10:59:23.175832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 10:59:23.176342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 10:59:23.176759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 10:59:23.177209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 10:59:23.186160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:23.186654 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:23.187098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:23.187830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:23.188294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:23.188728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:23.206671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for project 7d38e856f240411a9e040be046e4bbae. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 10:59:23.211907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Getting quotas for user c7c3887f21264885b5e50be86d97e5cb and project 7d38e856f240411a9e040be046e4bbae. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 10:59:23.224782 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 10:59:23.227121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 10:59:23.273457 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b803d67f-58d4-4fc4-8a30-9e13b25472f4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531579 Oct 28 10:59:23.274290 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3870/7735] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 10:59:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 10:59:23.285772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cfbdb713-42db-4753-a1fd-76043d13c293 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:23.286435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cfbdb713-42db-4753-a1fd-76043d13c293 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:23.344858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cfbdb713-42db-4753-a1fd-76043d13c293 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:23.353541 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cfbdb713-42db-4753-a1fd-76043d13c293 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1261 microversion: 2.1 time: 0.071675 Oct 28 10:59:23.354412 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3866/7736] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:23 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1261 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 10:59:24.376480 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:24.377749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:24.384893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:24.385729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:24.386398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:24.387868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:24.388527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:24.389208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:24.459788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:24.470698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c163f096-9fe5-402d-a950-3955299bc3f1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1321 microversion: 2.1 time: 0.098736 Oct 28 10:59:24.471537 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3871/7737] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:24 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1321 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:25.495300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:25.495855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:25.503699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:25.504207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:25.504661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:25.505436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:25.505910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:25.506355 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:25.702415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:25.710988 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6c79cb3b-27e0-43b0-8162-afaed87d3d49 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1361 microversion: 2.1 time: 0.219725 Oct 28 10:59:25.711806 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3867/7738] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:25 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:25.757120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-66fa8ed2-885c-4af5-aedc-f556e4ca930f req-5f2a0dae-234d-4560-8d49-d70e1357eebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48382dee-30ae-4283-a366-da8825f6d28b", "tag": "d58a1ade-a7bb-425c-9a60-9be02bc71c0c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:59:25.768416 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-66fa8ed2-885c-4af5-aedc-f556e4ca930f req-5f2a0dae-234d-4560-8d49-d70e1357eebe service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:25.769012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-66fa8ed2-885c-4af5-aedc-f556e4ca930f req-5f2a0dae-234d-4560-8d49-d70e1357eebe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:25.769530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-66fa8ed2-885c-4af5-aedc-f556e4ca930f req-5f2a0dae-234d-4560-8d49-d70e1357eebe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:25.782200 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-66fa8ed2-885c-4af5-aedc-f556e4ca930f req-5f2a0dae-234d-4560-8d49-d70e1357eebe service nova] Creating event network-changed:d58a1ade-a7bb-425c-9a60-9be02bc71c0c for instance 48382dee-30ae-4283-a366-da8825f6d28b on n-h2-zed-1 Oct 28 10:59:25.787321 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-66fa8ed2-885c-4af5-aedc-f556e4ca930f req-5f2a0dae-234d-4560-8d49-d70e1357eebe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034058 Oct 28 10:59:25.787934 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3872/7739] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:26.735563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:26.736180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:26.743111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:26.743598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:26.744040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:26.744725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:26.745207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:26.745637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:26.873610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:26.881349 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-059b1d53-e10b-40f6-a403-6f7f62ba33c1 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1361 microversion: 2.1 time: 0.149730 Oct 28 10:59:26.881913 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3868/7740] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:26 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:27.904524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:27.905262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:27.912269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:27.912758 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:27.913236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:27.913936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:27.914398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:27.914832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:28.043677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:28.051469 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-52b6f02e-2c56-4147-bfb9-6681154c5892 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1361 microversion: 2.1 time: 0.151179 Oct 28 10:59:28.052051 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3873/7741] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:27 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:29.075807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:29.076430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:29.083651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:29.084159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:29.084613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:29.085354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:29.085824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:29.086266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:29.312729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:29.320614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4411ae7d-0af6-4cfa-b3f1-d75ca1729829 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1361 microversion: 2.1 time: 0.249482 Oct 28 10:59:29.321229 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3869/7742] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:29 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:30.343732 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:30.344269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:30.351303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:30.351800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:30.352242 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:30.352973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:30.353445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:30.353877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:30.488930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:30.497218 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-35a68535-e45d-4deb-850d-9768de6f5bc6 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1361 microversion: 2.1 time: 0.157442 Oct 28 10:59:30.497809 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3874/7743] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:30 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:31.519623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:31.520273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:31.527187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:31.527679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:31.528153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:31.528849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:31.529343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:31.529782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:31.579297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3105ca54-da0b-4276-ac73-b9fcbfacd32b req-27cd7083-dac5-494c-b075-c1c3180fa3d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48382dee-30ae-4283-a366-da8825f6d28b", "name": "network-vif-plugged", "status": "completed", "tag": "d58a1ade-a7bb-425c-9a60-9be02bc71c0c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:59:31.591893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3105ca54-da0b-4276-ac73-b9fcbfacd32b req-27cd7083-dac5-494c-b075-c1c3180fa3d0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:31.592373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3105ca54-da0b-4276-ac73-b9fcbfacd32b req-27cd7083-dac5-494c-b075-c1c3180fa3d0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:31.592818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3105ca54-da0b-4276-ac73-b9fcbfacd32b req-27cd7083-dac5-494c-b075-c1c3180fa3d0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:31.606563 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3105ca54-da0b-4276-ac73-b9fcbfacd32b req-27cd7083-dac5-494c-b075-c1c3180fa3d0 service nova] Creating event network-vif-plugged:d58a1ade-a7bb-425c-9a60-9be02bc71c0c for instance 48382dee-30ae-4283-a366-da8825f6d28b on n-h2-zed-1 Oct 28 10:59:31.612124 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3105ca54-da0b-4276-ac73-b9fcbfacd32b req-27cd7083-dac5-494c-b075-c1c3180fa3d0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036503 Oct 28 10:59:31.612790 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3875/7744] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:59:31.663540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:31.671544 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8e05b248-bf82-4aea-a77a-ff2bf607baf4 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1361 microversion: 2.1 time: 0.155789 Oct 28 10:59:31.672110 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3870/7745] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:31 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:32.696110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:32.696807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:32.704110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:32.704598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:32.705093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:32.705790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:32.706249 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:32.706676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:32.838524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:32.847000 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-716d1cb5-568c-4c19-93aa-54d89714599b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1361 microversion: 2.1 time: 0.155897 Oct 28 10:59:32.847577 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3876/7746] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:32 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:33.870097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:33.870745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:33.873619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:33.879032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:33.879524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:33.879977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:33.880677 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:33.881170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:33.881617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:34.010006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:34.017709 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d4eb2685-bb98-4f3f-84c9-aa931575a47b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1552 microversion: 2.1 time: 0.151516 Oct 28 10:59:34.018274 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3871/7747] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:33 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:34.040278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:34.040930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:34.043493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:34.044219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:34.050881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:34.051381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:34.051830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:34.052532 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:34.053023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:34.053461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:34.181958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:34.189666 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b02a0805-4b57-4afb-8068-1caf62bc20c0 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1552 microversion: 2.1 time: 0.153257 Oct 28 10:59:34.190252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3877/7748] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:34 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:35.682684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e7fda5a-b9db-4447-b4f6-c597785fc97d"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:59:35.685670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:35.692479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:35.693017 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:35.693474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:35.694182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:35.694672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:35.695100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:35.945885 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93a6a968-ca0c-4d26-89fa-2a7e988d103e tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "POST /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266845 Oct 28 10:59:35.946534 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3872/7749] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 10:59:35 2022] POST /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:46.654189 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:46.654694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:46.657423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:46.658187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:46.665006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:46.665494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:46.665928 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:46.666616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:46.667065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:46.667489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:46.751056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lazy-loading 'services' on Instance uuid 48382dee-30ae-4283-a366-da8825f6d28b {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:59:46.819328 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a9fc3ac-d9e5-4ff2-b2cd-211fef3b93bd tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments/1e7fda5a-b9db-4447-b4f6-c597785fc97d" status: 202 len: 0 microversion: 2.1 time: 0.169319 Oct 28 10:59:46.819924 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3878/7750] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:59:46 2022] DELETE /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments/1e7fda5a-b9db-4447-b4f6-c597785fc97d => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 10:59:46.827331 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:46.828286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 10:59:46.832467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:46.834860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:46.843637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:46.844138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:46.844590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:46.845338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:46.845811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:46.846252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:46.877167 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-243956ae-7466-4d8a-8990-4854da20a1bc tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051739 Oct 28 10:59:46.877836 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3873/7751] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:46 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:59:47.891683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:47.894029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:47.900335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:47.900827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:47.901299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:47.902051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:47.902511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:47.902947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:47.933981 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5dff92e3-8b5c-44dc-a069-6379abaa634c tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047038 Oct 28 10:59:47.934552 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3879/7752] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:47 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:48.946744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:48.949937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:48.957235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:48.957742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:48.958198 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:48.958921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:48.959387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:48.959911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:48.992243 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cd4903e8-1356-471a-a47f-76844f47118b tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049516 Oct 28 10:59:48.992813 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3874/7753] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:48 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:50.005557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:50.007733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:50.015181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:50.015677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:50.016126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:50.016831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:50.017322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:50.017754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:50.051175 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-33d8f0ab-0829-4111-a64e-0ea989d1da2d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049830 Oct 28 10:59:50.051752 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3880/7754] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:50 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 10:59:51.063334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:51.065474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:51.072544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:51.073074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:51.073524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:51.074261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:51.074720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:51.075154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:51.108180 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9547aaf1-33e4-4738-80b0-7cce41578467 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048851 Oct 28 10:59:51.108754 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3875/7755] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:51 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:52.120539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:52.123333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:52.130126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:52.130611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:52.131054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:52.131746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:52.132203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:52.132631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:52.160768 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ec2b82c-88e3-4672-ba7d-c887b97d962d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044246 Oct 28 10:59:52.161359 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3881/7756] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 10:59:52 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 10:59:52.172706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:52.173236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:52.179602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:52.180101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:52.180551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:52.181291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:52.181761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:52.182203 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:52.257248 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] HTTP exception thrown: Instance 48382dee-30ae-4283-a366-da8825f6d28b is not attached to volume 1e7fda5a-b9db-4447-b4f6-c597785fc97d Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Request method failure captured: Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: request: DELETE /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments/1e7fda5a-b9db-4447-b4f6-c597785fc97d HTTP/1.1 Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7W5A7LCoxPs9irkuF1-jK4xbRoijcn1BKmQDnvPWy7GS90ZM-IeLzmOD3s-8qMP2fXhfEgleoTo-bnb8zs6vb_LAnEUAOXuzKrd9uhuVXyrhBhQAoMexLaR9mjghy2f6Jm_aZXb4aNOOQCi0MfTHd9oysDshL982ULZ4tTKsG0Xc6I Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d38e856f240411a9e040be046e4bbae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d38e856f240411a9e040be046e4bbae"}]}] Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c7c3887f21264885b5e50be86d97e5cb Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 48382dee-30ae-4283-a366-da8825f6d28b is not attached to volume 1e7fda5a-b9db-4447-b4f6-c597785fc97d Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'server_id': '48382dee-30ae-4283-a366-da8825f6d28b', 'id': '1e7fda5a-b9db-4447-b4f6-c597785fc97d'} Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1e7fda5a-b9db-4447-b4f6-c597785fc97d. Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48382dee-30ae-4283-a366-da8825f6d28b is not attached to volume 1e7fda5a-b9db-4447-b4f6-c597785fc97d Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:52.258844 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:52.263387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:59:52.263387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:59:52.263387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48382dee-30ae-4283-a366-da8825f6d28b is not attached to volume 1e7fda5a-b9db-4447-b4f6-c597785fc97d Oct 28 10:59:52.263387 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:52.263387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Returning 404 to user: Instance 48382dee-30ae-4283-a366-da8825f6d28b is not attached to volume 1e7fda5a-b9db-4447-b4f6-c597785fc97d {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:59:52.263387 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-78aaf2b3-4e5e-49f6-af53-75ec0f65b3b5 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments/1e7fda5a-b9db-4447-b4f6-c597785fc97d" status: 404 len: 154 microversion: 2.1 time: 0.091797 Oct 28 10:59:52.263387 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3876/7757] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 10:59:52 2022] DELETE /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b/os-volume_attachments/1e7fda5a-b9db-4447-b4f6-c597785fc97d => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:59:55.619725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:55.620253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:55.626711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:55.627208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:55.627658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:55.628363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:55.628823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:55.629285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:55.655166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 10:59:55.736595 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a343c9f0-a757-4776-92dd-3fb50a87dec8 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 204 len: 0 microversion: 2.1 time: 0.120556 Oct 28 10:59:55.737607 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3882/7758] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 10:59:55 2022] DELETE /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 10:59:55.746121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:55.746772 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:55.754518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:55.755107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:55.755635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:55.756424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:55.756997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:55.757540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:55.892620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:55.900492 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c434db68-fd1d-4898-93fb-b79ede1f2f50 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1558 microversion: 2.1 time: 0.158622 Oct 28 10:59:55.901118 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3877/7759] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:55 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:56.924588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:56.925307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:56.932205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:56.932689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:56.933734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:56.934415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:56.934869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:56.935294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:57.068756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:57.078974 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8e3be1d7-d2eb-4fc7-96ad-393327870fec tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1558 microversion: 2.1 time: 0.158293 Oct 28 10:59:57.079806 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3883/7760] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:56 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:57.940986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-fbbbc69f-5ad8-4976-bea5-d9770c4a874b req-9a803319-2638-4a7e-beb7-dde0c843ffbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48382dee-30ae-4283-a366-da8825f6d28b", "name": "network-vif-deleted", "tag": "d58a1ade-a7bb-425c-9a60-9be02bc71c0c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 10:59:57.953514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fbbbc69f-5ad8-4976-bea5-d9770c4a874b req-9a803319-2638-4a7e-beb7-dde0c843ffbf service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:57.954004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fbbbc69f-5ad8-4976-bea5-d9770c4a874b req-9a803319-2638-4a7e-beb7-dde0c843ffbf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:57.954442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-fbbbc69f-5ad8-4976-bea5-d9770c4a874b req-9a803319-2638-4a7e-beb7-dde0c843ffbf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:57.966297 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-fbbbc69f-5ad8-4976-bea5-d9770c4a874b req-9a803319-2638-4a7e-beb7-dde0c843ffbf service nova] Creating event network-vif-deleted:d58a1ade-a7bb-425c-9a60-9be02bc71c0c for instance 48382dee-30ae-4283-a366-da8825f6d28b on n-h2-zed-1 Oct 28 10:59:57.972203 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-fbbbc69f-5ad8-4976-bea5-d9770c4a874b req-9a803319-2638-4a7e-beb7-dde0c843ffbf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034691 Oct 28 10:59:57.973068 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3878/7761] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 10:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 10:59:58.104193 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:58.104736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:58.112431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:58.113361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:58.113630 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:58.114326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:58.114778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:58.115200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:58.147710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:58.148197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:58.148635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:58.149200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lazy-loading 'fault' on Instance uuid 48382dee-30ae-4283-a366-da8825f6d28b {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 10:59:58.190437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7c3887f21264885b5e50be86d97e5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d38e856f240411a9e040be046e4bbae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 10:59:58.198302 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c7beff16-161f-492a-b640-db77e0e17353 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 200 len: 1351 microversion: 2.1 time: 0.098325 Oct 28 10:59:58.198875 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3884/7762] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:58 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 10:59:59.222108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:59.222744 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] [instance: 48382dee-30ae-4283-a366-da8825f6d28b] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 10:59:59.228937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:59.229455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:59.229916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:59.230622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 10:59:59.231122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 10:59:59.231568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 10:59:59.244859 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] HTTP exception thrown: Instance 48382dee-30ae-4283-a366-da8825f6d28b could not be found. Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Request method failure captured: Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b HTTP/1.1 Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7W5A7LCoxPs9irkuF1-jK4xbRoijcn1BKmQDnvPWy7GS90ZM-IeLzmOD3s-8qMP2fXhfEgleoTo-bnb8zs6vb_LAnEUAOXuzKrd9uhuVXyrhBhQAoMexLaR9mjghy2f6Jm_aZXb4aNOOQCi0MfTHd9oysDshL982ULZ4tTKsG0Xc6I Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7d38e856f240411a9e040be046e4bbae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7d38e856f240411a9e040be046e4bbae", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7d38e856f240411a9e040be046e4bbae"}]}] Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 7d38e856f240411a9e040be046e4bbae Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1830666649 Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: c7c3887f21264885b5e50be86d97e5cb Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestEncryptedCinderVolumes-1830666649-project Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 48382dee-30ae-4283-a366-da8825f6d28b could not be found. Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '48382dee-30ae-4283-a366-da8825f6d28b'} Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48382dee-30ae-4283-a366-da8825f6d28b could not be found. Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48382dee-30ae-4283-a366-da8825f6d28b could not be found. Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:59.246983 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48382dee-30ae-4283-a366-da8825f6d28b could not be found. Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Returning 404 to user: Instance 48382dee-30ae-4283-a366-da8825f6d28b could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8df8d4a0-93d3-48f5-bdf3-91cc7c64665d tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b" status: 404 len: 111 microversion: 2.1 time: 0.031483 Oct 28 10:59:59.252201 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3879/7763] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 10:59:59 2022] GET /compute/v2.1/servers/48382dee-30ae-4283-a366-da8825f6d28b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 10:59:59.256982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9657b15e-03c0-4b36-b352-29d6747ea975 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] Calling method '.version_select at 0x7fca3323c9d0>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 10:59:59.277917 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9657b15e-03c0-4b36-b352-29d6747ea975 tempest-TestEncryptedCinderVolumes-1830666649 tempest-TestEncryptedCinderVolumes-1830666649-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-583802503" status: 202 len: 0 microversion: 2.1 time: 0.024365 Oct 28 10:59:59.278191 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3885/7764] 10.222.0.16 () {58 vars in 1275 bytes} [Fri Oct 28 10:59:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-583802503 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:00:25.805706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-55e9f3c5-ebbf-48d8-bd6f-5869fba7105c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'create', calling method: .version_select at 0x7fca3276f8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-556770786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrDheqpWhuaAhRX0ZLXeMJeUSksT+Z5wM7e8WNK4F1QIc7du0MzAfhKugRe5/OXH5gZ8LmSPuIGr6DoXFA73t3EK0fruYFLdX/pypxTOrzj5L93vsluiG0Ryo5WwauJ8g=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:00:25.811602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=14 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:25.812268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=34 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:25.825193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-55e9f3c5-ebbf-48d8-bd6f-5869fba7105c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for project 3717bdde41e0401e925316053c8b4b3a. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:00:25.830328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-55e9f3c5-ebbf-48d8-bd6f-5869fba7105c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for user 44d187857c82461dba93a33f32981127 and project 3717bdde41e0401e925316053c8b4b3a. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:00:25.854052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-55e9f3c5-ebbf-48d8-bd6f-5869fba7105c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052110 Oct 28 11:00:25.854594 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3880/7765] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:00:25 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:00:25.907273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1710364749", "imageRef": "6093067a-8bf0-4394-94e7-51c80666621f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-556770786", "networks": [{"uuid": "6b21aa1e-fd8c-443d-b46f-a7e50f160671"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:00:25.916580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:25.917452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:25.961161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] validate_networks() for [('6b21aa1e-fd8c-443d-b46f-a7e50f160671', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:00:26.329667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:00:26.330092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:00:26.330572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:00:26.330984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:00:26.331395 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:00:26.340049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:26.340526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:26.340988 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:26.341710 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:26.342164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:26.342591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:26.359200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for project 3717bdde41e0401e925316053c8b4b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:00:26.364316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for user 44d187857c82461dba93a33f32981127 and project 3717bdde41e0401e925316053c8b4b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:00:26.377069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:00:26.379291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6093067a-8bf0-4394-94e7-51c80666621f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:00:26.424787 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a3e55eda-9d45-4dda-9607-3cf103b4bb7a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.522226 Oct 28 11:00:26.425480 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3886/7766] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:00:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:00:26.436743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ed1fb22c-1ffd-49d7-8d4f-d59b3e9ffa6b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:26.437385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ed1fb22c-1ffd-49d7-8d4f-d59b3e9ffa6b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:26.492517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ed1fb22c-1ffd-49d7-8d4f-d59b3e9ffa6b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:26.501168 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ed1fb22c-1ffd-49d7-8d4f-d59b3e9ffa6b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1258 microversion: 2.1 time: 0.068699 Oct 28 11:00:26.501743 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3881/7767] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:26 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:27.523639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:27.524269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:27.533204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:27.533786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:27.534306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:27.535094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:27.535629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:27.536247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:27.606291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:27.614803 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7627402e-4a77-4112-beab-d04427cca1b6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1328 microversion: 2.1 time: 0.095053 Oct 28 11:00:27.627865 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3887/7768] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:27 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:28.638623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:28.639165 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:28.646546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:28.647044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:28.647516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:28.648439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:28.648919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:28.649359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:28.794833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:28.802632 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bb218755-38e0-48d6-95e4-65bba9f5f351 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.168102 Oct 28 11:00:28.803436 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3882/7769] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:28 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:29.828406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:29.829055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:29.836332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:29.836821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:29.837344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:29.838004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:29.838463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:29.838893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:29.984112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:29.993634 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-565473cd-3533-489d-841f-52461efbecdf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.169689 Oct 28 11:00:29.994228 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3888/7770] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:29 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:31.016289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:31.016957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:31.024333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:31.024844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:31.025401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:31.026126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:31.026599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:31.027086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:31.175196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:31.183322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e22a68c2-12c2-4886-9b71-67ed80677616 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.171374 Oct 28 11:00:31.184423 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3883/7771] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:31 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:32.207442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:32.208208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:32.215669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:32.216160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:32.216598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:32.217333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:32.217789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:32.218247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:32.353614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:32.363260 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4e2ec856-6281-4a49-abd2-6d81b6f7a51d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.159661 Oct 28 11:00:32.364055 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3889/7772] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:32 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:33.387148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:33.387900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:33.393787 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:00:33.394002 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:00:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 (ip 10.222.0.16) !!! Oct 28 11:00:33.398016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:33.398527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:33.398983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:33.399711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:33.400184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:33.400628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:33.561876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:33.570053 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d39cfa99-859e-4009-821c-72a38404deab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.187464 Oct 28 11:00:33.570646 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3884/7773] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:33 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:34.594074 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:34.595533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:34.604259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:34.604841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:34.605430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:34.606254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:34.606787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:34.607296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:34.752396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:34.760598 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8f64170-aa2c-4395-b147-16695c3f599a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.170704 Oct 28 11:00:34.762000 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3890/7774] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:34 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:35.785232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:35.785868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:35.792717 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:35.793256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:35.793713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:35.794421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:35.794891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:35.795330 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:35.921293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:35.929044 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9ab1cf4a-51b1-4519-aafd-8b83c2a4b34f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.147762 Oct 28 11:00:35.929611 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3885/7775] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:35 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:36.952684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:36.953322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:36.955993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:36.956658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:36.962642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:36.963122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:36.963562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:36.964248 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:36.964703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:36.965160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:37.093881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:37.101542 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6dcd6f1c-0352-402d-b660-7ff4473c9bf2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.152717 Oct 28 11:00:37.102108 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3891/7776] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:36 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:38.124930 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:38.126447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:38.130154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:00:38.136336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:38.136774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:38.137244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:38.137962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:38.138426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:38.138859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:38.559989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:38.567830 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1e2aef85-2203-42c3-a082-15753e4929e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.448210 Oct 28 11:00:38.568748 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3886/7777] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:38 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:38.698784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e77d95c1-f85d-4af0-b478-0a24a3109e78 req-1bdee518-81ca-4cc7-8ae2-d46e2275c3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5477f8-9e25-42e3-95d5-9bb09aab3593", "tag": "532cdfa2-85aa-4e1b-98df-d1f3d4645072"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:00:38.711104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e77d95c1-f85d-4af0-b478-0a24a3109e78 req-1bdee518-81ca-4cc7-8ae2-d46e2275c3b5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:38.711997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e77d95c1-f85d-4af0-b478-0a24a3109e78 req-1bdee518-81ca-4cc7-8ae2-d46e2275c3b5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:38.712564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e77d95c1-f85d-4af0-b478-0a24a3109e78 req-1bdee518-81ca-4cc7-8ae2-d46e2275c3b5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:38.724501 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e77d95c1-f85d-4af0-b478-0a24a3109e78 req-1bdee518-81ca-4cc7-8ae2-d46e2275c3b5 service nova] Creating event network-changed:532cdfa2-85aa-4e1b-98df-d1f3d4645072 for instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 on n-h2-zed-1 Oct 28 11:00:38.729402 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e77d95c1-f85d-4af0-b478-0a24a3109e78 req-1bdee518-81ca-4cc7-8ae2-d46e2275c3b5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034614 Oct 28 11:00:38.730169 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3892/7778] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:00:39.591757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:39.592415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:39.599803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:39.600304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:39.600756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:39.601502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:39.601973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:39.602416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:39.734878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:39.742729 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4e848c77-5391-4655-a894-6f2d2a2239e9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.154835 Oct 28 11:00:39.743316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3887/7779] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:39 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:40.767581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:40.768280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:40.774450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:40.774927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:40.775361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:40.776041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:40.776494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:40.776932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:40.903845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:40.911570 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6d88d138-5aeb-4f5a-b466-12b8b74affb1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.149851 Oct 28 11:00:40.912141 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3893/7780] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:40 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:41.935288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:41.935922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:41.942866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:41.943366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:41.943817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:41.944525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:41.945026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:41.945471 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:42.073577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:42.081283 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7080126-9d79-4da9-bd3e-87e9d8ac8020 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.149880 Oct 28 11:00:42.081890 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3888/7781] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:41 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:43.105329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:43.106450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:43.113280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:43.113769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:43.114211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:43.114911 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:43.115373 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:43.115800 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:43.245566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:43.253935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-53a54238-4dd7-4ea5-9936-883ccc0dec94 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.152540 Oct 28 11:00:43.254507 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3894/7782] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:43 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:43.851936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-24bcd825-3fbf-4b7f-945b-85283a471bb4 req-fcc95749-dcd5-4934-8712-a28ae10f5b3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5477f8-9e25-42e3-95d5-9bb09aab3593", "name": "network-vif-plugged", "status": "completed", "tag": "532cdfa2-85aa-4e1b-98df-d1f3d4645072"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:00:43.862696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-24bcd825-3fbf-4b7f-945b-85283a471bb4 req-fcc95749-dcd5-4934-8712-a28ae10f5b3c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:43.863202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-24bcd825-3fbf-4b7f-945b-85283a471bb4 req-fcc95749-dcd5-4934-8712-a28ae10f5b3c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:43.863654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-24bcd825-3fbf-4b7f-945b-85283a471bb4 req-fcc95749-dcd5-4934-8712-a28ae10f5b3c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:43.880316 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-24bcd825-3fbf-4b7f-945b-85283a471bb4 req-fcc95749-dcd5-4934-8712-a28ae10f5b3c service nova] Creating event network-vif-plugged:532cdfa2-85aa-4e1b-98df-d1f3d4645072 for instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 on n-h2-zed-1 Oct 28 11:00:43.885379 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-24bcd825-3fbf-4b7f-945b-85283a471bb4 req-fcc95749-dcd5-4934-8712-a28ae10f5b3c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037163 Oct 28 11:00:43.886615 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3889/7783] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:00:44.275596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:44.276219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:44.283033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:44.283525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:44.283968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:44.284667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:44.285160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:44.285597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:44.416832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:44.424606 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7caa2c2f-6377-48f3-aaac-56a850688b39 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.152952 Oct 28 11:00:44.425235 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3895/7784] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:44 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:45.449436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:45.450160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:45.456684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:45.457219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:45.457695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:45.458396 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:45.458859 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:45.459308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:45.590378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:45.598384 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c34aa3ab-6830-4312-8398-45de4b95afba tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1358 microversion: 2.1 time: 0.154276 Oct 28 11:00:45.598967 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3890/7785] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:45 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:46.621322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:46.622006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:46.628730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:46.629239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:46.629676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:46.630357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:46.630806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:46.631227 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:46.762166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:46.770143 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-233a3d95-93e5-41c3-aa83-ddc5dd33979d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1547 microversion: 2.1 time: 0.152714 Oct 28 11:00:46.770713 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3896/7786] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:46 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:46.792489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:46.793170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:46.800696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:46.801233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:46.801683 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:46.802384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:46.802849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:46.803285 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:46.935042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:46.942703 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1e8d967b-39a1-445c-a3b8-b6b27214f68a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1547 microversion: 2.1 time: 0.154197 Oct 28 11:00:46.943290 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3891/7787] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:46 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:46.966540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:46.971300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:46.972061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Searching by: {'deleted': False, 'project_id': '3717bdde41e0401e925316053c8b4b3a'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 11:00:46.977460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:46.977939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:46.978369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:46.979088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:46.979540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:46.979965 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:47.002794 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 11:00:47.030394 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eb1a2302-65fb-4f9b-ba30-7e91e4f14fe6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068277 Oct 28 11:00:47.030981 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3897/7788] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 11:00:46 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:00:47.042464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:00:47.043194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:47.049854 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:47.050356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:47.050809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:47.051518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:47.051984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:47.052423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:47.176654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:00:47.184791 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f113cc8-fa29-4e23-b873-1f8a5753f12f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1547 microversion: 2.1 time: 0.145642 Oct 28 11:00:47.185389 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3892/7789] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:00:47 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1547 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:00:48.900981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f53b26c-ed47-4ae9-b85a-b1cf36871df9"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:00:48.903331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:00:48.910099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:48.910580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:48.911222 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:48.911919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:00:48.912368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:00:48.913057 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:00:49.171560 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a45d0ef8-14d8-4022-9961-a20bde82d0c8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274396 Oct 28 11:00:49.172225 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3898/7790] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 11:00:48 2022] POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:01:02.198835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:01:02.199491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:01:02.202031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:02.202695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=62 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:02.208766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:02.209312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:02.209766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:02.210469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:02.210938 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:02.211377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:02.344826 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:01:02.353086 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4eee9de0-ed44-4879-8bf8-9fea9d989f7b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1593 microversion: 2.1 time: 0.158278 Oct 28 11:01:02.353660 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3893/7791] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:01:02 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1593 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:01:04.374803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:04.375464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:04.376512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:01:04.381487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-efb588e6-ec88-4afa-a0f7-74ba5cb68371 req-cba3dc1f-2e67-4150-aeb0-2885fb313fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5477f8-9e25-42e3-95d5-9bb09aab3593", "tag": "532cdfa2-85aa-4e1b-98df-d1f3d4645072"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:01:04.393854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-efb588e6-ec88-4afa-a0f7-74ba5cb68371 req-cba3dc1f-2e67-4150-aeb0-2885fb313fef service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:04.394643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-efb588e6-ec88-4afa-a0f7-74ba5cb68371 req-cba3dc1f-2e67-4150-aeb0-2885fb313fef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:04.395197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-efb588e6-ec88-4afa-a0f7-74ba5cb68371 req-cba3dc1f-2e67-4150-aeb0-2885fb313fef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:04.410825 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-efb588e6-ec88-4afa-a0f7-74ba5cb68371 req-cba3dc1f-2e67-4150-aeb0-2885fb313fef service nova] Creating event network-changed:532cdfa2-85aa-4e1b-98df-d1f3d4645072 for instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 on n-h2-zed-1 Oct 28 11:01:04.417931 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-efb588e6-ec88-4afa-a0f7-74ba5cb68371 req-cba3dc1f-2e67-4150-aeb0-2885fb313fef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044562 Oct 28 11:01:04.419035 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3899/7792] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:01:05.426288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2081391693"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:01:05.426853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:01:05.434790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:05.435296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:05.435753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:05.436476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:05.436976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:05.437445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:05.582708 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.network.security_group_api [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Adding security group 28cbc197-0b26-451f-891b-7b00e8ec3d31 to port 532cdfa2-85aa-4e1b-98df-d1f3d4645072 Oct 28 11:01:05.905402 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e3d4ca42-048b-44e8-ab27-16804a9d0139 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action" status: 202 len: 0 microversion: 2.1 time: 0.483002 Oct 28 11:01:05.906066 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3894/7793] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:01:05 2022] POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 11:01:05.915184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:01:05.915892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:01:05.926827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:05.927259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:05.928217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:05.929128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:05.929128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:05.929349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:06.082581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:01:06.091530 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7790509c-5a15-40d5-8d38-6183755021cf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1759 microversion: 2.1 time: 0.181026 Oct 28 11:01:06.092121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3900/7794] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:01:05 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:01:06.432451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-994d5ee6-d1c1-4b36-a104-5d82b221beb7 req-c6905d87-b0bb-45fd-af1b-4b9b948a44e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5477f8-9e25-42e3-95d5-9bb09aab3593", "tag": "532cdfa2-85aa-4e1b-98df-d1f3d4645072"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:01:06.443062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-994d5ee6-d1c1-4b36-a104-5d82b221beb7 req-c6905d87-b0bb-45fd-af1b-4b9b948a44e9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:01:06.443570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-994d5ee6-d1c1-4b36-a104-5d82b221beb7 req-c6905d87-b0bb-45fd-af1b-4b9b948a44e9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:01:06.444002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-994d5ee6-d1c1-4b36-a104-5d82b221beb7 req-c6905d87-b0bb-45fd-af1b-4b9b948a44e9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:01:06.455965 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-994d5ee6-d1c1-4b36-a104-5d82b221beb7 req-c6905d87-b0bb-45fd-af1b-4b9b948a44e9 service nova] Creating event network-changed:532cdfa2-85aa-4e1b-98df-d1f3d4645072 for instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 on n-h2-zed-1 Oct 28 11:01:06.461074 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-994d5ee6-d1c1-4b36-a104-5d82b221beb7 req-c6905d87-b0bb-45fd-af1b-4b9b948a44e9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032196 Oct 28 11:01:06.461671 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3895/7795] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:03:18.191486 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:03:18.192701 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:03:18.193237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:03:18.194196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:03:18.195204 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:03:18.195336 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action (ip 10.222.0.16) !!! Oct 28 11:03:18.196794 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:03:18.196992 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action (ip 10.222.0.16) !!! Oct 28 11:03:18.202356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:03:18.204562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:03:18.223181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:18.223662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:18.224098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:18.224790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:18.225273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:18.225712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:18.297477 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c7075df-f77b-49c0-b36a-1b31f2703e57 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action" status: 202 len: 0 microversion: 2.1 time: 0.107593 Oct 28 11:03:18.298192 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3901/7796] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:03:18 2022] POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:03:18.304613 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:03:18.305488 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:03:18.306062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:03:18.307561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:03:18.308848 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:03:18.309102 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:03:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 (ip 10.222.0.16) !!! Oct 28 11:03:18.317345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:03:18.318207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:03:18.328179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:18.328679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:18.329161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:18.329872 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:18.330341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:18.330779 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:18.561354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:03:18.569695 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b027db8-ef6b-4d1b-90ee-f0f25953897a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1761 microversion: 2.1 time: 0.266986 Oct 28 11:03:18.570275 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3896/7797] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:03:18 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1761 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:03:19.596621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:03:19.597488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:03:19.606775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:19.607269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:19.607715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:19.608424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:19.608883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:19.609342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:19.614138 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37178. Oct 28 11:03:19.614848 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37176. Oct 28 11:03:19.762751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:03:19.771674 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-388a2d61-7b33-4d77-90da-129fc84c8287 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1766 microversion: 2.1 time: 0.180483 Oct 28 11:03:19.772283 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3902/7798] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:03:19 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1766 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:03:20.795901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:03:20.796431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:03:20.805057 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:20.805560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:20.806011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:20.807311 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:03:20.807781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:03:20.808229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:03:20.815960 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37188. Oct 28 11:03:20.826222 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37186. Oct 28 11:03:20.953219 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:03:20.961456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c97554f6-9e92-4b67-9ae7-201a7cd5523b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1759 microversion: 2.1 time: 0.169548 Oct 28 11:03:20.962026 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3897/7799] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:03:20 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:04:50.396195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:04:50.397098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:04:50.401591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2081391693"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:04:50.402136 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:50.409338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:50.409832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:50.410276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:50.410967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:50.411426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:50.411856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:50.663506 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.network.security_group_api [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Removing security group 28cbc197-0b26-451f-891b-7b00e8ec3d31 from port 532cdfa2-85aa-4e1b-98df-d1f3d4645072 Oct 28 11:04:50.966448 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4cf38139-1ecf-431f-bf80-f6e14fda5403 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action" status: 202 len: 0 microversion: 2.1 time: 0.572063 Oct 28 11:04:50.967149 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3903/7800] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:04:50 2022] POST /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:04:50.974959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:04:50.975907 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:04:51.068704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5477f8-9e25-42e3-95d5-9bb09aab3593", "tag": "532cdfa2-85aa-4e1b-98df-d1f3d4645072"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:04:51.079726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:51.081171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:51.081981 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:51.096415 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] Creating event network-changed:532cdfa2-85aa-4e1b-98df-d1f3d4645072 for instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 on n-h2-zed-1 Oct 28 11:04:51.100879 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] [420eb877-8dd9-4309-89f4-4ffc18fe3f11] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:04:52.110748 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] [420eb877-8dd9-4309-89f4-4ffc18fe3f11] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 37234. Oct 28 11:04:52.114777 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e5e5b816-0ab1-43f0-85b5-67cfd7a787d1 req-3c0ccccf-bc47-44d9-8da7-e07d14a3e880 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.141751 Oct 28 11:04:52.115409 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3898/7801] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:04:52.299053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:52.299600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:52.306742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:52.307233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:52.307670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:52.309283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:52.309826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:52.310267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:52.394777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lazy-loading 'services' on Instance uuid 0b5477f8-9e25-42e3-95d5-9bb09aab3593 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:04:52.469283 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-618c420f-995b-4da4-b375-8878223c8598 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments/7f53b26c-ed47-4ae9-b85a-b1cf36871df9" status: 202 len: 0 microversion: 2.1 time: 0.173891 Oct 28 11:04:52.469898 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3904/7802] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 11:04:52 2022] DELETE /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments/7f53b26c-ed47-4ae9-b85a-b1cf36871df9 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:04:52.479499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:52.483070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:52.489711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:52.490467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:52.491080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:52.492379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:52.492880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:52.493810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:52.543619 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5882463-004c-49b9-b4a6-f719a3f2ffe1 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069087 Oct 28 11:04:52.544189 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3899/7803] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:04:52 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:04:53.557494 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:53.559840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:53.566973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:53.567463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:53.567940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:53.568633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:53.569128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:53.569558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:53.601663 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-11ec06fa-2a28-479a-9585-9f00b6c5f793 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048676 Oct 28 11:04:53.602252 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3905/7804] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:04:53 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:04:54.158247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1d43640a-74f7-4a0a-961b-98a77bad026d req-2771fd4b-2f00-435c-a12c-c7ed6fecd865 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b5477f8-9e25-42e3-95d5-9bb09aab3593", "tag": "532cdfa2-85aa-4e1b-98df-d1f3d4645072"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:04:54.168409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1d43640a-74f7-4a0a-961b-98a77bad026d req-2771fd4b-2f00-435c-a12c-c7ed6fecd865 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:54.168883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1d43640a-74f7-4a0a-961b-98a77bad026d req-2771fd4b-2f00-435c-a12c-c7ed6fecd865 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:54.169344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1d43640a-74f7-4a0a-961b-98a77bad026d req-2771fd4b-2f00-435c-a12c-c7ed6fecd865 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:54.180027 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1d43640a-74f7-4a0a-961b-98a77bad026d req-2771fd4b-2f00-435c-a12c-c7ed6fecd865 service nova] Creating event network-changed:532cdfa2-85aa-4e1b-98df-d1f3d4645072 for instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 on n-h2-zed-1 Oct 28 11:04:54.185627 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1d43640a-74f7-4a0a-961b-98a77bad026d req-2771fd4b-2f00-435c-a12c-c7ed6fecd865 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031161 Oct 28 11:04:54.186212 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3900/7805] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:04:54.615760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:54.618019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:54.625185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:54.625692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:54.626134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:54.626851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:54.627310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:54.627743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:54.663456 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50f65bc9-6e37-4669-bf2b-c553d6b37c95 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052325 Oct 28 11:04:54.664265 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3906/7806] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:04:54 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:04:55.676869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:55.679390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:55.687197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:55.687697 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:55.688151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:55.688865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:55.689362 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:55.689804 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:55.721171 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-93a6d93a-8daa-49af-8921-a527986c412f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048439 Oct 28 11:04:55.721646 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3901/7807] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:04:55 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:04:56.733505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:56.735647 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:56.742564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:56.743051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:56.743493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:56.744180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:56.744633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:56.745083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:56.774697 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fe636ffc-f636-4916-b3cb-235fa77c8690 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Oct 28 11:04:56.775222 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3907/7808] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:04:56 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:04:57.787074 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:57.789716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:57.797878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:57.798380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:57.798868 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:57.799777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:57.800368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:57.800809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:57.829013 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a965afd5-2753-41f7-ad66-a60e2fc26a30 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046169 Oct 28 11:04:57.829577 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3902/7809] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:04:57 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 11:04:57.840739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:04:57.841261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:04:57.847982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:57.848467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:57.848919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:57.849609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:04:57.850063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:04:57.850488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:04:57.924512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] HTTP exception thrown: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 is not attached to volume 7f53b26c-ed47-4ae9-b85a-b1cf36871df9 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Request method failure captured: Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments/7f53b26c-ed47-4ae9-b85a-b1cf36871df9 HTTP/1.1 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7Y7k1lNirK6q8YudIuZfGo5yDhvpbjWOqhNEAXYp-CuCXnQmebnalF1OLH5pk9cqvApElUZRUqZFEKMOjBJeR97g1JnhRyf201At0PNwxcyg7_toeH38vQNrYJPqr-I6mEgTLjAWMI-d1cAd1v09fGHWwOsfGDYVNDCaxoeD3cy3Nc Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3717bdde41e0401e925316053c8b4b3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3717bdde41e0401e925316053c8b4b3a"}]}] Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 44d187857c82461dba93a33f32981127 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 is not attached to volume 7f53b26c-ed47-4ae9-b85a-b1cf36871df9 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': '0b5477f8-9e25-42e3-95d5-9bb09aab3593', 'id': '7f53b26c-ed47-4ae9-b85a-b1cf36871df9'} Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7f53b26c-ed47-4ae9-b85a-b1cf36871df9. Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 is not attached to volume 7f53b26c-ed47-4ae9-b85a-b1cf36871df9 Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:04:57.926456 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:04:57.931438 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:04:57.931438 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:04:57.931438 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 is not attached to volume 7f53b26c-ed47-4ae9-b85a-b1cf36871df9 Oct 28 11:04:57.931438 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:04:57.931438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Returning 404 to user: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 is not attached to volume 7f53b26c-ed47-4ae9-b85a-b1cf36871df9 {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:04:57.931438 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-03309653-3cd3-4ecc-87e7-960f4fda6342 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments/7f53b26c-ed47-4ae9-b85a-b1cf36871df9" status: 404 len: 154 microversion: 2.1 time: 0.091745 Oct 28 11:04:57.931438 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3908/7810] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 11:04:57 2022] DELETE /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593/os-volume_attachments/7f53b26c-ed47-4ae9-b85a-b1cf36871df9 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 11:05:01.179634 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:01.180183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:01.182486 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:05:01.182655 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:05:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 (ip 10.222.0.16) !!! Oct 28 11:05:01.196120 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:01.196624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:01.197119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:01.197844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:01.198811 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:01.199284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:01.226424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:05:01.305630 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4580f3eb-70d9-4817-b351-3379ef24f16e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 204 len: 0 microversion: 2.1 time: 0.129352 Oct 28 11:05:01.306203 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3903/7811] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:05:01 2022] DELETE /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:05:01.314923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:01.315587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:01.324489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:01.325007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:01.325706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:01.326405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:01.326869 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:01.327300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:01.461976 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:01.469932 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-28fd01c1-ff1c-4122-8122-d5d8b915afb8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1553 microversion: 2.1 time: 0.158874 Oct 28 11:05:01.470506 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3909/7812] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:01 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:02.494342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:02.494990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:02.502465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:02.502962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:02.503417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:02.504133 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:02.504603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:02.505073 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:02.683514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:02.691246 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87c8f6b9-8a47-4858-b9f1-ef51be0643f0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1553 microversion: 2.1 time: 0.201237 Oct 28 11:05:02.691814 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3904/7813] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:02 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:03.715342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:03.715913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:03.722997 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:03.723487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:03.723930 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:03.724628 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:03.725122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:03.725554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:03.789603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:03.804510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-afe45aca-d99c-495c-b438-8d495ec9e65e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 200 len: 1511 microversion: 2.1 time: 0.093511 Oct 28 11:05:03.817121 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3910/7814] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:03 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 1511 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:03.916075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e66fb14c-0a0f-405b-bdf2-3e3af53dfc57 req-04529563-4f77-4f9e-9ce0-b9719ffec6b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b5477f8-9e25-42e3-95d5-9bb09aab3593", "name": "network-vif-deleted", "tag": "532cdfa2-85aa-4e1b-98df-d1f3d4645072"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:03.926851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e66fb14c-0a0f-405b-bdf2-3e3af53dfc57 req-04529563-4f77-4f9e-9ce0-b9719ffec6b2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:03.927338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e66fb14c-0a0f-405b-bdf2-3e3af53dfc57 req-04529563-4f77-4f9e-9ce0-b9719ffec6b2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:03.927778 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e66fb14c-0a0f-405b-bdf2-3e3af53dfc57 req-04529563-4f77-4f9e-9ce0-b9719ffec6b2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:03.938118 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e66fb14c-0a0f-405b-bdf2-3e3af53dfc57 req-04529563-4f77-4f9e-9ce0-b9719ffec6b2 service nova] Creating event network-vif-deleted:532cdfa2-85aa-4e1b-98df-d1f3d4645072 for instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 on n-h2-zed-1 Oct 28 11:05:03.943678 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e66fb14c-0a0f-405b-bdf2-3e3af53dfc57 req-04529563-4f77-4f9e-9ce0-b9719ffec6b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085540 Oct 28 11:05:03.944331 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3905/7815] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:05:04.828012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:04.828555 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 0b5477f8-9e25-42e3-95d5-9bb09aab3593] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:04.835459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:04.835953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:04.836401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:04.837133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:04.837597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:04.838038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:04.851542 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] HTTP exception thrown: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 could not be found. Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Request method failure captured: Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 HTTP/1.1 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7Y7k1lNirK6q8YudIuZfGo5yDhvpbjWOqhNEAXYp-CuCXnQmebnalF1OLH5pk9cqvApElUZRUqZFEKMOjBJeR97g1JnhRyf201At0PNwxcyg7_toeH38vQNrYJPqr-I6mEgTLjAWMI-d1cAd1v09fGHWwOsfGDYVNDCaxoeD3cy3Nc Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3717bdde41e0401e925316053c8b4b3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3717bdde41e0401e925316053c8b4b3a"}]}] Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 44d187857c82461dba93a33f32981127 Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 could not be found. Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '0b5477f8-9e25-42e3-95d5-9bb09aab3593'} Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 could not be found. Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 could not be found. Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:05:04.853102 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 could not be found. Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Returning 404 to user: Instance 0b5477f8-9e25-42e3-95d5-9bb09aab3593 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ec69156-dffe-4b5d-84c8-aa2e306ad0a0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593" status: 404 len: 111 microversion: 2.1 time: 0.030835 Oct 28 11:05:04.858927 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3911/7816] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:04 2022] GET /compute/v2.1/servers/0b5477f8-9e25-42e3-95d5-9bb09aab3593 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:05:04.864223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1017b5cb-f375-41de-afea-952590c79eaf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '.version_select at 0x7fca30757c10>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:04.888030 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1017b5cb-f375-41de-afea-952590c79eaf tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-556770786" status: 202 len: 0 microversion: 2.1 time: 0.027900 Oct 28 11:05:04.888608 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3906/7817] 10.222.0.16 () {58 vars in 1269 bytes} [Fri Oct 28 11:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-556770786 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:05:13.985786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-60c48ef8-3771-4bc2-8c54-a783c71bb636 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'create', calling method: .version_select at 0x7fca323b6430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1079174691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI8D3nRxgLlXY67+d0Er2IPDQbJktFziKEiVlaH7nxltSYNbtHTc39/d0QMFdNzZ/cIzkF03i4JcSb6Hnl/X+JK1szG7EjfwQZY9tSKrCGD2kzY4gBM1u0PXg2e5GJM9lA=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:14.005204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-60c48ef8-3771-4bc2-8c54-a783c71bb636 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for project 3717bdde41e0401e925316053c8b4b3a. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:05:14.010735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-60c48ef8-3771-4bc2-8c54-a783c71bb636 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for user 44d187857c82461dba93a33f32981127 and project 3717bdde41e0401e925316053c8b4b3a. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:05:14.040248 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-60c48ef8-3771-4bc2-8c54-a783c71bb636 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058299 Oct 28 11:05:14.040866 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3912/7818] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:05:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:05:14.088361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:14.093170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1244144502", "imageRef": "b3ccca5f-3558-4bd0-914a-9ff1f63b96d2", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1079174691", "networks": [{"uuid": "6b21aa1e-fd8c-443d-b46f-a7e50f160671"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:14.148482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] validate_networks() for [('6b21aa1e-fd8c-443d-b46f-a7e50f160671', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:05:14.572279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:05:14.572723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:05:14.573254 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:05:14.573678 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:05:14.574110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:05:14.583807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:14.584307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:14.584763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:14.585537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:14.586011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:14.586458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:14.607988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for project 3717bdde41e0401e925316053c8b4b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:05:14.613298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Getting quotas for user 44d187857c82461dba93a33f32981127 and project 3717bdde41e0401e925316053c8b4b3a. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:05:14.625637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:05:14.627995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b3ccca5f-3558-4bd0-914a-9ff1f63b96d2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:05:14.675017 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef14169f-2da8-4c67-bbf1-520b853b3ec9 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.588316 Oct 28 11:05:14.675689 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3907/7819] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:05:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:05:14.686797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1ae45fa3-edc4-43f5-be80-c1d650c66f11 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:14.687411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1ae45fa3-edc4-43f5-be80-c1d650c66f11 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:14.747412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1ae45fa3-edc4-43f5-be80-c1d650c66f11 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:14.754349 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1ae45fa3-edc4-43f5-be80-c1d650c66f11 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1259 microversion: 2.1 time: 0.071589 Oct 28 11:05:14.754970 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3913/7820] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:14 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:15.777892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:15.778544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:15.785626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:15.786117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:15.786566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:15.787261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:15.787720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:15.788153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:15.848379 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:15.856062 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9dd7f53b-e38b-4a42-ab65-7387a10796a3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1263 microversion: 2.1 time: 0.082144 Oct 28 11:05:15.856634 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3908/7821] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:15 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1263 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:16.878738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:16.879882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:16.883552 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:16.893352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:16.893847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:16.894297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:16.895006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:16.895461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:16.896564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:16.963432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:16.971307 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d0321647-9e28-438b-a630-4dde92df182b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1329 microversion: 2.1 time: 0.096525 Oct 28 11:05:16.971875 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3914/7822] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:16 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1329 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:17.995042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:17.995672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:18.002838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:18.003344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:18.004000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:18.004729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:18.005226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:18.005673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:18.149835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:18.158991 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3b41b578-7da6-405b-93e7-9eb4c80c46f2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.168068 Oct 28 11:05:18.159841 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3909/7823] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:17 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:05:19.183326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:19.184712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:19.192354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:19.193269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:19.193950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:19.195040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:19.195727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:19.196364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:19.339340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:19.348244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4f955916-6385-4848-9415-2f35dd0bc5fa tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.169213 Oct 28 11:05:19.349304 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3915/7824] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:19 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:20.373101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:20.373730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:20.380686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:20.381212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:20.381662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:20.382375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:20.383023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:20.383470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:20.519194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:20.527759 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffd079de-4c06-4825-bb16-caae55296dbb tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.159615 Oct 28 11:05:20.529367 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3910/7825] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:20 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:21.550542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:21.551251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:21.553220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:21.559803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:21.560337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:21.560812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:21.561588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:21.562054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:21.562489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:21.720826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:21.729906 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cf1bedb4-5a1a-49f8-b186-820996a89c5d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.183509 Oct 28 11:05:21.731456 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3916/7826] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:21 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:22.753606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:22.754240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:22.756424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:22.762562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:22.763067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:22.763631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:22.764276 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:22.764749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:22.765209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:22.907069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:22.915369 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b6b4bdf0-b46e-42c8-8462-745984f79d67 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.165627 Oct 28 11:05:22.916175 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3911/7827] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:22 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:23.939752 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:23.940404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:23.947619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:23.948115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:23.948550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:23.949343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:23.949803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:23.950234 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:24.122390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:24.130414 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-eddc50c3-4614-4d01-a25d-34d9ece7bf5a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.195258 Oct 28 11:05:24.131319 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3917/7828] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:23 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:25.152823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:25.153486 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:25.156233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:25.156986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:25.163159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:25.163613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:25.164054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:25.165960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:25.165960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:25.165960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:25.377520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:25.385382 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b8ef2da-a6be-4470-bc61-5e334ddfbb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.237038 Oct 28 11:05:25.385955 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3912/7829] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:25 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:25.524475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-86726d18-a108-4062-a23d-dc8e661b6975 req-bb091133-586b-4cde-8af8-9917415dff25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2", "tag": "6d4340b3-a9ae-42b4-b0be-f40cd0597bb3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:25.529620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:25.536153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-86726d18-a108-4062-a23d-dc8e661b6975 req-bb091133-586b-4cde-8af8-9917415dff25 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:25.536671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-86726d18-a108-4062-a23d-dc8e661b6975 req-bb091133-586b-4cde-8af8-9917415dff25 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:25.537122 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-86726d18-a108-4062-a23d-dc8e661b6975 req-bb091133-586b-4cde-8af8-9917415dff25 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:25.548213 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-86726d18-a108-4062-a23d-dc8e661b6975 req-bb091133-586b-4cde-8af8-9917415dff25 service nova] Creating event network-changed:6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 for instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 on n-h1-zed-1 Oct 28 11:05:25.553238 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-86726d18-a108-4062-a23d-dc8e661b6975 req-bb091133-586b-4cde-8af8-9917415dff25 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032511 Oct 28 11:05:25.553838 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3918/7830] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:05:26.408685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:26.409339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:26.416141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:26.416611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:26.417088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:26.418283 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:26.418745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:26.419176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:26.791181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:26.799652 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d683ecfb-f4f0-4658-9a9d-1fa9c2e4bf1e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.394856 Oct 28 11:05:26.800476 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3913/7831] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:26 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:27.823598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:27.825028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:27.831442 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:27.831934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:27.832382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:27.833115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:27.833579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:27.834016 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:27.961889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:27.969636 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d7a200b3-47a5-4049-9759-022d092d174c tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.151115 Oct 28 11:05:27.970205 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3919/7832] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:27 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:28.991999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:28.992611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:28.999498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:29.000005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:29.000436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:29.001162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:29.001629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:29.002067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:29.137482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:29.145162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-13f4dd46-b959-4914-aac9-96b6ca88c5f5 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.157009 Oct 28 11:05:29.145744 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3914/7833] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:28 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:30.168154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:30.169425 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:30.176225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:30.176714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:30.177181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:30.177881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:30.178339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:30.178764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:30.297117 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-8d208438-5517-47c1-baa0-ec6ecfbbbf1f req-b0c1c900-d9f7-4148-bbc4-9d472976cbb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2", "name": "network-vif-plugged", "status": "completed", "tag": "6d4340b3-a9ae-42b4-b0be-f40cd0597bb3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:30.308194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8d208438-5517-47c1-baa0-ec6ecfbbbf1f req-b0c1c900-d9f7-4148-bbc4-9d472976cbb4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:30.309516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8d208438-5517-47c1-baa0-ec6ecfbbbf1f req-b0c1c900-d9f7-4148-bbc4-9d472976cbb4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:30.310843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-8d208438-5517-47c1-baa0-ec6ecfbbbf1f req-b0c1c900-d9f7-4148-bbc4-9d472976cbb4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:30.322907 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-8d208438-5517-47c1-baa0-ec6ecfbbbf1f req-b0c1c900-d9f7-4148-bbc4-9d472976cbb4 service nova] Creating event network-vif-plugged:6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 for instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 on n-h1-zed-1 Oct 28 11:05:30.328448 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-8d208438-5517-47c1-baa0-ec6ecfbbbf1f req-b0c1c900-d9f7-4148-bbc4-9d472976cbb4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094340 Oct 28 11:05:30.329107 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3915/7834] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:05:30.331065 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:30.338668 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-68c8c973-9e79-4bb6-8d4e-3def267fdbee tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.174987 Oct 28 11:05:30.339236 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3920/7835] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:30 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:31.362347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:31.363186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:31.369463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:31.369963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:31.370426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:31.371651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:31.372123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:31.372567 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:31.501685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:31.509273 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b8aa7ea9-b3a7-4004-993a-c4df897024f8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1359 microversion: 2.1 time: 0.152110 Oct 28 11:05:31.509850 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3916/7836] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:31 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:32.532252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:32.533022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:32.540121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.540618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.541102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:32.541803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.542265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.542700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:32.671078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:32.678991 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5fa74b29-e04c-45f6-abfb-6b20c463fb86 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1548 microversion: 2.1 time: 0.150660 Oct 28 11:05:32.679563 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3921/7837] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:32 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:32.701518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:32.702145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:32.708843 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.709366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.709816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:32.710514 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.710974 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.711408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:32.841564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:32.849324 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-16c596f4-96f9-4a95-bb67-2f6827eaf28b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1548 microversion: 2.1 time: 0.152387 Oct 28 11:05:32.849904 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3917/7838] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:32 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:32.871290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:32.875983 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:32.876762 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Searching by: {'deleted': False, 'project_id': '3717bdde41e0401e925316053c8b4b3a'} {{(pid=128747) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 28 11:05:32.882036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.882515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.882949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:32.883665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.884114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.884539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:32.910408 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.multi_cell_list [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128747) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 28 11:05:32.937780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7298e7de-ad1b-4fe6-be3e-81c0147b8cd7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070757 Oct 28 11:05:32.938392 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3922/7839] 10.222.0.16 () {58 vars in 1125 bytes} [Fri Oct 28 11:05:32 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:05:32.950949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:32.951583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:32.957655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.958157 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.958612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:32.959322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:32.959795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:32.960242 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:33.088709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:33.096482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53c69b4e-3ba8-44e9-a2dd-fe118f0b3b33 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1548 microversion: 2.1 time: 0.150302 Oct 28 11:05:33.097092 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3918/7840] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:32 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:34.598738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "88b537c1-6337-4643-bb21-6cab2f658eaa"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:34.601112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:34.608569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:34.609088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:34.609527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:34.610215 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:34.610668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:34.611092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:34.872256 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0a629ec3-4f49-4a67-b840-de5f3e466f8a tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277426 Oct 28 11:05:34.872920 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3923/7841] 10.222.0.16 () {60 vars in 1323 bytes} [Fri Oct 28 11:05:34 2022] POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:05:45.820230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:45.820973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:45.824016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=15 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:45.824751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=64 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:45.830650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:45.831149 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:45.831603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:45.832338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:45.832809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:45.833278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:45.964656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:45.973598 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-54fff0db-b499-45b9-9b8c-91c369eaed6f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1594 microversion: 2.1 time: 0.157191 Oct 28 11:05:45.974172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3919/7842] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:45 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:47.531860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:47.532653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=15 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:47.533998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:05:47.538343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b649cae3-3ec3-451a-94e8-010b3778ef99 req-1ab0d3a0-36c9-443c-9f0c-991af4c6708a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2", "tag": "6d4340b3-a9ae-42b4-b0be-f40cd0597bb3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:47.551272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b649cae3-3ec3-451a-94e8-010b3778ef99 req-1ab0d3a0-36c9-443c-9f0c-991af4c6708a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:47.552051 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b649cae3-3ec3-451a-94e8-010b3778ef99 req-1ab0d3a0-36c9-443c-9f0c-991af4c6708a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:47.552731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b649cae3-3ec3-451a-94e8-010b3778ef99 req-1ab0d3a0-36c9-443c-9f0c-991af4c6708a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:47.566272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b649cae3-3ec3-451a-94e8-010b3778ef99 req-1ab0d3a0-36c9-443c-9f0c-991af4c6708a service nova] Creating event network-changed:6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 for instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 on n-h1-zed-1 Oct 28 11:05:47.571471 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b649cae3-3ec3-451a-94e8-010b3778ef99 req-1ab0d3a0-36c9-443c-9f0c-991af4c6708a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041409 Oct 28 11:05:47.572255 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3924/7843] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:05:48.627217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1279553541"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:48.627782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:48.634889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:48.635398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:48.635857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:48.636573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:48.637662 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:48.638107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:48.765681 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.network.security_group_api [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Adding security group b81a066d-3e56-4b47-a11b-41d5058ba0df to port 6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 Oct 28 11:05:49.080775 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6a9901e6-a720-4f84-a4db-98b3dcef7a76 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/action" status: 202 len: 0 microversion: 2.1 time: 0.457439 Oct 28 11:05:49.081518 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3920/7844] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:05:48 2022] POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:05:49.091181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:05:49.091877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:05:49.098186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:49.098754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:49.099192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:49.100092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:49.100557 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:49.101014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:49.257356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:05:49.265933 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c697cb8-c97a-477d-b16a-48e3ff3dfe5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1760 microversion: 2.1 time: 0.179720 Oct 28 11:05:49.266527 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3925/7845] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:05:49 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:05:49.586273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0129afb0-e538-4481-8e08-75dea10387dc req-e8bce6df-c788-492d-80c9-7e701eef5ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2", "tag": "6d4340b3-a9ae-42b4-b0be-f40cd0597bb3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:05:49.596660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0129afb0-e538-4481-8e08-75dea10387dc req-e8bce6df-c788-492d-80c9-7e701eef5ed3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:05:49.597207 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0129afb0-e538-4481-8e08-75dea10387dc req-e8bce6df-c788-492d-80c9-7e701eef5ed3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:05:49.597654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0129afb0-e538-4481-8e08-75dea10387dc req-e8bce6df-c788-492d-80c9-7e701eef5ed3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:05:49.610363 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0129afb0-e538-4481-8e08-75dea10387dc req-e8bce6df-c788-492d-80c9-7e701eef5ed3 service nova] Creating event network-changed:6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 for instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 on n-h1-zed-1 Oct 28 11:05:49.615458 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0129afb0-e538-4481-8e08-75dea10387dc req-e8bce6df-c788-492d-80c9-7e701eef5ed3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033099 Oct 28 11:05:49.616376 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3921/7846] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:06:05.000082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:06:05.002433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:05.005173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:05.006089 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:05.012045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:05.012534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:05.013003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:05.013699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:05.014154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:05.014583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:05.088217 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c00874c-d4e1-4baf-a610-c1ea2cb61284 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/action" status: 202 len: 0 microversion: 2.1 time: 0.091774 Oct 28 11:06:05.088872 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3926/7847] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:06:04 2022] POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:06:05.098255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:05.098977 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:05.101280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:05.102096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:05.108991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:05.109593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:05.110260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:05.111001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:05.111466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:05.111917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:05.592075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:05.601728 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9c302f68-7355-4783-9e0d-c7881bb05dd6 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1752 microversion: 2.1 time: 0.507109 Oct 28 11:06:05.602640 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3922/7848] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:05 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1752 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:06.626156 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:06.626853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:06.634262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:06.634745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:06.635178 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:06.635863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:06.636317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:06.636741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:06.784422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:06.793351 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad2d33be-58da-4da6-8c85-3130b99cf3e3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.170780 Oct 28 11:06:06.793932 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3927/7849] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:06 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:07.816303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:07.816965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:07.824139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:07.824636 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:07.825126 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:07.826081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:07.826551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:07.826990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:07.968752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:07.977104 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f8f2bc25-ab8b-4945-a335-ca8f2304ff88 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.164776 Oct 28 11:06:07.977690 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3923/7850] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:07 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:09.001673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:09.002298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:09.009094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:09.009581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:09.010025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:09.010719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:09.011182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:09.012255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:09.160321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:09.168678 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-15afe6ba-ea40-4c15-83f8-ceb4164968df tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.171117 Oct 28 11:06:09.169778 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3928/7851] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:08 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:10.192270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:10.192934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:10.199749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:10.200236 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:10.200684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:10.202152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:10.202612 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:10.203051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:10.346675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:10.354905 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-837a2bb0-3f3b-4084-90e6-b2bac0d3ad52 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.166528 Oct 28 11:06:10.355481 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3924/7852] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:10 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:11.378648 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:11.379277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:11.386964 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:11.387460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:11.387907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:11.389492 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:11.389894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:11.390333 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:11.534936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:11.543173 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4b4edb0e-8eeb-4ee5-a630-e1f99b2a7dab tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.168485 Oct 28 11:06:11.543751 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3929/7853] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:11 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:12.566687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:12.567343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:12.574223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:12.574718 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:12.575170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:12.576137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:12.577200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:12.577649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:12.716516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:12.725284 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0a0a5a34-6a06-43ba-9045-68bba65f9252 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.162488 Oct 28 11:06:12.725857 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3925/7854] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:12 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:13.749574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:13.750191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:13.757224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:13.757695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:13.758141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:13.758835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:13.759294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:13.759718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:13.901059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:13.909293 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bfd81296-e48e-467f-a0fc-268fbc0f2df0 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.164224 Oct 28 11:06:13.909869 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3930/7855] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:13 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:14.933516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:14.934138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:14.940954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:14.941446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:14.941920 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:14.942643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:14.943104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:14.943539 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:15.088568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:15.097568 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ea63aa72-67a3-4339-abe3-accbac5f3682 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.167926 Oct 28 11:06:15.098157 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3926/7856] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:14 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:16.120793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:16.121435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:16.128953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:16.129449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:16.129898 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:16.130595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:16.131054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:16.131484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:16.275488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:16.284289 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c283160f-efeb-4694-896c-6539e33ac57e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1757 microversion: 2.1 time: 0.167403 Oct 28 11:06:16.284864 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3931/7857] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:16 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:17.307982 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:17.308610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:17.316132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:17.316628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:17.317105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:17.317807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:17.318274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:17.318712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:17.492739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:17.501725 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c1c0259b-c74c-445a-aa67-69fc407afeb3 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1760 microversion: 2.1 time: 0.197583 Oct 28 11:06:17.502311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3927/7858] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:17 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1760 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:06:49.237707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1279553541"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:06:49.238307 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:49.240336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:49.241036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:49.242413 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:06:49.242596 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:06:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/action (ip 10.222.0.16) !!! Oct 28 11:06:49.254741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:49.255270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:49.255718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:49.256426 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:49.256893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:49.257352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:49.383794 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.network.security_group_api [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Removing security group b81a066d-3e56-4b47-a11b-41d5058ba0df from port 6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 Oct 28 11:06:49.689137 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-819c235d-624a-4898-9f12-82419bf73b5f tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/action" status: 202 len: 0 microversion: 2.1 time: 0.456387 Oct 28 11:06:49.689759 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3932/7859] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:06:49 2022] POST /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:06:49.697684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-41548c9a-9118-4039-853a-c573a846f547 req-219f3dea-8cb8-4d8a-b141-ee4a88ab318f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2", "tag": "6d4340b3-a9ae-42b4-b0be-f40cd0597bb3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:06:49.703600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:49.704455 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:06:49.711667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-41548c9a-9118-4039-853a-c573a846f547 req-219f3dea-8cb8-4d8a-b141-ee4a88ab318f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:49.712583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-41548c9a-9118-4039-853a-c573a846f547 req-219f3dea-8cb8-4d8a-b141-ee4a88ab318f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:49.712583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-41548c9a-9118-4039-853a-c573a846f547 req-219f3dea-8cb8-4d8a-b141-ee4a88ab318f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:49.725404 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-41548c9a-9118-4039-853a-c573a846f547 req-219f3dea-8cb8-4d8a-b141-ee4a88ab318f service nova] Creating event network-changed:6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 for instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 on n-h1-zed-1 Oct 28 11:06:49.730483 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-41548c9a-9118-4039-853a-c573a846f547 req-219f3dea-8cb8-4d8a-b141-ee4a88ab318f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036890 Oct 28 11:06:49.731388 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3928/7860] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:06:50.832568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:50.833117 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:50.839163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:50.839652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:50.840095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:50.840788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:50.841268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:50.841700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:50.923876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lazy-loading 'services' on Instance uuid 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:06:51.001300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea3ed1ac-7005-4a9e-ad39-9f60455b2e93 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments/88b537c1-6337-4643-bb21-6cab2f658eaa" status: 202 len: 0 microversion: 2.1 time: 0.173712 Oct 28 11:06:51.001910 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3933/7861] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 11:06:50 2022] DELETE /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments/88b537c1-6337-4643-bb21-6cab2f658eaa => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:06:51.013224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:51.015624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:51.022274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:51.023061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:51.023517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:51.024235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:51.024878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:51.025349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:51.060582 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3552c342-982a-4d89-b418-a1a57e1db3e7 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054055 Oct 28 11:06:51.061211 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3929/7862] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:06:51 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:06:51.747188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6fc21b96-3265-4ee8-bcc8-b665b82467d1 req-117a7b82-f856-4987-a835-b9a232479ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2", "tag": "6d4340b3-a9ae-42b4-b0be-f40cd0597bb3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:06:51.758083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6fc21b96-3265-4ee8-bcc8-b665b82467d1 req-117a7b82-f856-4987-a835-b9a232479ef9 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:51.758580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6fc21b96-3265-4ee8-bcc8-b665b82467d1 req-117a7b82-f856-4987-a835-b9a232479ef9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:51.759012 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6fc21b96-3265-4ee8-bcc8-b665b82467d1 req-117a7b82-f856-4987-a835-b9a232479ef9 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:51.771353 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6fc21b96-3265-4ee8-bcc8-b665b82467d1 req-117a7b82-f856-4987-a835-b9a232479ef9 service nova] Creating event network-changed:6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 for instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 on n-h1-zed-1 Oct 28 11:06:51.777169 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6fc21b96-3265-4ee8-bcc8-b665b82467d1 req-117a7b82-f856-4987-a835-b9a232479ef9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033928 Oct 28 11:06:51.778008 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3934/7863] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:06:52.075877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:52.078922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:52.085864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:52.086370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:52.086821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:52.087538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:52.088001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:52.088448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:52.119049 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c32d38d2-7fe4-443d-b5fd-ad465e525490 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047143 Oct 28 11:06:52.120495 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3930/7864] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:06:52 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:06:53.132293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:53.134637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:53.142394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:53.142887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:53.143329 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:53.144039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:53.144504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:53.144953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:53.177702 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a166335-c553-43c6-aaf0-90647b76b17b tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049800 Oct 28 11:06:53.178279 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3935/7865] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:06:53 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:06:54.191080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:54.193431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:54.200370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:54.200880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:54.201627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:54.202342 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:54.202812 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:54.203253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:54.232555 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-29bdff23-bb3d-4c8b-a5df-0969bb1d19cd tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Oct 28 11:06:54.233661 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3931/7866] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:06:54 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:06:55.245644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:55.247856 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:55.254711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:55.255202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:55.255646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:55.256347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:55.256811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:55.257264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:55.286732 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-74e12b54-7cfa-401a-ab66-494fcf276ca8 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Oct 28 11:06:55.287306 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3936/7867] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:06:55 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:06:56.299688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:56.301934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:56.308721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:56.309251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:56.309707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:56.310409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:56.310877 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:56.311954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:56.340502 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a84ff9f0-fd1e-453a-8fef-4372c54a7f71 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045315 Oct 28 11:06:56.341098 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3932/7868] 10.222.0.16 () {58 vars in 1302 bytes} [Fri Oct 28 11:06:56 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 28 11:06:56.351679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:56.352179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:56.359415 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:56.359890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:56.360323 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:56.361033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:56.361488 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:56.361915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:56.435637 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] HTTP exception thrown: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 is not attached to volume 88b537c1-6337-4643-bb21-6cab2f658eaa Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Request method failure captured: Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: request: DELETE /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments/88b537c1-6337-4643-bb21-6cab2f658eaa HTTP/1.1 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7Y7k1lNirK6q8YudIuZfGo5yDhvpbjWOqhNEAXYp-CuCXnQmebnalF1OLH5pk9cqvApElUZRUqZFEKMOjBJeR97g1JnhRyf201At0PNwxcyg7_toeH38vQNrYJPqr-I6mEgTLjAWMI-d1cAd1v09fGHWwOsfGDYVNDCaxoeD3cy3Nc Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3717bdde41e0401e925316053c8b4b3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3717bdde41e0401e925316053c8b4b3a"}]}] Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 44d187857c82461dba93a33f32981127 Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 is not attached to volume 88b537c1-6337-4643-bb21-6cab2f658eaa Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'server_id': '9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2', 'id': '88b537c1-6337-4643-bb21-6cab2f658eaa'} Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 88b537c1-6337-4643-bb21-6cab2f658eaa. Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 is not attached to volume 88b537c1-6337-4643-bb21-6cab2f658eaa Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:06:56.437880 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:06:56.442543 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:06:56.442543 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:06:56.442543 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 is not attached to volume 88b537c1-6337-4643-bb21-6cab2f658eaa Oct 28 11:06:56.442543 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:06:56.442543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Returning 404 to user: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 is not attached to volume 88b537c1-6337-4643-bb21-6cab2f658eaa {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:06:56.442543 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6ba4b3bb-d427-4b94-a685-d2e36ae2b6ec tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments/88b537c1-6337-4643-bb21-6cab2f658eaa" status: 404 len: 154 microversion: 2.1 time: 0.091691 Oct 28 11:06:56.442543 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3937/7869] 10.222.0.16 () {58 vars in 1416 bytes} [Fri Oct 28 11:06:56 2022] DELETE /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2/os-volume_attachments/88b537c1-6337-4643-bb21-6cab2f658eaa => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:06:59.690116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:59.690617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:59.697380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:59.697871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:59.698313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:59.699004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:59.699470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:59.699925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:59.725246 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:06:59.807691 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-810c5186-5bbe-4cf3-a3f7-ecf368ce7833 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 204 len: 0 microversion: 2.1 time: 0.121805 Oct 28 11:06:59.808432 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3933/7870] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:06:59 2022] DELETE /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:06:59.816561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:06:59.817368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:06:59.825188 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:59.825686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:59.826135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:59.827113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:06:59.827575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:06:59.828512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:06:59.961191 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:06:59.969703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4b4b5d52-889b-47ce-afaf-85469a51809e tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1554 microversion: 2.1 time: 0.157057 Oct 28 11:06:59.970272 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3938/7871] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:06:59 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:00.994480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:00.995192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:01.003364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:01.003858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:01.004308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:01.005034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:01.005500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:01.005945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:01.133212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:01.141080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a2330866-dab5-4070-b79a-eeee889fa33d tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1554 microversion: 2.1 time: 0.150881 Oct 28 11:07:01.141629 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3934/7872] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:00 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:02.046114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a8a2f436-cd5b-4d89-97b2-c22a9416763e req-f20ecac9-247a-482d-9c22-fc014de0115d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2", "name": "network-vif-deleted", "tag": "6d4340b3-a9ae-42b4-b0be-f40cd0597bb3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:07:02.056091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a8a2f436-cd5b-4d89-97b2-c22a9416763e req-f20ecac9-247a-482d-9c22-fc014de0115d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:02.056577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a8a2f436-cd5b-4d89-97b2-c22a9416763e req-f20ecac9-247a-482d-9c22-fc014de0115d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:02.057039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a8a2f436-cd5b-4d89-97b2-c22a9416763e req-f20ecac9-247a-482d-9c22-fc014de0115d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:02.068706 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a8a2f436-cd5b-4d89-97b2-c22a9416763e req-f20ecac9-247a-482d-9c22-fc014de0115d service nova] Creating event network-vif-deleted:6d4340b3-a9ae-42b4-b0be-f40cd0597bb3 for instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 on n-h1-zed-1 Oct 28 11:07:02.073858 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a8a2f436-cd5b-4d89-97b2-c22a9416763e req-f20ecac9-247a-482d-9c22-fc014de0115d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032141 Oct 28 11:07:02.074473 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3939/7873] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:07:02.164092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:02.164756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:02.173418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:02.173923 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:02.174376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:02.175090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:02.175557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:02.176003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:02.210318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:02.210816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:02.211266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:02.211729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lazy-loading 'fault' on Instance uuid 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:07:02.255386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44d187857c82461dba93a33f32981127', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3717bdde41e0401e925316053c8b4b3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:02.263321 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e55c6db2-4e60-42c5-af5a-251550326011 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 200 len: 1349 microversion: 2.1 time: 0.103572 Oct 28 11:07:02.263890 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3935/7874] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:02 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 1349 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:03.287404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:03.288147 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] [instance: 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:03.294315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:03.294802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:03.295746 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:03.296439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:03.296895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:03.297349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:03.310337 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] HTTP exception thrown: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 could not be found. Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Request method failure captured: Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 HTTP/1.1 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7Y7k1lNirK6q8YudIuZfGo5yDhvpbjWOqhNEAXYp-CuCXnQmebnalF1OLH5pk9cqvApElUZRUqZFEKMOjBJeR97g1JnhRyf201At0PNwxcyg7_toeH38vQNrYJPqr-I6mEgTLjAWMI-d1cAd1v09fGHWwOsfGDYVNDCaxoeD3cy3Nc Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3717bdde41e0401e925316053c8b4b3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3717bdde41e0401e925316053c8b4b3a", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3717bdde41e0401e925316053c8b4b3a"}]}] Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 3717bdde41e0401e925316053c8b4b3a Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestMinimumBasicScenario-191210244 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 44d187857c82461dba93a33f32981127 Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestMinimumBasicScenario-191210244-project Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 could not be found. Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2'} Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 could not be found. Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 could not be found. Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:07:03.312590 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 could not be found. Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Returning 404 to user: Instance 9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a479d7a5-4f7e-40c8-8965-ba21a72a56a2 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2" status: 404 len: 111 microversion: 2.1 time: 0.031791 Oct 28 11:07:03.317698 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3940/7875] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:03 2022] GET /compute/v2.1/servers/9d6ccd64-a1b5-4dab-9db6-4fe39a52b2e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:07:03.322790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-53bf44e1-38ce-406d-8f96-4ba16eb4d071 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] Calling method '.version_select at 0x7fca3073cb80>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:03.342477 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-53bf44e1-38ce-406d-8f96-4ba16eb4d071 tempest-TestMinimumBasicScenario-191210244 tempest-TestMinimumBasicScenario-191210244-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1079174691" status: 202 len: 0 microversion: 2.1 time: 0.023502 Oct 28 11:07:03.343042 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3936/7876] 10.222.0.16 () {58 vars in 1272 bytes} [Fri Oct 28 11:07:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1079174691 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 11:07:12.498719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f42cfa9f-66fd-4208-9981-df2d66683680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: .version_select at 0x7fca322aa160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2018439853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGNhAkTMSKM/pnENXxjWZ5gYBtPE1LcYS3j34nDPXKC++Vyr5V7tN3CuaxRiVJsn4frnnXAK0uAXxiHpGfBl4xqqsVIZE/CCk8KwL759LK1lBrzYShPbGPqf7KYgRpJgUw=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:07:12.514959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f42cfa9f-66fd-4208-9981-df2d66683680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:07:12.519969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-f42cfa9f-66fd-4208-9981-df2d66683680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:07:12.543269 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f42cfa9f-66fd-4208-9981-df2d66683680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.215402 Oct 28 11:07:12.543798 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3941/7877] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:07:12 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:07:18.217796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:18.218579 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:18.223075 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1149370558", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "2ef0fb06-b11f-4fb1-98c9-a3ef542f5759"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2018439853", "security_groups": [{"name": "tempest-secgroup-smoke-110044038"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:07:18.351866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] validate_networks() for [('2ef0fb06-b11f-4fb1-98c9-a3ef542f5759', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:07:18.863113 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:07:18.863544 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:07:18.864230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:07:18.865302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:07:18.865783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:07:18.875506 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:18.876003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:18.876451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:18.877230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:18.877694 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:18.878196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:18.900494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:07:18.906049 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:07:18.918562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:07:18.920936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:07:18.975477 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b7b99321-2691-40b5-a1b3-fe5221d58aa2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760036 Oct 28 11:07:18.977012 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3937/7878] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:07:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:07:18.984787 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:18.998236 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b2560015-681f-47fd-be69-68c948808ec0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:18.998851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b2560015-681f-47fd-be69-68c948808ec0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:19.101924 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b2560015-681f-47fd-be69-68c948808ec0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:19.115034 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b2560015-681f-47fd-be69-68c948808ec0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1267 microversion: 2.1 time: 0.131012 Oct 28 11:07:19.135990 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3942/7879] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:18 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:20.138516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:20.140456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:20.149096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:20.149878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:20.150339 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:20.151070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:20.151786 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:20.152328 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:20.271652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:20.289568 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-01f4460f-9d0b-4db9-abed-cd4c72fc02ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1327 microversion: 2.1 time: 0.154788 Oct 28 11:07:20.290170 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3938/7880] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:20 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1327 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:21.311956 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:21.312582 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:21.314757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:21.323672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:21.324180 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:21.324624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:21.325368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:21.325833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:21.326269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:21.459604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:21.468838 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-18743a78-4bbb-4235-847a-33984ed78dc5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1392 microversion: 2.1 time: 0.160311 Oct 28 11:07:21.469823 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3943/7881] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:21 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:21.752715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a092e201-c727-428a-af3c-b89915516023 req-ad50d140-6c80-402b-b79a-fb8718739718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b712744a-b6c8-4fc2-8ff5-8cf4f8430a48", "tag": "3d4055dd-0474-4c21-b436-b375ade09d37"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:07:21.762988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a092e201-c727-428a-af3c-b89915516023 req-ad50d140-6c80-402b-b79a-fb8718739718 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:21.763470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a092e201-c727-428a-af3c-b89915516023 req-ad50d140-6c80-402b-b79a-fb8718739718 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:21.764005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a092e201-c727-428a-af3c-b89915516023 req-ad50d140-6c80-402b-b79a-fb8718739718 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:21.775727 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a092e201-c727-428a-af3c-b89915516023 req-ad50d140-6c80-402b-b79a-fb8718739718 service nova] Creating event network-changed:3d4055dd-0474-4c21-b436-b375ade09d37 for instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 on n-h2-zed-1 Oct 28 11:07:21.781252 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a092e201-c727-428a-af3c-b89915516023 req-ad50d140-6c80-402b-b79a-fb8718739718 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032042 Oct 28 11:07:21.781854 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3939/7882] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:07:22.491612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:22.492171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:22.499740 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:22.500232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:22.500674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:22.501396 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:22.501863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:22.502298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:22.639112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:22.648456 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5af88546-c3e6-44cc-b5c7-8b9a541b1420 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1392 microversion: 2.1 time: 0.160751 Oct 28 11:07:22.649079 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3944/7883] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:22 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:23.674348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:23.675189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:23.681553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:23.682060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:23.682518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:23.683232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:23.683706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:23.684154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:23.816004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:23.823851 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-212695a3-3302-4e8e-9cd3-f3af6b666aba tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1392 microversion: 2.1 time: 0.155383 Oct 28 11:07:23.824432 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3940/7884] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:23 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:24.847705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:24.848283 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:24.855387 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:24.855886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:24.856332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:24.857161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:24.857635 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:24.858090 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:24.990817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:24.998522 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-674554a1-e6a3-4bbb-b256-52cb5ee91437 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1392 microversion: 2.1 time: 0.154840 Oct 28 11:07:24.999297 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3945/7885] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:24 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:26.021361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:26.021951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:26.028802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:26.029337 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:26.029787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:26.030500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:26.030963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:26.031418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:26.164965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:26.173261 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-939e9933-4cf7-4ef6-b622-622e5835a772 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1392 microversion: 2.1 time: 0.155898 Oct 28 11:07:26.173837 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3941/7886] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:26 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:27.196344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:27.196995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:27.204682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:27.205205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:27.205649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:27.206346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:27.206824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:27.207241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:27.340890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:27.348508 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d48ea67b-ed64-4096-b31d-4380ea5f1503 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1392 microversion: 2.1 time: 0.156036 Oct 28 11:07:27.349107 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3946/7887] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:27 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:27.770173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-9c6739ac-0479-4b4f-b00c-c89023ce46f6 req-5f02a669-69b6-4689-b92a-c7a1765e09d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b712744a-b6c8-4fc2-8ff5-8cf4f8430a48", "name": "network-vif-plugged", "status": "completed", "tag": "3d4055dd-0474-4c21-b436-b375ade09d37"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:07:27.782908 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9c6739ac-0479-4b4f-b00c-c89023ce46f6 req-5f02a669-69b6-4689-b92a-c7a1765e09d5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:27.783518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9c6739ac-0479-4b4f-b00c-c89023ce46f6 req-5f02a669-69b6-4689-b92a-c7a1765e09d5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:27.784213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-9c6739ac-0479-4b4f-b00c-c89023ce46f6 req-5f02a669-69b6-4689-b92a-c7a1765e09d5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:27.796428 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-9c6739ac-0479-4b4f-b00c-c89023ce46f6 req-5f02a669-69b6-4689-b92a-c7a1765e09d5 service nova] Creating event network-vif-plugged:3d4055dd-0474-4c21-b436-b375ade09d37 for instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 on n-h2-zed-1 Oct 28 11:07:27.801468 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-9c6739ac-0479-4b4f-b00c-c89023ce46f6 req-5f02a669-69b6-4689-b92a-c7a1765e09d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035033 Oct 28 11:07:27.802065 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3942/7888] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:07:28.371353 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:28.372000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:28.378815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:28.379341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:28.379788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:28.380484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:28.380970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:28.381406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:28.510812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:28.519014 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7dc9b6cf-5d6e-4b20-87a0-c4761efc8451 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1392 microversion: 2.1 time: 0.151522 Oct 28 11:07:28.519527 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3947/7889] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:28 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:29.540148 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:29.540963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:29.545631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:29.546973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:29.554321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:29.554822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:29.555272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:29.555976 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:29.556461 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:29.556889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:29.690211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:29.698002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-62383544-002e-4b89-8095-30133779e531 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1564 microversion: 2.1 time: 0.159655 Oct 28 11:07:29.698592 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3943/7890] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:29 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:29.721073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:29.721695 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:29.723546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:07:29.730407 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:29.730895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:29.731330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:29.732021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:29.732474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:29.732919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:29.863245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:29.871043 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-065bc6ff-c866-4486-853b-38472249be66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1564 microversion: 2.1 time: 0.154425 Oct 28 11:07:29.871618 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3948/7891] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:29 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:07:31.744863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:07:31.746154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:07:31.748439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1ac4fdfd-ad02-4206-a12b-15c787d58019 req-4ef1c6aa-91b7-4e66-aeff-b42c5f368de6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b712744a-b6c8-4fc2-8ff5-8cf4f8430a48", "tag": "3d4055dd-0474-4c21-b436-b375ade09d37"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:07:31.754926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:31.755722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:31.756865 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:31.757998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:31.758759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:31.759459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:31.760135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1ac4fdfd-ad02-4206-a12b-15c787d58019 req-4ef1c6aa-91b7-4e66-aeff-b42c5f368de6 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:07:31.760624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1ac4fdfd-ad02-4206-a12b-15c787d58019 req-4ef1c6aa-91b7-4e66-aeff-b42c5f368de6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:07:31.761103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1ac4fdfd-ad02-4206-a12b-15c787d58019 req-4ef1c6aa-91b7-4e66-aeff-b42c5f368de6 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:07:31.776545 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1ac4fdfd-ad02-4206-a12b-15c787d58019 req-4ef1c6aa-91b7-4e66-aeff-b42c5f368de6 service nova] Creating event network-changed:3d4055dd-0474-4c21-b436-b375ade09d37 for instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 on n-h2-zed-1 Oct 28 11:07:31.781767 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1ac4fdfd-ad02-4206-a12b-15c787d58019 req-4ef1c6aa-91b7-4e66-aeff-b42c5f368de6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037802 Oct 28 11:07:31.782394 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3949/7892] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:07:31.947860 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:07:31.956338 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0d5fd57d-0acf-4902-852f-760fbc3041d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1564 microversion: 2.1 time: 0.215549 Oct 28 11:07:31.957311 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3944/7893] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:07:31 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1564 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:08:03.241511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=13 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:03.242258 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=38 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:03.246680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:03.248922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:03.255737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:03.256228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:03.256667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:03.257400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:03.257853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:03.258280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:03.324929 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7db89270-ae70-453f-8f5d-ea92b4431b66 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action" status: 200 len: 24570 microversion: 2.1 time: 0.085348 Oct 28 11:08:03.325610 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3950/7894] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:08:03 2022] POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action => generated 24570 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:08:33.772288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:33.773095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:33.777828 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:33.778380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:33.785768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:33.786274 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:33.786734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:33.787443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:33.787922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:33.788372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:34.131009 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7ed90b2c-6bc0-40ed-98b4-06fa911314cc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action" status: 202 len: 0 microversion: 2.1 time: 0.360211 Oct 28 11:08:34.135013 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3945/7895] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:08:33 2022] POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 11:08:34.140789 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:34.149744 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:34.152715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:34.153487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:34.162293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:34.162796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:34.163255 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:34.163981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:34.164474 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:34.165014 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:34.307149 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:34.315987 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d3770060-01c1-45c8-9591-8302baec09c9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1687 microversion: 2.1 time: 0.179462 Oct 28 11:08:34.316570 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3951/7896] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:34 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:35.342864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:35.343507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:35.349940 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:35.350450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:35.350904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:35.351650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:35.352125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:35.352570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:35.482557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:35.490272 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b652ff0c-5b1c-481d-8352-c441c2c0c98c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1667 microversion: 2.1 time: 0.153034 Oct 28 11:08:35.490848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3946/7897] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:35 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:36.586464 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:36.588687 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:36.595860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:36.596343 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:36.596781 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:36.597507 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:36.597959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:36.598385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:36.666201 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-35629248-0dd7-461d-91fc-353fca2ffea5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action" status: 200 len: 32646 microversion: 2.1 time: 0.083480 Oct 28 11:08:36.666849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3952/7898] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:08:36 2022] POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action => generated 32646 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:08:36.679230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:36.679794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:36.686785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:36.687294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:36.687755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:36.688467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:36.688962 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:36.690054 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:36.754890 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-485dbb9e-0ebd-43b7-8017-42855302784a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action" status: 202 len: 0 microversion: 2.1 time: 0.079570 Oct 28 11:08:36.755554 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3947/7899] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:08:36 2022] POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 11:08:36.765753 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:36.766739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:36.774030 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:36.774521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:36.774991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:36.775700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:36.776224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:36.776614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:36.908612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:36.916759 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-95acdf67-5299-4bf0-8c6b-70f819cfe083 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1674 microversion: 2.1 time: 0.155877 Oct 28 11:08:36.917353 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3953/7900] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:36 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:37.943852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:37.944564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:37.950659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:37.951154 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:37.951603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:37.952299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:37.953046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:37.953483 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:38.086623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:38.095330 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3f7d26f9-87b3-4e7d-9aa8-2755fb4b38fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1682 microversion: 2.1 time: 0.157144 Oct 28 11:08:38.095903 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3948/7901] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:37 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:38.198757 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:38.200970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:38.208895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:38.209402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:38.209841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:38.210528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:38.211011 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:38.211433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:38.274637 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5375b43-94d3-4424-9398-36808fbc314a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action" status: 200 len: 37872 microversion: 2.1 time: 0.079689 Oct 28 11:08:38.275291 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3954/7902] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:08:38 2022] POST /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48/action => generated 37872 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:08:39.252153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:39.252675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:39.255946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e5f7864e-ec73-4877-8b0c-b5dd032a4d1a req-175f46a0-f0cd-4c2b-83f7-c4f7f189c026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b712744a-b6c8-4fc2-8ff5-8cf4f8430a48", "tag": "3d4055dd-0474-4c21-b436-b375ade09d37"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:39.262052 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:39.262897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:39.263365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:39.264103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:39.264798 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:39.265294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:39.268527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5f7864e-ec73-4877-8b0c-b5dd032a4d1a req-175f46a0-f0cd-4c2b-83f7-c4f7f189c026 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:39.269037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5f7864e-ec73-4877-8b0c-b5dd032a4d1a req-175f46a0-f0cd-4c2b-83f7-c4f7f189c026 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:39.269470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e5f7864e-ec73-4877-8b0c-b5dd032a4d1a req-175f46a0-f0cd-4c2b-83f7-c4f7f189c026 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:39.281332 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e5f7864e-ec73-4877-8b0c-b5dd032a4d1a req-175f46a0-f0cd-4c2b-83f7-c4f7f189c026 service nova] Creating event network-changed:3d4055dd-0474-4c21-b436-b375ade09d37 for instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 on n-h2-zed-1 Oct 28 11:08:39.286621 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e5f7864e-ec73-4877-8b0c-b5dd032a4d1a req-175f46a0-f0cd-4c2b-83f7-c4f7f189c026 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037550 Oct 28 11:08:39.287477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3955/7903] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:08:39.293644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:08:39.383868 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0467cb03-2349-4633-ae0d-6c4a9ba36e9a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 204 len: 0 microversion: 2.1 time: 0.136765 Oct 28 11:08:39.387706 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3949/7904] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:08:39 2022] DELETE /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:08:39.398026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:39.399321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:39.407071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:39.407653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:39.408344 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:39.409161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:39.409688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:39.410186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:39.551946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:39.559819 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-774ab3cd-1b00-4a42-8ce5-d62c962d317c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1688 microversion: 2.1 time: 0.166903 Oct 28 11:08:39.560605 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3956/7905] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:39 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:40.585158 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:40.585864 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:40.592869 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:40.593424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:40.593887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:40.594613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:40.595088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:40.595536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:40.771985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:40.779766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-009b1ed2-2c7e-4207-9143-2c58f7fb874f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1688 microversion: 2.1 time: 0.199030 Oct 28 11:08:40.780335 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3950/7906] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:40 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1688 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:41.803510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:41.804185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:41.811031 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:41.811526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:41.811970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:41.812680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:41.813162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:41.813601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:42.022802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:42.030952 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-691a77a6-fb2b-45aa-a3f1-37f2fe4d6964 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 200 len: 1570 microversion: 2.1 time: 0.231282 Oct 28 11:08:42.031599 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3957/7907] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:41 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 1570 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:42.150378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-d09f0e55-948d-4452-9392-ca3784ea9d4a req-a6ec1d6a-1e82-4a0b-9d8e-0d0df2b7e350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b712744a-b6c8-4fc2-8ff5-8cf4f8430a48", "name": "network-vif-deleted", "tag": "3d4055dd-0474-4c21-b436-b375ade09d37"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:42.160671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d09f0e55-948d-4452-9392-ca3784ea9d4a req-a6ec1d6a-1e82-4a0b-9d8e-0d0df2b7e350 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:42.161217 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d09f0e55-948d-4452-9392-ca3784ea9d4a req-a6ec1d6a-1e82-4a0b-9d8e-0d0df2b7e350 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:42.161693 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-d09f0e55-948d-4452-9392-ca3784ea9d4a req-a6ec1d6a-1e82-4a0b-9d8e-0d0df2b7e350 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:42.173084 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-d09f0e55-948d-4452-9392-ca3784ea9d4a req-a6ec1d6a-1e82-4a0b-9d8e-0d0df2b7e350 service nova] Creating event network-vif-deleted:3d4055dd-0474-4c21-b436-b375ade09d37 for instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 on n-h2-zed-1 Oct 28 11:08:42.177911 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-d09f0e55-948d-4452-9392-ca3784ea9d4a req-a6ec1d6a-1e82-4a0b-9d8e-0d0df2b7e350 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031316 Oct 28 11:08:42.178512 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3951/7908] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:08:43.055578 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:43.056204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b712744a-b6c8-4fc2-8ff5-8cf4f8430a48] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:43.063063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:43.063558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:43.064037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:43.064743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:43.065238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:43.065676 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:43.080123 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] HTTP exception thrown: Instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 could not be found. Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Request method failure captured: Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 HTTP/1.1 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7ffxW7IzOVzm9VzZb3lolIJroMzL5jlKpL7h17sKYJwD4trIZr_OSxOxSlxR9dzGbvMQyolBrfwg5zXfyKN-6MsCQ9nIGrZAi7TYTcj5XjEBtqfoQdU4v7g59EYORLpm-oqQcgLvgqRGIy8rJJBLgwkmqSQQURG2FyWGDlp8-mKU5s Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19a924fff2a74cd489ec2f9b0f43db97", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19a924fff2a74cd489ec2f9b0f43db97"}]}] Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 65c0789aabf74875985235644d9191a7 Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 could not be found. Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'b712744a-b6c8-4fc2-8ff5-8cf4f8430a48'} Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 could not be found. Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 could not be found. Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:08:43.081810 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 could not be found. Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Returning 404 to user: Instance b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c02e5053-7231-4397-9617-68325fb7f57b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48" status: 404 len: 111 microversion: 2.1 time: 0.031546 Oct 28 11:08:43.090461 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3958/7909] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:43 2022] GET /compute/v2.1/servers/b712744a-b6c8-4fc2-8ff5-8cf4f8430a48 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:08:46.297060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ef01b699-52d6-440c-bb86-ccd0502715aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '.version_select at 0x7fca320df1f0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:46.321447 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ef01b699-52d6-440c-bb86-ccd0502715aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2018439853" status: 202 len: 0 microversion: 2.1 time: 0.029532 Oct 28 11:08:46.322163 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3952/7910] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 11:08:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2018439853 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:08:46.347914 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cfc4b5a5-11cf-4cfd-94bb-c59047a7433f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: .version_select at 0x7fca322a80d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2064973952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE3W2O8KEPuPhEc5enZ3D+ALi6QC7gCOsQ4Z6ZLvzQEuD2HVe3G0PhHhe8vVLoUSOZUSE0T05XNEBV3/xsQelgVvfBWfvShlJgFMMJufoJnlv9Z2XJoun2eNHUl82VVqGA=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:46.365620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cfc4b5a5-11cf-4cfd-94bb-c59047a7433f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:08:46.372252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-cfc4b5a5-11cf-4cfd-94bb-c59047a7433f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:08:46.397675 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cfc4b5a5-11cf-4cfd-94bb-c59047a7433f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053576 Oct 28 11:08:46.398291 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3959/7911] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:08:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:08:51.886366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-501111606", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "460fce92-6b5f-4407-a827-7fa6a4d9266b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2064973952", "security_groups": [{"name": "tempest-secgroup-smoke-1738567640"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:52.008684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] validate_networks() for [('460fce92-6b5f-4407-a827-7fa6a4d9266b', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:08:52.167187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:52.708121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:08:52.708568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:08:52.709137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:08:52.709596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:08:52.710029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:08:52.722533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:52.724855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:52.725375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:52.726150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:52.726632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:52.727085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:52.748367 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:08:52.755563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:08:52.768657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:08:52.771201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:08:52.818654 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e55e0038-4219-46ec-b8c4-d860879e589a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.938085 Oct 28 11:08:52.819435 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3953/7912] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:08:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:08:52.832574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c9be03a-f9cd-4775-b35f-c76af1a7e9ce tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:52.833218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c9be03a-f9cd-4775-b35f-c76af1a7e9ce tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:52.902835 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c9be03a-f9cd-4775-b35f-c76af1a7e9ce tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:52.911154 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c9be03a-f9cd-4775-b35f-c76af1a7e9ce tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1266 microversion: 2.1 time: 0.083977 Oct 28 11:08:52.925277 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3960/7913] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:52 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:53.933714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:53.934444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:53.943046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:53.943847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:53.944503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:53.945446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:53.947051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:53.947738 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:54.026253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:54.035091 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4828cb38-c0ac-432f-8da4-2fb717f2a950 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1326 microversion: 2.1 time: 0.105150 Oct 28 11:08:54.035946 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3954/7914] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:53 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:55.059643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:55.060380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:55.062448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=36 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:08:55.074118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:55.075026 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:55.075658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:55.076562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:55.077287 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:55.078160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:55.328543 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:55.336241 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-87a07933-0f68-4a3d-b31c-48a4ea56489f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.280746 Oct 28 11:08:55.336819 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3961/7915] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:55 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:55.684627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-18e660ce-c0e0-48f8-8bc0-4461789820bd req-dbe0d52c-9a2e-404f-9ce8-04d83e681753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a00023-0242-4cb7-8d7c-54a1b778fe84", "tag": "3da47dd1-0974-408f-8ab7-e8965925b914"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:08:55.696169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-18e660ce-c0e0-48f8-8bc0-4461789820bd req-dbe0d52c-9a2e-404f-9ce8-04d83e681753 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:55.696689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-18e660ce-c0e0-48f8-8bc0-4461789820bd req-dbe0d52c-9a2e-404f-9ce8-04d83e681753 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:55.697186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-18e660ce-c0e0-48f8-8bc0-4461789820bd req-dbe0d52c-9a2e-404f-9ce8-04d83e681753 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:55.708789 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-18e660ce-c0e0-48f8-8bc0-4461789820bd req-dbe0d52c-9a2e-404f-9ce8-04d83e681753 service nova] Creating event network-changed:3da47dd1-0974-408f-8ab7-e8965925b914 for instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 on n-h2-zed-1 Oct 28 11:08:55.713749 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-18e660ce-c0e0-48f8-8bc0-4461789820bd req-dbe0d52c-9a2e-404f-9ce8-04d83e681753 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033010 Oct 28 11:08:55.714358 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3955/7916] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:08:56.361044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:56.361706 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:56.368662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:56.369181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:56.369616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:56.370311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:56.370773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:56.371311 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:56.558978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:56.567476 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-12712963-686f-47e8-b780-53857aafd155 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.210539 Oct 28 11:08:56.568050 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3962/7917] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:56 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:57.592527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:57.593268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:57.600232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:57.600735 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:57.601214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:57.601927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:57.602395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:57.602839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:57.733321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:57.741136 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fd49887d-9cc8-4c41-82d6-8c07faa512fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.153756 Oct 28 11:08:57.741714 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3956/7918] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:57 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:08:58.763689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:08:58.764310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:08:58.771314 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:58.771863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:58.772313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:58.773082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:08:58.773542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:08:58.773974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:08:58.997167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:08:59.004870 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ca78a25-e8a8-4ee5-9303-79561a318b53 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.245155 Oct 28 11:08:59.005477 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3963/7919] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:08:58 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:00.028632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:09:00.029297 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:00.036267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:00.036773 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:00.037259 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:00.037980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:00.038457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:00.038905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:00.178060 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:09:00.186080 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-779b18df-c835-4928-a82f-7cfad5e20c42 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.161411 Oct 28 11:09:00.186677 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3957/7920] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:09:00 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:01.210155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:09:01.210809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:01.217679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:01.218170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:01.218614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:01.219309 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:01.219771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:01.220812 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:01.356643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:09:01.364510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64e13497-9714-4097-9bef-3a7289f8cf97 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.158200 Oct 28 11:09:01.365130 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3964/7921] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:09:01 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:02.248144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-040bf4df-1d54-4da1-ad01-441d834ddd3d req-43843c06-f5fa-4d7f-9924-74e3cf52e3cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a00023-0242-4cb7-8d7c-54a1b778fe84", "name": "network-vif-plugged", "status": "completed", "tag": "3da47dd1-0974-408f-8ab7-e8965925b914"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:09:02.259783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-040bf4df-1d54-4da1-ad01-441d834ddd3d req-43843c06-f5fa-4d7f-9924-74e3cf52e3cb service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:02.260301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-040bf4df-1d54-4da1-ad01-441d834ddd3d req-43843c06-f5fa-4d7f-9924-74e3cf52e3cb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:02.260757 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-040bf4df-1d54-4da1-ad01-441d834ddd3d req-43843c06-f5fa-4d7f-9924-74e3cf52e3cb service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:02.272294 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-040bf4df-1d54-4da1-ad01-441d834ddd3d req-43843c06-f5fa-4d7f-9924-74e3cf52e3cb service nova] Creating event network-vif-plugged:3da47dd1-0974-408f-8ab7-e8965925b914 for instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 on n-h2-zed-1 Oct 28 11:09:02.277558 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-040bf4df-1d54-4da1-ad01-441d834ddd3d req-43843c06-f5fa-4d7f-9924-74e3cf52e3cb service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033418 Oct 28 11:09:02.278174 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3958/7922] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:09:02.387346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:09:02.387900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:02.394733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:02.395229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:02.395674 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:02.396374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:02.396837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:02.397299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:02.788623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:09:02.796408 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c83979f-c158-43e3-8f38-3978a74657f7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.413073 Oct 28 11:09:02.797001 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3965/7923] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:09:02 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:03.819463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:09:03.820179 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:03.822284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:03.822965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:03.824566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:03.830991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:03.831491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:03.831948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:03.832666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:03.833169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:03.833613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:03.975245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:09:03.982996 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6f19e179-362f-4884-afd3-dc3105800cb2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1392 microversion: 2.1 time: 0.167844 Oct 28 11:09:03.983588 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3959/7924] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:09:03 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:05.006358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:09:05.006966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:05.008811 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:05.010310 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:05.016597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:05.017128 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:05.017580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:05.018354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:05.018825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:05.019262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:05.151056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:09:05.160362 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-20f81c20-5946-44e8-9d00-827d0241e20a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1563 microversion: 2.1 time: 0.157833 Oct 28 11:09:05.160969 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3966/7925] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:09:05 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:05.185044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:09:05.185669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:05.192626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:05.193161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:05.193607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:05.194306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:05.194771 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:05.195209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:05.325100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:09:05.333258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f0526f46-abfe-4d6f-aefc-45d4d0c4d3e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1563 microversion: 2.1 time: 0.152087 Oct 28 11:09:05.333827 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3960/7926] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:09:05 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:06.893225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:09:06.893845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:06.902279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b97ee2b1-152f-4008-bef9-1e521ef937cd req-9e798418-d3cd-4e10-ad94-601865b3e0dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a00023-0242-4cb7-8d7c-54a1b778fe84", "tag": "3da47dd1-0974-408f-8ab7-e8965925b914"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:09:06.912272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:06.912765 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:06.913233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:06.913941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:06.914397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:06.914825 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:06.923056 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b97ee2b1-152f-4008-bef9-1e521ef937cd req-9e798418-d3cd-4e10-ad94-601865b3e0dc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:06.923551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b97ee2b1-152f-4008-bef9-1e521ef937cd req-9e798418-d3cd-4e10-ad94-601865b3e0dc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:06.923994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b97ee2b1-152f-4008-bef9-1e521ef937cd req-9e798418-d3cd-4e10-ad94-601865b3e0dc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:06.935812 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b97ee2b1-152f-4008-bef9-1e521ef937cd req-9e798418-d3cd-4e10-ad94-601865b3e0dc service nova] Creating event network-changed:3da47dd1-0974-408f-8ab7-e8965925b914 for instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 on n-h2-zed-1 Oct 28 11:09:06.941286 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b97ee2b1-152f-4008-bef9-1e521ef937cd req-9e798418-d3cd-4e10-ad94-601865b3e0dc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042388 Oct 28 11:09:06.941897 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3961/7927] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:09:07.101303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:09:07.110033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3c3ca86a-5f19-45ee-91e7-55260bdd642e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1563 microversion: 2.1 time: 0.219994 Oct 28 11:09:07.110629 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3967/7928] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:09:06 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1563 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:09:38.386934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=5 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:38.387700 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=38 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:09:38.391955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:09:38.394270 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:09:38.401247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:38.401752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:38.402210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:38.402925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:09:38.403403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:09:38.403851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:09:38.470678 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5b38c22-6f18-4745-9842-f50d22033cb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84/action" status: 200 len: 24564 microversion: 2.1 time: 0.085796 Oct 28 11:09:38.471555 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3962/7929] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:09:38 2022] POST /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84/action => generated 24564 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:10:08.877192 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:08.877902 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=42 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:08.882132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:10:08.884361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:08.891022 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:08.891521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:08.891970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:08.892673 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:08.893163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:08.893602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:08.965590 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c728df9-5813-4e17-8937-eaa054c46215 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84/action" status: 202 len: 0 microversion: 2.1 time: 0.090296 Oct 28 11:10:08.966232 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3968/7930] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:10:08 2022] POST /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:10:08.975542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:08.976264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:08.979045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:08.979890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=4 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:08.986006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:08.986518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:08.987096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:08.987708 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:08.988186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:08.988631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:09.216288 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:09.224811 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8db3111f-87ee-483c-b4ad-be95e158a33c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1674 microversion: 2.1 time: 0.253543 Oct 28 11:10:09.225432 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3963/7931] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:08 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1674 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:10.251548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:10.252261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:10.259028 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:10.259525 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:10.259970 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:10.260670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:10.261165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:10.261602 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:10.447109 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:10.455244 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3cc67fd5-19b4-402f-bbd1-bde5fac65e4a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.208981 Oct 28 11:10:10.455816 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3969/7932] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:10 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:11.479439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:11.480071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:11.487619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:11.488121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:11.488577 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:11.489312 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:11.489791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:11.490234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:11.622118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:11.629860 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-82935720-2cc1-4fa5-8dbb-f4e667897570 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.154928 Oct 28 11:10:11.630436 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3964/7933] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:11 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:12.652840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:12.653562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:12.660340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:12.660830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:12.661302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:12.661993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:12.662450 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:12.662880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:12.795210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:12.802950 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-81c47d43-4f10-4e13-b605-d64deb1d50f9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.154037 Oct 28 11:10:12.804027 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3970/7934] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:12 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:13.827329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:13.827995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:13.836372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:13.836876 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:13.837359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:13.838081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:13.838558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:13.839004 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:13.968055 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:13.975966 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fe4f75a2-cacf-4b3f-9046-4788f0c78038 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.152568 Oct 28 11:10:13.976537 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3965/7935] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:13 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:14.999177 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:14.999799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:15.003175 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:10:15.003307 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:10:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 (ip 10.222.0.16) !!! Oct 28 11:10:15.010375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:15.010878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:15.011326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:15.012033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:15.012496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:15.012953 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:15.150261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:15.158299 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d9a3033d-1183-47e2-9dcd-1fa52f0980c3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.162926 Oct 28 11:10:15.158878 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3971/7936] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:14 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:16.182494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:16.183127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:16.190082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:16.190616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:16.191077 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:16.191795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:16.192268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:16.192720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:16.324304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:16.333456 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-20aedd0b-9d20-4178-9eff-c378c17329e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.155454 Oct 28 11:10:16.334014 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3966/7937] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:16 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:17.356599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:17.357237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:17.364099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:17.364598 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:17.365080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:17.366294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:17.366763 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:17.367201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:17.499478 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:17.507345 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bf71a782-4153-4c51-957c-b88d9eba040a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.154803 Oct 28 11:10:17.507936 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3972/7938] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:17 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:18.531064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:18.531726 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:18.538593 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:18.539098 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:18.539556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:18.540265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:18.540742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:18.541210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:18.673130 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:18.681797 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7b5285ae-e201-49fd-ba5d-fe30689cb1f5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.154634 Oct 28 11:10:18.682388 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3967/7939] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:18 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:19.705992 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:19.706649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:19.713585 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:19.714081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:19.714533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:19.715241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:19.715705 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:19.716142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:19.851102 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:19.858972 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d43b4c6f-86ae-4518-9ae6-4026d56d8bac tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1679 microversion: 2.1 time: 0.157277 Oct 28 11:10:19.859554 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3973/7940] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:19 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:20.882273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:10:20.882895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:20.889321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:20.889809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:20.890253 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:20.890969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:20.891419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:20.891856 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:21.024419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:10:21.032240 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e07af1b7-78b4-4d18-9386-648c4738b028 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1682 microversion: 2.1 time: 0.153935 Oct 28 11:10:21.032819 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3968/7941] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:10:20 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:10:53.247358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:10:53.249621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:10:53.251950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:53.252619 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:10:53.258749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:53.259254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:53.259712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:53.260422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:10:53.260892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:10:53.261423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:10:53.334002 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-066d6ab6-987d-40b8-ad6e-376f6f4834ea tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84/action" status: 200 len: 68993 microversion: 2.1 time: 0.090399 Oct 28 11:10:53.334662 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3974/7942] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:10:53 2022] POST /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84/action => generated 68993 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:11:10.507295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:10.507824 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:10.510046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:10.511102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:10.514179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:10.515114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:10.517654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:10.518369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:10.519214 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:10.520025 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:10.520501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:10.521145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:10.549752 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:11:10.570174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3625c5fd-d8f5-4435-9585-671f98212841 req-58644139-7747-4704-ba26-c410344a9d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84a00023-0242-4cb7-8d7c-54a1b778fe84", "tag": "3da47dd1-0974-408f-8ab7-e8965925b914"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:11:10.585621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3625c5fd-d8f5-4435-9585-671f98212841 req-58644139-7747-4704-ba26-c410344a9d73 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:10.585621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3625c5fd-d8f5-4435-9585-671f98212841 req-58644139-7747-4704-ba26-c410344a9d73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:10.585621 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3625c5fd-d8f5-4435-9585-671f98212841 req-58644139-7747-4704-ba26-c410344a9d73 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:10.595372 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3625c5fd-d8f5-4435-9585-671f98212841 req-58644139-7747-4704-ba26-c410344a9d73 service nova] Creating event network-changed:3da47dd1-0974-408f-8ab7-e8965925b914 for instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 on n-h2-zed-1 Oct 28 11:11:10.601102 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3625c5fd-d8f5-4435-9585-671f98212841 req-58644139-7747-4704-ba26-c410344a9d73 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093328 Oct 28 11:11:10.602349 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3975/7943] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:11:10.637521 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e762b40d-1584-4726-97a6-392063f0cf95 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 204 len: 0 microversion: 2.1 time: 0.133995 Oct 28 11:11:10.638482 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3969/7944] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:11:10 2022] DELETE /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:11:10.647351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:10.648061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:10.655966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:10.656990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:10.657760 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:10.658667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:10.659305 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:10.660037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:10.805604 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:10.813512 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9116c90e-f4f1-4542-b336-ae4c5c592fb8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1688 microversion: 2.1 time: 0.170381 Oct 28 11:11:10.814248 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3976/7945] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:10 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:11.839680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:11.840323 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:11.847805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:11.848575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:11.849078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:11.849794 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:11.850271 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:11.850720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:11.989516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:11.998052 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7098360d-d399-4885-b5f2-fb3c02c832d5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1688 microversion: 2.1 time: 0.162744 Oct 28 11:11:11.998637 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3970/7946] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:11 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:12.893423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e3746c4b-6d69-4ed8-87da-2593e56d25c5 req-df7c62b2-1892-42ec-9edb-649450c12c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84a00023-0242-4cb7-8d7c-54a1b778fe84", "name": "network-vif-deleted", "tag": "3da47dd1-0974-408f-8ab7-e8965925b914"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:11:12.906372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e3746c4b-6d69-4ed8-87da-2593e56d25c5 req-df7c62b2-1892-42ec-9edb-649450c12c48 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:12.906860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e3746c4b-6d69-4ed8-87da-2593e56d25c5 req-df7c62b2-1892-42ec-9edb-649450c12c48 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:12.907299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e3746c4b-6d69-4ed8-87da-2593e56d25c5 req-df7c62b2-1892-42ec-9edb-649450c12c48 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:12.919936 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e3746c4b-6d69-4ed8-87da-2593e56d25c5 req-df7c62b2-1892-42ec-9edb-649450c12c48 service nova] Creating event network-vif-deleted:3da47dd1-0974-408f-8ab7-e8965925b914 for instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 on n-h2-zed-1 Oct 28 11:11:12.925388 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e3746c4b-6d69-4ed8-87da-2593e56d25c5 req-df7c62b2-1892-42ec-9edb-649450c12c48 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035654 Oct 28 11:11:12.926004 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3977/7947] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:11:13.022776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:13.023819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:13.031325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:13.031833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:13.032368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:13.033137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:13.033613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:13.034737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:13.068413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:13.068939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:13.069417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:13.069874 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lazy-loading 'fault' on Instance uuid 84a00023-0242-4cb7-8d7c-54a1b778fe84 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:11:13.115691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:13.124012 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-de93dc0d-de8c-4ca7-b6a2-cbecaf75362e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 200 len: 1356 microversion: 2.1 time: 0.105808 Oct 28 11:11:13.124669 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3971/7948] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:13 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:14.148878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:14.150139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 84a00023-0242-4cb7-8d7c-54a1b778fe84] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:14.156259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:14.156750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:14.157240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:14.157938 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:14.158400 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:14.158834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:14.175222 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] HTTP exception thrown: Instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 could not be found. Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Request method failure captured: Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 HTTP/1.1 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7ffxW7IzOVzm9VzZb3lolIJroMzL5jlKpL7h17sKYJwD4trIZr_OSxOxSlxR9dzGbvMQyolBrfwg5zXfyKN-6MsCQ9nIGrZAi7TYTcj5XjEBtqfoQdU4v7g59EYORLpm-oqQcgLvgqRGIy8rJJBLgwkmqSQQURG2FyWGDlp8-mKU5s Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19a924fff2a74cd489ec2f9b0f43db97", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19a924fff2a74cd489ec2f9b0f43db97"}]}] Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 65c0789aabf74875985235644d9191a7 Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 could not be found. Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '84a00023-0242-4cb7-8d7c-54a1b778fe84'} Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 could not be found. Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 could not be found. Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:11:14.176843 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 could not be found. Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Returning 404 to user: Instance 84a00023-0242-4cb7-8d7c-54a1b778fe84 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-87774554-f937-43e4-ae46-eb76346c993c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84" status: 404 len: 111 microversion: 2.1 time: 0.034558 Oct 28 11:11:14.182319 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3978/7949] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:14 2022] GET /compute/v2.1/servers/84a00023-0242-4cb7-8d7c-54a1b778fe84 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:11:17.450884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ad067f02-87a6-4341-9180-02a63d33aab6 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '.version_select at 0x7fca326173a0>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:17.472135 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ad067f02-87a6-4341-9180-02a63d33aab6 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2064973952" status: 202 len: 0 microversion: 2.1 time: 0.025016 Oct 28 11:11:17.472959 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3972/7950] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 11:11:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2064973952 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:11:17.505946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-30e1a92c-1754-42d3-b0c9-9750b21b46e5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: .version_select at 0x7fca3301b790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1768649955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBuPYRhGRvIXnBiYfG1Xis7y6bSNd+9huKO/YNUHx2Z8T87FUkfDDcUZbW4Q7EeXc1mgUgm+NDpcVv75tFRlnuR0aaVwLhxZUTxrT2+RxgYKICqsacAYJOkrHB88H1Pkyg=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:11:17.522160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-30e1a92c-1754-42d3-b0c9-9750b21b46e5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:11:17.528376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-30e1a92c-1754-42d3-b0c9-9750b21b46e5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:11:17.552835 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-30e1a92c-1754-42d3-b0c9-9750b21b46e5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050678 Oct 28 11:11:17.553407 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3979/7951] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:11:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:11:22.949548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-776795642", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "3e5877ac-2680-4f81-ba6f-a9f11826a6a2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1768649955", "security_groups": [{"name": "tempest-secgroup-smoke-2064444335"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:11:23.069900 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] validate_networks() for [('3e5877ac-2680-4f81-ba6f-a9f11826a6a2', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:11:23.120394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:23.620633 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:11:23.621420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:11:23.622748 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:11:23.624122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:11:23.624766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:11:23.639880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:23.641500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:23.643437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:23.645063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:23.647492 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:23.648176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:23.687382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:11:23.698618 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:11:23.714823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:11:23.718287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:11:23.773583 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [d1df3681-c805-43c0-98f8-5fe994109871] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:11:24.783233 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [d1df3681-c805-43c0-98f8-5fe994109871] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38242. Oct 28 11:11:24.788100 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-944fa97c-f127-4f87-a96f-c6e22acc63f1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.844424 Oct 28 11:11:24.788772 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3973/7952] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:11:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 11:11:24.800245 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b36a3e3-4f35-43ee-9671-006f770cb3c2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:24.800870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b36a3e3-4f35-43ee-9671-006f770cb3c2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:24.805138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:24.876238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b36a3e3-4f35-43ee-9671-006f770cb3c2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:24.884635 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b36a3e3-4f35-43ee-9671-006f770cb3c2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1266 microversion: 2.1 time: 0.088409 Oct 28 11:11:24.885868 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3980/7953] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:24 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:25.907644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:25.908280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:25.915452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:25.915959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:25.916426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:25.917186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:25.917833 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:25.918498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:26.044298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:26.052858 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0c5919a5-9484-416c-bdaa-5c2841b37622 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1326 microversion: 2.1 time: 0.149044 Oct 28 11:11:26.054333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3974/7954] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:25 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:27.079003 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:27.079754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:27.089424 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:27.089922 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:27.090363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:27.091079 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:27.091540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:27.091973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:27.226595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:27.235589 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7a88473c-d4e9-4e99-95d6-f750c3896940 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1392 microversion: 2.1 time: 0.162041 Oct 28 11:11:27.236185 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3981/7955] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:27 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:27.436212 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-1c992433-83bc-4a78-b833-def952de640e req-68b0ab7d-8562-4980-9c11-114cbe96d4bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:11:27.447456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1c992433-83bc-4a78-b833-def952de640e req-68b0ab7d-8562-4980-9c11-114cbe96d4bc service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:27.447942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1c992433-83bc-4a78-b833-def952de640e req-68b0ab7d-8562-4980-9c11-114cbe96d4bc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:27.448386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-1c992433-83bc-4a78-b833-def952de640e req-68b0ab7d-8562-4980-9c11-114cbe96d4bc service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:27.459880 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-1c992433-83bc-4a78-b833-def952de640e req-68b0ab7d-8562-4980-9c11-114cbe96d4bc service nova] Creating event network-changed:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h2-zed-1 Oct 28 11:11:27.464855 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-1c992433-83bc-4a78-b833-def952de640e req-68b0ab7d-8562-4980-9c11-114cbe96d4bc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032411 Oct 28 11:11:27.465507 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3975/7956] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:11:28.260288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:28.260804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:28.267531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:28.268021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:28.268460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:28.269275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:28.269731 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:28.270160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:28.403714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:28.411328 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9656e57b-a684-4d17-bbb9-df2519710a5b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1392 microversion: 2.1 time: 0.155780 Oct 28 11:11:28.411901 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3982/7957] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:28 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:29.435505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:29.436224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:29.442493 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:29.443000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:29.443457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:29.444168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:29.444647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:29.445122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:29.581601 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:29.590061 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-05aba31a-3c36-4dce-9ad7-a00bdd8f35d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1392 microversion: 2.1 time: 0.159704 Oct 28 11:11:29.590655 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3976/7958] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:29 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:11:30.612542 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:30.613197 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:30.620099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:30.620596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:30.621087 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:30.621786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:30.622252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:30.622689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:30.753376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:30.761165 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-17aa34a6-d3be-47d1-8544-811130a88c39 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1392 microversion: 2.1 time: 0.152378 Oct 28 11:11:30.761739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3983/7959] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:30 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:31.783713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:31.784349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:31.791861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:31.792374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:31.792835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:31.793571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:31.794048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:31.794499 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:31.923707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:31.932113 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7e98866c-c5d9-4933-9c5f-0c2ee390784c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1392 microversion: 2.1 time: 0.152370 Oct 28 11:11:31.932696 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3977/7960] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:31 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:32.954439 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:32.955363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:32.962187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:32.962692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:32.963143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:32.963853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:32.964319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:32.964755 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:33.107548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:33.108788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-7c98d640-c2ff-4b56-aa5e-da4b3ed45a2a req-73ed6252-5860-4892-af94-106ccf9ff56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "name": "network-vif-plugged", "status": "completed", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:11:33.115717 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7747955c-73a8-4733-ad34-621a50b20381 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1392 microversion: 2.1 time: 0.165270 Oct 28 11:11:33.116526 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3984/7961] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:32 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:33.123689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c98d640-c2ff-4b56-aa5e-da4b3ed45a2a req-73ed6252-5860-4892-af94-106ccf9ff56e service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:33.124197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c98d640-c2ff-4b56-aa5e-da4b3ed45a2a req-73ed6252-5860-4892-af94-106ccf9ff56e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:33.124653 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-7c98d640-c2ff-4b56-aa5e-da4b3ed45a2a req-73ed6252-5860-4892-af94-106ccf9ff56e service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:33.139775 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-7c98d640-c2ff-4b56-aa5e-da4b3ed45a2a req-73ed6252-5860-4892-af94-106ccf9ff56e service nova] Creating event network-vif-plugged:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h2-zed-1 Oct 28 11:11:33.144955 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-7c98d640-c2ff-4b56-aa5e-da4b3ed45a2a req-73ed6252-5860-4892-af94-106ccf9ff56e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108209 Oct 28 11:11:33.145579 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3978/7962] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:11:34.139452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:34.140809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:34.147887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:34.148384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:34.148833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:34.149599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:34.150099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:34.150538 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:34.282904 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:34.291439 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-55efd9d8-1587-41d1-89e9-b1ef28d6db05 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1392 microversion: 2.1 time: 0.155850 Oct 28 11:11:34.292016 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3985/7963] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:34 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:35.311711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:35.312629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:35.317968 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:35.318720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:35.326457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:35.326960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:35.327418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:35.328132 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:35.328609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:35.329093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:35.461174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:35.469053 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4bbf0023-38a6-45e8-838b-095e16179e55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1564 microversion: 2.1 time: 0.158201 Oct 28 11:11:35.469629 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3979/7964] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:35 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:35.491466 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:35.492029 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:35.494612 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:11:35.500548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:35.501111 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:35.501565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:35.502274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:35.502735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:35.503168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:35.639299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:35.647055 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2ca0fa68-c310-4008-bc6b-cc6420c43ae1 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1564 microversion: 2.1 time: 0.159571 Oct 28 11:11:35.647635 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3986/7965] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:35 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:11:37.225957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:11:37.226590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:11:37.236533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:37.237438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:37.237991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:37.238627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:37.239104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:37.239588 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:37.288730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-6bcf9fd5-05bc-41eb-b228-cbdb9451c3cf req-27a2dc69-d9e0-4b7f-8d9c-d4dc9cd3c551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:11:37.299104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6bcf9fd5-05bc-41eb-b228-cbdb9451c3cf req-27a2dc69-d9e0-4b7f-8d9c-d4dc9cd3c551 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:11:37.299618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6bcf9fd5-05bc-41eb-b228-cbdb9451c3cf req-27a2dc69-d9e0-4b7f-8d9c-d4dc9cd3c551 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:11:37.300049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-6bcf9fd5-05bc-41eb-b228-cbdb9451c3cf req-27a2dc69-d9e0-4b7f-8d9c-d4dc9cd3c551 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:11:37.313027 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-6bcf9fd5-05bc-41eb-b228-cbdb9451c3cf req-27a2dc69-d9e0-4b7f-8d9c-d4dc9cd3c551 service nova] Creating event network-changed:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h2-zed-1 Oct 28 11:11:37.318486 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-6bcf9fd5-05bc-41eb-b228-cbdb9451c3cf req-27a2dc69-d9e0-4b7f-8d9c-d4dc9cd3c551 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093959 Oct 28 11:11:37.322027 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3987/7966] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:11:37.393361 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:11:37.401348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-642ac46f-ae9f-4cea-9c0f-dbdff4989e73 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1564 microversion: 2.1 time: 0.179555 Oct 28 11:11:37.402189 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3980/7967] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:11:37 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1564 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:08.673384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:08.674168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=38 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:08.678958 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:12:08.681273 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:08.689590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:08.690082 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:08.690527 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:08.691220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:08.691681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:08.692112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:08.759266 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-80ecfa93-41c2-46a1-9123-fe497123d8aa tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action" status: 200 len: 24566 microversion: 2.1 time: 0.087775 Oct 28 11:12:08.759937 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3988/7968] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:12:08 2022] POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action => generated 24566 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:12:38.956825 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:38.957629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:39.008575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:12:39.011237 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:39.017949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:39.018454 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:39.018910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:39.019729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:39.020218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:39.020691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:39.059391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:39.065941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Old instance type m1.heat2, new instance type m1.heat {{(pid=128748) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 28 11:12:39.072543 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:12:39.073009 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:12:39.073502 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:12:39.073931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:12:39.074363 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:12:39.137092 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-828acd09-08d4-4b16-9d2f-85c0a9994ea9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action" status: 202 len: 0 microversion: 2.1 time: 0.182362 Oct 28 11:12:39.137713 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3981/7969] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:12:38 2022] POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:12:39.147422 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:39.148247 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:39.152366 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:39.153137 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:12:39.160691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:39.161391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:39.161836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:39.162735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:39.163361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:39.163803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:39.308517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:39.316442 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d44dd95-f501-4adf-ad87-2123930ae4a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1691 microversion: 2.1 time: 0.173663 Oct 28 11:12:39.317040 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3989/7970] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:39 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:40.342503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:40.343078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:40.350347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:40.350852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:40.351304 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:40.352026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:40.352482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:40.352941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:40.492195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:40.500006 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-52f30d13-93e5-4703-8ed9-79fdd673876f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1691 microversion: 2.1 time: 0.163618 Oct 28 11:12:40.500684 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3982/7971] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:40 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:41.524268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:41.524890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:41.531801 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:41.532289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:41.532729 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:41.533448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:41.533903 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:41.534328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:41.668947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:41.679261 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-97a47181-2522-4f7f-9199-f68c5a2c705f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.158921 Oct 28 11:12:41.679835 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3990/7972] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:41 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:42.703789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:42.704447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:42.711622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:42.712118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:42.712568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:42.713303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:42.713776 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:42.714218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:42.845560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:42.853582 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e087b36a-adfd-4e6f-ad4e-4daf50f09d4d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.153708 Oct 28 11:12:42.854169 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3983/7973] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:42 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:43.877769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:43.878317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:43.885046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:43.885533 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:43.885978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:43.886670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:43.887126 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:43.887554 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:44.021347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:44.029127 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48cc5711-6e4d-44ce-a5cd-b68551e45eb4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.155330 Oct 28 11:12:44.029699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3991/7974] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:43 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:45.053558 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:45.054224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:45.061119 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:45.061622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:45.062081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:45.062862 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:45.063343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:45.063785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:45.197147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:45.206289 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-74e2f4c5-ef8a-4966-b189-7beedb76d3cd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.156686 Oct 28 11:12:45.206876 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3984/7975] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:45 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:46.229872 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:46.230487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:46.237754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:46.238239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:46.238683 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:46.239372 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:46.239832 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:46.240265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:46.371336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:46.379594 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45e5d13e-8078-4018-b9d7-744c738df05d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.153637 Oct 28 11:12:46.380198 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3992/7976] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:46 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:47.403208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:47.403832 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:47.410609 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:47.411101 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:47.411552 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:47.412249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:47.412714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:47.413184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:47.545368 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:47.553030 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9dd1e22a-1918-49e9-971a-f1351b44945c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.153691 Oct 28 11:12:47.553601 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3985/7977] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:47 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:48.576451 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:48.577103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:48.584791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:48.585317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:48.585769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:48.586476 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:48.586939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:48.587592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:48.717413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:48.725759 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a5be1cdf-2265-44e1-ba1c-0f9b75d7498d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.153195 Oct 28 11:12:48.726333 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3993/7978] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:48 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:49.749150 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:49.749787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:49.760061 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:49.760573 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:49.761072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:49.761796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:49.762272 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:49.762715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:49.901770 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:49.909714 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8db4617c-2e3e-4c8e-aa03-267a553d4e77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.164571 Oct 28 11:12:49.910289 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3986/7979] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:49 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:50.935381 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:50.936006 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:50.942530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:50.943017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:50.943463 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:50.944161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:50.944636 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:50.945086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:51.079265 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:51.087297 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-871c1852-4abd-4867-bc74-44ae95a1638e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.155921 Oct 28 11:12:51.087873 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3994/7980] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:50 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:52.111571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:52.112206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:52.118444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:52.118953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:52.119442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:52.120279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:52.120769 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:52.121243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:52.253532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:52.261442 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7c27f553-b77f-4b20-8ad6-6183e0e8a9b0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1696 microversion: 2.1 time: 0.154116 Oct 28 11:12:52.262020 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3987/7981] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:52 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:53.285827 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:53.286460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:53.294202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:53.294689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:53.295133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:53.295824 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:53.296280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:53.296707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:53.432042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:53.439993 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-08007326-7d74-4fe5-a457-309d77ecae26 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1695 microversion: 2.1 time: 0.158739 Oct 28 11:12:53.440569 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3995/7982] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:53 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1695 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:53.819142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-47f3b3a1-9720-4455-bfd5-af24510e0f7f req-5309c50d-0b0f-4915-a149-864c29a514f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "name": "network-vif-unplugged", "status": "completed", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:12:53.831028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-47f3b3a1-9720-4455-bfd5-af24510e0f7f req-5309c50d-0b0f-4915-a149-864c29a514f1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:53.831525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-47f3b3a1-9720-4455-bfd5-af24510e0f7f req-5309c50d-0b0f-4915-a149-864c29a514f1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:53.831975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-47f3b3a1-9720-4455-bfd5-af24510e0f7f req-5309c50d-0b0f-4915-a149-864c29a514f1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:53.845060 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-47f3b3a1-9720-4455-bfd5-af24510e0f7f req-5309c50d-0b0f-4915-a149-864c29a514f1 service nova] Creating event network-vif-unplugged:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h1-zed-1 Oct 28 11:12:53.850581 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-47f3b3a1-9720-4455-bfd5-af24510e0f7f req-5309c50d-0b0f-4915-a149-864c29a514f1 service nova] Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 11:12:53.862055 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-47f3b3a1-9720-4455-bfd5-af24510e0f7f req-5309c50d-0b0f-4915-a149-864c29a514f1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046791 Oct 28 11:12:53.862706 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3988/7983] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:12:54.464020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:54.464656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:54.471452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:54.471949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:54.472399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:54.473140 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:54.473610 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:54.474049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:54.615932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:54.623802 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-93d70582-8c28-4441-b5fe-1cb541aeabf0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1695 microversion: 2.1 time: 0.163751 Oct 28 11:12:54.624383 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3996/7984] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:54 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1695 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:55.649081 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:55.649806 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:55.655975 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:55.657000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:55.657459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:55.658160 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:55.658628 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:55.659096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:55.796308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:55.804771 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-808dbbdf-da83-4ebd-ba8e-0c96f3cf9cbe tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1693 microversion: 2.1 time: 0.160847 Oct 28 11:12:55.805394 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3989/7985] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:55 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1693 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:55.899820 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-42a1e33b-1c6a-46fd-bf54-f67bfdeb7d75 req-8b485914-ae36-40d9-9595-d099863f8504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:12:55.910656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-42a1e33b-1c6a-46fd-bf54-f67bfdeb7d75 req-8b485914-ae36-40d9-9595-d099863f8504 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:55.911135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-42a1e33b-1c6a-46fd-bf54-f67bfdeb7d75 req-8b485914-ae36-40d9-9595-d099863f8504 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:55.911566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-42a1e33b-1c6a-46fd-bf54-f67bfdeb7d75 req-8b485914-ae36-40d9-9595-d099863f8504 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:55.923297 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-42a1e33b-1c6a-46fd-bf54-f67bfdeb7d75 req-8b485914-ae36-40d9-9595-d099863f8504 service nova] Creating event network-changed:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h1-zed-1 Oct 28 11:12:55.928599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [req-42a1e33b-1c6a-46fd-bf54-f67bfdeb7d75 req-8b485914-ae36-40d9-9595-d099863f8504 service nova] Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128747) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 11:12:55.939546 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-42a1e33b-1c6a-46fd-bf54-f67bfdeb7d75 req-8b485914-ae36-40d9-9595-d099863f8504 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043460 Oct 28 11:12:55.940154 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3997/7986] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:12:56.827671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:56.828844 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:56.836016 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:56.836518 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:56.836997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:56.837714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:56.838181 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:56.838623 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:57.121571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:57.130028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5c4df6a6-e963-4af7-9dcc-9828dc6ace99 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1690 microversion: 2.1 time: 0.306280 Oct 28 11:12:57.130704 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3990/7987] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:56 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1690 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:57.154584 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:12:57.155303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:57.161592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:57.162162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:57.162692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:57.163816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:57.164349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:57.164852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:57.223329 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0cd8db02-6b40-421f-a4c9-f01ac6e963d2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action" status: 204 len: 0 microversion: 2.1 time: 0.073588 Oct 28 11:12:57.223983 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3998/7988] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:12:57 2022] POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:12:57.232050 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:57.232681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:57.238849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:57.239446 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:57.240136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:57.240855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:57.241394 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:57.242036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:57.460008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:57.467882 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a4d431d3-be78-4eaa-9cc3-6a0776b18e49 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1690 microversion: 2.1 time: 0.239665 Oct 28 11:12:57.468467 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3991/7989] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:57 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1690 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:57.490905 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:57.491620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:57.497867 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:57.498364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:57.498814 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:57.499509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:57.500561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:57.501045 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:57.637289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:57.645290 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4710bb88-271e-4d94-a85e-7814541db230 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1690 microversion: 2.1 time: 0.158534 Oct 28 11:12:57.645875 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 3999/7990] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:57 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:12:57.992805 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b42e91ca-8b4a-4dcd-8d36-a602975ecc60 req-c1f76f83-4cbf-4641-8127-053dfa07fca2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "name": "network-vif-plugged", "status": "completed", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:12:58.004141 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b42e91ca-8b4a-4dcd-8d36-a602975ecc60 req-c1f76f83-4cbf-4641-8127-053dfa07fca2 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:58.005354 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b42e91ca-8b4a-4dcd-8d36-a602975ecc60 req-c1f76f83-4cbf-4641-8127-053dfa07fca2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:58.006417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b42e91ca-8b4a-4dcd-8d36-a602975ecc60 req-c1f76f83-4cbf-4641-8127-053dfa07fca2 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:58.019218 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b42e91ca-8b4a-4dcd-8d36-a602975ecc60 req-c1f76f83-4cbf-4641-8127-053dfa07fca2 service nova] Creating event network-vif-plugged:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h1-zed-1 Oct 28 11:12:58.025452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [req-b42e91ca-8b4a-4dcd-8d36-a602975ecc60 req-c1f76f83-4cbf-4641-8127-053dfa07fca2 service nova] Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-zed-1', 'n-h2-zed-1'} {{(pid=128748) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 28 11:12:58.039270 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b42e91ca-8b4a-4dcd-8d36-a602975ecc60 req-c1f76f83-4cbf-4641-8127-053dfa07fca2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051227 Oct 28 11:12:58.039855 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3992/7991] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:12:58.755617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:12:58.756481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:12:58.765722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:58.766253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:58.766703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:58.767421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:12:58.767915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:12:58.768355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:12:58.904770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:12:58.913141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b4f89206-c4f8-4a59-8b3c-6f588e86c011 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1682 microversion: 2.1 time: 0.163820 Oct 28 11:12:58.913728 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4000/7992] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:12:58 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:21.099127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:21.101469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:21.103998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=28 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:21.105151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:21.110996 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:21.111501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:21.111961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:21.112687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:21.113195 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:21.113644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:21.181959 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9508563b-d0b3-4d0b-9c5b-9a0488cade2f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action" status: 200 len: 24565 microversion: 2.1 time: 0.087041 Oct 28 11:13:21.182875 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3993/7993] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:13:21 2022] POST /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356/action => generated 24565 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:13:28.176958 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6f9466ab-2be8-4cc9-a07e-44cfebd4748d req-ba036b20-1c87-476d-b7ca-db1fa7a469c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:28.184411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:28.184933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:28.187167 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=24 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:28.187841 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:28.194120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:28.194859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:28.195433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:28.196164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6f9466ab-2be8-4cc9-a07e-44cfebd4748d req-ba036b20-1c87-476d-b7ca-db1fa7a469c7 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:28.196326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:28.196667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6f9466ab-2be8-4cc9-a07e-44cfebd4748d req-ba036b20-1c87-476d-b7ca-db1fa7a469c7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:28.197027 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:28.197359 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6f9466ab-2be8-4cc9-a07e-44cfebd4748d req-ba036b20-1c87-476d-b7ca-db1fa7a469c7 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:28.197659 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:28.210703 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6f9466ab-2be8-4cc9-a07e-44cfebd4748d req-ba036b20-1c87-476d-b7ca-db1fa7a469c7 service nova] Creating event network-changed:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h1-zed-1 Oct 28 11:13:28.215800 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6f9466ab-2be8-4cc9-a07e-44cfebd4748d req-ba036b20-1c87-476d-b7ca-db1fa7a469c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042982 Oct 28 11:13:28.216746 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3994/7994] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:13:28.229936 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:13:28.316864 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-64578a63-1b65-4438-9e84-990efdc94859 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 204 len: 0 microversion: 2.1 time: 0.146011 Oct 28 11:13:28.318036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4001/7995] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:13:28 2022] DELETE /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:13:28.327103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:28.327830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:28.335215 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:28.335720 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:28.336180 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:28.336895 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:28.337406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:28.337850 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:28.472403 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:28.480486 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c2abfc56-8368-4c58-b1e9-4ce4acffab1d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1688 microversion: 2.1 time: 0.158113 Oct 28 11:13:28.481088 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3995/7996] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:28 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:29.505816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:29.506520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:29.513403 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:29.513894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:29.514338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:29.515053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:29.515505 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:29.515935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:29.653064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:29.661411 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-281eacf8-ec1f-429b-8129-05688c912055 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1688 microversion: 2.1 time: 0.159842 Oct 28 11:13:29.661992 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4002/7997] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:29 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:30.410011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-394af333-f260-4fcb-97ad-00b57b0325cb req-ab479007-a4d2-4f44-9fd8-f9138b019d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4543b2ab-5f23-4f6e-864f-d14ba536c356", "name": "network-vif-deleted", "tag": "c942ff02-9445-4375-86e3-1778ede7d1f3"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:30.422340 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-394af333-f260-4fcb-97ad-00b57b0325cb req-ab479007-a4d2-4f44-9fd8-f9138b019d40 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:30.423848 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-394af333-f260-4fcb-97ad-00b57b0325cb req-ab479007-a4d2-4f44-9fd8-f9138b019d40 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:30.424308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-394af333-f260-4fcb-97ad-00b57b0325cb req-ab479007-a4d2-4f44-9fd8-f9138b019d40 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:30.436866 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-394af333-f260-4fcb-97ad-00b57b0325cb req-ab479007-a4d2-4f44-9fd8-f9138b019d40 service nova] Creating event network-vif-deleted:c942ff02-9445-4375-86e3-1778ede7d1f3 for instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 on n-h1-zed-1 Oct 28 11:13:30.443309 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-394af333-f260-4fcb-97ad-00b57b0325cb req-ab479007-a4d2-4f44-9fd8-f9138b019d40 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037323 Oct 28 11:13:30.443921 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3996/7998] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:13:30.685339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:30.686005 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:30.693623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:30.694120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:30.694562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:30.695268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:30.695723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:30.696151 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:30.729694 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:30.730185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:30.730625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:30.731080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lazy-loading 'fault' on Instance uuid 4543b2ab-5f23-4f6e-864f-d14ba536c356 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:13:30.777252 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:30.786394 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-338ee399-58b3-4d54-8c1d-78b92e53f304 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 200 len: 1356 microversion: 2.1 time: 0.104889 Oct 28 11:13:30.786984 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4003/7999] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:30 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 1356 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:31.811096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:31.811817 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 4543b2ab-5f23-4f6e-864f-d14ba536c356] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:31.819661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:31.820168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:31.820627 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:31.821414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:31.821894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:31.822344 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:31.835865 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] HTTP exception thrown: Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 could not be found. Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Request method failure captured: Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 HTTP/1.1 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7ffxW7IzOVzm9VzZb3lolIJroMzL5jlKpL7h17sKYJwD4trIZr_OSxOxSlxR9dzGbvMQyolBrfwg5zXfyKN-6MsCQ9nIGrZAi7TYTcj5XjEBtqfoQdU4v7g59EYORLpm-oqQcgLvgqRGIy8rJJBLgwkmqSQQURG2FyWGDlp8-mKU5s Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19a924fff2a74cd489ec2f9b0f43db97", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19a924fff2a74cd489ec2f9b0f43db97"}]}] Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 65c0789aabf74875985235644d9191a7 Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 could not be found. Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '4543b2ab-5f23-4f6e-864f-d14ba536c356'} Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 could not be found. Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 could not be found. Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:13:31.837555 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 could not be found. Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Returning 404 to user: Instance 4543b2ab-5f23-4f6e-864f-d14ba536c356 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bc769289-cebd-45bc-8398-b120c072c89c tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356" status: 404 len: 111 microversion: 2.1 time: 0.032187 Oct 28 11:13:31.843348 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3997/8000] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:31 2022] GET /compute/v2.1/servers/4543b2ab-5f23-4f6e-864f-d14ba536c356 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:13:35.054845 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4ed489ca-ffcf-4f4f-87f7-5df28cc5ee1f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '.version_select at 0x7fca32e1f430>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:35.060281 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4ed489ca-ffcf-4f4f-87f7-5df28cc5ee1f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [2330d91e-2023-421e-b116-bc73d1f9a12b] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:13:36.069742 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [None req-4ed489ca-ffcf-4f4f-87f7-5df28cc5ee1f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [2330d91e-2023-421e-b116-bc73d1f9a12b] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38460. Oct 28 11:13:36.090774 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4ed489ca-ffcf-4f4f-87f7-5df28cc5ee1f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1768649955" status: 202 len: 0 microversion: 2.1 time: 1.040476 Oct 28 11:13:36.091354 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4004/8001] 10.222.0.16 () {58 vars in 1284 bytes} [Fri Oct 28 11:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1768649955 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:13:36.117570 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-06c9ffc9-48ca-446e-803b-290c6bfb0908 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: .version_select at 0x7fca32323040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-979156460", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCuVBVjAsBWSOlGwxlWcJp4Fk2dptNAQ3FgE0+EVgVhWoyrlNmzvDaB1FbMDHOwSg39MScoqv+hFXirNfrJsbqRSsIyqPbWWi0nZRyuTdItDWLMxJSB+YHKIIEjxUDTMw=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:36.135737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-06c9ffc9-48ca-446e-803b-290c6bfb0908 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:13:36.140891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-06c9ffc9-48ca-446e-803b-290c6bfb0908 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:13:36.154506 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-06c9ffc9-48ca-446e-803b-290c6bfb0908 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [501ee0d2-8b61-492e-85c1-1779ec4fd822] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:13:37.161510 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [None req-06c9ffc9-48ca-446e-803b-290c6bfb0908 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [501ee0d2-8b61-492e-85c1-1779ec4fd822] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38464. Oct 28 11:13:37.175546 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-06c9ffc9-48ca-446e-803b-290c6bfb0908 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.061893 Oct 28 11:13:37.176151 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3998/8002] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:13:36 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:13:42.892066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:42.896799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1382349220", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "ab47e938-593f-4846-b11c-29d7a76b52b8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-979156460", "security_groups": [{"name": "tempest-secgroup-smoke-1214371797"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:43.054686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] validate_networks() for [('ab47e938-593f-4846-b11c-29d7a76b52b8', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:13:43.527093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:13:43.527521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:13:43.528008 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:13:43.528452 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:13:43.528882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:13:43.544158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:43.544660 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:43.545143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:43.545865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:43.546321 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:43.546748 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:43.564723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:13:43.571184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:13:43.586322 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:13:43.588637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:13:43.635279 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [fcf95f5f-eea0-40ea-a055-0b816b418595] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:13:44.642604 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [fcf95f5f-eea0-40ea-a055-0b816b418595] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38514. Oct 28 11:13:44.646497 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8f5de7c0-5f5a-4b92-9461-3856c8ae1c20 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.757571 Oct 28 11:13:44.647384 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4005/8003] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:13:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1759 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:13:44.657038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:44.663059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b09b72ba-b41f-4d0e-836b-8d4fa8f50936 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:44.664083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b09b72ba-b41f-4d0e-836b-8d4fa8f50936 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:44.752607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b09b72ba-b41f-4d0e-836b-8d4fa8f50936 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:44.767884 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b09b72ba-b41f-4d0e-836b-8d4fa8f50936 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1266 microversion: 2.1 time: 0.112707 Oct 28 11:13:44.785135 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 3999/8004] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:44 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1266 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:45.797110 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:45.798547 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:45.806224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:45.806726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:45.807176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:45.807897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:45.808383 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:45.808817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:45.881541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:45.891150 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f5d622ca-c796-4ac9-8e8e-924f89732808 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1318 microversion: 2.1 time: 0.098116 Oct 28 11:13:45.891841 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4006/8005] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:45 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1318 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:46.917485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:46.918620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:46.928705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:46.929227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:46.930317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:46.931232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:46.931897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:46.932672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:47.177672 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:47.185348 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d0e1fef2-933c-4d45-91d2-1f7013e98542 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1392 microversion: 2.1 time: 0.273792 Oct 28 11:13:47.185926 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4000/8006] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:46 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1392 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:47.379596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-d0dc5436-4589-4271-addf-36710ff9d863 req-2f5e37bd-7aac-4e1d-865e-852b9ba5ed7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ced1c0-3aa7-452e-87b9-fa2c85173d95", "tag": "60690441-6be8-4d3b-b776-4941d4da05cc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:47.390896 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d0dc5436-4589-4271-addf-36710ff9d863 req-2f5e37bd-7aac-4e1d-865e-852b9ba5ed7a service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:47.391739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d0dc5436-4589-4271-addf-36710ff9d863 req-2f5e37bd-7aac-4e1d-865e-852b9ba5ed7a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:47.392170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-d0dc5436-4589-4271-addf-36710ff9d863 req-2f5e37bd-7aac-4e1d-865e-852b9ba5ed7a service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:47.403914 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-d0dc5436-4589-4271-addf-36710ff9d863 req-2f5e37bd-7aac-4e1d-865e-852b9ba5ed7a service nova] Creating event network-changed:60690441-6be8-4d3b-b776-4941d4da05cc for instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 on n-h2-zed-1 Oct 28 11:13:47.409437 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-d0dc5436-4589-4271-addf-36710ff9d863 req-2f5e37bd-7aac-4e1d-865e-852b9ba5ed7a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033637 Oct 28 11:13:47.410036 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4007/8007] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:13:48.210211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:48.210840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:48.217758 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:48.218263 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:48.218723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:48.219435 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:48.219919 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:48.220392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:48.354301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:48.362575 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-464f4aad-ebf7-4332-97c1-5138aecfea2b tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1392 microversion: 2.1 time: 0.156596 Oct 28 11:13:48.363145 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4001/8008] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:48 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:49.387577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:49.388342 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:49.395662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:49.396152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:49.396600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:49.397339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:49.397803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:49.398238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:49.541437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:49.549351 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f549b4c7-9bb7-44d6-89c6-52e4197d92c4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1392 microversion: 2.1 time: 0.167282 Oct 28 11:13:49.549942 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4008/8009] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:49 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1392 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:50.572855 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:50.573607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:50.582131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:50.582637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:50.583092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:50.583814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:50.584286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:50.584736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:50.714822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:50.723181 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09911ebe-ff83-4125-8632-85ebd5b93a7e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1392 microversion: 2.1 time: 0.154408 Oct 28 11:13:50.723750 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4002/8010] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:50 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:51.711398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e515ad53-bdd9-49ad-aab5-2925bcf806fb req-09ca15cd-b930-43ad-9e86-80c7c86640da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ced1c0-3aa7-452e-87b9-fa2c85173d95", "name": "network-vif-plugged", "status": "completed", "tag": "60690441-6be8-4d3b-b776-4941d4da05cc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:51.721501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e515ad53-bdd9-49ad-aab5-2925bcf806fb req-09ca15cd-b930-43ad-9e86-80c7c86640da service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:51.722860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e515ad53-bdd9-49ad-aab5-2925bcf806fb req-09ca15cd-b930-43ad-9e86-80c7c86640da service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:51.723267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e515ad53-bdd9-49ad-aab5-2925bcf806fb req-09ca15cd-b930-43ad-9e86-80c7c86640da service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:51.736376 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e515ad53-bdd9-49ad-aab5-2925bcf806fb req-09ca15cd-b930-43ad-9e86-80c7c86640da service nova] Creating event network-vif-plugged:60690441-6be8-4d3b-b776-4941d4da05cc for instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 on n-h2-zed-1 Oct 28 11:13:51.741688 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e515ad53-bdd9-49ad-aab5-2925bcf806fb req-09ca15cd-b930-43ad-9e86-80c7c86640da service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034549 Oct 28 11:13:51.742592 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4009/8011] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:13:51.746495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:51.747517 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:51.751766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:51.756123 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:51.756749 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:51.757292 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:51.758100 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:51.758646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:51.759177 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:51.944521 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:51.952581 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d36e065c-eb1f-41a7-9cf9-59bd11131987 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1392 microversion: 2.1 time: 0.210265 Oct 28 11:13:51.964970 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4003/8012] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:51 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1392 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:52.977232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:52.977927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:52.984853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:52.985361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:52.985797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:52.986479 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:52.986929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:52.987354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:53.122485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:53.130218 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bb7ae660-8bba-4842-8aa4-56e9336f98fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1392 microversion: 2.1 time: 0.157249 Oct 28 11:13:53.130795 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4010/8013] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:52 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:54.152533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:54.153210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:54.160096 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:54.160596 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:54.161086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:54.161796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:54.162265 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:54.162704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:54.296793 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:54.305094 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4fa588d9-0702-4902-8aa4-dc4fd88e7413 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1564 microversion: 2.1 time: 0.156527 Oct 28 11:13:54.305662 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4004/8014] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:54 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:54.328059 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:54.328700 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:54.330728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:54.331919 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:54.338783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:54.339264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:54.339701 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:54.340386 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:54.340839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:54.341297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:54.472929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:54.480616 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0b81ab2e-c007-4d24-bce3-b6aed63b3560 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1564 microversion: 2.1 time: 0.156417 Oct 28 11:13:54.481224 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4011/8015] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:54 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:13:56.055391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:13:56.056175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:13:56.058219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3af90cbe-0a81-4518-9c40-8e2930ddb76a req-9a07d46c-f8eb-443e-a2ab-d73632fa4b2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ced1c0-3aa7-452e-87b9-fa2c85173d95", "tag": "60690441-6be8-4d3b-b776-4941d4da05cc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:13:56.058632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:13:56.065176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:56.066000 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:56.066635 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:56.068001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:56.068487 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:56.068963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:56.071708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3af90cbe-0a81-4518-9c40-8e2930ddb76a req-9a07d46c-f8eb-443e-a2ab-d73632fa4b2d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:13:56.072583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3af90cbe-0a81-4518-9c40-8e2930ddb76a req-9a07d46c-f8eb-443e-a2ab-d73632fa4b2d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:13:56.073134 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3af90cbe-0a81-4518-9c40-8e2930ddb76a req-9a07d46c-f8eb-443e-a2ab-d73632fa4b2d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:13:56.087897 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3af90cbe-0a81-4518-9c40-8e2930ddb76a req-9a07d46c-f8eb-443e-a2ab-d73632fa4b2d service nova] Creating event network-changed:60690441-6be8-4d3b-b776-4941d4da05cc for instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 on n-h2-zed-1 Oct 28 11:13:56.093294 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3af90cbe-0a81-4518-9c40-8e2930ddb76a req-9a07d46c-f8eb-443e-a2ab-d73632fa4b2d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039157 Oct 28 11:13:56.094238 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4012/8016] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:13:56.560620 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:13:56.569464 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9b20a016-be52-4704-b1bf-26182b2e4dae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1564 microversion: 2.1 time: 0.518028 Oct 28 11:13:56.570063 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4005/8017] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:13:56 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1564 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:14:27.852534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:14:27.853316 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=32 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:14:27.857723 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:14:27.860033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:14:27.867993 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:14:27.868489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:14:27.868963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:14:27.869669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:14:27.870132 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:14:27.870568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:14:27.951852 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dfa5768c-dca6-4f98-9088-400a5f5a0638 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action" status: 200 len: 24570 microversion: 2.1 time: 0.101243 Oct 28 11:14:27.952526 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4013/8018] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:14:27 2022] POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action => generated 24570 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:14:58.394231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=5 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:14:58.395090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:14:58.400711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-310ebd73-4f6f-491a-b961-51cae9d61bcc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:14:58.407704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ebd73-4f6f-491a-b961-51cae9d61bcc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:14:58.408208 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ebd73-4f6f-491a-b961-51cae9d61bcc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:14:58.408664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-310ebd73-4f6f-491a-b961-51cae9d61bcc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:14:58.431382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-310ebd73-4f6f-491a-b961-51cae9d61bcc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Going to try to stop instance {{(pid=128748) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 28 11:14:58.471970 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-310ebd73-4f6f-491a-b961-51cae9d61bcc tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action" status: 202 len: 0 microversion: 2.1 time: 0.079428 Oct 28 11:14:58.476146 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4006/8019] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:14:58 2022] POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:14:58.482327 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:14:58.482929 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:14:58.485433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:14:58.486093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:14:58.492981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:14:58.493519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:14:58.493957 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:14:58.494754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:14:58.495210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:14:58.495677 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:14:58.630279 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:14:58.638022 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b809cd9e-c598-45b5-a397-1717f0608bcd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.160226 Oct 28 11:14:58.638598 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4014/8020] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:14:58 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:14:59.663737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:14:59.664457 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:14:59.670689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:14:59.671188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:14:59.671640 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:14:59.672352 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:14:59.672823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:14:59.673289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:14:59.809308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:14:59.817766 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c0c56382-382c-43fc-b907-a34af02b9150 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.159449 Oct 28 11:14:59.818386 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4007/8021] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:14:59 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:00.843049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:00.843603 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:00.851080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:00.851563 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:00.851999 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:00.852686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:00.853169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:00.853597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:00.990278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:00.998191 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d4cbf5c1-16b3-42f9-857c-2fdc55116b55 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.159070 Oct 28 11:15:00.998776 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4015/8022] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:00 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:02.021024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:02.021650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:02.028680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:02.029222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:02.029707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:02.030489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:02.030967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:02.031417 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:02.169071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:02.177132 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e5ae533a-83c0-4fc7-8404-0af00d68b60f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.160040 Oct 28 11:15:02.178258 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4008/8023] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:02 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:03.200842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:03.201501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:03.208513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:03.209042 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:03.209496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:03.210202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:03.210667 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:03.211106 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:03.340244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:03.348157 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-c09dad7b-0c67-4d7a-854b-a49743a1cf5f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.151288 Oct 28 11:15:03.348763 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4016/8024] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:03 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:04.371987 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:04.372625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:04.379719 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:04.380223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:04.380847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:04.381765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:04.382333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:04.382777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:04.512576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:04.520251 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9c09795-1e0e-412e-bc36-eb7445f750a4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.152213 Oct 28 11:15:04.520824 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4009/8025] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:04 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:05.544297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:05.544826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:05.551681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:05.552170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:05.552613 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:05.553340 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:05.553802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:05.554232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:05.683907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:05.691680 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9286d9cc-4422-42d8-bd27-8bde13e350fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.151388 Oct 28 11:15:05.692254 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4017/8026] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:05 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:06.715431 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:06.716063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:06.723652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:06.724162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:06.725153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:06.725875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:06.726353 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:06.726838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:06.860201 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:06.868689 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-239eb7a7-21c0-40a8-bcbe-9afecad3f288 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.157132 Oct 28 11:15:06.869302 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4010/8027] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:06 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:07.891707 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:07.892294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:07.899684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:07.900182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:07.900634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:07.901369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:07.901836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:07.902275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:08.036104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:08.043892 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d59db896-78bf-4243-9018-47360a53bc4e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1692 microversion: 2.1 time: 0.156231 Oct 28 11:15:08.044481 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4018/8028] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:07 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:09.067430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:09.068102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:09.075307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:09.075816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:09.076273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:09.077026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:09.077501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:09.077948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:09.263412 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:09.271760 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-11d13b40-2c69-4151-8607-1eff25190680 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1669 microversion: 2.1 time: 0.207890 Oct 28 11:15:09.272333 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4011/8029] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:09 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1669 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:15:10.369548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:15:10.371806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:10.378803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:10.379292 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:10.379737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:10.380432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:10.382163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:10.382163 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:10.447052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1c111fc1-0892-4fea-ab27-bf42f94bf0fb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action" status: 200 len: 36867 microversion: 2.1 time: 0.081326 Oct 28 11:15:10.447970 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4019/8030] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:15:10 2022] POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action => generated 36867 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:15:10.460333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ffa9befe-7fc2-4cc3-9747-1438139dcdf2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:15:10.467170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa9befe-7fc2-4cc3-9747-1438139dcdf2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:10.467665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa9befe-7fc2-4cc3-9747-1438139dcdf2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:10.468118 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ffa9befe-7fc2-4cc3-9747-1438139dcdf2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:10.489835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ffa9befe-7fc2-4cc3-9747-1438139dcdf2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Going to try to start instance {{(pid=128748) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 28 11:15:10.531148 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ffa9befe-7fc2-4cc3-9747-1438139dcdf2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action" status: 202 len: 0 microversion: 2.1 time: 0.075417 Oct 28 11:15:10.531749 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4012/8031] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:15:10 2022] POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:15:10.541232 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:10.541941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:10.550001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:10.551139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:10.551595 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:10.552338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:10.553091 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:10.553526 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:10.737199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:10.745682 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad0ba8fa-9049-44e1-b3fa-d5c349a49be5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1678 microversion: 2.1 time: 0.208732 Oct 28 11:15:10.746270 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4020/8032] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:10 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:11.770196 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:15:11.770957 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:11.778378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:11.779028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:11.779605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:11.780357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:11.780852 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:11.781319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:11.923444 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:15:11.931885 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e1d943ba-285e-49da-8df9-83d22e36991a tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1682 microversion: 2.1 time: 0.166231 Oct 28 11:15:11.932464 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4013/8033] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:15:11 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:15:46.151503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:15:46.153741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:15:46.156482 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=14 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:15:46.157173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:15:46.165915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:46.166404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:46.166852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:46.167549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:15:46.168009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:15:46.168440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:15:46.254553 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fd92748e-fcd6-42fe-8841-176b83d8515d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action" status: 200 len: 61429 microversion: 2.1 time: 0.106809 Oct 28 11:15:46.255538 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4021/8034] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:15:46 2022] POST /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95/action => generated 61429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:16:03.268532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:03.269691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:03.271352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5dcd9e8e-d9e0-4230-b0b0-22a2c3f7772f req-6dc1a99d-00fb-4434-9a9b-7bf4d667e209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6ced1c0-3aa7-452e-87b9-fa2c85173d95", "tag": "60690441-6be8-4d3b-b776-4941d4da05cc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:16:03.275266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=16 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:03.276469 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:03.278671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:03.279306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:03.279453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:03.280002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:03.280160 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:03.281316 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:03.282345 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:03.282984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:03.287037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5dcd9e8e-d9e0-4230-b0b0-22a2c3f7772f req-6dc1a99d-00fb-4434-9a9b-7bf4d667e209 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:03.287790 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5dcd9e8e-d9e0-4230-b0b0-22a2c3f7772f req-6dc1a99d-00fb-4434-9a9b-7bf4d667e209 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:03.288467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5dcd9e8e-d9e0-4230-b0b0-22a2c3f7772f req-6dc1a99d-00fb-4434-9a9b-7bf4d667e209 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:03.300427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5dcd9e8e-d9e0-4230-b0b0-22a2c3f7772f req-6dc1a99d-00fb-4434-9a9b-7bf4d667e209 service nova] Creating event network-changed:60690441-6be8-4d3b-b776-4941d4da05cc for instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 on n-h2-zed-1 Oct 28 11:16:03.305896 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5dcd9e8e-d9e0-4230-b0b0-22a2c3f7772f req-6dc1a99d-00fb-4434-9a9b-7bf4d667e209 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039009 Oct 28 11:16:03.307012 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4022/8035] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:16:03.310774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:16:03.403599 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7780619d-d0a1-4480-bba3-10eeb557c6b5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 204 len: 0 microversion: 2.1 time: 0.138723 Oct 28 11:16:03.404198 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4014/8036] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:16:03 2022] DELETE /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:16:03.413348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:03.414294 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:03.420639 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:03.421175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:03.421625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:03.422339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:03.422807 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:03.423240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:03.562864 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:03.570949 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b0047c91-0059-413f-8a20-2995a877c7e4 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1688 microversion: 2.1 time: 0.162372 Oct 28 11:16:03.571875 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4023/8037] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:03 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:04.596226 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:04.597104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:04.604503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:04.605044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:04.605503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:04.606225 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:04.606698 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:04.607170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:04.815366 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:04.823316 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9061a7fc-e9ee-4cac-a737-3fcd70fb66cb tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1688 microversion: 2.1 time: 0.231365 Oct 28 11:16:04.823948 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4015/8038] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:04 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1688 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:05.608742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-5d2fcc63-900f-484e-a8c8-6cea74dc30b7 req-837ddd9b-3f52-4720-b971-1881f54ec5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6ced1c0-3aa7-452e-87b9-fa2c85173d95", "name": "network-vif-deleted", "tag": "60690441-6be8-4d3b-b776-4941d4da05cc"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:16:05.619669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d2fcc63-900f-484e-a8c8-6cea74dc30b7 req-837ddd9b-3f52-4720-b971-1881f54ec5f5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:05.620158 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d2fcc63-900f-484e-a8c8-6cea74dc30b7 req-837ddd9b-3f52-4720-b971-1881f54ec5f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:05.620596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-5d2fcc63-900f-484e-a8c8-6cea74dc30b7 req-837ddd9b-3f52-4720-b971-1881f54ec5f5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:05.632098 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-5d2fcc63-900f-484e-a8c8-6cea74dc30b7 req-837ddd9b-3f52-4720-b971-1881f54ec5f5 service nova] Creating event network-vif-deleted:60690441-6be8-4d3b-b776-4941d4da05cc for instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 on n-h2-zed-1 Oct 28 11:16:05.637667 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-5d2fcc63-900f-484e-a8c8-6cea74dc30b7 req-837ddd9b-3f52-4720-b971-1881f54ec5f5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032679 Oct 28 11:16:05.638270 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4024/8039] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:16:05.847647 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:05.848286 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:05.855723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:05.856251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:05.856712 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:05.857451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:05.857925 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:05.858371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:05.890928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:05.891443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:05.891911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:05.892384 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lazy-loading 'fault' on Instance uuid b6ced1c0-3aa7-452e-87b9-fa2c85173d95 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:16:05.935676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:05.943893 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-830bf3e3-7207-479e-930b-f3a84d9c1ac8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 200 len: 1356 microversion: 2.1 time: 0.100071 Oct 28 11:16:05.944698 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4016/8040] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:05 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 1356 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:06.969092 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:06.969793 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: b6ced1c0-3aa7-452e-87b9-fa2c85173d95] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:06.975876 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:06.976370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:06.976815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:06.977530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:06.977986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:06.978916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:06.992128 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] HTTP exception thrown: Instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 could not be found. Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Request method failure captured: Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 HTTP/1.1 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7ffxW7IzOVzm9VzZb3lolIJroMzL5jlKpL7h17sKYJwD4trIZr_OSxOxSlxR9dzGbvMQyolBrfwg5zXfyKN-6MsCQ9nIGrZAi7TYTcj5XjEBtqfoQdU4v7g59EYORLpm-oqQcgLvgqRGIy8rJJBLgwkmqSQQURG2FyWGDlp8-mKU5s Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19a924fff2a74cd489ec2f9b0f43db97", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19a924fff2a74cd489ec2f9b0f43db97"}]}] Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 65c0789aabf74875985235644d9191a7 Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 could not be found. Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'b6ced1c0-3aa7-452e-87b9-fa2c85173d95'} Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 could not be found. Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 could not be found. Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:16:06.993749 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 could not be found. Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Returning 404 to user: Instance b6ced1c0-3aa7-452e-87b9-fa2c85173d95 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-cecbf58c-1127-4489-8238-f7f10401a198 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95" status: 404 len: 111 microversion: 2.1 time: 0.031710 Oct 28 11:16:06.999809 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4025/8041] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:06 2022] GET /compute/v2.1/servers/b6ced1c0-3aa7-452e-87b9-fa2c85173d95 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 28 11:16:10.207325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2653aedf-1aee-430c-bd35-44f462ac8c54 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '.version_select at 0x7fca327b2280>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:10.229814 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2653aedf-1aee-430c-bd35-44f462ac8c54 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-979156460" status: 202 len: 0 microversion: 2.1 time: 0.026239 Oct 28 11:16:10.230410 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4017/8042] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 11:16:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-979156460 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:16:10.262859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4c7617a7-164b-4561-835e-130b973596a0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: .version_select at 0x7fca32db6280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-484016033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECXMVBPjnlRHSXECWR15wayIIqju+IS/uaUqC4CrpkPw0Dm1N/qepJWvRLB52LjYi4G7Wla3ZTeCWtmMJbtFpxY1/q8LysxB1yW32Am47SHkwo+drJQR7kBR5CUcGQ/Pg=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:16:10.280537 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4c7617a7-164b-4561-835e-130b973596a0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:16:10.286173 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-4c7617a7-164b-4561-835e-130b973596a0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:16:10.310243 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4c7617a7-164b-4561-835e-130b973596a0 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051942 Oct 28 11:16:10.310852 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4026/8043] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:16:10 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:16:15.728875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2117738940", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "networks": [{"uuid": "b95e925d-4362-4fa5-8607-8beae7ac915d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-484016033", "security_groups": [{"name": "tempest-secgroup-smoke-931340657"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:16:15.837740 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] validate_networks() for [('b95e925d-4362-4fa5-8607-8beae7ac915d', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:16:15.940011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:16.575918 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:16:16.576704 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:16:16.577335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:16:16.578003 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:16:16.578545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:16:16.589707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:16.590654 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:16.591294 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:16.592238 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:16.592917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:16.593566 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:16.612479 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:16:16.622386 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Getting quotas for user 65c0789aabf74875985235644d9191a7 and project 19a924fff2a74cd489ec2f9b0f43db97. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:16:16.635969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:16:16.638425 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:16:16.685673 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [d1df3681-c805-43c0-98f8-5fe994109871] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:16:17.693776 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [d1df3681-c805-43c0-98f8-5fe994109871] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 38724. Oct 28 11:16:17.697897 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-09ddf4f0-ccd9-4f82-803b-5a10e6bf2e59 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.974168 Oct 28 11:16:17.698756 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4018/8044] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:16:15 2022] POST /compute/v2.1/servers => generated 405 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:16:17.708254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:17.712810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e95b70ae-33ef-4809-9cd2-6370f1c365ae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:17.713529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e95b70ae-33ef-4809-9cd2-6370f1c365ae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:17.786035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e95b70ae-33ef-4809-9cd2-6370f1c365ae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:17.793893 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e95b70ae-33ef-4809-9cd2-6370f1c365ae tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1266 microversion: 2.1 time: 0.087679 Oct 28 11:16:17.797423 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4027/8045] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:17 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:18.817904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:18.818547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:18.825374 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:18.825888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:18.826347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:18.827072 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:18.827548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:18.828111 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:18.907533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:18.917204 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d80aa9d8-9dd5-49da-926a-fb6b8aea6752 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1326 microversion: 2.1 time: 0.104066 Oct 28 11:16:18.918009 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4019/8046] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:18 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:19.948738 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:19.949573 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:19.955917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:19.956487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:19.957033 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:19.958072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:19.958599 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:19.959123 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:20.214290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:20.222173 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba6e7c95-8bea-4fbf-a429-ad6387ed9d43 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1391 microversion: 2.1 time: 0.278708 Oct 28 11:16:20.222870 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4028/8047] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:19 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1391 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:20.364785 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-322212bf-874b-42bf-896d-6d2ca3910196 req-e10e1dfd-a386-491f-9d59-f369ab556a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2a3517-9f99-4a5b-af74-8a2f547d38d7", "tag": "2af877e9-d1ce-4cb3-95ae-41874d31b966"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:16:20.378948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-322212bf-874b-42bf-896d-6d2ca3910196 req-e10e1dfd-a386-491f-9d59-f369ab556a9d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:20.379701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-322212bf-874b-42bf-896d-6d2ca3910196 req-e10e1dfd-a386-491f-9d59-f369ab556a9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:20.380163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-322212bf-874b-42bf-896d-6d2ca3910196 req-e10e1dfd-a386-491f-9d59-f369ab556a9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:20.394548 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-322212bf-874b-42bf-896d-6d2ca3910196 req-e10e1dfd-a386-491f-9d59-f369ab556a9d service nova] Creating event network-changed:2af877e9-d1ce-4cb3-95ae-41874d31b966 for instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 on n-h2-zed-1 Oct 28 11:16:20.400210 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-322212bf-874b-42bf-896d-6d2ca3910196 req-e10e1dfd-a386-491f-9d59-f369ab556a9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040487 Oct 28 11:16:20.401172 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4020/8048] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:16:21.245224 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:21.245847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:21.252724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:21.253253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:21.253699 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:21.254401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:21.254868 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:21.255304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:21.389631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:21.397338 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ddbf20db-e7f7-40ed-acfc-08419d090184 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1391 microversion: 2.1 time: 0.156047 Oct 28 11:16:21.397914 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4029/8049] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:21 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:22.422188 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:22.422942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:22.429369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:22.429871 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:22.430325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:22.431030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:22.431504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:22.431945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:22.566675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:22.574867 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e974b664-8dbb-43aa-a1b5-39b47e7d0045 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1391 microversion: 2.1 time: 0.157133 Oct 28 11:16:22.575448 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4021/8050] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:22 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:23.598691 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:23.599261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:23.606460 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:23.607037 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:23.607561 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:23.608276 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:23.608741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:23.609203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:23.750948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:23.759123 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9aad06b7-cdaf-48d1-9aed-b4824f5120e2 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1391 microversion: 2.1 time: 0.164416 Oct 28 11:16:23.760434 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4030/8051] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:23 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:24.782830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:24.783462 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:24.791029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:24.791536 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:24.791993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:24.792701 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:24.793204 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:24.793650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:24.926266 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:24.934085 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a9c64c2c-4075-42a7-8bd4-ce6595f0c8ca tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1391 microversion: 2.1 time: 0.155167 Oct 28 11:16:24.934660 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4022/8052] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:24 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:25.957977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:25.958629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:25.965711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:25.966207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:25.966656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:25.967361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:25.967830 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:25.968268 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:26.098916 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:26.106750 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ec1a5b5f-f5c4-42d6-99b8-64b7a0c7f0b8 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1391 microversion: 2.1 time: 0.152988 Oct 28 11:16:26.107328 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4031/8053] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:25 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1391 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:26.492642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-4d8be50d-13c4-487a-8427-d362b97103ab req-eab7a5d1-5cce-4fcc-b106-5d1a3a9c76c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a3517-9f99-4a5b-af74-8a2f547d38d7", "name": "network-vif-plugged", "status": "completed", "tag": "2af877e9-d1ce-4cb3-95ae-41874d31b966"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:16:26.504984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4d8be50d-13c4-487a-8427-d362b97103ab req-eab7a5d1-5cce-4fcc-b106-5d1a3a9c76c3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:26.505507 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4d8be50d-13c4-487a-8427-d362b97103ab req-eab7a5d1-5cce-4fcc-b106-5d1a3a9c76c3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:26.505965 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-4d8be50d-13c4-487a-8427-d362b97103ab req-eab7a5d1-5cce-4fcc-b106-5d1a3a9c76c3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:26.517463 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-4d8be50d-13c4-487a-8427-d362b97103ab req-eab7a5d1-5cce-4fcc-b106-5d1a3a9c76c3 service nova] Creating event network-vif-plugged:2af877e9-d1ce-4cb3-95ae-41874d31b966 for instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 on n-h2-zed-1 Oct 28 11:16:26.522701 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-4d8be50d-13c4-487a-8427-d362b97103ab req-eab7a5d1-5cce-4fcc-b106-5d1a3a9c76c3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033809 Oct 28 11:16:26.523306 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4023/8054] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:16:27.130895 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:27.131436 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:27.138796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:27.139285 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:27.139726 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:27.140423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:27.140882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:27.141335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:27.270632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:27.278599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9b7f47c9-4590-4026-9727-32ec932f6544 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1391 microversion: 2.1 time: 0.151660 Oct 28 11:16:27.279181 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4032/8055] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:27 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:28.302808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:28.303532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:28.305580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:28.306273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:28.313990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:28.314494 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:28.314953 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:28.315714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:28.316197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:28.316646 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:28.451476 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:28.461400 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b2975774-82b0-498a-965d-bddc785c88a3 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1562 microversion: 2.1 time: 0.162965 Oct 28 11:16:28.461982 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4024/8056] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:28 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:28.484549 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:28.485195 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:28.487098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:16:28.493124 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:28.493629 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:28.494077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:28.494770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:28.495229 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:28.495662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:28.626228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:28.634589 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2c91677c-65f0-4d66-b6a0-1902700f6f78 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1562 microversion: 2.1 time: 0.153385 Oct 28 11:16:28.635193 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4033/8057] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:28 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:16:30.506589 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:16:30.507768 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:16:30.508237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-df1c2c2d-dae3-4e6e-9e12-c48144bf77af req-2118494c-b149-424a-b20f-ed9e9f59c44d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2a3517-9f99-4a5b-af74-8a2f547d38d7", "tag": "2af877e9-d1ce-4cb3-95ae-41874d31b966"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:16:30.515682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:30.516470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:30.516949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:30.517681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:30.518159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:30.518691 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:30.520504 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-df1c2c2d-dae3-4e6e-9e12-c48144bf77af req-2118494c-b149-424a-b20f-ed9e9f59c44d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:16:30.521093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-df1c2c2d-dae3-4e6e-9e12-c48144bf77af req-2118494c-b149-424a-b20f-ed9e9f59c44d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:16:30.521775 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-df1c2c2d-dae3-4e6e-9e12-c48144bf77af req-2118494c-b149-424a-b20f-ed9e9f59c44d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:16:30.533224 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-df1c2c2d-dae3-4e6e-9e12-c48144bf77af req-2118494c-b149-424a-b20f-ed9e9f59c44d service nova] Creating event network-changed:2af877e9-d1ce-4cb3-95ae-41874d31b966 for instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 on n-h2-zed-1 Oct 28 11:16:30.538853 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-df1c2c2d-dae3-4e6e-9e12-c48144bf77af req-2118494c-b149-424a-b20f-ed9e9f59c44d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Oct 28 11:16:30.540423 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4034/8058] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:16:30.656426 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:16:30.664446 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c721b6ca-99e5-4d8d-9e98-c946cbee4fe5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1562 microversion: 2.1 time: 0.162755 Oct 28 11:16:30.668966 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4025/8059] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:16:30 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1562 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:01.944391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:01.945166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=38 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:01.950142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:01.952399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:01.959719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:01.960204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:01.960643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:01.961362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:01.961818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:01.962243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:02.033414 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48768571-26e1-4b54-aa24-a2274f1cc8a9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action" status: 200 len: 24564 microversion: 2.1 time: 0.090904 Oct 28 11:17:02.034097 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4035/8060] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:17:01 2022] POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action => generated 24564 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:17:32.440937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:32.441742 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:32.445896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:32.446470 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:32.454005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:32.454508 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:32.454967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:32.455673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:32.456144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:32.456583 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:32.481432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lazy-loading 'flavor' on Instance uuid 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:17:32.545002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49201147-6019-41e8-982e-1ffde7a2e09d tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action" status: 202 len: 0 microversion: 2.1 time: 0.106339 Oct 28 11:17:32.545912 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4026/8061] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:17:32 2022] POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:17:32.554998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:32.557609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:32.562164 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:32.563120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:32.569348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:32.569778 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:32.570225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:32.570940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:32.571401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:32.571833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:32.714588 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:32.722361 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fef3d470-20a4-4a47-a1ad-26654283fd77 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1688 microversion: 2.1 time: 0.172133 Oct 28 11:17:32.723199 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4036/8062] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:32 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:33.748184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:33.748945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:33.755105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:33.755611 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:33.756071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:33.756781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:33.757282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:33.757723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:33.895673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:33.904128 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a75ea7c8-3556-4444-ae8a-03a58f4990b9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1688 microversion: 2.1 time: 0.161345 Oct 28 11:17:33.904721 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4027/8063] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:33 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:34.928176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:34.928842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:34.936708 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:34.937237 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:34.937686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:34.938393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:34.938884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:34.939326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:35.114393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:35.123292 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3bc21473-7dac-4aa6-a304-b162d5d63885 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1671 microversion: 2.1 time: 0.199167 Oct 28 11:17:35.123952 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4037/8064] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:34 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1671 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:36.220360 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:36.222571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:36.229905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:36.230409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:36.230863 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:36.231574 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:36.232053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:36.232497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:36.293752 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b01c5e1c-03d0-419f-a441-453b4bbd72fd tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action" status: 200 len: 37348 microversion: 2.1 time: 0.077247 Oct 28 11:17:36.294393 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4028/8065] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:17:36 2022] POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action => generated 37348 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:17:36.306697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:36.307239 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:36.314101 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:36.314592 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:36.315035 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:36.315727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:36.316186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:36.316614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:36.382486 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f68bc773-186b-424a-bfe8-9ec79feef79e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action" status: 202 len: 0 microversion: 2.1 time: 0.080074 Oct 28 11:17:36.383126 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4038/8066] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:17:36 2022] POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:17:36.392406 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:36.393170 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:36.402606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:36.403189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:36.403927 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:36.404666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:36.405173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:36.405626 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:36.548248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:36.556291 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-38c35f85-4a87-4900-82d3-34092dfa2060 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1677 microversion: 2.1 time: 0.168275 Oct 28 11:17:36.568928 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4029/8067] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:36 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:17:37.581623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:37.582332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:37.589413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:37.589913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:37.590357 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:37.591064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:37.591524 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:37.591954 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:37.726382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:37.734843 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8712f194-a762-4abd-98dd-d13742fc8810 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1677 microversion: 2.1 time: 0.158376 Oct 28 11:17:37.735853 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4039/8068] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:37 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:38.759409 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:38.760044 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:38.766998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:38.767501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:38.767986 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:38.768707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:38.769218 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:38.769665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:38.899827 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:38.907840 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c50d40e8-ca16-4efc-a172-9c110b50f6c5 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1680 microversion: 2.1 time: 0.152323 Oct 28 11:17:38.908426 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4030/8069] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:38 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:39.004989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:39.007218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:39.014499 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:39.014991 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:39.015435 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:39.016159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:39.016620 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:39.017081 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:39.080052 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-958f0031-4259-4b6a-b670-75292f9af775 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action" status: 200 len: 37348 microversion: 2.1 time: 0.078803 Oct 28 11:17:39.080740 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4040/8070] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:17:38 2022] POST /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7/action => generated 37348 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 28 11:17:40.532822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:40.533413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:40.543649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:40.544451 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:40.544916 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:40.545875 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:40.546347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:40.546787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:40.574956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:17:40.659513 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fdb2563d-d04f-4627-b3f8-def37e726c3e tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 204 len: 0 microversion: 2.1 time: 0.130007 Oct 28 11:17:40.660520 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4031/8071] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:17:40 2022] DELETE /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:17:40.670807 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:40.671803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:40.677948 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:40.678830 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:40.678970 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:40.679604 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:40.680151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:40.680551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:40.690047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-a3c23148-4bf8-44b8-89ef-f30e1e3ed8b2 req-e24c8f2b-25db-48da-b2b5-fd1a16df5c6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a2a3517-9f99-4a5b-af74-8a2f547d38d7", "tag": "2af877e9-d1ce-4cb3-95ae-41874d31b966"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:40.700711 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a3c23148-4bf8-44b8-89ef-f30e1e3ed8b2 req-e24c8f2b-25db-48da-b2b5-fd1a16df5c6b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:40.701317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a3c23148-4bf8-44b8-89ef-f30e1e3ed8b2 req-e24c8f2b-25db-48da-b2b5-fd1a16df5c6b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:40.701826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-a3c23148-4bf8-44b8-89ef-f30e1e3ed8b2 req-e24c8f2b-25db-48da-b2b5-fd1a16df5c6b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:40.714515 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-a3c23148-4bf8-44b8-89ef-f30e1e3ed8b2 req-e24c8f2b-25db-48da-b2b5-fd1a16df5c6b service nova] Creating event network-changed:2af877e9-d1ce-4cb3-95ae-41874d31b966 for instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 on n-h2-zed-1 Oct 28 11:17:40.721496 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-a3c23148-4bf8-44b8-89ef-f30e1e3ed8b2 req-e24c8f2b-25db-48da-b2b5-fd1a16df5c6b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189714 Oct 28 11:17:40.725988 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4041/8072] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:17:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:17:40.822894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:40.830788 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-43c46a51-7509-4e48-bbad-1696699fa007 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1686 microversion: 2.1 time: 0.165949 Oct 28 11:17:40.831377 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4032/8073] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:40 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1686 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:41.857739 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:41.858352 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:41.868399 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:41.868887 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:41.869347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:41.870047 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:41.870502 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:41.870933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:42.001048 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:42.009521 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-44cde51e-3afe-4906-b9ae-657ddbaae7e7 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1686 microversion: 2.1 time: 0.157529 Oct 28 11:17:42.010113 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4042/8074] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:41 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:43.032998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:43.033668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:43.040504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:43.041048 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:43.041504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:43.042222 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:43.042695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:43.043139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:43.108262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65c0789aabf74875985235644d9191a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19a924fff2a74cd489ec2f9b0f43db97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:17:43.117427 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-253ddd64-a3c6-43ff-b377-1f106328402f tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 200 len: 1501 microversion: 2.1 time: 0.088437 Oct 28 11:17:43.118603 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4033/8075] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:43 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 1501 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:17:43.169217 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-fa84ecd4-220b-49d7-875e-2aca3250250c req-1ee1e2c6-187d-47c8-ad21-8b68e0560280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a2a3517-9f99-4a5b-af74-8a2f547d38d7", "name": "network-vif-deleted", "tag": "2af877e9-d1ce-4cb3-95ae-41874d31b966"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:43.181046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fa84ecd4-220b-49d7-875e-2aca3250250c req-1ee1e2c6-187d-47c8-ad21-8b68e0560280 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:43.181546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fa84ecd4-220b-49d7-875e-2aca3250250c req-1ee1e2c6-187d-47c8-ad21-8b68e0560280 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:43.181981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-fa84ecd4-220b-49d7-875e-2aca3250250c req-1ee1e2c6-187d-47c8-ad21-8b68e0560280 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:43.193627 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-fa84ecd4-220b-49d7-875e-2aca3250250c req-1ee1e2c6-187d-47c8-ad21-8b68e0560280 service nova] Creating event network-vif-deleted:2af877e9-d1ce-4cb3-95ae-41874d31b966 for instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 on n-h2-zed-1 Oct 28 11:17:43.199425 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-fa84ecd4-220b-49d7-875e-2aca3250250c req-1ee1e2c6-187d-47c8-ad21-8b68e0560280 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Oct 28 11:17:43.200147 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4043/8076] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:17:44.142131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:44.142751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] [instance: 9a2a3517-9f99-4a5b-af74-8a2f547d38d7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:17:44.149801 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:44.150306 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:44.150766 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:44.151482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:17:44.151959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:17:44.152414 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:17:44.166533 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] HTTP exception thrown: Instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 could not be found. Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Request method failure captured: Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 HTTP/1.1 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7ffxW7IzOVzm9VzZb3lolIJroMzL5jlKpL7h17sKYJwD4trIZr_OSxOxSlxR9dzGbvMQyolBrfwg5zXfyKN-6MsCQ9nIGrZAi7TYTcj5XjEBtqfoQdU4v7g59EYORLpm-oqQcgLvgqRGIy8rJJBLgwkmqSQQURG2FyWGDlp8-mKU5s Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/19a924fff2a74cd489ec2f9b0f43db97"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_19a924fff2a74cd489ec2f9b0f43db97", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/19a924fff2a74cd489ec2f9b0f43db97"}]}] Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 19a924fff2a74cd489ec2f9b0f43db97 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1347276881 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 65c0789aabf74875985235644d9191a7 Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1347276881-project Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 could not be found. Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '9a2a3517-9f99-4a5b-af74-8a2f547d38d7'} Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 could not be found. Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 could not be found. Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:17:44.167602 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 could not be found. Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Returning 404 to user: Instance 9a2a3517-9f99-4a5b-af74-8a2f547d38d7 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a4650969-a9e7-48e0-9bac-2b6ca19477d9 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7" status: 404 len: 111 microversion: 2.1 time: 0.030949 Oct 28 11:17:44.173931 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4034/8077] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:17:44 2022] GET /compute/v2.1/servers/9a2a3517-9f99-4a5b-af74-8a2f547d38d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:17:47.132697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e890eacb-3ce2-419d-aef6-401d61a4ba07 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] Calling method '.version_select at 0x7fca323fe310>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:17:47.172677 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e890eacb-3ce2-419d-aef6-401d61a4ba07 tempest-TestNetworkAdvancedServerOps-1347276881 tempest-TestNetworkAdvancedServerOps-1347276881-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-484016033" status: 202 len: 0 microversion: 2.1 time: 0.045316 Oct 28 11:17:47.173599 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4044/8078] 10.222.0.16 () {58 vars in 1281 bytes} [Fri Oct 28 11:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-484016033 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:17:58.366939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:58.369069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:58.566911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0f7ecf00-a378-4d23-9caf-344aaece59f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'create', calling method: .version_select at 0x7fca321f1550>, body: {"keypair": {"name": "tempest-TestShelveInstance-477217945", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCm42aY1JV1OGpGzryYw0lT8EDTrF12KI/tBw7LNF9dCJ1470i9aBlCTQId6kBJ+eQ1AYu1AFvAlFAUoT4/mVhc2gcAbFOHHXhbqArgK34ArU/Bkr544j3tlmKBsNVQXA=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:58.585224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0f7ecf00-a378-4d23-9caf-344aaece59f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for project ac5d7744d6c24245af328843551dac5d. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:17:58.591739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-0f7ecf00-a378-4d23-9caf-344aaece59f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for user 1696563726cc4d289edacece3fd2aef9 and project ac5d7744d6c24245af328843551dac5d. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:17:58.621739 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0f7ecf00-a378-4d23-9caf-344aaece59f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.261035 Oct 28 11:17:58.622259 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4035/8079] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:17:58 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:17:59.627724 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:59.628512 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:17:59.632686 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1581207857", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-477217945", "security_groups": [{"name": "tempest-secgroup-smoke-1668822910"}], "networks": [{"uuid": "e2d55547-489f-4a71-96df-0e6f64690024"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:17:59.748978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] validate_networks() for [('e2d55547-489f-4a71-96df-0e6f64690024', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:18:00.134969 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:18:00.135406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:18:00.135891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:18:00.136313 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:18:00.136737 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:18:00.145736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:00.146231 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:00.146681 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:00.147421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:00.147888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:00.148325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:00.166860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for project ac5d7744d6c24245af328843551dac5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:18:00.172296 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for user 1696563726cc4d289edacece3fd2aef9 and project ac5d7744d6c24245af328843551dac5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:18:00.185440 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:18:00.187886 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:18:00.236222 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-189df905-fb2b-419f-93db-864a17981a7b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.610235 Oct 28 11:18:00.237257 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4045/8080] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:17:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:18:00.249881 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5d28350a-77b4-4f11-a7a3-2106c3578265 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:00.250520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5d28350a-77b4-4f11-a7a3-2106c3578265 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:00.311885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5d28350a-77b4-4f11-a7a3-2106c3578265 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:00.319877 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5d28350a-77b4-4f11-a7a3-2106c3578265 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1246 microversion: 2.1 time: 0.074778 Oct 28 11:18:00.332927 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4036/8081] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:00 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1246 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:01.346421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:01.348052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:01.356080 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:01.357038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:01.357745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:01.358771 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:01.359288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:01.359947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:01.440961 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:01.460367 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ba036c47-512b-4bcb-920b-692831e5d6fc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1306 microversion: 2.1 time: 0.119481 Oct 28 11:18:01.461782 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4046/8082] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:01 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1306 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:02.487298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:02.488031 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:02.495063 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:02.495648 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:02.496200 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:02.497015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:02.497565 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:02.498085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:02.640026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:02.648640 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-484d076e-c416-4d7b-a5c9-73db9dd59850 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1372 microversion: 2.1 time: 0.165385 Oct 28 11:18:02.649277 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4037/8083] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:02 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:02.895853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e9ebc7e4-1b41-4aa6-a60f-be22c61896f8 req-9d102c8f-ad91-4e2e-8825-07b3f243e2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:18:02.908501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9ebc7e4-1b41-4aa6-a60f-be22c61896f8 req-9d102c8f-ad91-4e2e-8825-07b3f243e2a5 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:02.909170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9ebc7e4-1b41-4aa6-a60f-be22c61896f8 req-9d102c8f-ad91-4e2e-8825-07b3f243e2a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:02.910084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e9ebc7e4-1b41-4aa6-a60f-be22c61896f8 req-9d102c8f-ad91-4e2e-8825-07b3f243e2a5 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:02.922278 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e9ebc7e4-1b41-4aa6-a60f-be22c61896f8 req-9d102c8f-ad91-4e2e-8825-07b3f243e2a5 service nova] Creating event network-changed:17f45898-1e23-42bb-8d3a-2371396691b5 for instance cb71bf3a-f216-436c-b58a-472b7c531e60 on n-h2-zed-1 Oct 28 11:18:02.928140 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e9ebc7e4-1b41-4aa6-a60f-be22c61896f8 req-9d102c8f-ad91-4e2e-8825-07b3f243e2a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036581 Oct 28 11:18:02.928788 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4047/8084] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:18:03.671789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:03.672434 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:03.679293 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:03.679791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:03.680244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:03.680960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:03.681427 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:03.681866 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:03.812213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:03.819997 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-43197227-1706-4ec4-90fc-f5e38ece112c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1372 microversion: 2.1 time: 0.152098 Oct 28 11:18:03.821182 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4038/8085] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:03 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:04.845382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:04.846103 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:04.852776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:04.853299 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:04.853779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:04.854510 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:04.854974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:04.855410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:05.000182 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:05.008088 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca134960-46d2-42e0-9c84-222a66f082f3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1372 microversion: 2.1 time: 0.168054 Oct 28 11:18:05.008669 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4048/8086] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:04 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:06.031870 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:06.032430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:06.039936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:06.040439 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:06.040891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:06.041658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:06.042131 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:06.042575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:06.177105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:06.185728 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a4207178-a6ad-447d-93af-5c11979f508e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1372 microversion: 2.1 time: 0.157814 Oct 28 11:18:06.186357 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4039/8087] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:06 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:07.208672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:07.209351 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:07.216487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:07.217023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:07.217469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:07.218207 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:07.218669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:07.219100 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:07.351631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:07.359248 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fc52e2e7-2966-4035-bece-4c14954b953d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1372 microversion: 2.1 time: 0.154811 Oct 28 11:18:07.359827 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4049/8088] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:07 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:08.383223 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:08.383818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:08.390788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:08.391295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:08.391753 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:08.392464 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:08.392967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:08.393416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:08.525382 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:08.533079 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-84f8d074-0e44-4757-926e-6205b3add4dd tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1372 microversion: 2.1 time: 0.154457 Oct 28 11:18:08.533671 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4040/8089] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:08 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:09.074187 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-57b44388-00a0-45ff-b5ae-0f08d9570d71 req-5833927b-b685-4680-b563-b63af93b1fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "name": "network-vif-plugged", "status": "completed", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:18:09.083897 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-57b44388-00a0-45ff-b5ae-0f08d9570d71 req-5833927b-b685-4680-b563-b63af93b1fc1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:09.084384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-57b44388-00a0-45ff-b5ae-0f08d9570d71 req-5833927b-b685-4680-b563-b63af93b1fc1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:09.084821 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-57b44388-00a0-45ff-b5ae-0f08d9570d71 req-5833927b-b685-4680-b563-b63af93b1fc1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:09.099030 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-57b44388-00a0-45ff-b5ae-0f08d9570d71 req-5833927b-b685-4680-b563-b63af93b1fc1 service nova] Creating event network-vif-plugged:17f45898-1e23-42bb-8d3a-2371396691b5 for instance cb71bf3a-f216-436c-b58a-472b7c531e60 on n-h2-zed-1 Oct 28 11:18:09.104721 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-57b44388-00a0-45ff-b5ae-0f08d9570d71 req-5833927b-b685-4680-b563-b63af93b1fc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100675 Oct 28 11:18:09.105382 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4050/8090] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:18:09.555884 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:09.556523 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:09.563447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:09.563952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:09.564410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:09.565155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:09.565639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:09.566090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:09.698205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:09.705987 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-13b375c7-f2b6-47fd-86d4-3d5a2f22f42d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1372 microversion: 2.1 time: 0.154120 Oct 28 11:18:09.706570 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4041/8091] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:09 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:10.729803 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:18:10.730616 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=6 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:18:10.735133 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:10.735846 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:10.743574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:10.744073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:10.744519 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:10.745251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:10.745718 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:10.746152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:10.884640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:10.892477 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b9491465-1c80-413f-8826-f090cb5afede tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1557 microversion: 2.1 time: 0.165030 Oct 28 11:18:10.893074 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4051/8092] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:10 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:10.915690 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:18:10.916321 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:18:10.918216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:18:10.924585 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:10.925145 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:10.925603 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:10.926319 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:10.926788 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:10.927278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:11.062193 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:18:11.070055 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e05ab270-7671-430c-b319-21a6d6bd8609 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1557 microversion: 2.1 time: 0.158848 Oct 28 11:18:11.070634 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4042/8093] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:18:10 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:18:13.036119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-bf2f5f9d-8e38-44dc-9884-e05b8a873427 req-f3c08bc6-7f3f-4876-8861-2f5bafbd8e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:18:13.046773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bf2f5f9d-8e38-44dc-9884-e05b8a873427 req-f3c08bc6-7f3f-4876-8861-2f5bafbd8e71 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:18:13.047264 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bf2f5f9d-8e38-44dc-9884-e05b8a873427 req-f3c08bc6-7f3f-4876-8861-2f5bafbd8e71 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:18:13.047728 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bf2f5f9d-8e38-44dc-9884-e05b8a873427 req-f3c08bc6-7f3f-4876-8861-2f5bafbd8e71 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:18:13.060361 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-bf2f5f9d-8e38-44dc-9884-e05b8a873427 req-f3c08bc6-7f3f-4876-8861-2f5bafbd8e71 service nova] Creating event network-changed:17f45898-1e23-42bb-8d3a-2371396691b5 for instance cb71bf3a-f216-436c-b58a-472b7c531e60 on n-h2-zed-1 Oct 28 11:18:13.065633 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-bf2f5f9d-8e38-44dc-9884-e05b8a873427 req-f3c08bc6-7f3f-4876-8861-2f5bafbd8e71 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085660 Oct 28 11:18:13.066260 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4052/8094] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:20:38.634555 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:20:38.635559 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:20:38.636105 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:20:38.637114 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=36 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:20:38.637900 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:20:38.638103 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:20:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60/action (ip 10.222.0.16) !!! Oct 28 11:20:38.639479 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:20:38.639623 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:20:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60/action (ip 10.222.0.16) !!! Oct 28 11:20:38.640728 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:20:38.640854 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:20:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60/action (ip 10.222.0.16) !!! Oct 28 11:20:38.646153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:20:38.646705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:38.657598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:38.658097 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:38.658547 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:38.659255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:38.659721 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:38.660161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:38.684416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lazy-loading 'flavor' on Instance uuid cb71bf3a-f216-436c-b58a-472b7c531e60 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:20:39.037450 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4f9b0059-f311-462f-927f-483a03fad8a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60/action" status: 202 len: 0 microversion: 2.1 time: 0.405442 Oct 28 11:20:39.038276 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4043/8095] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:20:38 2022] POST /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60/action => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:20:39.045961 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:20:39.047489 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:20:39.048335 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:20:39.049346 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=32 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:20:39.050616 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:20:39.051066 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:20:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 (ip 10.222.0.16) !!! Oct 28 11:20:39.058449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:39.059199 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:39.068689 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:39.069219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:39.069662 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:39.070397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:39.070862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:39.071291 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:39.350544 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:39.359064 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d5829e51-076c-4604-99e5-0a67e7a74f72 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.315443 Oct 28 11:20:39.359653 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4053/8096] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:39 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:40.389652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:40.390555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:40.400095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:40.400599 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:40.401450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:40.402173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:40.402644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:40.403089 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:40.407051 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39086. Oct 28 11:20:40.410194 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39084. Oct 28 11:20:40.538211 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:40.546449 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fbb1d3e2-3158-48c6-809f-fa825567e41c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.164027 Oct 28 11:20:40.547033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4044/8097] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:40 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:41.570534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:41.571713 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:41.581412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:41.581915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:41.582358 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:41.583054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:41.583513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:41.583941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:41.588491 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39094. Oct 28 11:20:41.591249 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39092. Oct 28 11:20:41.717120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:41.724921 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b714819a-6ad9-4fa6-a5a8-19920bd044f7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.158334 Oct 28 11:20:41.725643 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4054/8098] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:41 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:42.747682 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:42.748303 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:42.755151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:42.755644 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:42.756091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:42.756791 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:42.757278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:42.757714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:42.887125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:42.894798 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1786b246-b08d-4bd7-9796-d8ab88191453 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.151059 Oct 28 11:20:42.895364 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4045/8099] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:42 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:43.918984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:43.919609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:43.926445 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:43.926935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:43.927376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:43.928070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:43.928530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:43.928981 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:44.063741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:44.072188 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ccf2bbee-c9b2-4d63-bbfa-e601f593a1d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.157779 Oct 28 11:20:44.072770 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4055/8100] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:43 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:45.095782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:45.096442 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:45.103808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:45.104305 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:45.104756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:45.105488 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:45.105959 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:45.106401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:45.240782 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:45.250098 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d959817b-ff3f-47a2-8d08-d07b5e37784e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.158197 Oct 28 11:20:45.250683 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4046/8101] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:45 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:46.273211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:46.273865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:46.280618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:46.281142 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:46.281583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:46.282275 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:46.282735 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:46.283168 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:46.411113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:46.419344 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3ce7f6d3-186a-4ed6-99f8-9821285d14ab tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.150096 Oct 28 11:20:46.419924 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4056/8102] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:46 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:47.443621 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:47.444247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:47.451656 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:47.452153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:47.452606 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:47.453338 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:47.453809 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:47.454249 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:47.582649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:47.590676 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c387d35c-9082-411f-b494-67689a809792 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.150983 Oct 28 11:20:47.591562 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4047/8103] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:47 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:48.614104 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:48.614725 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:48.622098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:48.622591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:48.623034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:48.623736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:48.624198 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:48.624631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:48.759062 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:48.766831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-42c472f2-4e06-4def-a6d0-0439dc29fecb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.156602 Oct 28 11:20:48.767412 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4057/8104] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:48 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:49.790803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:49.791428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:49.798402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:49.798905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:49.799356 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:49.800059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:49.800529 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:49.800995 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:49.933989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:49.941763 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2343c312-eb4e-4802-b43a-2218c48a9a1d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.155509 Oct 28 11:20:49.942335 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4048/8105] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:49 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:50.965401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:50.966002 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:50.972880 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:50.973390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:50.973828 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:50.974511 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:50.974963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:50.975391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:51.113847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:51.121986 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-568a19c9-b24e-4071-8fb8-86a87aa332e2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1702 microversion: 2.1 time: 0.160485 Oct 28 11:20:51.122570 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4058/8106] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:50 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1702 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:52.145251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:52.145909 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:52.152815 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:52.153341 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:52.153822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:52.154524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:52.154993 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:52.155460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:52.289373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:52.297320 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-49eebf3a-6d6b-4ff8-95f0-9e04ac25ddfa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1702 microversion: 2.1 time: 0.156224 Oct 28 11:20:52.297892 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4049/8107] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:52 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1702 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:53.321664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:53.322225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:53.328978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:53.329469 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:53.329912 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:53.330633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:53.331093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:53.331522 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:53.463420 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:53.471272 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-789ae675-031b-4842-862f-de3a3f8721d6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1702 microversion: 2.1 time: 0.154135 Oct 28 11:20:53.471855 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4059/8108] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:53 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1702 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:54.494765 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:54.495322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:54.502257 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:54.502761 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:54.503220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:54.503961 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:54.504437 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:54.504889 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:54.638901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:54.647000 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-07171ca7-74a8-4fd2-b8d7-a6e40c8dc6de tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1702 microversion: 2.1 time: 0.156203 Oct 28 11:20:54.647577 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4050/8109] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:54 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1702 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:55.671356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:55.674272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:55.681521 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:55.682484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:55.683077 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:55.683878 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:55.684417 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:55.684891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:55.854568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:55.863074 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0c10c228-0781-4851-a423-3c62f9b1d7b6 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.195592 Oct 28 11:20:55.880531 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4060/8110] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:55 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:55.942933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-a76aa76b-9303-480c-bc0a-317a36510e8f req-82478b5e-29c4-4660-9821-0eeb1518c5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "name": "network-vif-plugged", "status": "completed", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:20:55.954127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a76aa76b-9303-480c-bc0a-317a36510e8f req-82478b5e-29c4-4660-9821-0eeb1518c5d8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:55.955032 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a76aa76b-9303-480c-bc0a-317a36510e8f req-82478b5e-29c4-4660-9821-0eeb1518c5d8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:55.955754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-a76aa76b-9303-480c-bc0a-317a36510e8f req-82478b5e-29c4-4660-9821-0eeb1518c5d8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:55.968676 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-a76aa76b-9303-480c-bc0a-317a36510e8f req-82478b5e-29c4-4660-9821-0eeb1518c5d8 service nova] Creating event network-vif-plugged:17f45898-1e23-42bb-8d3a-2371396691b5 for instance cb71bf3a-f216-436c-b58a-472b7c531e60 on n-h2-zed-1 Oct 28 11:20:55.974574 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-a76aa76b-9303-480c-bc0a-317a36510e8f req-82478b5e-29c4-4660-9821-0eeb1518c5d8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036546 Oct 28 11:20:55.975419 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4051/8111] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:20:56.888804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:56.890063 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:56.900989 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:56.901498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:56.901943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:56.902871 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:56.903517 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:56.904000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:57.059890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:57.068223 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0cb038d1-3d79-4745-af5d-c91fbf516766 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.183382 Oct 28 11:20:57.069043 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4061/8112] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:56 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:58.094835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:58.095689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:58.102128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:58.102714 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:58.103233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:58.104022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:58.104481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:58.104946 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:58.255845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:58.264836 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6dbe7f8a-2e78-436a-ac71-b20b36ead25c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.176591 Oct 28 11:20:58.265447 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4052/8113] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:58 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:20:59.289670 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:20:59.291075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:20:59.298308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:59.299064 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:59.299509 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:59.300213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:20:59.300842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:20:59.301536 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:20:59.454633 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:20:59.466462 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d6daf837-20db-44a9-9ca0-5b875c76f58e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.180950 Oct 28 11:20:59.480933 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4062/8114] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:20:59 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:00.492045 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:00.493516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:00.501999 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:00.502969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:00.503687 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:00.504472 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:00.505042 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:00.505555 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:00.662400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:00.671896 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c1130841-0be5-49dd-9c6d-2f3f4057a131 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.184534 Oct 28 11:21:00.672771 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4053/8115] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:00 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:01.696354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:01.697575 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:01.704889 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:01.705412 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:01.705863 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:01.706574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:01.707044 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:01.707471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:01.863531 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:01.873429 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-935ea4a6-770d-4119-b43d-09cdd407b67c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.181292 Oct 28 11:21:01.888537 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4063/8116] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:01 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:02.900348 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:02.901006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:02.909882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:02.909882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:02.909882 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:02.910298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:02.911163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:02.911914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:03.069963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:03.081800 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f4714ae1-5f33-4664-b986-8b442f14bd9d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.187824 Oct 28 11:21:03.085742 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4054/8117] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:02 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:04.107290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:04.108860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:04.116567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:04.117894 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:04.118567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:04.119348 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:04.119884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:04.120406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:04.264665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:04.273517 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a7cfa393-87c1-4185-aa29-bc17c02bc156 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1697 microversion: 2.1 time: 0.170075 Oct 28 11:21:04.274195 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4064/8118] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:04 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:05.296790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:05.297410 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:05.304509 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:05.305689 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:05.306138 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:05.306849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:05.307314 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:05.307751 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:05.440043 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:05.447975 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2fc44bc9-1975-45c6-98d1-c4c66b8b4b4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1679 microversion: 2.1 time: 0.155297 Oct 28 11:21:05.448550 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4055/8119] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:05 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:06.472054 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:06.472679 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:06.479631 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:06.480131 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:06.480576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:06.481303 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:06.481770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:06.482204 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:06.621139 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:06.628876 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3d30b565-0815-4b0a-86d9-5c268d60c7e5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1679 microversion: 2.1 time: 0.160827 Oct 28 11:21:06.629475 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4065/8120] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:06 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:07.653707 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:07.654467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:07.661879 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:07.662475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:07.663127 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:07.663892 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:07.664561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:07.665142 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:07.798227 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:07.806848 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f9c5cf61-f424-48c0-8f49-494b7bb416d8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1622 microversion: 2.1 time: 0.157068 Oct 28 11:21:07.807427 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4056/8121] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:07 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1622 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:07.829940 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:21:07.830546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:07.838020 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:07.838540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:07.838980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:07.839675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:07.840251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:07.840684 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:07.900990 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-23293de0-21e8-47a8-802c-2b09a4f09dba req-62290d17-579c-462d-8b64-03fde03abfc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "name": "network-vif-unplugged", "status": "completed", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:21:07.911187 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-23293de0-21e8-47a8-802c-2b09a4f09dba req-62290d17-579c-462d-8b64-03fde03abfc1 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:07.911569 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-23293de0-21e8-47a8-802c-2b09a4f09dba req-62290d17-579c-462d-8b64-03fde03abfc1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:07.912024 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-23293de0-21e8-47a8-802c-2b09a4f09dba req-62290d17-579c-462d-8b64-03fde03abfc1 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:07.925808 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.compute.server_external_events [req-23293de0-21e8-47a8-802c-2b09a4f09dba req-62290d17-579c-462d-8b64-03fde03abfc1 service nova] Unable to find a host for instance cb71bf3a-f216-436c-b58a-472b7c531e60. Dropping event network-vif-unplugged {{(pid=128748) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 11:21:07.926717 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-23293de0-21e8-47a8-802c-2b09a4f09dba req-62290d17-579c-462d-8b64-03fde03abfc1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030574 Oct 28 11:21:07.927502 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4057/8122] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 28 11:21:07.930061 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128747) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 11:21:07.994685 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [fcf95f5f-eea0-40ea-a055-0b816b418595] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:21:09.001231 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [fcf95f5f-eea0-40ea-a055-0b816b418595] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39198. Oct 28 11:21:09.004372 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1edff396-261d-4d34-8639-4428e234f7c8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60/action" status: 202 len: 0 microversion: 2.1 time: 1.178409 Oct 28 11:21:09.005087 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4066/8123] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:21:07 2022] POST /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60/action => generated 0 bytes in 1180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:21:09.013867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:09.014497 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:09.017335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=31 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:09.022849 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:09.023960 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:09.024421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:09.025167 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:09.025643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:09.026085 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:09.029038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:09.170546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:09.178957 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-eecba6ac-eeaa-4943-8a82-a5022fa4a97f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1630 microversion: 2.1 time: 0.169048 Oct 28 11:21:09.179700 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4058/8124] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:09 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1630 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:10.203398 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:10.204114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:10.206967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:10.213284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:10.213783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:10.214228 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:10.214934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:10.215393 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:10.215829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:10.234114 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:21:10.353471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:10.361141 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-77922d40-444b-471f-89f7-5761c6531e8d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.162462 Oct 28 11:21:10.361723 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4067/8125] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:10 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:11.384080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:11.384713 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:11.392258 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:11.392840 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:11.393393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:11.394104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:11.394571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:11.395011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:11.609917 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:11.619317 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9489b58f-b9fb-44c7-8088-4171ef93f621 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.239608 Oct 28 11:21:11.639033 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4059/8126] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:11 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:12.647842 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:12.649434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:12.657665 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:12.658251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:12.658962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:12.660141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:12.660791 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:12.661574 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:12.810032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:12.818221 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-426f971e-ac83-4495-8dbe-06cf9e79b66f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.174992 Oct 28 11:21:12.819029 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4068/8127] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:12 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:13.845512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:13.846248 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:13.853663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:13.854279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:13.854831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:13.855637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:13.856176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:13.856686 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:14.018370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:14.026894 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8d9d8a2f-2ac3-49de-b212-b6bb9bd3e97c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.186103 Oct 28 11:21:14.027734 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4060/8128] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:13 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:15.050741 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:15.051350 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:15.058341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:15.058833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:15.061053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:15.061839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:15.062330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:15.062783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:15.228606 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:15.236723 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4fbfffe5-8786-4089-9bed-40a08cc4b8af tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.189818 Oct 28 11:21:15.237341 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4069/8129] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:15 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:16.261185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:16.261887 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:16.268680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:16.269220 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:16.269674 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:16.270380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:16.270851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:16.271289 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:16.416234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:16.424231 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-14736da7-2cad-4827-a975-276b9f3ad8a8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.167592 Oct 28 11:21:16.425097 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4061/8130] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:16 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:17.448169 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:17.448776 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:17.455565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:17.456053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:17.456495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:17.457209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:17.457668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:17.458096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:17.593625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:17.601519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-042d3032-ddc3-4e2b-b38b-8af92cd48f85 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.157757 Oct 28 11:21:17.602102 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4070/8131] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:17 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:18.625465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:18.626176 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:18.633685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:18.634275 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:18.634730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:18.635441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:18.635905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:18.636343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:18.768327 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:18.776116 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-855a62fd-9a09-4b66-9914-ad97f2cd598c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.154582 Oct 28 11:21:18.776687 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4062/8132] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:18 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:19.800978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:19.802565 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:19.811317 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:19.812308 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:19.813078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:19.814166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:19.814923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:19.815587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:19.966405 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:19.977818 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f801e371-7fcb-4042-892c-1b86c734efbb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.181570 Oct 28 11:21:19.990564 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4071/8133] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:19 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:21.001580 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:21.002210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:21.009522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:21.010015 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:21.010460 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:21.011159 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:21.011650 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:21.012083 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:21.142008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:21.150639 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c80f7ecc-31f9-4e24-9397-31805f308af7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.153018 Oct 28 11:21:21.151217 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4063/8134] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:20 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:22.174018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:22.174649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:22.182039 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:22.182534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:22.182980 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:22.183948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:22.184419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:22.184855 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:22.316072 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:22.324510 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-2244ee5c-8c80-46b2-a68c-449342dbf01c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.154458 Oct 28 11:21:22.325122 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4072/8135] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:22 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:23.348051 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:23.348727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:23.356725 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:23.357284 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:23.357739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:23.358490 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:23.358963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:23.359438 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:23.495587 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:23.503557 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d2155155-e6cd-4cc5-b314-b40857fa3e1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.159513 Oct 28 11:21:23.504341 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4064/8136] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:23 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:21:24.527577 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:24.528179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:24.535594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:24.536095 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:24.536539 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:24.537278 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:24.537742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:24.538172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:24.673816 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:24.682102 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-313d1fa7-9881-4eee-aaae-c97374ffa602 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.158743 Oct 28 11:21:24.682672 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4073/8137] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:24 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:25.705867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:25.706491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:25.713759 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:25.714260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:25.714710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:25.715413 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:25.715880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:25.716320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:25.851136 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:25.859514 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d277a651-4a7b-4ff7-9a6d-01dcb9617881 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.157613 Oct 28 11:21:25.860112 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4065/8138] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:25 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:26.883656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:26.884288 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:26.891098 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:26.891591 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:26.892038 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:26.892736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:26.893233 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:26.893666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:27.022431 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:27.030866 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-df96f90f-c2bd-4162-a0aa-be3409fccdca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.151813 Oct 28 11:21:27.031545 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4074/8139] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:26 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:28.054210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:28.055343 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:28.062309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:28.062818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:28.063273 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:28.063984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:28.064459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:28.064914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:28.200429 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:28.208270 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1791d92b-454a-44a6-a485-4921c0113afc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.158101 Oct 28 11:21:28.208855 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4066/8140] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:28 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:29.232390 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:29.233024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:29.239719 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:29.240202 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:29.240638 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:29.241355 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:29.241809 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:29.242826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:29.374697 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:29.382427 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2d3ea3d-1fd7-494f-82a9-be966a51f3ca tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.153986 Oct 28 11:21:29.383001 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4075/8141] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:29 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:30.405888 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:30.406516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:30.413419 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:30.414576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:30.415030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:30.415737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:30.416245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:30.416688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:30.546973 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:30.554820 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-007975d5-e9ed-4432-9c39-19e90aae1f64 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.152899 Oct 28 11:21:30.555400 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4067/8142] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:30 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:31.578032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:31.578692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:31.585944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:31.586438 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:31.586884 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:31.587759 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:31.588046 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:31.588483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:31.723915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:31.732209 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-50522e18-b704-49cb-9cc3-4a4679ed1695 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.158061 Oct 28 11:21:31.732798 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4076/8143] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:31 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:32.186309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-27fd15ac-7a0d-4c7b-85ff-85e324cc093c req-fa2830d7-fb1c-4c94-b0a2-78008168ac7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "name": "network-vif-plugged", "status": "completed", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:21:32.197005 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-27fd15ac-7a0d-4c7b-85ff-85e324cc093c req-fa2830d7-fb1c-4c94-b0a2-78008168ac7f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:32.197498 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-27fd15ac-7a0d-4c7b-85ff-85e324cc093c req-fa2830d7-fb1c-4c94-b0a2-78008168ac7f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:32.197943 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-27fd15ac-7a0d-4c7b-85ff-85e324cc093c req-fa2830d7-fb1c-4c94-b0a2-78008168ac7f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:32.208969 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-27fd15ac-7a0d-4c7b-85ff-85e324cc093c req-fa2830d7-fb1c-4c94-b0a2-78008168ac7f service nova] Creating event network-vif-plugged:17f45898-1e23-42bb-8d3a-2371396691b5 for instance cb71bf3a-f216-436c-b58a-472b7c531e60 on n-h2-zed-1 Oct 28 11:21:32.214322 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-27fd15ac-7a0d-4c7b-85ff-85e324cc093c req-fa2830d7-fb1c-4c94-b0a2-78008168ac7f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031774 Oct 28 11:21:32.215077 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4068/8144] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:21:32.754882 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:32.755433 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:32.762625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:32.763120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:32.763567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:32.764270 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:32.764736 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:32.765205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:32.899119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:32.906895 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3f19235b-3211-4fc5-acb8-80ae68eeccf5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.156027 Oct 28 11:21:32.907483 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4077/8145] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:32 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:33.932213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:33.933047 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:33.939448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:33.939955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:33.940415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:33.941183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:33.941660 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:33.942102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:34.084418 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:34.093575 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-2b2f8920-88b8-4712-a344-5ddb2cb803a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1688 microversion: 2.1 time: 0.167092 Oct 28 11:21:34.094156 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4069/8146] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:33 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:21:35.118152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:21:35.118799 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:21:35.125836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:35.126328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:35.126796 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:35.127498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:21:35.127959 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:21:35.128391 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:21:35.258130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:21:35.266092 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-509bcd77-0cfd-44ff-96e8-8f6bd788bc23 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1675 microversion: 2.1 time: 0.151837 Oct 28 11:21:35.266670 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4078/8147] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:21:35 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:11.916860 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=23 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:11.917714 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=71 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:11.918536 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:23:11.918684 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:23:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 11:23:11.923384 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-c302d34c-13b8-49cd-a053-6011c84fb9f5 req-43b88c71-6b9b-4a3c-84e9-ad8d1fabe740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:23:11.928696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=23 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:11.929639 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=67 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:11.934629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:11.935139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:11.942705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:11.942901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:11.943295 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:11.944008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:11.944710 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:11.945112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:11.948397 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c302d34c-13b8-49cd-a053-6011c84fb9f5 req-43b88c71-6b9b-4a3c-84e9-ad8d1fabe740 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:11.948946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c302d34c-13b8-49cd-a053-6011c84fb9f5 req-43b88c71-6b9b-4a3c-84e9-ad8d1fabe740 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:11.950462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-c302d34c-13b8-49cd-a053-6011c84fb9f5 req-43b88c71-6b9b-4a3c-84e9-ad8d1fabe740 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:11.961750 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-c302d34c-13b8-49cd-a053-6011c84fb9f5 req-43b88c71-6b9b-4a3c-84e9-ad8d1fabe740 service nova] Creating event network-changed:17f45898-1e23-42bb-8d3a-2371396691b5 for instance cb71bf3a-f216-436c-b58a-472b7c531e60 on n-h2-zed-1 Oct 28 11:23:11.967818 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-c302d34c-13b8-49cd-a053-6011c84fb9f5 req-43b88c71-6b9b-4a3c-84e9-ad8d1fabe740 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052821 Oct 28 11:23:11.968430 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4079/8148] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:23:11.973505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:23:12.061692 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bdd10403-ee90-477b-8951-42e24677d399 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 204 len: 0 microversion: 2.1 time: 0.149606 Oct 28 11:23:12.062737 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4070/8149] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:23:11 2022] DELETE /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:23:12.072141 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:12.072851 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:12.079493 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:12.079990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:12.080432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:12.081289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:12.082284 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:12.082716 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:12.216040 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:12.223867 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f054300c-7092-449e-8331-af410cef9f44 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.156276 Oct 28 11:23:12.224449 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4080/8150] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:12 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:13.248561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:13.249278 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:13.256926 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:13.257453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:13.257912 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:13.258642 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:13.259122 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:13.259571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:13.408358 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:13.417455 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-a4b9d749-bee8-4066-9d9c-b278e7eaaf22 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1681 microversion: 2.1 time: 0.173245 Oct 28 11:23:13.418057 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4071/8151] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:13 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:14.420076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-317d8785-c65b-4af1-b1a5-da5220c76f4e req-f8eaab48-f1fb-4fd7-8099-1c3607c4921c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb71bf3a-f216-436c-b58a-472b7c531e60", "name": "network-vif-deleted", "tag": "17f45898-1e23-42bb-8d3a-2371396691b5"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:23:14.430088 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-317d8785-c65b-4af1-b1a5-da5220c76f4e req-f8eaab48-f1fb-4fd7-8099-1c3607c4921c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:14.430566 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-317d8785-c65b-4af1-b1a5-da5220c76f4e req-f8eaab48-f1fb-4fd7-8099-1c3607c4921c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:14.431036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-317d8785-c65b-4af1-b1a5-da5220c76f4e req-f8eaab48-f1fb-4fd7-8099-1c3607c4921c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:14.440320 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:14.441027 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:14.444432 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-317d8785-c65b-4af1-b1a5-da5220c76f4e req-f8eaab48-f1fb-4fd7-8099-1c3607c4921c service nova] Creating event network-vif-deleted:17f45898-1e23-42bb-8d3a-2371396691b5 for instance cb71bf3a-f216-436c-b58a-472b7c531e60 on n-h2-zed-1 Oct 28 11:23:14.448139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:14.448666 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:14.449151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:14.449652 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-317d8785-c65b-4af1-b1a5-da5220c76f4e req-f8eaab48-f1fb-4fd7-8099-1c3607c4921c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085606 Oct 28 11:23:14.449880 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:14.450369 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:14.450681 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4081/8152] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:23:14.453845 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:14.490307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:14.490829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:14.491268 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:14.491734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lazy-loading 'fault' on Instance uuid cb71bf3a-f216-436c-b58a-472b7c531e60 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:23:14.532078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:14.540503 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-48412edb-9b6b-439b-a1db-0e16567a41a9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 200 len: 1336 microversion: 2.1 time: 0.104001 Oct 28 11:23:14.541108 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4072/8153] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:14 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 1336 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:23:15.565967 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:15.566664 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: cb71bf3a-f216-436c-b58a-472b7c531e60] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:15.573698 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:15.574176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:15.574611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:15.575297 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:15.575751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:15.576175 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:15.593118 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] HTTP exception thrown: Instance cb71bf3a-f216-436c-b58a-472b7c531e60 could not be found. Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Request method failure captured: Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 HTTP/1.1 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7phqwSYTqaf4YY7a0JIgG_14t9vHaFfS71U7tqL8ZBn320NEvgti9wt8joTh_-vBzkvyHaaFCClTOZ6siMbgRDog752lQpW82EVecFEVQzHY5IMUMCwI0Xiuky0fdkAI00OT7f78btwF7wvfS7kKWiz3ygPmrS5E-4iR2Ye3rrVddc Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: ac5d7744d6c24245af328843551dac5d Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestShelveInstance-387586826 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5d7744d6c24245af328843551dac5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5d7744d6c24245af328843551dac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ac5d7744d6c24245af328843551dac5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ac5d7744d6c24245af328843551dac5d"}]}] Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestShelveInstance-387586826 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: ac5d7744d6c24245af328843551dac5d Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestShelveInstance-387586826 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestShelveInstance-387586826-project Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: 1696563726cc4d289edacece3fd2aef9 Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestShelveInstance-387586826-project Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance cb71bf3a-f216-436c-b58a-472b7c531e60 could not be found. Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': 'cb71bf3a-f216-436c-b58a-472b7c531e60'} Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb71bf3a-f216-436c-b58a-472b7c531e60 could not be found. Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb71bf3a-f216-436c-b58a-472b7c531e60 could not be found. Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:23:15.594769 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb71bf3a-f216-436c-b58a-472b7c531e60 could not be found. Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Returning 404 to user: Instance cb71bf3a-f216-436c-b58a-472b7c531e60 could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9eacb0a0-6f65-4df5-b58b-f99856828410 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60" status: 404 len: 111 microversion: 2.1 time: 0.034476 Oct 28 11:23:15.600622 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4082/8154] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:15 2022] GET /compute/v2.1/servers/cb71bf3a-f216-436c-b58a-472b7c531e60 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:23:15.760842 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3c7461f4-2d4b-4634-b7bf-84891075db1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '.version_select at 0x7fca307d3e50>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:15.784258 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3c7461f4-2d4b-4634-b7bf-84891075db1f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-477217945" status: 202 len: 0 microversion: 2.1 time: 0.027364 Oct 28 11:23:15.784859 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4073/8155] 10.222.0.16 () {58 vars in 1251 bytes} [Fri Oct 28 11:23:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-477217945 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:23:15.809154 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-24b1cf0c-f059-4870-a17f-52412cfa3f8f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'create', calling method: .version_select at 0x7fca33059310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1315863306", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJrl/MXnSb8S6g+xgx8Pbicr32jNkiiu31cDOrRjJqq2YSANZk3mqeDSwzKihj7gNPE5KXl/xLcGm65vK6dl1NZjVZjI9sC4DElWOlEeKEodPoqs7kXWrQA4L+dDJCNzA=="}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:23:15.825138 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-24b1cf0c-f059-4870-a17f-52412cfa3f8f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for project ac5d7744d6c24245af328843551dac5d. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:23:15.830208 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-24b1cf0c-f059-4870-a17f-52412cfa3f8f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for user 1696563726cc4d289edacece3fd2aef9 and project ac5d7744d6c24245af328843551dac5d. Resources: {'key_pairs'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:23:15.858642 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-24b1cf0c-f059-4870-a17f-52412cfa3f8f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.054307 Oct 28 11:23:15.859275 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4083/8156] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:23:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:23:32.231194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:32.231966 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:32.235922 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1005543016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1315863306", "security_groups": [{"name": "tempest-secgroup-smoke-302981664"}], "networks": [{"uuid": "e2d55547-489f-4a71-96df-0e6f64690024"}], "block_device_mapping_v2": [{"uuid": "39b82094-9356-46a5-a604-421e92c02e4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:23:32.349398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] validate_networks() for [('e2d55547-489f-4a71-96df-0e6f64690024', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:23:32.760696 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:23:32.761175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:23:32.761673 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:23:32.762103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:23:32.762537 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:23:32.771576 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:32.772070 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:32.772525 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:32.773336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:32.773819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:32.774264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:32.792106 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for project ac5d7744d6c24245af328843551dac5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:23:32.797351 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Getting quotas for user 1696563726cc4d289edacece3fd2aef9 and project ac5d7744d6c24245af328843551dac5d. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:23:32.855632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:23:32.857787 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39b82094-9356-46a5-a604-421e92c02e4b',volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:23:32.993506 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b990987e-27ca-4e18-8a02-d9779e6f4a66 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.763954 Oct 28 11:23:32.994067 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4074/8157] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:23:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 28 11:23:33.005767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-613ca5ca-4f14-4462-9eb7-9482396902fa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:33.006485 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-613ca5ca-4f14-4462-9eb7-9482396902fa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:33.010326 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=12 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:33.012181 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=4 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:33.013253 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:33.072019 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-613ca5ca-4f14-4462-9eb7-9482396902fa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:33.078988 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-613ca5ca-4f14-4462-9eb7-9482396902fa tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1089 microversion: 2.1 time: 0.077415 Oct 28 11:23:33.079556 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4084/8158] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:33 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1089 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:34.101370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cc2892e1-042f-4629-88bd-7ac5dc3bdf0f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:34.102001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cc2892e1-042f-4629-88bd-7ac5dc3bdf0f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:34.155578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cc2892e1-042f-4629-88bd-7ac5dc3bdf0f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:34.162700 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cc2892e1-042f-4629-88bd-7ac5dc3bdf0f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1089 microversion: 2.1 time: 0.065370 Oct 28 11:23:34.163272 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4075/8159] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:34 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:35.185852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:35.187021 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:35.195055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:35.195653 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:35.196097 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:35.197174 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:35.197637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:35.198069 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:35.265927 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:35.274572 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-46a20873-2348-4300-97c7-9d6a1e6becfb tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1205 microversion: 2.1 time: 0.092873 Oct 28 11:23:35.275515 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4085/8160] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:35 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1205 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:36.298416 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:36.299155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:36.307398 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:36.308556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:36.309624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:36.310548 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:36.311262 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:36.312375 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:36.548147 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:36.557523 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e80b9aca-08c2-46ee-88f4-7c642d10c264 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1272 microversion: 2.1 time: 0.263166 Oct 28 11:23:36.558119 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4076/8161] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:36 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:36.700261 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-e1cf85a3-a9de-4236-8269-917e1a415473 req-9b3171ed-07ab-4a3f-be73-eb32d781f1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:23:36.712854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e1cf85a3-a9de-4236-8269-917e1a415473 req-9b3171ed-07ab-4a3f-be73-eb32d781f1f3 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:36.713671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e1cf85a3-a9de-4236-8269-917e1a415473 req-9b3171ed-07ab-4a3f-be73-eb32d781f1f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:36.714295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-e1cf85a3-a9de-4236-8269-917e1a415473 req-9b3171ed-07ab-4a3f-be73-eb32d781f1f3 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:36.727745 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-e1cf85a3-a9de-4236-8269-917e1a415473 req-9b3171ed-07ab-4a3f-be73-eb32d781f1f3 service nova] Creating event network-changed:cab328cf-68b6-41f7-9547-dfe4766c375f for instance 16192b1b-110b-4ad0-a633-d37a89865587 on n-h1-zed-1 Oct 28 11:23:36.733233 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-e1cf85a3-a9de-4236-8269-917e1a415473 req-9b3171ed-07ab-4a3f-be73-eb32d781f1f3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036685 Oct 28 11:23:36.733875 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4086/8162] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:23:37.579819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:37.582727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:37.591185 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:37.591699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:37.592308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:37.593241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:37.593890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:37.594480 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:37.817684 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:37.826020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-31182a3f-8121-4b00-b7af-75fea84ca297 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1272 microversion: 2.1 time: 0.250128 Oct 28 11:23:37.827303 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4077/8163] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:37 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1272 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:38.852600 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:38.853330 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:38.859614 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:38.860129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:38.860572 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:38.861312 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:38.861770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:38.862205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:38.998797 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:39.006735 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ebea2a2b-18ea-40d8-9d2a-24154a0071d4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1272 microversion: 2.1 time: 0.159372 Oct 28 11:23:39.007323 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4087/8164] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:38 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:40.029267 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:40.030139 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:40.036964 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:40.037466 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:40.037914 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:40.038632 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:40.039099 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:40.039541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:40.179391 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:40.187145 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1d402aea-f845-4ed0-bebe-68bde541f686 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1272 microversion: 2.1 time: 0.162127 Oct 28 11:23:40.187726 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4078/8165] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:40 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:41.210756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:41.211623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:41.218468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:41.218949 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:41.219385 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:41.220066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:41.220520 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:41.220975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:41.350238 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:41.357885 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ce8fe2f9-9b8b-4318-aa98-6040fa629aba tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.151015 Oct 28 11:23:41.358458 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4088/8166] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:41 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:42.382637 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:42.383264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:42.389456 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:42.389949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:42.390393 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:42.391088 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:42.391554 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:42.391985 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:42.529317 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:42.537614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cb96d50b-79fe-4a3b-af51-e67a05068dce tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.159182 Oct 28 11:23:42.538194 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4079/8167] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:42 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:43.560155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:43.560777 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:43.563130 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:43.569541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:43.570041 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:43.570486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:43.571214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:43.571680 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:43.572112 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:43.706200 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:43.714800 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-41ecb9f3-7d84-4876-82f1-4f2ecd6cf28f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.158561 Oct 28 11:23:43.715392 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4089/8168] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:43 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:44.738039 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:44.738675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:44.740561 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:44.742395 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=8 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:23:44.748821 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:44.749350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:44.749816 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:44.750527 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:44.751030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:44.751741 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:44.884619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:44.892962 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-bfb14acc-0abb-4732-91ad-68f493cd5d15 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.158551 Oct 28 11:23:44.893647 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4080/8169] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:44 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:45.916272 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:45.916941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:45.923890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:45.924468 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:45.924833 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:45.925560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:45.926024 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:45.926459 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:46.058669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:46.067384 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-a09dad4e-23ca-464b-ab04-82569376d41a tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.155058 Oct 28 11:23:46.067964 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4090/8170] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:45 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:47.091685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:47.092307 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:47.099241 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:47.099739 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:47.100184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:47.101600 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:47.102116 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:47.102590 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:47.237080 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:47.245044 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1f7d12a6-ff3a-4001-ab74-b30ad1a8e9f8 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.157243 Oct 28 11:23:47.245623 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4081/8171] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:47 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:48.269870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:48.270467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:48.277829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:48.278315 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:48.278764 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:48.279487 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:48.279944 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:48.280374 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:48.417120 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:48.424895 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ea031e26-6c0b-4457-87f9-ff5484821800 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.158965 Oct 28 11:23:48.425509 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4091/8172] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:48 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:49.447452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:49.448103 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:49.454945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:49.455441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:49.455894 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:49.456594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:49.457090 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:49.457531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:49.587663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:49.595614 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-655ae187-c3a9-4a85-892e-770d3ba15260 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.152083 Oct 28 11:23:49.596195 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4082/8173] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:49 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:50.590484 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-3bf1b190-0f68-4f55-90be-c5419c41a7de req-8fc1ce7a-d97e-45c4-a370-1827c53270b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "name": "network-vif-plugged", "status": "completed", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:23:50.600456 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3bf1b190-0f68-4f55-90be-c5419c41a7de req-8fc1ce7a-d97e-45c4-a370-1827c53270b4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:50.600974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3bf1b190-0f68-4f55-90be-c5419c41a7de req-8fc1ce7a-d97e-45c4-a370-1827c53270b4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:50.601410 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-3bf1b190-0f68-4f55-90be-c5419c41a7de req-8fc1ce7a-d97e-45c4-a370-1827c53270b4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:50.613165 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-3bf1b190-0f68-4f55-90be-c5419c41a7de req-8fc1ce7a-d97e-45c4-a370-1827c53270b4 service nova] Creating event network-vif-plugged:cab328cf-68b6-41f7-9547-dfe4766c375f for instance 16192b1b-110b-4ad0-a633-d37a89865587 on n-h1-zed-1 Oct 28 11:23:50.618703 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-3bf1b190-0f68-4f55-90be-c5419c41a7de req-8fc1ce7a-d97e-45c4-a370-1827c53270b4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082364 Oct 28 11:23:50.619296 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4092/8174] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:23:50.619485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:50.620108 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:50.627300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:50.627800 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:50.628256 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:50.628991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:50.629463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:50.629911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:50.808453 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:50.816314 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-302220ec-600a-428e-8a44-e73053f52afe tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1260 microversion: 2.1 time: 0.201226 Oct 28 11:23:50.816920 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4083/8175] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:50 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1260 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:23:51.842513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:51.843165 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:51.849347 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:51.849838 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:51.850280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:51.850974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:51.851434 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:51.851865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:51.988254 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:51.996607 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f76df075-3401-4368-897b-b2f8a171f141 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1444 microversion: 2.1 time: 0.160471 Oct 28 11:23:51.997230 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4093/8176] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:51 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:52.020308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:23:52.020955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:23:52.027858 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:52.028347 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:52.028789 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:52.029511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:52.030205 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:52.030651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:52.161086 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:23:52.169029 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-6b87974c-bf11-4cba-9637-74e4c19e423f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1444 microversion: 2.1 time: 0.152910 Oct 28 11:23:52.169613 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4084/8177] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:23:52 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:23:53.774394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-81c17604-2080-4367-a7e4-a8d0b3015ad3 req-d99bf4fb-00dc-4b09-99f0-9ecea35668fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:23:53.784862 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-81c17604-2080-4367-a7e4-a8d0b3015ad3 req-d99bf4fb-00dc-4b09-99f0-9ecea35668fd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:23:53.785392 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-81c17604-2080-4367-a7e4-a8d0b3015ad3 req-d99bf4fb-00dc-4b09-99f0-9ecea35668fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:23:53.785831 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-81c17604-2080-4367-a7e4-a8d0b3015ad3 req-d99bf4fb-00dc-4b09-99f0-9ecea35668fd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:23:53.797576 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-81c17604-2080-4367-a7e4-a8d0b3015ad3 req-d99bf4fb-00dc-4b09-99f0-9ecea35668fd service nova] Creating event network-changed:cab328cf-68b6-41f7-9547-dfe4766c375f for instance 16192b1b-110b-4ad0-a633-d37a89865587 on n-h1-zed-1 Oct 28 11:23:53.802645 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-81c17604-2080-4367-a7e4-a8d0b3015ad3 req-d99bf4fb-00dc-4b09-99f0-9ecea35668fd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Oct 28 11:23:53.803253 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4094/8178] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:25:46.339902 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:25:46.341132 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:25:46.341732 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:25:46.342617 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=56 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:25:46.343539 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:25:46.343708 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587/action (ip 10.222.0.16) !!! Oct 28 11:25:46.344945 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:25:46.345105 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587/action (ip 10.222.0.16) !!! Oct 28 11:25:46.346255 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:25:46.346384 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587/action (ip 10.222.0.16) !!! Oct 28 11:25:46.351949 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:25:46.352504 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:46.364046 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:46.364545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:46.365034 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:46.365745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:46.366216 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:46.366655 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:46.393671 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.objects.instance [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lazy-loading 'flavor' on Instance uuid 16192b1b-110b-4ad0-a633-d37a89865587 {{(pid=128748) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:25:46.464477 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c56f89f5-569c-423e-848d-8e42021dbdcc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587/action" status: 202 len: 0 microversion: 2.1 time: 0.126438 Oct 28 11:25:46.465103 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4085/8179] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:25:46 2022] POST /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:25:46.472307 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:25:46.473218 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:25:46.473925 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=24 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:25:46.474854 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=48 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:25:46.475683 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:25:46.475823 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 (ip 10.222.0.16) !!! Oct 28 11:25:46.477830 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:25:46.478010 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:25:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 (ip 10.222.0.16) !!! Oct 28 11:25:46.487879 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:46.488590 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:46.503530 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:46.504018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:46.504461 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:46.505184 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:46.505643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:46.506071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:46.691093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:46.698831 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6aea37a3-41e1-4a9c-af10-246cee54d724 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.228694 Oct 28 11:25:46.699404 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4095/8180] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:46 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:47.726135 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:47.726851 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:47.735878 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:47.736376 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:47.736823 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:47.737553 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:47.738022 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:47.738459 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:47.743242 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39664. Oct 28 11:25:47.743952 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39666. Oct 28 11:25:47.917835 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:47.925730 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-05ec1d8c-b7ed-4b1f-b20c-83e51515f70e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.205782 Oct 28 11:25:47.926319 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4086/8181] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:47 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:48.949218 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:48.949873 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:48.959176 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:48.959669 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:48.960115 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:48.960813 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:48.961300 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:48.961734 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:48.969417 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39672. Oct 28 11:25:48.970158 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39674. Oct 28 11:25:49.097369 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:49.105854 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3af82a2d-d288-4791-a4ce-c7b928fb262e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.161186 Oct 28 11:25:49.106439 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4096/8182] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:48 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:50.129743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:50.130372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:50.137755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:50.138252 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:50.138699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:50.139402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:50.139867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:50.140308 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:50.273608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:50.281993 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f5542727-873d-433a-9722-d6b627d3b5d3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.156201 Oct 28 11:25:50.282559 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4087/8183] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:50 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:51.305143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:51.305754 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:51.313018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:51.313498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:51.313934 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:51.314617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:51.315076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:51.315498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:51.444121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:51.451875 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-61e030c2-0582-4607-9027-b1874580f857 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.150718 Oct 28 11:25:51.452451 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4097/8184] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:51 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:52.475651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:52.476279 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:52.483722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:52.484209 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:52.484657 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:52.485390 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:52.485857 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:52.486296 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:52.620421 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:52.628257 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5cbb10fe-62f3-489b-bd9e-18e899ed53a3 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.156887 Oct 28 11:25:52.628832 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4088/8185] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:52 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:53.650658 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:53.651339 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:53.658148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:53.658637 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:53.659083 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:53.659780 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:53.660240 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:53.660675 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:53.801568 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:53.810113 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d876ce49-949d-40d4-8efe-73aef2e6cb51 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.163380 Oct 28 11:25:53.810697 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4098/8186] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:53 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:54.833538 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:54.834173 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:54.841994 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:54.842430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:54.842885 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:54.843594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:54.844071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:54.844515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:54.975839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:54.984298 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1e9b75b8-396c-4ee8-b7c7-35ecef3debed tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.154697 Oct 28 11:25:54.984964 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4089/8187] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:54 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:56.007702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:56.009586 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:56.015874 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:56.016364 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:56.016804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:56.017528 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:56.017984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:56.018423 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:56.149649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:56.158068 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4584fcf0-7adf-40f2-94da-2cc7de1e7394 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.154310 Oct 28 11:25:56.158651 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4099/8188] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:56 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:57.181796 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:57.182430 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:57.189680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:57.190192 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:57.190649 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:57.191364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:57.191836 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:57.192281 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:57.384956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:57.393093 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-c346af9b-e2ab-47e7-ac27-dd0508d4e57c tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.215192 Oct 28 11:25:57.393685 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4090/8189] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:57 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:58.416576 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:58.417214 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:58.424153 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:58.424642 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:58.425107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:58.425802 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:58.426260 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:58.426688 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:58.558933 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:58.569075 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1226ffc3-9256-46c3-bccc-f72844a41684 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.156377 Oct 28 11:25:58.569660 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4100/8190] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:58 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:25:59.592715 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:25:59.593781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:25:59.600839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:59.601377 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:59.601834 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:59.602556 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:25:59.603029 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:25:59.603475 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:25:59.748747 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:25:59.756755 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-69d5ce85-18dc-45b4-b073-6ab2b8f96395 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.167861 Oct 28 11:25:59.757435 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4091/8191] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:25:59 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:00.780159 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:00.781443 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:00.788486 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:00.789007 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:00.789475 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:00.790171 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:00.790626 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:00.791052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:00.931939 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:00.941045 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-bd838605-e17e-41e5-ade5-fbf4a87fd227 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.165347 Oct 28 11:26:00.941628 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4101/8192] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:00 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:01.965664 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:01.966322 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:01.973163 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:01.973668 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:01.974121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:01.974831 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:01.975309 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:01.975754 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:02.108520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:02.116366 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1aa3f740-cc9c-47ed-9c59-35285b795ba2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1509 microversion: 2.1 time: 0.155539 Oct 28 11:26:02.116961 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4092/8193] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:01 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:02.139241 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:26:02.139852 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:02.147157 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:02.147651 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:02.148129 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:02.148840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:02.149337 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:02.149773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:02.180078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128747) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 28 11:26:02.246565 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-45eb639d-3b30-4383-b817-2cb1b7a4ec39 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "POST /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587/action" status: 202 len: 0 microversion: 2.1 time: 0.111762 Oct 28 11:26:02.247112 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4102/8194] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:26:02 2022] POST /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 28 11:26:02.255372 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:02.256104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:02.262503 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:02.263001 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:02.263448 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:02.264213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:02.264681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:02.265155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:02.417625 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:02.425367 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-248a54d2-2e0c-4b42-bc1a-c2740a02728b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1517 microversion: 2.1 time: 0.173955 Oct 28 11:26:02.434602 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4093/8195] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:02 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:02.898325 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1cb90eb1-1741-412e-b4b7-00dde7257259 req-7c5a0e7f-c61a-40f7-9fce-9279b857ac0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "name": "network-vif-unplugged", "status": "completed", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:26:02.907986 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1cb90eb1-1741-412e-b4b7-00dde7257259 req-7c5a0e7f-c61a-40f7-9fce-9279b857ac0f service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:02.908401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1cb90eb1-1741-412e-b4b7-00dde7257259 req-7c5a0e7f-c61a-40f7-9fce-9279b857ac0f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:02.908881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1cb90eb1-1741-412e-b4b7-00dde7257259 req-7c5a0e7f-c61a-40f7-9fce-9279b857ac0f service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:02.921818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.compute.server_external_events [req-1cb90eb1-1741-412e-b4b7-00dde7257259 req-7c5a0e7f-c61a-40f7-9fce-9279b857ac0f service nova] Unable to find a host for instance 16192b1b-110b-4ad0-a633-d37a89865587. Dropping event network-vif-unplugged {{(pid=128747) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 28 11:26:02.922725 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1cb90eb1-1741-412e-b4b7-00dde7257259 req-7c5a0e7f-c61a-40f7-9fce-9279b857ac0f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028385 Oct 28 11:26:02.923473 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4103/8196] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 28 11:26:03.450033 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:03.450564 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:03.457415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:03.457911 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:03.458364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:03.459067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:03.459541 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:03.459980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:03.599546 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:03.608020 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b5d52587-4525-4ac4-804e-3f76a9560061 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1519 microversion: 2.1 time: 0.162497 Oct 28 11:26:03.608596 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4094/8197] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:03 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:04.631968 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:04.632523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:04.639449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:04.639943 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:04.640382 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:04.641108 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:04.641569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:04.642000 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:04.787666 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:04.796927 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63e87713-2d6c-45c3-8bac-a38f41ef2587 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1519 microversion: 2.1 time: 0.168875 Oct 28 11:26:04.797534 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4104/8198] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:04 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:05.820669 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:05.821422 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:05.829037 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:05.829549 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:05.830008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:05.830731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:05.831210 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:05.831659 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:05.985485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:05.993613 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e963c2cb-638e-4867-a2be-5ef3eb203083 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1519 microversion: 2.1 time: 0.176857 Oct 28 11:26:05.994190 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4095/8199] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:05 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:07.017328 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:07.017900 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:07.024682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:07.025201 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:07.025657 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:07.026834 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:07.027289 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:07.027712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:07.159127 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:07.167621 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e1968cc-f8f5-4730-90d0-20d306b738c7 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1519 microversion: 2.1 time: 0.153774 Oct 28 11:26:07.181068 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4105/8200] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:07 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:08.190847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:08.191598 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:08.199006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:08.199510 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:08.199954 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:08.200665 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:08.201153 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:08.201591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:08.413224 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:08.422585 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-59c5cfae-e7b5-465c-8e82-617a934b39d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.235735 Oct 28 11:26:08.423179 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4096/8201] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:08 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:09.128058 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0c7deee7-1063-4d4b-992c-59327efe6a22 req-812d9fba-b366-413f-a801-e741368d35b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:26:09.139788 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0c7deee7-1063-4d4b-992c-59327efe6a22 req-812d9fba-b366-413f-a801-e741368d35b0 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:09.140286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0c7deee7-1063-4d4b-992c-59327efe6a22 req-812d9fba-b366-413f-a801-e741368d35b0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:09.140727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0c7deee7-1063-4d4b-992c-59327efe6a22 req-812d9fba-b366-413f-a801-e741368d35b0 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:09.154282 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0c7deee7-1063-4d4b-992c-59327efe6a22 req-812d9fba-b366-413f-a801-e741368d35b0 service nova] Creating event network-changed:cab328cf-68b6-41f7-9547-dfe4766c375f for instance 16192b1b-110b-4ad0-a633-d37a89865587 on n-h2-zed-1 Oct 28 11:26:09.160852 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0c7deee7-1063-4d4b-992c-59327efe6a22 req-812d9fba-b366-413f-a801-e741368d35b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036073 Oct 28 11:26:09.161522 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4106/8202] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:26:09.445980 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:09.446610 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:09.454144 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:09.454591 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:09.455053 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:09.455763 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:09.456235 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:09.456681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:09.691724 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:09.699509 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-996535a3-9e19-4d96-9398-ce3a22995f1e tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.257438 Oct 28 11:26:09.700209 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4097/8203] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:09 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:10.724891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:10.725649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:10.732009 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:10.732503 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:10.732974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:10.733672 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:10.734135 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:10.734570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:10.867783 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:10.876601 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-85b90bb0-8720-455d-8bb7-b7fc874c276d tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.156740 Oct 28 11:26:10.877292 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4107/8204] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:10 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:11.902095 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:11.902729 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:11.909557 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:11.910067 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:11.910524 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:11.911233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:11.911706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:11.912152 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:12.042019 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:12.049938 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8208d340-cd98-48b6-b22e-61724c7356f2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.152378 Oct 28 11:26:12.050516 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4098/8205] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:11 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:13.072932 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:13.073553 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:13.080496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:13.081017 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:13.081467 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:13.082161 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:13.082618 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:13.083049 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:13.219034 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:13.226833 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f3157c1b-8332-4bcd-b005-a9fd45922dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.157851 Oct 28 11:26:13.227409 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4108/8206] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:13 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:26:14.250332 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:14.250984 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:14.257983 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:14.258481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:14.258933 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:14.259675 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:14.260867 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:14.261182 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:14.280140 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:26:14.394104 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:14.401999 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-42de742a-c8be-414b-810e-8bc0a62c96dc tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.155699 Oct 28 11:26:14.402581 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4099/8207] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:14 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:15.425942 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:15.426498 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:15.433401 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:15.433892 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:15.434332 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:15.435023 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:15.435481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:15.435907 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:15.565501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:15.573717 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-48bd025a-39b9-4115-994f-14381ed48775 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.151281 Oct 28 11:26:15.574296 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4109/8208] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:15 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:16.597336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:16.597963 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:16.600658 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=31 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:26:16.607002 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:16.607500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:16.607952 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:16.608663 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:16.609169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:16.609619 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:16.744467 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:16.752368 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-4fce6b4a-1abf-4a14-b029-b23b7b56299f tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.159006 Oct 28 11:26:16.752944 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4100/8209] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:16 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:17.775601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:17.776223 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:17.779850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:26:17.785118 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:17.785611 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:17.786053 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:17.786785 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:17.787280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:17.787715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:17.792571 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:26:17.925656 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:17.933533 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3cf74d86-7f74-46c6-8aff-4083fdc58ed0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.161799 Oct 28 11:26:17.934237 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4110/8210] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:17 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:18.957233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:18.957890 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:18.964545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:18.965071 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:18.965519 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:18.966213 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:18.966676 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:18.967110 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:19.095325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:19.105492 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e22fe01e-5095-405a-9c65-4e47f6b86883 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.151898 Oct 28 11:26:19.106316 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4101/8211] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:18 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:20.130001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:20.130634 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:20.137376 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:20.137877 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:20.138365 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:20.139075 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:20.139540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:20.139973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:20.272750 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:20.281282 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-63b6b910-bc71-4fa4-9f95-6497b1c8b638 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.155204 Oct 28 11:26:20.281881 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4111/8212] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:20 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:21.304723 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:21.305378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:21.312385 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:21.312893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:21.313378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:21.314102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:21.314575 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:21.315020 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:21.379389 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-bfe26799-a638-43e9-a08d-1abd9d5baf32 req-9e05cebd-71e2-4695-8e1e-0075d6743198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "name": "network-vif-plugged", "status": "completed", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:26:21.390562 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bfe26799-a638-43e9-a08d-1abd9d5baf32 req-9e05cebd-71e2-4695-8e1e-0075d6743198 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:21.391269 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bfe26799-a638-43e9-a08d-1abd9d5baf32 req-9e05cebd-71e2-4695-8e1e-0075d6743198 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:21.391773 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-bfe26799-a638-43e9-a08d-1abd9d5baf32 req-9e05cebd-71e2-4695-8e1e-0075d6743198 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:21.404597 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-bfe26799-a638-43e9-a08d-1abd9d5baf32 req-9e05cebd-71e2-4695-8e1e-0075d6743198 service nova] Creating event network-vif-plugged:cab328cf-68b6-41f7-9547-dfe4766c375f for instance 16192b1b-110b-4ad0-a633-d37a89865587 on n-h2-zed-1 Oct 28 11:26:21.409907 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-bfe26799-a638-43e9-a08d-1abd9d5baf32 req-9e05cebd-71e2-4695-8e1e-0075d6743198 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034744 Oct 28 11:26:21.410619 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4112/8213] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:26:21.455886 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:21.464241 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-3a9b2b88-8b07-47b8-9a73-b67214ea4de4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.163484 Oct 28 11:26:21.465449 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4102/8214] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:21 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:22.489810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:22.490508 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:22.497354 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:22.497836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:22.498274 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:22.498973 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:22.499430 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:22.499859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:22.635550 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:22.644322 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-9d24599d-bfb4-4aa8-af63-d6e4f1c8ee59 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1575 microversion: 2.1 time: 0.159569 Oct 28 11:26:22.644925 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4113/8215] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:22 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:26:23.671093 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:26:23.671734 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:26:23.678688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:23.679191 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:23.679651 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:23.680365 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:26:23.680839 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:26:23.681313 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:26:23.817450 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:26:23.826002 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b7243aa-c972-443d-91e4-dd0870c663d2 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1562 microversion: 2.1 time: 0.159544 Oct 28 11:26:23.826575 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4103/8216] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:26:23 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1562 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:37.787203 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=7 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:37.788155 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=19 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:37.789956 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=7 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:37.790941 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=26 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:27:37.792950 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:37.793523 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:37.797443 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-0eb3c65d-f639-4f61-a0f9-bf417ed3dee9 req-1981e1f7-d400-45db-a302-32c26cd4f190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:27:37.800596 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:37.803216 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:37.803712 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:37.804448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:37.805094 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:37.805534 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:37.807802 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0eb3c65d-f639-4f61-a0f9-bf417ed3dee9 req-1981e1f7-d400-45db-a302-32c26cd4f190 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:37.808299 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0eb3c65d-f639-4f61-a0f9-bf417ed3dee9 req-1981e1f7-d400-45db-a302-32c26cd4f190 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:37.808951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-0eb3c65d-f639-4f61-a0f9-bf417ed3dee9 req-1981e1f7-d400-45db-a302-32c26cd4f190 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:37.823725 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-0eb3c65d-f639-4f61-a0f9-bf417ed3dee9 req-1981e1f7-d400-45db-a302-32c26cd4f190 service nova] Creating event network-changed:cab328cf-68b6-41f7-9547-dfe4766c375f for instance 16192b1b-110b-4ad0-a633-d37a89865587 on n-h2-zed-1 Oct 28 11:27:37.829296 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-0eb3c65d-f639-4f61-a0f9-bf417ed3dee9 req-1981e1f7-d400-45db-a302-32c26cd4f190 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041624 Oct 28 11:27:37.830871 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4104/8217] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:27:37.833560 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:27:37.919401 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-781427a4-92b6-40dd-929b-b644fa79fd31 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "DELETE /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 204 len: 0 microversion: 2.1 time: 0.133944 Oct 28 11:27:37.924226 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4114/8218] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:27:37 2022] DELETE /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:27:37.931432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:37.932551 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:37.939706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:37.940318 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:37.940846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:37.941685 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:37.942260 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:37.942774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:38.083155 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:27:38.091425 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-441cf536-8684-47e1-91b7-46209c7ccec5 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.164807 Oct 28 11:27:38.092208 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4105/8219] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:37 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:39.117066 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:39.118004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:39.125286 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:39.125817 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:39.126262 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:39.126974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:39.127448 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:39.127883 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:39.264282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:27:39.272873 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dc0534f6-9a37-4e2e-a0f1-c6e06cc4fc57 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1568 microversion: 2.1 time: 0.161688 Oct 28 11:27:39.273487 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4115/8220] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:39 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:40.229934 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-65d55d2c-c08a-4193-b26e-76e37d191b22 req-3468b917-d580-44d6-84fa-e36feff63fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16192b1b-110b-4ad0-a633-d37a89865587", "name": "network-vif-deleted", "tag": "cab328cf-68b6-41f7-9547-dfe4766c375f"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:27:40.239482 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-65d55d2c-c08a-4193-b26e-76e37d191b22 req-3468b917-d580-44d6-84fa-e36feff63fef service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:40.239969 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-65d55d2c-c08a-4193-b26e-76e37d191b22 req-3468b917-d580-44d6-84fa-e36feff63fef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:40.241300 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-65d55d2c-c08a-4193-b26e-76e37d191b22 req-3468b917-d580-44d6-84fa-e36feff63fef service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:40.253028 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-65d55d2c-c08a-4193-b26e-76e37d191b22 req-3468b917-d580-44d6-84fa-e36feff63fef service nova] Creating event network-vif-deleted:cab328cf-68b6-41f7-9547-dfe4766c375f for instance 16192b1b-110b-4ad0-a633-d37a89865587 on n-h2-zed-1 Oct 28 11:27:40.258162 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-65d55d2c-c08a-4193-b26e-76e37d191b22 req-3468b917-d580-44d6-84fa-e36feff63fef service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090739 Oct 28 11:27:40.258783 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4106/8221] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:27:40.296779 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:40.297437 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:40.304402 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:40.304893 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:40.305368 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:40.306068 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:40.306529 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:40.306962 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:40.371096 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:27:40.379346 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-0281635e-8ec2-41a7-b291-a3119d195fb4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1220 microversion: 2.1 time: 0.086524 Oct 28 11:27:40.379930 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4116/8222] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:40 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:41.404631 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:41.405387 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:41.412234 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:41.412745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:41.413232 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:41.413951 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:41.414428 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:41.414883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:41.481814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:27:41.490482 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-d6ffb0ca-0465-40e8-b3bc-13bcc6bedc4b tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1220 microversion: 2.1 time: 0.091060 Oct 28 11:27:41.491071 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4107/8223] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:41 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1220 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:42.513945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:42.514751 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:42.522036 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:42.522541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:42.522995 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:42.523722 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:42.524205 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:42.524644 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:42.590891 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:27:42.599504 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f7a631ab-25f0-47e5-b559-48891c5faad4 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1220 microversion: 2.1 time: 0.089624 Oct 28 11:27:42.602961 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4117/8224] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:42 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1220 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:43.622905 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:43.623474 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:43.630484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:43.630991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:43.631458 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:43.632175 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:43.632652 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:43.633129 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:43.697373 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:27:43.705483 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-85d881e6-74fe-45ad-89de-e8b089888dc0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1220 microversion: 2.1 time: 0.086417 Oct 28 11:27:43.706066 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4108/8225] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:43 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:44.729915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:44.731219 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:44.738116 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:44.738609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:44.739056 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:44.740162 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:44.740742 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:44.741298 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:44.780974 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:44.781470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:44.781917 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:44.782379 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.objects.instance [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lazy-loading 'fault' on Instance uuid 16192b1b-110b-4ad0-a633-d37a89865587 {{(pid=128747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 28 11:27:44.831444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1696563726cc4d289edacece3fd2aef9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac5d7744d6c24245af328843551dac5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:27:44.838903 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-692c9e8a-7fb5-4b49-8a2d-e16ed13cefa9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 200 len: 1179 microversion: 2.1 time: 0.113003 Oct 28 11:27:44.839499 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4118/8226] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:44 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 1179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:27:45.862629 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:45.863255 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] [instance: 16192b1b-110b-4ad0-a633-d37a89865587] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:27:45.870174 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:45.870670 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:45.871121 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:45.871829 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:27:45.872298 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:27:45.872733 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:27:45.886806 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] HTTP exception thrown: Instance 16192b1b-110b-4ad0-a633-d37a89865587 could not be found. Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Request method failure captured: Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 HTTP/1.1 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7phqwSYTqaf4YY7a0JIgG_14t9vHaFfS71U7tqL8ZBn320NEvgti9wt8joTh_-vBzkvyHaaFCClTOZ6siMbgRDog752lQpW82EVecFEVQzHY5IMUMCwI0Xiuky0fdkAI00OT7f78btwF7wvfS7kKWiz3ygPmrS5E-4iR2Ye3rrVddc Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: ac5d7744d6c24245af328843551dac5d Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestShelveInstance-387586826 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5d7744d6c24245af328843551dac5d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/ac5d7744d6c24245af328843551dac5d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_ac5d7744d6c24245af328843551dac5d", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/ac5d7744d6c24245af328843551dac5d"}]}] Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestShelveInstance-387586826 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: ac5d7744d6c24245af328843551dac5d Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestShelveInstance-387586826 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestShelveInstance-387586826-project Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: 1696563726cc4d289edacece3fd2aef9 Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestShelveInstance-387586826-project Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance 16192b1b-110b-4ad0-a633-d37a89865587 could not be found. Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': '16192b1b-110b-4ad0-a633-d37a89865587'} Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16192b1b-110b-4ad0-a633-d37a89865587 could not be found. Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16192b1b-110b-4ad0-a633-d37a89865587 could not be found. Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:27:45.888495 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16192b1b-110b-4ad0-a633-d37a89865587 could not be found. Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Returning 404 to user: Instance 16192b1b-110b-4ad0-a633-d37a89865587 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-87b3e168-5acd-48a0-a3e0-f54ea6dd57d0 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587" status: 404 len: 111 microversion: 2.1 time: 0.031367 Oct 28 11:27:45.894736 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4109/8227] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:27:45 2022] GET /compute/v2.1/servers/16192b1b-110b-4ad0-a633-d37a89865587 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:27:46.053622 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ad8a04bc-2708-42aa-b8e0-ef0008354bd9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] Calling method '.version_select at 0x7fca330dc280>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:27:46.079504 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ad8a04bc-2708-42aa-b8e0-ef0008354bd9 tempest-TestShelveInstance-387586826 tempest-TestShelveInstance-387586826-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1315863306" status: 202 len: 0 microversion: 2.1 time: 0.030370 Oct 28 11:27:46.084443 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4119/8228] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 11:27:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1315863306 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 28 11:28:03.451501 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=12 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:03.452277 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=24 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:03.726156 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1db15eb0-0726-4ce5-af0d-f9580352d53d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Action: 'create', calling method: .version_select at 0x7fca328d6d30>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-809175433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIKEFsYFe6haqpUmbLcPDVAVzjNvGWO3kotYGsuqowANIBK9B5U31xoStw4mnTaM0G61PLYOpU1LOMtZbXWTLLzzaRVrUTjooj+wyEcKIoc/Inj5eUGn1Gph6vPsTnyEQ=="}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:28:03.747992 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-1db15eb0-0726-4ce5-af0d-f9580352d53d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Getting quotas for project 94a59548e7fb4bef903c6c719e7dad37. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:28:03.754064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-1db15eb0-0726-4ce5-af0d-f9580352d53d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Getting quotas for user ed30b4137a904cf6ad1705c03f43cb86 and project 94a59548e7fb4bef903c6c719e7dad37. Resources: {'key_pairs'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:28:03.791358 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1db15eb0-0726-4ce5-af0d-f9580352d53d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.344923 Oct 28 11:28:03.801098 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4110/8229] 10.222.0.16 () {60 vars in 1159 bytes} [Fri Oct 28 11:28:03 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:28:04.772052 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:04.772963 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:04.777597 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1651247105", "imageRef": "c7ac23d6-0e32-4a44-9d15-3c8a5df377c1", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-809175433", "security_groups": [{"name": "tempest-secgroup-smoke-1579168531"}], "networks": [{"uuid": "d7028882-6bd5-4511-8f49-758950d72877"}]}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:28:04.888211 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.network.neutron [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] validate_networks() for [('d7028882-6bd5-4511-8f49-758950d72877', None, None, None, None, None)] {{(pid=128747) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:28:05.404808 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Flavor limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:28:05.405406 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Image limits 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:28:05.405935 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Flavor pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:28:05.406356 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Image pref 0:0:0 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:28:05.406786 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.virt.hardware [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:28:05.416071 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:05.416605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:05.417093 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:05.417840 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:05.418306 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:05.418743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:05.437243 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Getting quotas for project 94a59548e7fb4bef903c6c719e7dad37. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:28:05.443226 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.quota [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Getting quotas for user ed30b4137a904cf6ad1705c03f43cb86 and project 94a59548e7fb4bef903c6c719e7dad37. Resources: {'ram', 'instances', 'cores'} {{(pid=128747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:28:05.457836 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Going to run 1 instances... {{(pid=128747) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:28:05.460513 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='c7ac23d6-0e32-4a44-9d15-3c8a5df377c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:28:05.511033 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-b8ec9d50-d3dc-478b-85ae-a118a10f885c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.741317 Oct 28 11:28:05.511699 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4120/8230] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:28:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 11:28:05.524463 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1f091a3f-5529-4d76-a693-d87bfbeb2b96 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:05.525334 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1f091a3f-5529-4d76-a693-d87bfbeb2b96 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:05.588370 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-1f091a3f-5529-4d76-a693-d87bfbeb2b96 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:05.603231 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1f091a3f-5529-4d76-a693-d87bfbeb2b96 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1248 microversion: 2.1 time: 0.083504 Oct 28 11:28:05.603838 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4111/8231] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:05 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1248 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:06.627948 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1e3b6581-c069-4959-b64d-03f45051f6c4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:06.628558 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1e3b6581-c069-4959-b64d-03f45051f6c4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:06.681220 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1e3b6581-c069-4959-b64d-03f45051f6c4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:06.688780 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1e3b6581-c069-4959-b64d-03f45051f6c4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1248 microversion: 2.1 time: 0.066148 Oct 28 11:28:06.689874 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4121/8232] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:06 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1248 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:07.711790 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:07.712424 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:07.719511 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:07.721520 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:07.722380 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:07.723125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:07.723594 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:07.724329 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:07.801023 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:07.809228 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-968c187a-abb7-4242-a73e-bf9f4710fab4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1308 microversion: 2.1 time: 0.101318 Oct 28 11:28:07.809927 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4112/8233] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:07 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:08.835001 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:08.835570 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:08.842926 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:08.843839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:08.843839 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:08.844564 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:08.845256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:08.845890 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:09.075921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:09.083794 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-69d1857c-3e83-4a42-87f5-521a9bd613bd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.252769 Oct 28 11:28:09.084378 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4122/8234] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:08 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 28 11:28:09.249616 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-b1cf9bd1-2cb9-47d6-a94b-834204afeabe req-0bd65b4a-1b4e-4cb1-8891-fdd8229938fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d18a06-5618-48c6-be80-17d150f2f7c7", "tag": "ac5f117f-a740-473f-b2ab-4c97e501a80c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:28:09.265971 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b1cf9bd1-2cb9-47d6-a94b-834204afeabe req-0bd65b4a-1b4e-4cb1-8891-fdd8229938fe service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:09.266481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b1cf9bd1-2cb9-47d6-a94b-834204afeabe req-0bd65b4a-1b4e-4cb1-8891-fdd8229938fe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:09.266936 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-b1cf9bd1-2cb9-47d6-a94b-834204afeabe req-0bd65b4a-1b4e-4cb1-8891-fdd8229938fe service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:09.279900 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-b1cf9bd1-2cb9-47d6-a94b-834204afeabe req-0bd65b4a-1b4e-4cb1-8891-fdd8229938fe service nova] Creating event network-changed:ac5f117f-a740-473f-b2ab-4c97e501a80c for instance a3d18a06-5618-48c6-be80-17d150f2f7c7 on n-h2-zed-1 Oct 28 11:28:09.297079 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-b1cf9bd1-2cb9-47d6-a94b-834204afeabe req-0bd65b4a-1b4e-4cb1-8891-fdd8229938fe service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051265 Oct 28 11:28:09.298228 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4113/8235] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:28:10.107070 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:10.107623 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:10.114977 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:10.115473 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:10.115923 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:10.116652 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:10.117179 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:10.117617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:10.247166 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:10.255690 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-d936f76b-4d49-43f8-af9e-c096a47b7221 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.152622 Oct 28 11:28:10.256278 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4123/8236] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:10 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:11.279378 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:11.280091 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:11.286302 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:11.286795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:11.287243 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:11.287937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:11.288401 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:11.288838 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:11.422264 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:11.430009 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb80683f-276a-4b83-bc6c-4fd00934088d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.155854 Oct 28 11:28:11.430590 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4114/8237] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:11 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:12.452966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:12.453583 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:12.460982 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:12.461470 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:12.461910 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:12.462625 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:12.463086 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:12.463516 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:12.593076 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:12.601599 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e2cf3dc8-5490-42d7-87e4-c03d5ea21fee tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.152575 Oct 28 11:28:12.602183 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4124/8238] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:12 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:13.623893 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:13.624531 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:13.631489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:13.631991 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:13.632447 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:13.633184 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:13.633661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:13.634107 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:13.765901 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:13.774590 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e521d977-6d8f-4451-81f0-a4cc3f870593 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.154529 Oct 28 11:28:13.775399 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4115/8239] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:13 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:14.797587 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:14.798704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:14.805870 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:14.806363 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:14.806810 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:14.807515 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:14.807975 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:14.808404 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:14.946668 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:14.954354 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dbb8b8ee-b3e8-498b-b2e4-973d8b55ced2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.160698 Oct 28 11:28:14.954945 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4125/8240] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:14 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:15.861532 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6e3e704c-9514-45c1-9b4e-b680d7643c96 req-ea0ee225-9862-415a-8954-6c3487691dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d18a06-5618-48c6-be80-17d150f2f7c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f117f-a740-473f-b2ab-4c97e501a80c"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:28:15.867592 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:15.875699 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6e3e704c-9514-45c1-9b4e-b680d7643c96 req-ea0ee225-9862-415a-8954-6c3487691dca service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:15.876189 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6e3e704c-9514-45c1-9b4e-b680d7643c96 req-ea0ee225-9862-415a-8954-6c3487691dca service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:15.877164 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6e3e704c-9514-45c1-9b4e-b680d7643c96 req-ea0ee225-9862-415a-8954-6c3487691dca service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:15.888228 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6e3e704c-9514-45c1-9b4e-b680d7643c96 req-ea0ee225-9862-415a-8954-6c3487691dca service nova] Creating event network-vif-plugged:ac5f117f-a740-473f-b2ab-4c97e501a80c for instance a3d18a06-5618-48c6-be80-17d150f2f7c7 on n-h2-zed-1 Oct 28 11:28:15.894376 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6e3e704c-9514-45c1-9b4e-b680d7643c96 req-ea0ee225-9862-415a-8954-6c3487691dca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036624 Oct 28 11:28:15.894985 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4116/8241] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:28:15.977282 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:15.977906 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:15.979769 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:15.986472 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:15.986966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:15.987444 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:15.988152 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:15.988617 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:15.989078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:16.159767 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:16.167496 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-1bb9dcbc-173f-469f-b9cf-89b0160ae8b3 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.194179 Oct 28 11:28:16.168076 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4126/8242] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:15 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:17.192102 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:17.192743 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:17.199822 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:17.200324 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:17.200781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:17.201516 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:17.201988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:17.202436 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:17.337711 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:17.345822 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-9aee4517-dfdc-4833-85d9-1f347db8e9d1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1374 microversion: 2.1 time: 0.158581 Oct 28 11:28:17.346416 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4117/8243] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:17 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1374 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:18.368471 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:18.369119 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:18.370978 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=8 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:28:18.377196 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:18.377704 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:18.378148 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:18.378829 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:18.379280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:18.379703 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:18.508823 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:18.517122 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8009fc7e-4165-4f8a-a221-88e512bf7512 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1559 microversion: 2.1 time: 0.152481 Oct 28 11:28:18.518207 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4127/8244] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:18 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:18.540261 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:28:18.540921 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:28:18.546937 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:18.547441 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:18.547897 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:18.548608 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:18.549171 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:18.549622 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:18.678420 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:28:18.686149 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-fb9f87e3-c1a2-4f8e-ad10-154f05cbf1e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1559 microversion: 2.1 time: 0.150170 Oct 28 11:28:18.686724 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4118/8245] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:28:18 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:28:20.315491 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-067f1635-2853-4aac-803d-533f1e0a927f req-754355b5-9543-45fa-8921-f7901cde91cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d18a06-5618-48c6-be80-17d150f2f7c7", "tag": "ac5f117f-a740-473f-b2ab-4c97e501a80c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:28:20.325290 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-067f1635-2853-4aac-803d-533f1e0a927f req-754355b5-9543-45fa-8921-f7901cde91cd service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:28:20.325850 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-067f1635-2853-4aac-803d-533f1e0a927f req-754355b5-9543-45fa-8921-f7901cde91cd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:28:20.326569 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-067f1635-2853-4aac-803d-533f1e0a927f req-754355b5-9543-45fa-8921-f7901cde91cd service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:28:20.338519 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-067f1635-2853-4aac-803d-533f1e0a927f req-754355b5-9543-45fa-8921-f7901cde91cd service nova] Creating event network-changed:ac5f117f-a740-473f-b2ab-4c97e501a80c for instance a3d18a06-5618-48c6-be80-17d150f2f7c7 on n-h2-zed-1 Oct 28 11:28:20.344047 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-067f1635-2853-4aac-803d-533f1e0a927f req-754355b5-9543-45fa-8921-f7901cde91cd service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033032 Oct 28 11:28:20.344739 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4128/8246] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:30:46.262325 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:30:46.263236 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:30:46.264092 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:30:46.264896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=34 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:30:46.266202 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:30:46.266363 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:30:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7/action (ip 10.222.0.16) !!! Oct 28 11:30:46.271007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1053798992"}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:30:46.273333 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:30:46.282233 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:30:46.283247 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:30:46.283705 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:30:46.284423 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:30:46.284891 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:30:46.285364 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:30:46.485951 n-d-zed-1 devstack@n-api.service[128748]: ERROR oslo.messaging._drivers.impl_rabbit [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [420eb877-8dd9-4309-89f4-4ffc18fe3f11] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 28 11:30:47.272800 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [8dcf28fa-0674-458d-8744-6799d42391a7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40054. Oct 28 11:30:47.273578 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] [09e25103-70f7-42b4-beea-0c786707bb89] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40052. Oct 28 11:30:47.492629 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [420eb877-8dd9-4309-89f4-4ffc18fe3f11] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40056. Oct 28 11:30:47.498916 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-34a6cb2a-7740-4de4-a307-5ccb85ff0838 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "POST /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7/action" status: 202 len: 0 microversion: 2.1 time: 1.238852 Oct 28 11:30:47.499563 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4119/8247] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:30:46 2022] POST /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7/action => generated 0 bytes in 1240 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 11:30:54.570947 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:30:54.571850 n-d-zed-1 devstack@n-api.service[128747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 28 11:30:54.572489 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:30:54.573277 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=40 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:30:54.574525 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:30:54.574697 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 11:30:54.576029 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 28 11:30:54.576182 n-d-zed-1 devstack@n-api.service[128747]: Fri Oct 28 11:30:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 11:30:54.698747 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-9c9e7887-9553-4e4f-9526-c6bb4a1d8bb4 req-f4cf8c34-fe74-43e2-9298-52fa79b84bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d18a06-5618-48c6-be80-17d150f2f7c7", "name": "network-vif-plugged", "status": "completed", "tag": "ac5f117f-a740-473f-b2ab-4c97e501a80c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:30:54.708921 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9c9e7887-9553-4e4f-9526-c6bb4a1d8bb4 req-f4cf8c34-fe74-43e2-9298-52fa79b84bd8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:30:54.709419 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9c9e7887-9553-4e4f-9526-c6bb4a1d8bb4 req-f4cf8c34-fe74-43e2-9298-52fa79b84bd8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:30:54.709859 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-9c9e7887-9553-4e4f-9526-c6bb4a1d8bb4 req-f4cf8c34-fe74-43e2-9298-52fa79b84bd8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:30:54.721683 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-9c9e7887-9553-4e4f-9526-c6bb4a1d8bb4 req-f4cf8c34-fe74-43e2-9298-52fa79b84bd8 service nova] Creating event network-vif-plugged:ac5f117f-a740-473f-b2ab-4c97e501a80c for instance a3d18a06-5618-48c6-be80-17d150f2f7c7 on n-h2-zed-1 Oct 28 11:30:54.726873 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-9c9e7887-9553-4e4f-9526-c6bb4a1d8bb4 req-f4cf8c34-fe74-43e2-9298-52fa79b84bd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157956 Oct 28 11:30:54.727473 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4129/8248] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:31:06.170371 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:06.171162 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:06.176128 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-244174163", "imageRef": "2d85ab1c-100a-411f-a214-209bf40d3fad", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-809175433", "security_groups": [{"name": "tempest-secgroup-smoke-1579168531"}], "networks": [{"uuid": "d7028882-6bd5-4511-8f49-758950d72877"}]}} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:31:06.402910 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.network.neutron [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] validate_networks() for [('d7028882-6bd5-4511-8f49-758950d72877', None, None, None, None, None)] {{(pid=128748) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 28 11:31:06.827500 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Flavor limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 28 11:31:06.827942 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Image limits 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 28 11:31:06.828432 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Flavor pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 28 11:31:06.828861 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Image pref 0:0:0 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 28 11:31:06.829335 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.virt.hardware [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128748) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 28 11:31:06.838810 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:06.839287 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:06.839737 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:06.840484 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:06.841245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:06.841688 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:06.863040 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Getting quotas for project 94a59548e7fb4bef903c6c719e7dad37. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 28 11:31:06.868349 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.quota [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Getting quotas for user ed30b4137a904cf6ad1705c03f43cb86 and project 94a59548e7fb4bef903c6c719e7dad37. Resources: {'ram', 'instances', 'cores'} {{(pid=128748) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 28 11:31:06.880661 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Going to run 1 instances... {{(pid=128748) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 28 11:31:06.883197 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d85ab1c-100a-411f-a214-209bf40d3fad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128748) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 28 11:31:06.932146 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b792f834-483d-4ec4-a1af-036978fdd376 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763501 Oct 28 11:31:06.933636 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4120/8249] 10.222.0.16 () {60 vars in 1147 bytes} [Fri Oct 28 11:31:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 28 11:31:06.943388 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:06.944146 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:06.950359 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-903d52d0-e24a-4bfb-a4c3-65067e2cc2c5 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:06.951304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-903d52d0-e24a-4bfb-a4c3-65067e2cc2c5 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:06.965488 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [6d21c867-10ad-49c2-82ee-aba905a951f3] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40222. Oct 28 11:31:06.967784 n-d-zed-1 devstack@n-api.service[128747]: INFO oslo.messaging._drivers.impl_rabbit [-] [5957d174-01af-4615-bf05-b3115f2636c7] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 40224. Oct 28 11:31:07.088640 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-903d52d0-e24a-4bfb-a4c3-65067e2cc2c5 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:07.096726 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-903d52d0-e24a-4bfb-a4c3-65067e2cc2c5 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1247 microversion: 2.1 time: 0.155535 Oct 28 11:31:07.097400 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4130/8250] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:06 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1247 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:08.120251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:08.121038 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:08.127231 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:08.127736 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:08.128194 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:08.128928 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:08.129405 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:08.129853 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:08.222783 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:08.230999 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-e90f0305-a606-43c9-821a-622f477379c0 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1307 microversion: 2.1 time: 0.115441 Oct 28 11:31:08.232166 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4121/8251] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:08 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1307 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:08.611733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-0d33b570-6e02-4893-b0dc-c29f925ceaa1 req-7b8728e0-f2ba-41df-893b-348acc56ec9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d18a06-5618-48c6-be80-17d150f2f7c7", "name": "network-vif-unplugged", "status": "completed", "tag": "ac5f117f-a740-473f-b2ab-4c97e501a80c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:31:08.630837 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0d33b570-6e02-4893-b0dc-c29f925ceaa1 req-7b8728e0-f2ba-41df-893b-348acc56ec9c service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:08.634772 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0d33b570-6e02-4893-b0dc-c29f925ceaa1 req-7b8728e0-f2ba-41df-893b-348acc56ec9c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:08.635609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-0d33b570-6e02-4893-b0dc-c29f925ceaa1 req-7b8728e0-f2ba-41df-893b-348acc56ec9c service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:08.653199 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-0d33b570-6e02-4893-b0dc-c29f925ceaa1 req-7b8728e0-f2ba-41df-893b-348acc56ec9c service nova] Creating event network-vif-unplugged:ac5f117f-a740-473f-b2ab-4c97e501a80c for instance a3d18a06-5618-48c6-be80-17d150f2f7c7 on n-h2-zed-1 Oct 28 11:31:08.662834 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-0d33b570-6e02-4893-b0dc-c29f925ceaa1 req-7b8728e0-f2ba-41df-893b-348acc56ec9c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055592 Oct 28 11:31:08.667638 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4131/8252] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:31:09.255764 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:09.257137 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:09.270036 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:09.270638 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:09.271168 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:09.272030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:09.272777 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:09.273491 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:09.487161 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:09.510314 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-5685cfd4-08c6-4c62-befc-5ea96587560d tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.259646 Oct 28 11:31:09.510915 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4122/8253] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:09 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:10.533945 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:10.534643 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:10.541998 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:10.542495 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:10.542946 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:10.543655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:10.544113 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:10.544541 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:10.690580 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:10.700671 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-ca67471f-b065-4a6f-8d1e-44a5a1b05bc1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.171365 Oct 28 11:31:10.702089 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4132/8254] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:10 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:11.724795 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:11.725818 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:11.732945 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:11.733481 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:11.733939 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:11.734667 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:11.735301 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:11.735755 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:11.896115 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:11.903740 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-cee59594-6f86-426b-98dc-67c5b6d23144 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.183491 Oct 28 11:31:11.904307 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4123/8255] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:11 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:12.926966 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:12.928567 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:12.935756 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:12.936341 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:12.936849 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:12.937641 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:12.938225 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:12.938717 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:13.087984 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:13.098982 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-fbb295de-faf0-481d-b718-d9967f91fbc4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.175773 Oct 28 11:31:13.100174 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4133/8256] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:12 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:14.123847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:14.125402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:14.135064 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:14.135988 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:14.136571 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:14.137445 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:14.138028 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:14.138563 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:14.282533 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:14.291638 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-f1bbc01e-b439-454e-bb35-292b285ca87c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.172510 Oct 28 11:31:14.292405 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4124/8257] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:14 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:15.314702 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:15.316170 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:15.323462 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:15.324055 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:15.324579 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:15.325411 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:15.325881 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:15.326319 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:15.470244 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:15.479115 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-e44fb57d-5e2b-4da6-b146-582fcc1a17a8 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.168317 Oct 28 11:31:15.479849 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4134/8258] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:15 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:16.503059 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:16.503781 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:16.510624 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:16.511125 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:16.511584 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:16.512291 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:16.512762 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:16.513229 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:16.728008 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:16.737549 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-b1849899-37e4-45ab-96d2-e3443f0325e4 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.238898 Oct 28 11:31:16.738189 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4125/8259] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:16 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:17.093143 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell0:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:17.141421 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-ee5e8cf8-34e8-490a-958b-a7015b456145 req-dea17144-9b60-4a56-a8a6-6d87bf1847d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417dd302-236a-4c9c-b3a5-463880840b7f", "tag": "2df4b7ff-f14d-44d4-b28c-ce61fd439002"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:31:17.151609 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ee5e8cf8-34e8-490a-958b-a7015b456145 req-dea17144-9b60-4a56-a8a6-6d87bf1847d4 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:17.152099 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ee5e8cf8-34e8-490a-958b-a7015b456145 req-dea17144-9b60-4a56-a8a6-6d87bf1847d4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:17.152743 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-ee5e8cf8-34e8-490a-958b-a7015b456145 req-dea17144-9b60-4a56-a8a6-6d87bf1847d4 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:17.164306 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-ee5e8cf8-34e8-490a-958b-a7015b456145 req-dea17144-9b60-4a56-a8a6-6d87bf1847d4 service nova] Creating event network-changed:2df4b7ff-f14d-44d4-b28c-ce61fd439002 for instance 417dd302-236a-4c9c-b3a5-463880840b7f on n-h1-zed-1 Oct 28 11:31:17.169315 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-ee5e8cf8-34e8-490a-958b-a7015b456145 req-dea17144-9b60-4a56-a8a6-6d87bf1847d4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093774 Oct 28 11:31:17.169929 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4135/8260] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:31:17.760730 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:17.761325 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:17.763169 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=2 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:17.764030 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell0:SELECT=6 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:31:17.771026 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:17.771540 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:17.771998 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:17.772722 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:17.773613 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:17.774062 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:17.915495 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:17.923532 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-ed6597f0-442c-43ff-988b-8c716344a730 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.167192 Oct 28 11:31:17.924610 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4126/8261] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:17 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:18.947605 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:18.948304 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:18.954481 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:18.955601 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:18.956043 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:18.956727 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:18.957206 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:18.957632 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:19.091535 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:19.099202 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-4447a485-c452-402b-8f07-8ad408e7bd5c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.156692 Oct 28 11:31:19.099780 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4136/8262] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:18 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:20.122082 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:20.122709 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:20.129578 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:20.130079 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:20.130535 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:20.131240 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:20.131716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:20.132186 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:20.269560 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:20.277263 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-091ec555-ca53-49a0-b81a-4c12a381ad08 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.159097 Oct 28 11:31:20.277848 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4127/8263] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:20 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:21.300432 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:21.301073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:21.307865 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:21.308349 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:21.308784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:21.309501 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:21.309952 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:21.310375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:21.441546 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:21.449180 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8a8ff269-5e56-4a6a-ab76-da22d70bc7ed tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.152669 Oct 28 11:31:21.449751 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4137/8264] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:21 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:22.323400 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-e8d2dac2-f48f-4c05-a891-feb7ef74db44 req-e516f622-2d8b-4330-9c9c-3b0c97e83e9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dd302-236a-4c9c-b3a5-463880840b7f", "name": "network-vif-plugged", "status": "completed", "tag": "2df4b7ff-f14d-44d4-b28c-ce61fd439002"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:31:22.333727 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e8d2dac2-f48f-4c05-a891-feb7ef74db44 req-e516f622-2d8b-4330-9c9c-3b0c97e83e9d service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:22.334228 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e8d2dac2-f48f-4c05-a891-feb7ef74db44 req-e516f622-2d8b-4330-9c9c-3b0c97e83e9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:22.334706 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-e8d2dac2-f48f-4c05-a891-feb7ef74db44 req-e516f622-2d8b-4330-9c9c-3b0c97e83e9d service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:22.346854 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-e8d2dac2-f48f-4c05-a891-feb7ef74db44 req-e516f622-2d8b-4330-9c9c-3b0c97e83e9d service nova] Creating event network-vif-plugged:2df4b7ff-f14d-44d4-b28c-ce61fd439002 for instance 417dd302-236a-4c9c-b3a5-463880840b7f on n-h1-zed-1 Oct 28 11:31:22.352310 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-e8d2dac2-f48f-4c05-a891-feb7ef74db44 req-e516f622-2d8b-4330-9c9c-3b0c97e83e9d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033563 Oct 28 11:31:22.353360 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4128/8265] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:31:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:31:22.473078 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:22.473784 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:22.480692 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:22.481331 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:22.481770 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:22.482496 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:22.482951 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:22.483375 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:22.613259 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:22.620926 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-8ee39c5f-090a-41dd-bd96-e97a151641dd tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1373 microversion: 2.1 time: 0.152494 Oct 28 11:31:22.621512 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4138/8266] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:22 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:23.645847 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:23.646465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:23.655485 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:23.656006 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:23.656489 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:23.657251 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:23.657731 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:23.658183 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:23.808643 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:23.816796 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8a9b87f8-ffed-401e-8668-af09d3af30ad tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1557 microversion: 2.1 time: 0.176752 Oct 28 11:31:23.817430 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4129/8267] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:23 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1557 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:23.839918 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:31:23.840545 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:31:23.852267 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:23.852818 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:23.853295 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:23.854013 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:23.854477 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:23.854913 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:23.994362 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:31:24.002300 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-5ae37430-a613-4a93-afb3-c2438466df73 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1557 microversion: 2.1 time: 0.166271 Oct 28 11:31:24.002946 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4139/8268] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:31:23 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:31:25.931997 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-72b108ef-9c43-4694-bdb7-b69d8c7e1987 req-9767b825-5dc1-4658-ac91-c0d947ff0f52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417dd302-236a-4c9c-b3a5-463880840b7f", "tag": "2df4b7ff-f14d-44d4-b28c-ce61fd439002"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:31:25.942513 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-72b108ef-9c43-4694-bdb7-b69d8c7e1987 req-9767b825-5dc1-4658-ac91-c0d947ff0f52 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:31:25.943007 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-72b108ef-9c43-4694-bdb7-b69d8c7e1987 req-9767b825-5dc1-4658-ac91-c0d947ff0f52 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:31:25.943449 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-72b108ef-9c43-4694-bdb7-b69d8c7e1987 req-9767b825-5dc1-4658-ac91-c0d947ff0f52 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:31:25.955653 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-72b108ef-9c43-4694-bdb7-b69d8c7e1987 req-9767b825-5dc1-4658-ac91-c0d947ff0f52 service nova] Creating event network-changed:2df4b7ff-f14d-44d4-b28c-ce61fd439002 for instance 417dd302-236a-4c9c-b3a5-463880840b7f on n-h1-zed-1 Oct 28 11:31:25.960783 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-72b108ef-9c43-4694-bdb7-b69d8c7e1987 req-9767b825-5dc1-4658-ac91-c0d947ff0f52 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032447 Oct 28 11:31:25.961440 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4130/8269] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:32:57.836209 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=22 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:32:57.837107 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=46 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:32:57.842004 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1473571588"}} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:32:57.844671 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:32:57.851798 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:32:57.852293 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:32:57.852745 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:32:57.853483 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:32:57.853947 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:32:57.854413 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:32:58.056073 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-7622d21e-6f85-4da2-918d-1b687aec5a6b tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "POST /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f/action" status: 202 len: 0 microversion: 2.1 time: 0.222525 Oct 28 11:32:58.056737 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4140/8270] 10.222.0.16 () {60 vars in 1278 bytes} [Fri Oct 28 11:32:57 2022] POST /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 28 11:33:02.935402 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:02.936695 n-d-zed-1 devstack@n-api.service[128748]: DEBUG dbcounter [-] [128748] Writing DB stats nova_cell1:SELECT=54 {{(pid=128748) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:02.938040 n-d-zed-1 devstack@n-api.service[128748]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 28 11:33:02.938455 n-d-zed-1 devstack@n-api.service[128748]: Fri Oct 28 11:33:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.16) !!! Oct 28 11:33:02.947058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-c558c5fa-f98e-4493-9ab5-222d66d8708a req-629ef56a-d906-4d51-a484-e70344ba1c3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dd302-236a-4c9c-b3a5-463880840b7f", "name": "network-vif-plugged", "status": "completed", "tag": "2df4b7ff-f14d-44d4-b28c-ce61fd439002"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:33:02.961244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c558c5fa-f98e-4493-9ab5-222d66d8708a req-629ef56a-d906-4d51-a484-e70344ba1c3b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:02.961955 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c558c5fa-f98e-4493-9ab5-222d66d8708a req-629ef56a-d906-4d51-a484-e70344ba1c3b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:02.962716 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-c558c5fa-f98e-4493-9ab5-222d66d8708a req-629ef56a-d906-4d51-a484-e70344ba1c3b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:02.979503 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-c558c5fa-f98e-4493-9ab5-222d66d8708a req-629ef56a-d906-4d51-a484-e70344ba1c3b service nova] Creating event network-vif-plugged:2df4b7ff-f14d-44d4-b28c-ce61fd439002 for instance 417dd302-236a-4c9c-b3a5-463880840b7f on n-h1-zed-1 Oct 28 11:33:02.988178 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-c558c5fa-f98e-4493-9ab5-222d66d8708a req-629ef56a-d906-4d51-a484-e70344ba1c3b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055958 Oct 28 11:33:02.988787 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4131/8271] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:33:11.781186 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_api:SELECT=2 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:11.782073 n-d-zed-1 devstack@n-api.service[128747]: DEBUG dbcounter [-] [128747] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 28 11:33:11.786761 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:11.787394 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:11.798084 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:11.798581 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:11.799018 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:11.799733 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:11.800429 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:11.800853 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:11.830806 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Going to try to terminate instance {{(pid=128747) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:33:11.851415 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-6ad538c3-877c-4dd3-812f-a55d843d053a req-e64ef74b-b677-49d5-b866-221e83bdb528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "417dd302-236a-4c9c-b3a5-463880840b7f", "tag": "2df4b7ff-f14d-44d4-b28c-ce61fd439002"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:33:11.864245 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6ad538c3-877c-4dd3-812f-a55d843d053a req-e64ef74b-b677-49d5-b866-221e83bdb528 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:11.865883 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6ad538c3-877c-4dd3-812f-a55d843d053a req-e64ef74b-b677-49d5-b866-221e83bdb528 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:11.866562 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-6ad538c3-877c-4dd3-812f-a55d843d053a req-e64ef74b-b677-49d5-b866-221e83bdb528 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:11.879350 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-6ad538c3-877c-4dd3-812f-a55d843d053a req-e64ef74b-b677-49d5-b866-221e83bdb528 service nova] Creating event network-changed:2df4b7ff-f14d-44d4-b28c-ce61fd439002 for instance 417dd302-236a-4c9c-b3a5-463880840b7f on n-h1-zed-1 Oct 28 11:33:11.884596 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-6ad538c3-877c-4dd3-812f-a55d843d053a req-e64ef74b-b677-49d5-b866-221e83bdb528 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103435 Oct 28 11:33:11.885461 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4132/8272] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 28 11:33:11.917199 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-dea1d9dd-2802-446c-9110-45374fd1a485 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "DELETE /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 204 len: 0 microversion: 2.1 time: 0.138293 Oct 28 11:33:11.917949 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4141/8273] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:33:11 2022] DELETE /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:33:11.929904 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:11.934280 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:11.945392 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:11.945898 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:11.946350 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:11.947069 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:11.947542 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:11.947978 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:12.086967 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:33:12.095023 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-7431f7a9-9e93-4647-832a-7149f158b047 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1681 microversion: 2.1 time: 0.170263 Oct 28 11:33:12.095599 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4133/8274] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:33:11 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:33:12.957361 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-1fa45956-1703-4e61-ac6c-780f0e2b614e req-b100117d-6737-4b73-ad38-5d367974b330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dd302-236a-4c9c-b3a5-463880840b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "2df4b7ff-f14d-44d4-b28c-ce61fd439002"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:33:12.969185 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1fa45956-1703-4e61-ac6c-780f0e2b614e req-b100117d-6737-4b73-ad38-5d367974b330 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:12.969682 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1fa45956-1703-4e61-ac6c-780f0e2b614e req-b100117d-6737-4b73-ad38-5d367974b330 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:12.970548 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-1fa45956-1703-4e61-ac6c-780f0e2b614e req-b100117d-6737-4b73-ad38-5d367974b330 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:12.982935 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-1fa45956-1703-4e61-ac6c-780f0e2b614e req-b100117d-6737-4b73-ad38-5d367974b330 service nova] Creating event network-vif-unplugged:2df4b7ff-f14d-44d4-b28c-ce61fd439002 for instance 417dd302-236a-4c9c-b3a5-463880840b7f on n-h1-zed-1 Oct 28 11:33:12.987972 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-1fa45956-1703-4e61-ac6c-780f0e2b614e req-b100117d-6737-4b73-ad38-5d367974b330 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034725 Oct 28 11:33:12.988614 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4142/8275] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:33:13.119896 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:13.120465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:13.127512 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:13.128012 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:13.128465 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:13.129206 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:13.129680 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:13.130745 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:13.271408 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:33:13.279301 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-8ba77522-915d-42ef-aa53-6d0371d0bb4c tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1681 microversion: 2.1 time: 0.163511 Oct 28 11:33:13.279904 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4134/8276] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:33:13 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:33:14.304594 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:14.312210 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:14.317826 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:14.318338 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:14.319320 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:14.319518 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:14.319937 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:14.320370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:14.380681 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [req-435d0a28-dd24-44a2-b991-c6a269a01bed req-68f03baf-49ee-48cf-b701-9958a7a9bed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "417dd302-236a-4c9c-b3a5-463880840b7f", "name": "network-vif-deleted", "tag": "2df4b7ff-f14d-44d4-b28c-ce61fd439002"}]} {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:33:14.396244 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-435d0a28-dd24-44a2-b991-c6a269a01bed req-68f03baf-49ee-48cf-b701-9958a7a9bed8 service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:14.396746 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-435d0a28-dd24-44a2-b991-c6a269a01bed req-68f03baf-49ee-48cf-b701-9958a7a9bed8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:14.397230 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [req-435d0a28-dd24-44a2-b991-c6a269a01bed req-68f03baf-49ee-48cf-b701-9958a7a9bed8 service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:14.398025 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:33:14.411004 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.compute.server_external_events [req-435d0a28-dd24-44a2-b991-c6a269a01bed req-68f03baf-49ee-48cf-b701-9958a7a9bed8 service nova] Creating event network-vif-deleted:2df4b7ff-f14d-44d4-b28c-ce61fd439002 for instance 417dd302-236a-4c9c-b3a5-463880840b7f on n-h1-zed-1 Oct 28 11:33:14.416147 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-6609360f-dc74-4601-ab9e-c3f852e8eefe tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 200 len: 1495 microversion: 2.1 time: 0.115942 Oct 28 11:33:14.417203 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4143/8277] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:33:14 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 1495 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:33:14.417900 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [req-435d0a28-dd24-44a2-b991-c6a269a01bed req-68f03baf-49ee-48cf-b701-9958a7a9bed8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049432 Oct 28 11:33:14.418513 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4135/8278] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:33:15.440032 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:15.440655 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: 417dd302-236a-4c9c-b3a5-463880840b7f] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:15.448251 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:15.448730 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:15.449213 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:15.449915 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:15.450380 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:15.450815 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:15.464178 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.wsgi [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] HTTP exception thrown: Instance 417dd302-236a-4c9c-b3a5-463880840b7f could not be found. Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Request method failure captured: Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: request: GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f HTTP/1.1 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: Accept: application/json Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: Accept-Encoding: identity Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: Connection: close Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: Content-Length: 0 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: Content-Type: application/json Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: Host: 10.222.0.16 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: Openstack-System-Scope: None Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: User-Agent: python-urllib3/1.26.12 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Auth-Token: gAAAAABjW7y-kPS1BG4ZKKeojXmhSjn9-FmLzyb_UjRwwPXOj9EKQK3tGH4JOmF41WZw6qRkcqBXTN_HEz0E-wxBEPzDGOWMJO9JJR3thlKC0WfbQcqRaUIyyIX5Pfot6Z6hQRFkDFgZPMnMrS_Dg_bjk1ZZfTCh59dXbXsGd3NMZqG1laG9a_s Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Id: None Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Domain-Name: None Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Identity-Status: Confirmed Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Is-Admin-Project: True Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Id: default Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Domain-Name: Default Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Id: 94a59548e7fb4bef903c6c719e7dad37 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Project-Name: tempest-TestSnapshotPattern-446992707 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Role: member,reader Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Roles: member,reader Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a59548e7fb4bef903c6c719e7dad37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a59548e7fb4bef903c6c719e7dad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94a59548e7fb4bef903c6c719e7dad37", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94a59548e7fb4bef903c6c719e7dad37"}]}] Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant: tempest-TestSnapshotPattern-446992707 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Id: 94a59548e7fb4bef903c6c719e7dad37 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-Tenant-Name: tempest-TestSnapshotPattern-446992707 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-User: tempest-TestSnapshotPattern-446992707-project Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Id: default Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-User-Domain-Name: Default Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-User-Id: ed30b4137a904cf6ad1705c03f43cb86 Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: X-User-Name: tempest-TestSnapshotPattern-446992707-project Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: method: > Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: exception: Instance 417dd302-236a-4c9c-b3a5-463880840b7f could not be found. Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: action_args: {'id': '417dd302-236a-4c9c-b3a5-463880840b7f'} Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 417dd302-236a-4c9c-b3a5-463880840b7f could not be found. Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 417dd302-236a-4c9c-b3a5-463880840b7f could not be found. Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:33:15.465847 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 417dd302-236a-4c9c-b3a5-463880840b7f could not be found. Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: ERROR nova.api.openstack.wsgi Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Returning 404 to user: Instance 417dd302-236a-4c9c-b3a5-463880840b7f could not be found. {{(pid=128747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-3af0e45a-f504-4301-85aa-9da918a31230 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f" status: 404 len: 111 microversion: 2.1 time: 0.031179 Oct 28 11:33:15.472172 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4144/8279] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:33:15 2022] GET /compute/v2.1/servers/417dd302-236a-4c9c-b3a5-463880840b7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:33:16.773256 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-4a702e4a-ac1b-407b-9c1b-0c637e25d0f6 req-c73ef636-a058-447e-afc9-91a49df899bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d18a06-5618-48c6-be80-17d150f2f7c7", "tag": "ac5f117f-a740-473f-b2ab-4c97e501a80c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:33:16.775522 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:16.776151 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:16.782846 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:16.783357 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:16.783814 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:16.784545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:16.784715 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4a702e4a-ac1b-407b-9c1b-0c637e25d0f6 req-c73ef636-a058-447e-afc9-91a49df899bf service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:16.785058 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:16.785302 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4a702e4a-ac1b-407b-9c1b-0c637e25d0f6 req-c73ef636-a058-447e-afc9-91a49df899bf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:16.785505 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:16.786121 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-4a702e4a-ac1b-407b-9c1b-0c637e25d0f6 req-c73ef636-a058-447e-afc9-91a49df899bf service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:16.797485 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-4a702e4a-ac1b-407b-9c1b-0c637e25d0f6 req-c73ef636-a058-447e-afc9-91a49df899bf service nova] Creating event network-changed:ac5f117f-a740-473f-b2ab-4c97e501a80c for instance a3d18a06-5618-48c6-be80-17d150f2f7c7 on n-h2-zed-1 Oct 28 11:33:16.802945 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-4a702e4a-ac1b-407b-9c1b-0c637e25d0f6 req-c73ef636-a058-447e-afc9-91a49df899bf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033810 Oct 28 11:33:16.803883 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4145/8280] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:33:16.816679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Going to try to terminate instance {{(pid=128748) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 28 11:33:16.900864 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-1fc13d6b-3468-4383-936c-2572969b18e1 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 204 len: 0 microversion: 2.1 time: 0.135825 Oct 28 11:33:16.901376 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4136/8281] 10.222.0.16 () {58 vars in 1239 bytes} [Fri Oct 28 11:33:16 2022] DELETE /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 28 11:33:16.910990 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:16.912540 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.compute.api [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128747) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:16.919449 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:16.919941 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:16.920646 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:16.921649 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:16.922280 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:16.922888 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:17.098624 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.policy [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128747) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:33:17.106539 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-29519873-93e0-45b0-835d-db6e082291f2 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1684 microversion: 2.1 time: 0.200389 Oct 28 11:33:17.107126 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4146/8282] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:33:16 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1684 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:33:18.130819 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:18.131545 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:18.137607 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:18.138112 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:18.138568 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:18.139282 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:18.139756 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:18.140202 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:18.277078 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.policy [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed30b4137a904cf6ad1705c03f43cb86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94a59548e7fb4bef903c6c719e7dad37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128748) authorize /opt/stack/nova/nova/policy.py:199}} Oct 28 11:33:18.285087 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-0b27af57-d7c2-4eb6-9443-a33882aac216 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 200 len: 1565 microversion: 2.1 time: 0.158869 Oct 28 11:33:18.285667 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4137/8283] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:33:18 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 1565 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 28 11:33:18.699370 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [req-b6c7627c-0928-4036-b52d-9656d13fc1e7 req-e6f29747-cd69-488a-be2a-a558fccd301b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d18a06-5618-48c6-be80-17d150f2f7c7", "name": "network-vif-deleted", "tag": "ac5f117f-a740-473f-b2ab-4c97e501a80c"}]} {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 28 11:33:18.710336 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b6c7627c-0928-4036-b52d-9656d13fc1e7 req-e6f29747-cd69-488a-be2a-a558fccd301b service nova] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:18.710804 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b6c7627c-0928-4036-b52d-9656d13fc1e7 req-e6f29747-cd69-488a-be2a-a558fccd301b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:18.711246 n-d-zed-1 devstack@n-api.service[128747]: DEBUG oslo_concurrency.lockutils [req-b6c7627c-0928-4036-b52d-9656d13fc1e7 req-e6f29747-cd69-488a-be2a-a558fccd301b service nova] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:18.723104 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.compute.server_external_events [req-b6c7627c-0928-4036-b52d-9656d13fc1e7 req-e6f29747-cd69-488a-be2a-a558fccd301b service nova] Creating event network-vif-deleted:ac5f117f-a740-473f-b2ab-4c97e501a80c for instance a3d18a06-5618-48c6-be80-17d150f2f7c7 on n-h2-zed-1 Oct 28 11:33:18.728037 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [req-b6c7627c-0928-4036-b52d-9656d13fc1e7 req-e6f29747-cd69-488a-be2a-a558fccd301b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032484 Oct 28 11:33:18.728647 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4147/8284] 10.222.0.16 () {64 vars in 1317 bytes} [Fri Oct 28 11:33:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 28 11:33:19.309452 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '>' {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:19.310011 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.compute.api [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] [instance: a3d18a06-5618-48c6-be80-17d150f2f7c7] Fetching instance by UUID {{(pid=128748) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 28 11:33:19.316774 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:19.317336 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:19.317803 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:19.318515 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Acquiring lock "308273ef-dc1c-40ee-a51c-31916410c877" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 28 11:33:19.318989 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 28 11:33:19.319433 n-d-zed-1 devstack@n-api.service[128748]: DEBUG oslo_concurrency.lockutils [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Lock "308273ef-dc1c-40ee-a51c-31916410c877" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128748) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 28 11:33:19.333030 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.wsgi [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] HTTP exception thrown: Instance a3d18a06-5618-48c6-be80-17d150f2f7c7 could not be found. Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Request method failure captured: Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: request: GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 HTTP/1.1 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: Accept: application/json Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: Accept-Encoding: identity Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: Connection: close Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: Content-Length: 0 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: Content-Type: application/json Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: Host: 10.222.0.16 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: Openstack-System-Scope: None Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: User-Agent: python-urllib3/1.26.12 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Auth-Token: gAAAAABjW7y-kPS1BG4ZKKeojXmhSjn9-FmLzyb_UjRwwPXOj9EKQK3tGH4JOmF41WZw6qRkcqBXTN_HEz0E-wxBEPzDGOWMJO9JJR3thlKC0WfbQcqRaUIyyIX5Pfot6Z6hQRFkDFgZPMnMrS_Dg_bjk1ZZfTCh59dXbXsGd3NMZqG1laG9a_s Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Id: None Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Domain-Name: None Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Identity-Status: Confirmed Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Is-Admin-Project: True Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Id: default Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Domain-Name: Default Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Id: 94a59548e7fb4bef903c6c719e7dad37 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Project-Name: tempest-TestSnapshotPattern-446992707 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Role: member,reader Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Roles: member,reader Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a59548e7fb4bef903c6c719e7dad37"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/94a59548e7fb4bef903c6c719e7dad37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_94a59548e7fb4bef903c6c719e7dad37", "adminURL": "http://10.222.0.16:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/94a59548e7fb4bef903c6c719e7dad37"}]}] Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant: tempest-TestSnapshotPattern-446992707 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Id: 94a59548e7fb4bef903c6c719e7dad37 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-Tenant-Name: tempest-TestSnapshotPattern-446992707 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-User: tempest-TestSnapshotPattern-446992707-project Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Id: default Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-User-Domain-Name: Default Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-User-Id: ed30b4137a904cf6ad1705c03f43cb86 Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: X-User-Name: tempest-TestSnapshotPattern-446992707-project Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: method: > Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: exception: Instance a3d18a06-5618-48c6-be80-17d150f2f7c7 could not be found. Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: action_args: {'id': 'a3d18a06-5618-48c6-be80-17d150f2f7c7'} Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: {{(pid=128748) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d18a06-5618-48c6-be80-17d150f2f7c7 could not be found. Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d18a06-5618-48c6-be80-17d150f2f7c7 could not be found. Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 28 11:33:19.334679 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d18a06-5618-48c6-be80-17d150f2f7c7 could not be found. Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: ERROR nova.api.openstack.wsgi Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: DEBUG nova.api.openstack.wsgi [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Returning 404 to user: Instance a3d18a06-5618-48c6-be80-17d150f2f7c7 could not be found. {{(pid=128748) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: INFO nova.api.openstack.requestlog [None req-04c48104-9111-47f3-8d13-2fb02b6fb5e6 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7" status: 404 len: 111 microversion: 2.1 time: 0.030843 Oct 28 11:33:19.340605 n-d-zed-1 devstack@n-api.service[128748]: [pid: 128748|app: 0|req: 4138/8285] 10.222.0.16 () {58 vars in 1236 bytes} [Fri Oct 28 11:33:19 2022] GET /compute/v2.1/servers/a3d18a06-5618-48c6-be80-17d150f2f7c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 28 11:33:19.497909 n-d-zed-1 devstack@n-api.service[128747]: DEBUG nova.api.openstack.wsgi [None req-f7aef79a-b310-41bc-be75-1905bccd5389 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] Calling method '.version_select at 0x7fca33295700>' {{(pid=128747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 28 11:33:19.521373 n-d-zed-1 devstack@n-api.service[128747]: INFO nova.api.openstack.requestlog [None req-f7aef79a-b310-41bc-be75-1905bccd5389 tempest-TestSnapshotPattern-446992707 tempest-TestSnapshotPattern-446992707-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-809175433" status: 202 len: 0 microversion: 2.1 time: 0.027493 Oct 28 11:33:19.521886 n-d-zed-1 devstack@n-api.service[128747]: [pid: 128747|app: 0|req: 4148/8286] 10.222.0.16 () {58 vars in 1254 bytes} [Fri Oct 28 11:33:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-809175433 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)